Kaz: iM HERE Whats up Hi. So how do I use thiss, just run worker_script.py? Aoede: have you run through the install instructions in the readme? wait hang on, there's no worker_script.py for newsgrabber-warrior definitely don't run that Wait, I was looking at wrong git repo Sorry :P https://pastebin.com/UZt2Tg6U this happens for some tasks, others work fine i'm here from the wiki link, where can i get the scraper scripts? never mind, i found the git. where should i point to for the rsync server? crusher__: https://github.com/ArchiveTeam/NewsGrabber-Warrior scripts have changed a fair few times -warrior is the one you want Sounds like the wiki page needs an update then. And the topic in this channel stupid scaleway restarted one of my instances i don't suppose there is a way to run the scripts on windows is there xD Bah, may as well install a distro on that machine crusher__: virtual machine crusher__: They would probably with the Linux compatibilty thing Windows 10 has But a VM is probably a better choice jrwr other than that :P Windows Linux Subsystem or try reallly hard in cygwin Eh... This machine won't be doing anything other than archive team for the foreseeable future Linux Ubuntu 16.04 works well yeah i'll probably install ubuntu server and throw lxde on to make it a bit lighter i don't feel like fighting with slitaz today, so that's as thin as it is going to get xD If you're comfortable enough with the command line, why not skip the window system entirely and just run a headless system? It doesn't get much lighter than that. Then connect from another machine via ssh and run the scripts in tmux or screen. i could, and i probably should but lxde is so bloody light it hardly matters xD it also does make my life a bit easier :P Sure. I'm so used to the terminal that it'd actually make it harder for me, but to each their own. :-) https://hastebin.com/nepeyirepa.css M247... These people are supposed to know what they are doing JAA: The Unix Haters Handbook is still mostly accurage when it comes to X11: "most computers running X run just four programs: xterm, xload, xclock, and a window manager" You just need to swap "Chromium" for "xclock" (since the window manager includes a clock these days) and it's accurate Finally got it working. Sometimes I really hate python... HCross2: routing looks ace Kaz: it's literally one side of the road to the other via several European cities. Several times :p lol Haha, I hadn't even noticed that That's actually really impressive Kaz: http://bgp.he.net/AS9009#_bogons it gets better Hahaha what Why Wtf are they doing They're also announcing rfc1918 space to the public internet err... doesn't that break a lot? Nobody will accept the routes Nobody (hopefully) O.o At somepoint someone will.. and we'll be in a world of hurt they'd basically get depeered on that then? Or rather.. one of M247s core will forgive me if i'm using the wrong terminology, i'm fascinated by networking, but by no means an expert. so assuming someone accepts their route, what happens? Everyone who is either connected to that person who accepts directly.. or also hasn't configured their stuff right will send that data to M24Seven.. who won't probably have the capacity.. and will promptly fall ovet Over And then I'll ask where half of my infrastructure has just gone all the public schools in my province share one giant 10.x.x.x network... (internal) Same in my area.. Sadly Kaz: it's a mess over here :p We've got NAT behind NAT behind NAT in some cases yeesh how do you do anything? IPv6 can't happen soon enough (I'm count myself as lucky that I have it at home) crusher: I wait for a couple of months.. and the broadband supplier looses their contract MrRadar: one of the biggest UK ISPs still doesn't do it Doesn't look like ipv6 is going to happen any time soon at least where i am My ISP is Bell Canada, I have an external address and i'm lucky enough they don't block or filter any ports Eh. We've got government mandated filters here which is odd compared to the flip side of the di-oploly here in canada Heck.. my phone provider blocks archive.org I've had a row with them before O_o WHY??? And who? Three UK Rogers is the other big one here, they don't block sites, but they do block mail ports, filter others and they have gotten in huge amounts of trouble for picking on p2p traffic ive not done age ID with them as prepay is fine for me https://usercontent.irccloud-cdn.com/file/2trI9bao/Screenshot_20170621-213528.png wtf? OK, that makes a bit more sense that's insane to me My phone provider, T-Mobile US has a similar "feature" but you don't need to provide ID or anything to turn it off censorship even for mature content reasons should be an opt-in. never an opt-out unless *maybe* the product is specifically for youth What's better is that they need a credit card to validate.. I don't need to borrow so I don't have one your banked might offer a prepaid linked to your debit bank* Eh. I've just tried with my Monzo MasterCard.. let's see if that fools them Eh, having a 0 annual fee credit card is a good idea even if you never plan to carry a balance. They're useful for travel (car rental and hotel deposits) and shopping at shadier online shops I've got a "mastercard" that i can instantly dump funds onto directly from my bank account crusher: government makes all filtering opt out Ew crusher: that's what Monzo is for me HCross2: At least it is opt out HCross2: i guess thats better than nothing... For now.. who knows that the new government may do Yeah. Ill-considered is probably the nicest way to describe the policy proposals I've seen floated by them Regarding the Internet and encryption Can you spot the scraper? : http://imgur.com/a/1u0vi xD hmm, me and underscor both put in a 16618mb item very recently (within 2 items of eachother) coincidence, or lists being reused?