[00:09] *** vOYtEC has joined #archiveteam [00:35] *** chazchaz has quit IRC (Read error: Operation timed out) [00:36] *** HCross has quit IRC (Read error: Connection reset by peer) [00:37] *** HCross has joined #archiveteam [00:40] *** chazchaz has joined #archiveteam [00:47] *** Stiletto has quit IRC (Ping timeout: 246 seconds) [01:00] http://bluesock.org/~willkg/blog/pyvideo/status_20160115.html - PyVideo is shutting down [01:03] seems worth dumping into archivebot, but otherwise seems to be shutting down pretty cleanly. They already exported their data to a git repo. [01:17] *** maseck_ has quit IRC (ircd.choopa.net irc.teksavvy.ca) [01:17] *** logan has quit IRC (ircd.choopa.net irc.teksavvy.ca) [01:17] *** zenguy has quit IRC (ircd.choopa.net irc.teksavvy.ca) [01:17] *** Mayonaise has quit IRC (ircd.choopa.net irc.teksavvy.ca) [01:17] *** closure has quit IRC (ircd.choopa.net irc.teksavvy.ca) [01:17] *** Nertsy has quit IRC (ircd.choopa.net irc.teksavvy.ca) [01:17] *** Baljem has quit IRC (ircd.choopa.net irc.teksavvy.ca) [01:17] *** mr-b has quit IRC (ircd.choopa.net irc.teksavvy.ca) [01:21] *** JesseW has joined #archiveteam [01:35] *** tephra has joined #archiveteam [01:35] *** tephra_ has quit IRC (Read error: Connection reset by peer) [01:36] *** maseck has joined #archiveteam [01:36] *** logan has joined #archiveteam [01:38] *** zenguy has joined #archiveteam [01:38] *** closure has joined #archiveteam [01:38] *** Nertsy has joined #archiveteam [01:39] *** lbft_ has quit IRC (Read error: Operation timed out) [01:39] *** mr-b has joined #archiveteam [01:39] *** GLaDOS has quit IRC (Ping timeout: 633 seconds) [01:39] *** achip has quit IRC (Read error: Operation timed out) [01:40] *** GLaDOS has joined #archiveteam [01:40] *** lbft has joined #archiveteam [01:41] *** wyatt8750 has quit IRC (Read error: Operation timed out) [01:41] *** Baljem has joined #archiveteam [01:42] *** megaminxw has quit IRC (Quit: Leaving.) [01:45] *** Mayonaise has joined #archiveteam [01:46] *** rizzzz has quit IRC (Ping timeout: 633 seconds) [01:46] *** kyan_ has joined #archiveteam [01:52] *** rizzzz has joined #archiveteam [01:53] *** JesseW has quit IRC (Leaving.) [01:55] *** kyan has quit IRC (Ping timeout: 663 seconds) [01:56] *** beardicus has quit IRC (Read error: Operation timed out) [01:57] *** lbft has quit IRC (Ping timeout: 626 seconds) [01:58] *** arkiver has quit IRC (Read error: Operation timed out) [01:58] *** lbft has joined #archiveteam [02:00] *** jk[SVP] has quit IRC (Read error: Operation timed out) [02:01] *** jk[[SVP]] has joined #archiveteam [02:01] *** bai_ has joined #archiveteam [02:01] *** jk[[SVP]] is now known as jk[SVP] [02:01] *** JesseW has joined #archiveteam [02:02] *** kyan has joined #archiveteam [02:02] *** Jonimus has quit IRC (Ping timeout: 629 seconds) [02:02] *** arkiver has joined #archiveteam [02:02] *** wyatt8750 has joined #archiveteam [02:02] *** bai has quit IRC (Read error: Connection reset by peer) [02:02] *** rossdylan has quit IRC (Read error: Operation timed out) [02:02] *** Sanqui has quit IRC (Ping timeout: 629 seconds) [02:10] *** aMunster has quit IRC (Ping timeout: 629 seconds) [02:10] *** vegbrasil has quit IRC (Read error: Operation timed out) [02:10] *** kyan_ has quit IRC (Ping timeout: 620 seconds) [02:10] *** phuzion has quit IRC (Read error: Operation timed out) [02:10] *** toad1 has quit IRC (Ping timeout: 851 seconds) [02:10] *** mutoso_ has quit IRC (Read error: Operation timed out) [02:10] *** Sanqui has joined #archiveteam [02:10] *** mutoso has joined #archiveteam [02:10] *** Jonimus has joined #archiveteam [02:21] *** logchfoo3 starts logging #archiveteam at Tue Jan 19 02:21:49 2016 [02:21] *** logchfoo3 has joined #archiveteam [02:21] *** logchfoo3 has quit IRC (Connection closed) [02:22] *** logchfoo4 starts logging #archiveteam at Tue Jan 19 02:22:52 2016 [02:22] *** logchfoo4 has joined #archiveteam [02:26] *** username1 has joined #archiveteam [02:29] *** schbirid2 has quit IRC (Read error: Operation timed out) [02:45] *** nwf_ has quit IRC (Ping timeout: 633 seconds) [02:49] *** beardicus has joined #archiveteam [02:50] *** vegbrasil has joined #archiveteam [02:50] *** aMunster has joined #archiveteam [02:57] *** vegbrasil has quit IRC (Read error: Operation timed out) [03:03] *** aMunster has quit IRC (Ping timeout: 633 seconds) [03:14] *** kyan_ has joined #archiveteam [03:15] *** kyan has quit IRC (Ping timeout: 260 seconds) [03:16] *** kyan_ is now known as kyan [03:19] *** beardicus has quit IRC (Read error: Operation timed out) [03:23] *** aMunster has joined #archiveteam [03:24] *** beardicus has joined #archiveteam [03:24] *** vegbrasil has joined #archiveteam [03:27] *** dashcloud has quit IRC (Quit: No Ping reply in 180 seconds.) [03:28] *** megaminxw has joined #archiveteam [03:29] *** dashcloud has joined #archiveteam [03:33] *** nwf_ has joined #archiveteam [03:55] *** BlueMaxim has joined #archiveteam [05:01] *** megaminx1 has joined #archiveteam [05:03] *** megaminxw has quit IRC (Ping timeout: 252 seconds) [06:03] *** kyan_ has joined #archiveteam [06:07] *** kyan has quit IRC (Ping timeout: 260 seconds) [06:07] *** kyan_ is now known as kyan [06:15] arkiver: OK [07:20] *** phuzion has quit IRC (Quit: No Ping reply in 180 seconds.) [07:22] Going to bed, full work here tomorrow. [07:22] g'night [07:24] *** phuzion has joined #archiveteam [07:28] *** megaminx1 has quit IRC (Quit: Leaving.) [07:38] are there any other community web projects I can create tcp sessions for? some crawling or something [07:40] Atluxity: btw, I think some of your IPs may be running into soft blocks from urlteam targets. [07:40] particularly bitly seems to be generating a lot of timeouts... [07:44] anything I can do? [07:45] * JesseW shrug [07:45] I don't know [07:45] keep an eye on it, and let me know if you think of anything? :-) [07:48] yeah [07:58] it's still producing, which is good [08:02] *** megaminxw has joined #archiveteam [08:03] *** JesseW has quit IRC (Read error: Operation timed out) [08:39] *** wutno has joined #archiveteam [08:48] *** atomotic has joined #archiveteam [08:48] *** JesseW has joined #archiveteam [09:40] *** JesseW has quit IRC (Read error: Operation timed out) [09:43] *** megaminxw has quit IRC (Quit: Leaving.) [10:03] *** godane has quit IRC (Quit: Leaving.) [10:05] *** megaminxw has joined #archiveteam [10:05] *** SmileyG has quit IRC (Read error: Operation timed out) [10:10] *** ersi_ is now known as ersi [10:50] *** Smiley has joined #archiveteam [11:01] *** PotcFdk has quit IRC (Ping timeout: 506 seconds) [11:20] *** brayden has quit IRC (Quit: Leaving) [11:39] *** brayden has joined #archiveteam [12:11] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [12:18] *** Morbus has joined #archiveteam [12:19] *** Ravenloft has joined #archiveteam [12:29] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [12:52] *** K4k has joined #archiveteam [12:52] *** K4k has quit IRC (Remote host closed the connection!) [12:53] *** K4k has joined #archiveteam [12:53] *** K4k has quit IRC (Connection closed) [12:56] *** K4k has joined #archiveteam [13:04] *** atomotic has joined #archiveteam [13:22] *** brayden has quit IRC (Quit: Leaving) [13:34] *** dashcloud has quit IRC (Read error: Operation timed out) [13:37] *** dashcloud has joined #archiveteam [13:49] *** WinterFox has quit IRC (Remote host closed the connection) [14:06] *** brayden has joined #archiveteam [14:06] *** Ravenloft has quit IRC (Ping timeout: 370 seconds) [14:30] *** megaminxw has quit IRC (Quit: Leaving.) [14:34] Atluxity: you can run gamefront if your IPs aren't blocked by them [14:34] *** HCross2 has joined #archiveteam [14:38] low concurrent? [14:38] Nope, we can use high concurrent on that [14:39] From the grabs it looks ike you did a lot in the ast for that proect too [14:40] yeah :D [14:41] ok, I'm running [14:41] awesome! [14:45] my servers (49) are now running 30 concurrent for terroroftinytown-grab, 10 for thingiverse-grab, 10 for oldfriends-grab, 10 for gamefront-grab, and 1 for googlecode-grab [14:45] This is normal on oldfriends, right? Server returned 500 (RETRFINISHED). Sleeping. [14:45] awesome [14:45] *** Ravenloft has joined #archiveteam [14:45] Oh are we running thingiverse too? [14:46] well.. I am anyway :P [14:57] *** K4k has quit IRC (Read error: Operation timed out) [15:02] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [15:30] *** K4k_ has joined #archiveteam [15:36] *** K4k_ has quit IRC (Read error: Connection reset by peer) [15:46] phuzion: how did your ansible script come along? [15:48] HCross2: Pretty good, I stopped playing with it but if you've got suggestions, feel free to do a pull request [15:49] * Nemo_bis has been playing with ansible too lately [15:49] I'm starting to learn ansible now, and I'll take a look when I get home [15:50] Feel free to play around with this: https://github.com/phuzion/archiveteam-deploy [15:52] Does it handle when wget-lua falls over? [15:53] All it does is build the machines and start the scripts. [15:54] If you wanna test it, it works really well with Digital Ocean CentOS 6.7 x64 VMs. [15:55] (it works really well because that's what I built it on) [16:05] *** Amitari has joined #archiveteam [16:06] I found a site that might be historically important today. It's Silicon Graphics old documentation site. http://techpubs.sgi.com/library/tpl/cgi-bin/init.cgi [16:06] It says that the stuff has been moved, and that the old one will redirect later, but the new site doesn't seem to contain the manuals for some of the older stuff like the Indy. [16:08] Does anyone know how to Wget that site? [16:08] Or anything that should be done? [16:08] sounds like a job for #archivebot [16:14] Oh, that's another channel? I'll go ask them there. [16:15] *** chazchaz has quit IRC (Read error: Operation timed out) [16:16] Amitari: being archived. [16:16] *** Ravenloft has quit IRC (Ping timeout: 360 seconds) [16:16] Oh, it already is? [16:20] *** chazchaz has joined #archiveteam [16:30] *** Amitari has quit IRC (Leaving) [16:31] aaaa [16:31] already burned 60gig in 1 day [16:31] and 500gig total trafficz [16:41] limebyte, I do 200GB a day [17:21] *** zerkalo_ has quit IRC (Read error: Connection reset by peer) [17:27] *** Ghost_of_ has joined #archiveteam [17:33] *** nertzy has joined #archiveteam [17:50] *** JesseW has joined #archiveteam [17:52] Wow, that Friends United thing is bullshit [17:53] Yea [17:56] glad I dont have to count my gigs... [17:57] thingiverse pretty much done [17:57] our newsbot is doing ~200GB a day right now [17:57] That's.. not little [17:57] most popular item has nearly 5k hits right now [17:57] nice [17:58] oldfriends done [17:58] Good good [17:58] ersi, I plan to double that at least [17:58] let me know if you need help with bandwidth, HCross [17:59] *** JesseW has quit IRC (Leaving.) [17:59] Ok [17:59] the host is very flexible, and I told him what was going on and he likes it a lot. Basically said to me "let me know when you get close, and we will see :)" [18:00] nice [18:00] hmmm... my gamefronts seem to be stalling [18:01] managing over 30 requests a second right now [18:13] *** JW_work has quit IRC (Read error: Operation timed out) [18:19] eh [18:19] guys should i ask fusa for more traffic? [18:19] maybe they give me 2TB free [18:21] *** JW_work has joined #archiveteam [18:26] if you don't have the resources it's ok, we have a good number of volunteers [18:30] *** K4k has joined #archiveteam [18:43] *** dserodio has joined #archiveteam [18:46] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [19:21] *** terburg has joined #archiveteam [19:43] *** K4k has quit IRC (Read error: Operation timed out) [19:51] *** nertzy has joined #archiveteam [19:52] *** K4k has joined #archiveteam [20:03] Hey, that idiot who spoke in the first person hasn't been around in a while. [20:03] * SketchCow breathes in the fresh air [20:03] Sorry, third person [20:09] xD [20:14] SketchCow: this user is quite happy with that [20:14] ;) [20:22] I wish we'd been able to extract suggested URLs from him, or at least point him towards somewhere else to do that work… [20:23] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [20:27] *** JW_work has quit IRC (Quit: Leaving.) [20:32] *** BlueMaxim has joined #archiveteam [20:33] No. [20:33] No, I hope he caught cancer of the cancer and died of both, concurrently. Twice. [20:33] you honeybadger [20:34] Long after anything resembling a socially-acclaimated human being would note they were being an obtuse, shitbrain toolbox, he kept at it, moving to private messages and multiple channels when not listened to. [20:34] People like that need to be shunned, shamed, neutered and stabbed in one eye [20:34] :P [20:42] *** nertzy has joined #archiveteam [20:46] *** godane has joined #archiveteam [20:50] *** Ghost_of_ has quit IRC (Quit: Leaving) [20:54] only one eye? ok. [20:54] * xmc takes note [21:00] *** VADemon has joined #archiveteam [21:03] xmc: Yes, only one eye. The other eye gets infected three weeks later as a result of some strange bacterial infection from the neutering process, and goes blind in that eye, too. [21:11] *** JesseW has joined #archiveteam [21:12] *** JW_work has joined #archiveteam [21:15] No. No. [21:15] One eye so he can see what's happening. [21:18] *** JW_work has quit IRC (Quit: Leaving.) [21:19] *** Ghost_of_ has joined #archiveteam [21:19] Eh, shunned and threatened with implausible tortures or not, their suggestions of sites that might be worth archiving could still be useful. Quite likely not worth the hassle of getting them, though. [21:20] remind me to never get on archiveteam's bad side [21:21] s/archiveteam/SketchCow/ as far as I've noticed. But I agree with the point. [21:24] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [21:27] *** nertzy has joined #archiveteam [21:29] SketchCow: It's because I banned his nick. He probably likes his nick. [21:29] that user probably likes his nick* [21:30] *** Lord_Nigh sets mode: +o balrog [21:33] eah isn't that just in the main elation repo? [21:33] oops wrong channel [21:34] *** antomatic has joined #archiveteam [21:34] *** LordNigh2 has joined #archiveteam [21:35] *** balrog sets mode: +o LordNigh2 [21:35] *** brayden has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** maseck has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** tephra has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** Start has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** antomati_ has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** cadbury has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** w0rp has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** mismatch_ has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** nox has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** [phire] has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** afics has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** Lord_Nigh has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** Apathy has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** lukeman_ has quit IRC (hub.dk irc.inet.tele.dk) [21:35] *** dan- has quit IRC (hub.dk irc.inet.tele.dk) [21:36] *** w0rp_ has joined #archiveteam [21:36] *** mismatchm has joined #archiveteam [21:36] *** lukeman has joined #archiveteam [21:37] *** lytv has quit IRC (Quit: Leaving) [21:38] *** maseck_ has joined #archiveteam [21:38] *** scyther has joined #archiveteam [21:40] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [21:41] *** tephra_ has joined #archiveteam [21:48] *** K4k has quit IRC (Read error: Operation timed out) [21:49] *** lytv has joined #archiveteam [21:50] *** Apathy has joined #archiveteam [21:50] *** afics has joined #archiveteam [21:50] *** [phire] has joined #archiveteam [21:50] *** w0rp_ is now known as w0rp [21:51] *** LordNigh2 is now known as Lord_Nigh [21:54] *** cadbury has joined #archiveteam [22:14] *** achip has joined #archiveteam [22:16] *** Start has joined #archiveteam [22:27] *** nertzy has joined #archiveteam [22:30] *** scyther has quit IRC (Leaving) [22:40] *** nox has joined #archiveteam [22:49] *** dan- has joined #archiveteam [23:05] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [23:10] *** terburg has quit IRC (Quit: terburg) [23:10] *** JesseW has quit IRC (Leaving.) [23:54] *** Rotab has quit IRC (hub.se irc.du.se) [23:54] *** Boppen has quit IRC (hub.se irc.du.se) [23:54] *** Deewiant has quit IRC (hub.se irc.du.se) [23:54] *** w0rp has quit IRC (hub.se irc.underworld.no) [23:54] *** mutoso has quit IRC (hub.se irc.underworld.no) [23:54] *** wednesday has quit IRC (hub.se irc.underworld.no) [23:54] *** Atom-- has quit IRC (hub.se irc.underworld.no) [23:54] *** ats_ has quit IRC (hub.se irc.underworld.no) [23:54] *** zino has quit IRC (hub.se irc.underworld.no) [23:54] *** z00nx has quit IRC (hub.se irc.underworld.no) [23:54] *** nekomune has quit IRC (hub.se irc.underworld.no) [23:54] *** ersi has quit IRC (hub.se irc.underworld.no) [23:54] *** midas has quit IRC (hub.se irc.underworld.no) [23:54] *** Nemo_bis has quit IRC (hub.se irc.underworld.no) [23:54] *** Jon has quit IRC (hub.se irc.underworld.no) [23:54] *** Rye has quit IRC (hub.se irc.underworld.no) [23:54] *** Fletcher has quit IRC (hub.se irc.underworld.no) [23:54] *** filippo__ has quit IRC (hub.se irc.underworld.no) [23:54] *** espes___ has quit IRC (hub.se irc.underworld.no) [23:54] *** useretai- has quit IRC (hub.se irc.underworld.no) [23:54] *** will has quit IRC (hub.se irc.underworld.no) [23:54] *** antomatic has quit IRC (hub.se efnet.port80.se) [23:54] *** HCross2 has quit IRC (hub.se efnet.port80.se) [23:54] *** wutno has quit IRC (hub.se efnet.port80.se) [23:54] *** kyan has quit IRC (hub.se efnet.port80.se) [23:54] *** GLaDOS has quit IRC (hub.se efnet.port80.se) [23:54] *** unstable has quit IRC (hub.se efnet.port80.se) [23:54] *** _desu___ has quit IRC (hub.se efnet.port80.se) [23:54] *** Peetz0r_ has quit IRC (hub.se efnet.port80.se) [23:54] *** aliz has quit IRC (hub.se efnet.port80.se) [23:54] *** wp494 has quit IRC (hub.se efnet.port80.se) [23:54] *** edsu has quit IRC (hub.se efnet.port80.se) [23:54] *** hive-mind has quit IRC (hub.se efnet.port80.se) [23:54] *** Muad-Dib has quit IRC (hub.se efnet.port80.se) [23:54] *** Famicoma1 has quit IRC (hub.se efnet.port80.se) [23:54] *** ivan` has quit IRC (hub.se efnet.port80.se) [23:54] *** PepsiMax_ has quit IRC (hub.se efnet.port80.se) [23:54] *** SilSte has quit IRC (hub.se efnet.port80.se) [23:54] *** Kazzy has quit IRC (hub.se efnet.port80.se) [23:54] *** mistym has quit IRC (hub.se efnet.port80.se) [23:54] *** tjg has quit IRC (hub.se efnet.port80.se) [23:54] *** zhongfu has quit IRC (hub.se efnet.port80.se) [23:54] *** pikhq has quit IRC (hub.se efnet.port80.se) [23:54] *** Kenshin has quit IRC (hub.se efnet.port80.se) [23:54] *** Rickster has quit IRC (hub.se efnet.port80.se) [23:54] *** Atluxity has quit IRC (hub.se efnet.port80.se) [23:54] *** Ctrl-S___ has quit IRC (hub.se efnet.port80.se) [23:54] *** VonGuard has quit IRC (hub.se efnet.port80.se) [23:54] *** zyphlar_ has quit IRC (hub.se efnet.port80.se) [23:54] *** beeper has quit IRC (hub.se efnet.port80.se) [23:54] *** kevin has quit IRC (hub.se efnet.port80.se) [23:54] *** bauruine has quit IRC (hub.se efnet.port80.se) [23:54] *** karissa__ has quit IRC (hub.se efnet.port80.se) [23:54] *** sigkell has quit IRC (hub.se efnet.port80.se) [23:54] *** Gfy has quit IRC (hub.se efnet.port80.se) [23:54] *** Fusl has quit IRC (hub.se efnet.port80.se) [23:54] *** hades_ has quit IRC (hub.se efnet.port80.se) [23:54] *** joepie91 has quit IRC (hub.se efnet.port80.se) [23:54] *** SadDM has quit IRC (hub.se efnet.port80.se) [23:54] *** redlob has quit IRC (hub.se efnet.port80.se) [23:54] *** JSharp___ has quit IRC (hub.se efnet.port80.se) [23:54] *** Vito` has quit IRC (hub.se efnet.port80.se) [23:54] *** deathy has quit IRC (hub.se efnet.port80.se) [23:54] *** abartov__ has quit IRC (hub.se efnet.port80.se) [23:54] *** johtso has quit IRC (hub.se efnet.port80.se) [23:55] *** JesseW has joined #archiveteam [23:59] *** Rotab has joined #archiveteam [23:59] *** Boppen has joined #archiveteam [23:59] *** Deewiant has joined #archiveteam