[00:09] *** Famicoma1 has joined #archiveteam-bs [00:39] SketchCow: i noticed your picture of Poughkeepsie Journal [00:39] on twitter [00:40] there archives: http://poughkeepsiejournal.newspapers.com/ [00:40] sadly its pay wall [00:45] eek! is IA down? [00:46] temporarily; rebooting [00:46] the whole thing? [00:47] lol [00:47] "we're rebooting the building" [00:47] like web.archive.org and s3.archive.org are both unresponsive [00:47] https://twitter.com/internetarchive/status/707315476737576961 [00:48] archive.org does give a scheduled maintenance page though. didn't see that. cool. [00:48] https://twitter.com/Bobo_90__/status/707366942248726528 [00:48] this is a priceless response [00:48] quite clearly got a new target audience there [00:48] with the in-browser emulation [00:48] :) [00:48] yeah! [00:48] Interestingly, http://blog.archive.org is still up [00:51] *** dashcloud has quit IRC (Read error: Operation timed out) [00:53] chfoo-: chfoo0: can you please send me the logs for googlecode? I need to requeue some items and then we'll restart the grab [00:54] *** dashcloud has joined #archiveteam-bs [00:56] *** chfoo0 is now known as chfoo [00:57] I need more FTP things to do arkiver :-D [00:57] I sent you items :-D [01:38] *** JesseW has joined #archiveteam-bs [01:40] *** dxrt_ is now known as dxrt [01:48] *** dashcloud has quit IRC (Read error: Operation timed out) [01:48] *** hawc145 is now known as HCross [01:52] *** dashcloud has joined #archiveteam-bs [01:58] oh wow, after whatever happened here, I am now getting up to 12mb/s [02:01] to FOS? [02:01] no, to IA [02:01] ohh, lol [02:01] xmc: any idea how I can rename a file/ [02:01] Im getting 500 Internal Server Errors [02:01] like I suppose I could download it and then upload it back to the same archive again [02:02] they restarted their servers [02:02] yeah, im getting 450Mbps up to them though now [02:02] https://twitter.com/internetarchive/status/707366988960571392 [02:04] xmc: oh nvm I'm an idiot it's easy [02:07] and it still can't clear things as fast as it can bring them in, lol! [02:08] lol [02:17] erg, "503 slow down" [02:17] well [02:17] if that's the bottleneck I'd say life is good. [02:18] yeah ive hit the same [02:19] FalconK, how much do you need to upload? [02:20] HCross: 195GB in buffer right now [02:20] I'm thinking of adding correct 503 handling to the uploader, since it doesn't look that hard [02:21] ah. Not bad - im trying to shift 1.8TB of news to the IA. My script seems to be using a way to high concurrent [02:22] you probably don't need to concurrently upload multiple streams to any single target. [02:22] people doing that was part of what made a mess on FOS [02:22] yeah [02:36] *** tomwsmf-a has joined #archiveteam-bs [02:36] *** arkiver has quit IRC (Ping timeout: 260 seconds) [02:38] botpie91, tell arkiver that http://paste.nerds.io/nijosehici.coffee was happening, and did just after he disconnected [02:38] HCross: I'll pass that on when arkiver is around. [02:40] I've started a local grab of www.litmir.co (ru) that was reported to be taken over by right holders. Quite many "forum" topics seem to have been forcefully deleted, grabbing what's left of books and etc [02:41] Unsure if it's allowed to upload this kind of stuff to archive.org, hence the local grab [02:42] damn sons [02:42] I'm just trying to get my 60G to FOS so I can reboot my laptop :( [02:43] *** dxrt has quit IRC (Read error: Operation timed out) [02:43] *** dxrt has joined #archiveteam-bs [02:45] *** kvieta has quit IRC (Read error: Operation timed out) [02:46] *** beardicus has quit IRC (Read error: Operation timed out) [02:47] *** toad1 has quit IRC (Read error: Operation timed out) [02:48] *** phuz has quit IRC (Read error: Operation timed out) [02:48] *** SimpBrai1 has quit IRC (Read error: Operation timed out) [02:49] *** is- has joined #archiveteam-bs [02:49] *** closure has quit IRC (Ping timeout: 633 seconds) [02:50] that might take you a few years ;) [02:52] *** is-_ has quit IRC (Read error: Connection reset by peer) [02:54] *** botpie91 has quit IRC (Ping timeout: 633 seconds) [02:54] *** phuzion has joined #archiveteam-bs [02:56] *** arkiver has joined #archiveteam-bs [02:57] *** SimpBrai1 has joined #archiveteam-bs [03:07] *** VADemon has quit IRC (Quit: left4dead) [03:12] *** kvieta has joined #archiveteam-bs [03:12] *** toad1 has joined #archiveteam-bs [03:14] *** botpie91 has joined #archiveteam-bs [03:14] *** beardicus has joined #archiveteam-bs [03:14] *** winr4r has quit IRC (Ping timeout: 260 seconds) [03:14] *** winr4r has joined #archiveteam-bs [03:15] *** closure has joined #archiveteam-bs [03:15] *** midas sets mode: +o closure [03:30] *** JesseW has quit IRC (Quit: Leaving.) [03:58] *** bwn has quit IRC (Ping timeout: 492 seconds) [04:19] *** bwn has joined #archiveteam-bs [04:20] *** bwn has quit IRC (Client Quit) [04:31] *** xXx_ndidd has quit IRC (Read error: Connection reset by peer) [04:34] *** logan2 has joined #archiveteam-bs [04:36] *** logan has quit IRC (Read error: Operation timed out) [04:39] *** vtyl has joined #archiveteam-bs [04:40] *** lytv has quit IRC (Read error: Operation timed out) [04:48] *** Simpbrai_ has quit IRC (Read error: Operation timed out) [04:48] *** Simpbrai_ has joined #archiveteam-bs [05:01] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [05:11] *** acridAxid has quit IRC (marauder) [05:12] *** Sk1d has quit IRC (Ping timeout: 250 seconds) [05:12] *** acridAxid has joined #archiveteam-bs [05:19] *** Sk1d has joined #archiveteam-bs [05:45] *** logan2 has quit IRC (Read error: Operation timed out) [05:46] *** logan has joined #archiveteam-bs [06:16] *** Famicoma1 has quit IRC (Ping timeout: 260 seconds) [06:28] *** JesseW has joined #archiveteam-bs [07:20] *** metalcamp has joined #archiveteam-bs [07:37] *** Famicoma1 has joined #archiveteam-bs [07:58] 1. ErkDog: Stop complaining and give me information. [07:58] Where's the bottleneck. [08:00] *** JesseW has quit IRC (Quit: Leaving.) [08:14] *** signius has joined #archiveteam-bs [08:54] *** schbirid has joined #archiveteam-bs [09:12] *** pikhq has quit IRC (Ping timeout: 506 seconds) [09:21] yipdw_: thanks for littleboots a couple of years ago, popped back in my head today again. [09:22] *** bwn has joined #archiveteam-bs [09:57] *** vitzli has joined #archiveteam-bs [10:06] *** metalcamp has quit IRC (Ping timeout: 250 seconds) [11:11] *** metalcamp has joined #archiveteam-bs [11:41] *** metalcamp has quit IRC (Ping timeout: 250 seconds) [12:33] *** metalcamp has joined #archiveteam-bs [12:36] *** toad1 has quit IRC (Read error: Operation timed out) [12:38] *** closure has quit IRC (Read error: Operation timed out) [12:38] *** vtyl has quit IRC (Read error: Operation timed out) [12:40] *** botpie91 has quit IRC (Ping timeout: 633 seconds) [12:41] *** beardicus has quit IRC (Read error: Operation timed out) [12:41] *** kvieta has quit IRC (Read error: Operation timed out) [12:42] *** lytv has joined #archiveteam-bs [12:42] *** toad1 has joined #archiveteam-bs [12:51] *** metal_cam has joined #archiveteam-bs [12:51] *** metalcamp has quit IRC (Ping timeout: 258 seconds) [12:57] *** metal_cam is now known as metalcamp [13:04] *** kvieta has joined #archiveteam-bs [13:04] *** VADemon has joined #archiveteam-bs [13:05] *** beardicus has joined #archiveteam-bs [13:07] *** closure has joined #archiveteam-bs [13:08] *** midas sets mode: +o closure [13:08] *** botpie91 has joined #archiveteam-bs [14:05] *** vitzli has quit IRC (Leaving) [14:23] *** tomwsmf-a has joined #archiveteam-bs [14:35] *** pgoetz has quit IRC (Remote host closed the connection) [15:10] *** Start has quit IRC (Quit: Disconnected.) [15:45] *** Start has joined #archiveteam-bs [16:13] http://researchscan.comsys.rwth-aachen.de/ we should ask them for the info for the FTP grab. [16:23] *** RichardG_ has quit IRC (Ping timeout: 258 seconds) [16:30] *** RichardG has joined #archiveteam-bs [16:47] maybe shodan.io would donate a list [16:48] Perhaps @Viss might be able to help us out a little bit. He does a lot with Shodan [16:51] *** Start_ has joined #archiveteam-bs [16:51] *** Start has quit IRC (Read error: Connection reset by peer) [16:51] *** Start_ is now known as Start [16:59] *** JesseW has joined #archiveteam-bs [17:07] *** Start has quit IRC (Quit: Disconnected.) [17:13] *** JesseW has quit IRC (Quit: Leaving.) [17:23] *** metalcamp has quit IRC (Ping timeout: 258 seconds) [17:42] *** metalcamp has joined #archiveteam-bs [17:46] *** VADemon has quit IRC (Quit: left4dead) [18:39] *** jut has joined #archiveteam-bs [18:58] *** bwn has quit IRC (Read error: Operation timed out) [19:09] *** schbirid has quit IRC (Quit: Leaving) [19:23] *** bwn has joined #archiveteam-bs [19:28] *** jut has quit IRC (Read error: Connection reset by peer) [19:28] *** schbirid has joined #archiveteam-bs [20:38] *** Start has joined #archiveteam-bs [20:41] chfoo, can we have svchfoo3 etc in #newsgrabberbot please [20:44] logging might also be nice, but it's not very important [20:44] arkiver: 02:38Z tell arkiver that http://paste.nerds.io/nijosehici.coffee was happening, and did just after he disconnected [20:44] it's mostly the bot reporting things [20:44] oops :P [20:45] haha yep, should be fixed now [20:45] *** Start has quit IRC (Quit: Disconnected.) [20:45] yeah, I was awake at strange times this morning [20:45] right [21:05] HCross: you can use the /invite command [21:07] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [21:10] *** Lord_Nigh has joined #archiveteam-bs [21:16] *** metalcamp has quit IRC (Ping timeout: 258 seconds) [21:31] geez, I seem to be on the broken tier of Heroku service [21:32] first my Redis instance was flagged with "serious error"; two days later, the Postgres instance was flagged with "serious error" [21:32] everyone's favorite tier [21:32] I appreciate that the problems were resolved quickly, but wtf [21:32] are they trying to sell me HA in an underhanded way [21:39] *** schbirid has quit IRC (Quit: Leaving) [21:40] *** tomwsmf-a has quit IRC (Ping timeout: 258 seconds) [22:28] *** lysobit has quit IRC (Quit: that hurt deep, nsh) [22:32] *** lysobit has joined #archiveteam-bs [22:38] *** ndiddy has joined #archiveteam-bs [22:44] *** Kenshin has quit IRC (Ping timeout: 260 seconds) [22:48] *** Kenshin has joined #archiveteam-bs [22:49] *** dashcloud has quit IRC (Read error: Operation timed out) [22:57] *** dashcloud has joined #archiveteam-bs [23:28] *** beardicus has quit IRC (Read error: Operation timed out) [23:29] *** botpie91 has quit IRC (Read error: Operation timed out) [23:30] *** closure has quit IRC (Read error: Operation timed out) [23:31] *** kvieta has quit IRC (Ping timeout: 633 seconds) [23:54] *** kvieta has joined #archiveteam-bs [23:54] *** beardicus has joined #archiveteam-bs