[00:03] *** remsen has quit IRC (Leaving) [00:20] I see the wikis are being uploaded! Thanks! [00:26] *** remsen has joined #archiveteam [00:51] *** primus104 has quit IRC (Leaving.) [00:55] *** Emcy_ has quit IRC (Read error: Connection reset by peer) [00:58] *** bwn has quit IRC (Read error: Operation timed out) [01:07] *** vitzli has joined #archiveteam [01:15] Hello, something went wrong on gamefront grab, tracker shows very large items being uploaded/downloaded, but gamefront.com/files/idfromtracker return 'File not found' [01:18] *** bwn has joined #archiveteam [01:27] *** vitzli has quit IRC (Quit: Leaving) [01:30] arkiver: Go ahead and grab ftp sites and warc them. [01:39] *** JesseW has joined #archiveteam [01:40] *** zenguy_pc has quit IRC (Read error: Operation timed out) [01:53] *** zenguy_pc has joined #archiveteam [01:54] *** JesseW has quit IRC (Leaving.) [02:22] ever since I rebooted my warrior this past weekend to get updated wiki scripts, the web UI doesnt work and it seems to be hung if I stay on the wiki project. Is the tracker getting any uploads from warriors? I dont see the logos [02:25] *** zyphlar has quit IRC (Ping timeout: 252 seconds) [02:25] *** abartov has quit IRC (Ping timeout: 252 seconds) [02:25] *** abartov has joined #archiveteam [02:25] *** zyphlar has joined #archiveteam [02:26] *** deathy_ has quit IRC (Ping timeout: 252 seconds) [02:26] *** tjg has quit IRC (Read error: Connection reset by peer) [02:26] *** deathy_ has joined #archiveteam [02:28] *** tjg has joined #archiveteam [02:32] *** Coderjoe has quit IRC (Read error: Operation timed out) [02:48] *** Coderjoe has joined #archiveteam [02:58] *** JesseW has joined #archiveteam [03:38] *** zenguy_pc has quit IRC (Read error: Operation timed out) [03:54] *** zenguy_pc has joined #archiveteam [04:01] *** bwn has quit IRC (Read error: Operation timed out) [04:09] *** xk_id has quit IRC (Remote host closed the connection) [04:10] *** xk_id has joined #archiveteam [04:10] *** zenguy_pc has quit IRC (Read error: Operation timed out) [04:11] *** xk_id has quit IRC (Remote host closed the connection) [04:38] *** K4k has joined #archiveteam [04:56] *** aaaaaaaaa has quit IRC (Leaving) [04:56] *** nertzy has joined #archiveteam [05:04] SketchCow: Any chance we can turn gamefront back on? Or is FOS still churning through TBs of content? [05:04] *** wyatt8750 has quit IRC (Read error: Operation timed out) [05:08] *** wyatt8750 has joined #archiveteam [05:20] *** K4k has quit IRC (WeeChat 1.0.1) [05:25] Gamerfront is absorbing a mass of FOS. [05:25] Be patient. A day or two. [05:26] Also, we are pumping in wikis into it. Thousands of wikis. tiny files. [05:26] Machine hates that too. [05:27] Ok, cool. I was just curious. [05:27] Have there been any significantly large wikis uploaded yet? [05:38] Atom__: the wikis project is going strong, but I do not see a lot from warriors http://tracker.archiveteam.org/wikis/ [05:39] Atluxity, Atom__, there are two warriors assigned to wikis right now. Basically everyone else is on auto or urlteam. [05:39] (and the auto ones are running urlteam anyways because that's the default right now) [05:40] * phuzion out [05:42] *** xk_id has joined #archiveteam [05:44] *** JesseW has quit IRC (Leaving.) [05:45] *** nwf has quit IRC (Remote host closed the connection) [05:45] *** nwf has joined #archiveteam [05:46] *** RedType has quit IRC (Remote host closed the connection) [05:49] *** WinterFox has joined #archiveteam [05:50] *** RedType has joined #archiveteam [05:50] *** wp494 has quit IRC (LOUD UNNECESSARY QUIT MESSAGES) [05:54] *** xk_id has quit IRC (Read error: Operation timed out) [06:05] *** JesseW has joined #archiveteam [06:13] *** bwn has joined #archiveteam [06:38] *** BlueMaxim has quit IRC (Read error: Operation timed out) [06:39] *** BlueMaxim has joined #archiveteam [06:47] *** xk_id has joined #archiveteam [06:49] *** remsen has quit IRC (Read error: Operation timed out) [06:50] *** remsen has joined #archiveteam [06:57] *** xk_id has quit IRC (Read error: Operation timed out) [07:00] *** Elegance has quit IRC (Read error: Operation timed out) [07:00] *** Elegance has joined #archiveteam [07:01] *** ploopkazo has joined #archiveteam [07:02] *** yeoldetoa has quit IRC (Read error: Operation timed out) [07:02] *** Gfy has quit IRC (Read error: Operation timed out) [07:03] *** Froggypwn has quit IRC (Read error: Operation timed out) [07:03] *** Froggypwn has joined #archiveteam [07:05] *** matthusby has quit IRC (Read error: Operation timed out) [07:06] *** matthusby has joined #archiveteam [07:06] *** goekesmi has quit IRC (Ping timeout: 499 seconds) [07:07] *** yeoldetoa has joined #archiveteam [07:07] *** ploopkaz- has quit IRC (Read error: Operation timed out) [07:09] *** goekesmi has joined #archiveteam [07:10] *** Administr has quit IRC (Ping timeout: 369 seconds) [07:12] *** chazchaz has quit IRC (Ping timeout: 369 seconds) [07:12] *** atlogbot has quit IRC (Ping timeout: 369 seconds) [07:13] *** dcmorton has quit IRC (Ping timeout: 369 seconds) [07:14] *** BlueMaxim has quit IRC (Read error: Operation timed out) [07:21] *** phiren has quit IRC (ZNC - http://znc.in) [07:21] *** JesseW has quit IRC (Leaving.) [07:22] *** mistym has quit IRC (Ping timeout: 369 seconds) [07:23] *** VADemon has joined #archiveteam [07:23] *** mistym has joined #archiveteam [07:23] *** [phire] has joined #archiveteam [07:25] *** BlueMaxim has joined #archiveteam [07:26] *** dcmorton has joined #archiveteam [07:26] *** swebb has quit IRC (Read error: Operation timed out) [07:27] *** swebb has joined #archiveteam [07:29] *** Gfy has joined #archiveteam [07:29] *** dserodio has quit IRC (Read error: Operation timed out) [07:32] *** atlogbot has joined #archiveteam [07:32] *** Administr has joined #archiveteam [07:33] *** dserodio has joined #archiveteam [07:33] *** slyphic_ has joined #archiveteam [07:33] *** slyphic has quit IRC (Ping timeout: 1221 seconds) [07:39] *** Administr has quit IRC (Ping timeout: 369 seconds) [07:42] *** chazchaz has joined #archiveteam [07:47] *** xk_id has joined #archiveteam [07:49] *** atlogbot has quit IRC (Ping timeout: 369 seconds) [07:52] *** wp494 has joined #archiveteam [07:53] *** dserodio has quit IRC (Ping timeout: 1221 seconds) [07:57] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [07:59] *** xk_id has quit IRC (Ping timeout: 615 seconds) [08:04] *** Administr has joined #archiveteam [08:04] *** dserodio has joined #archiveteam [08:04] *** atlogbot has joined #archiveteam [08:05] *** primus104 has joined #archiveteam [08:07] *** bzc6p_ has joined #archiveteam [08:11] *** bzc6p has quit IRC (Read error: Operation timed out) [08:26] *** xk_id has joined #archiveteam [08:28] *** schbirid has joined #archiveteam [08:35] *** xk_id has quit IRC (Read error: Operation timed out) [08:39] *** atomotic has joined #archiveteam [08:54] *** primus104 has quit IRC (Leaving.) [09:26] *** Start has quit IRC (Read error: Connection reset by peer) [09:35] *** Start has joined #archiveteam [09:41] *** VADemon has quit IRC (left4dead) [09:49] *** fgdfs has joined #archiveteam [09:57] *** fgdfs has quit IRC (Quit: Page closed) [10:04] *** bwn has quit IRC (Read error: Operation timed out) [10:07] *** xk_id has joined #archiveteam [10:08] *** MMovie1 has quit IRC (Ping timeout: 310 seconds) [10:16] *** xk_id has quit IRC (Read error: Operation timed out) [10:20] *** primus104 has joined #archiveteam [10:44] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [10:45] *** [phire] has quit IRC (Quit: ZNC - http://znc.in) [10:45] *** sigkell has joined #archiveteam [10:48] *** [phire] has joined #archiveteam [10:49] *** atomotic has joined #archiveteam [11:07] *** xk_id has joined #archiveteam [11:09] *** bwn has joined #archiveteam [11:16] *** xk_id has quit IRC (Read error: Operation timed out) [11:31] *** zenguy_pc has joined #archiveteam [11:37] *** BlueMaxim has quit IRC (Read error: Connection reset by peer) [11:57] *** remsen has quit IRC (Read error: Operation timed out) [12:03] *** remsen has joined #archiveteam [12:08] *** xk_id has joined #archiveteam [12:08] *** WinterFox has quit IRC (Remote host closed the connection) [12:10] *** anomie has quit IRC (Read error: Connection reset by peer) [12:14] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [12:18] *** anomie has joined #archiveteam [12:19] *** xk_id has quit IRC (Ping timeout: 616 seconds) [12:19] *** vitzli has joined #archiveteam [12:20] *** MMovie has joined #archiveteam [13:03] *** hictooth_ has joined #archiveteam [13:14] *** [phire] has quit IRC (Quit: ZNC - http://znc.in) [13:23] *** atomotic has joined #archiveteam [13:25] *** [phire] has joined #archiveteam [13:30] *** hictooth_ has quit IRC (Quit: Page closed) [13:30] *** nertzy has joined #archiveteam [13:34] *** zenguy_pc has quit IRC (Read error: Operation timed out) [13:48] *** zenguy_pc has joined #archiveteam [14:02] *** cvb has joined #archiveteam [14:03] Atlantic reporter: Have you tried to get in touch with Grantland about saving a copy? [14:03] Me: We have been getting a copy since November 1st. [14:03] Me: We do not "get in touch". We act. [14:07] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [14:08] Fuck yeah! [14:10] *** xk_id has joined #archiveteam [14:15] SketchCow: i put grantland in archivebot [14:16] i think i did that november 1st [14:20] Yes [14:20] That's what I told her. [14:22] *** xk_id has quit IRC (Read error: Operation timed out) [14:23] *** primus104 has quit IRC (Leaving.) [14:23] SketchCow: i found pdfs on download.audible.com [14:24] i'm grabbing a set of them [14:24] there very random [14:25] *** hictooth has joined #archiveteam [14:25] i'm also getting a series from americanarchives.org [14:26] called North Carolina Now [14:26] over 1000 episodes of that is on there [14:30] *** vitzli has quit IRC (Quit: Leaving) [14:36] *** hictooth has quit IRC (Ping timeout: 240 seconds) [14:47] *** hictooth has joined #archiveteam [14:48] *** garyrh has quit IRC (http://bnc4free.com/) [14:54] *** godane has quit IRC (Ping timeout: 310 seconds) [14:55] *** hictooth has quit IRC (Quit: Page closed) [14:57] *** Start has quit IRC (Quit: Disconnected.) [14:59] *** phuzion has quit IRC (Adios y'all) [14:59] *** phuzion has joined #archiveteam [15:10] *** godane has joined #archiveteam [15:10] *** godane has quit IRC (Client Quit) [15:11] *** xk_id has joined #archiveteam [15:24] *** vitzli has joined #archiveteam [15:30] *** pwnsrv has joined #archiveteam [15:31] *** xk_id has quit IRC (Read error: Operation timed out) [15:32] SketchCow: awesome, will do that! [15:36] *** zenguy_pc has quit IRC (Read error: Operation timed out) [15:41] new wikis added. [15:41] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [15:42] So to be clear, these are mediawikieu items [15:42] the 'eu' part in that means 'external urls', which means only the external urls from these wikis are grabbed [15:43] later on we'll also do all items again without the 'eu' part, which will download the wikis themselves, not the external urls [15:43] Ohhhhhhhhhh, ok. I was confused about that. [15:44] Thanks for the clarification :) [15:44] ;) [15:44] I was wondering why we were so hyper-focused on wikis in the european union [15:44] arkiver: Does the pipeline already support downloading the wikis by api.php or are we going to manually crawl them? [15:45] through api.php [15:45] Awesome. --images and --xml I assume? [15:46] https://github.com/ArchiveTeam/wikis-grab/blob/master/pipeline.py#L212-L283 [15:46] scripts are based on wikiteam scripts, but are heavily edited [15:46] Ok, cool [15:49] *** zenguy_pc has joined #archiveteam [15:50] *** mutoso has joined #archiveteam [15:54] 12 [16:03] *** garyrh has joined #archiveteam [16:05] *** Ungstein1 has quit IRC (Quit: Leaving.) [16:05] *** Ungstein has joined #archiveteam [16:09] *** Ungstein has quit IRC (Client Quit) [16:09] *** Start has joined #archiveteam [16:09] *** Ungstein has joined #archiveteam [16:10] *** godane has joined #archiveteam [16:12] *** xk_id has joined #archiveteam [16:13] *** vitzli has quit IRC (Quit: Leaving) [16:19] *** Ungstein has quit IRC (Quit: Leaving.) [16:19] *** Ungstein has joined #archiveteam [16:22] *** xk_id has quit IRC (Read error: Operation timed out) [16:38] *** primus104 has joined #archiveteam [16:51] http://www.theatlantic.com/technology/archive/2015/11/grantland-is-dead-long-live-grantland/414103/ [16:57] *** scyther has joined #archiveteam [16:59] *** JesseW has joined #archiveteam [17:05] *** Start has quit IRC (Quit: Disconnected.) [17:20] *** Start has joined #archiveteam [17:22] *** Ungstein1 has joined #archiveteam [17:24] *** Ungstein has quit IRC (Ping timeout: 252 seconds) [17:25] *** JesseW has quit IRC (Leaving.) [17:32] *** nertzy has joined #archiveteam [17:36] *** zenguy_pc has quit IRC (Ping timeout: 252 seconds) [17:40] *** schbirid has quit IRC (Read error: Operation timed out) [17:43] *** xk_id has joined #archiveteam [17:44] *** Silvan has quit IRC (Quit: No Ping reply in 180 seconds.) [17:46] *** schbirid has joined #archiveteam [17:48] *** Ghost_of_ has joined #archiveteam [17:49] *** SilSte has joined #archiveteam [17:50] *** zenguy_pc has joined #archiveteam [17:50] heh. [17:51] preparing for dashboard meltdown [17:52] *** xk_id has quit IRC (Read error: Operation timed out) [17:58] *** scyther has quit IRC (Quit: Leaving) [17:59] joepie91: !ao http://archivebot.at.ninjawedding.org:4567/ [17:59] lol [18:02] *** Start has quit IRC (Quit: Disconnected.) [18:04] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [18:06] phuzion: hah [18:07] *** Start has joined #archiveteam [18:09] so why is there an ftp-grab repository now, and how is it different from the existing ftp-nab repository [18:10] that's mostly a question for arkiver, who made that repository [18:11] we have a lot of repos, maybe he forgot about ftp-nab [18:15] *** Start has quit IRC (Quit: Disconnected.) [18:19] *** aaaaaaaaa has joined #archiveteam [18:20] *** gfscott has joined #archiveteam [18:21] *** gfscott has quit IRC (Quit: Page closed) [18:28] Me and SketchCow talked about this at IMPAKT. We'll turn the ftp project into a warrior project. [18:30] *** remsen has quit IRC (Read error: Operation timed out) [18:30] Going to shove FTP as WARCs into the archive. [18:32] SketchCow: is there documentation of what an FTP warc should look like? [18:33] ah ok [18:33] The spec for warc focuses mainly on HTTP, for obvious reasons. [18:34] *** godane has quit IRC (Quit: Leaving.) [18:36] *** insane_al has joined #archiveteam [18:37] *** godane has joined #archiveteam [18:37] *** jtvjan has joined #archiveteam [18:37] Help screenr is on fire [18:37] I've a suspicion it looks somewhat like FTP as acceessed through an HTTP proxy. [18:39] http://s13.postimg.org/usxfrdron/image.png [18:41] jtvjan: actually looks like a vaguely reasonable reason (although it _is_ possible to work around it, just probably not economical) [18:41] paging arkiver [18:41] another video website [18:43] *** remsen has joined #archiveteam [18:44] jtvjan: question, do you have a WAG of how big screenr might be? [18:45] Kind of small, i guess.. Ill try researching [18:45] what is 'WAG'? [18:46] Wild-assed guess? [18:46] lol [18:46] ah [18:46] Yeah [18:46] wag = wild-assed guess [18:49] *** jtvjan has quit IRC (Ping timeout: 240 seconds) [19:09] archivebot already produces ftp warcs [19:10] ah yes, I can check wpull for documentation [19:11] I haven't looked at them but ftp is also a human-readable protocol so I would assume it works the same as http but with ftp response codes and such [19:26] heh. more human-readable than machine-readable [19:27] http://aaron.blog.archive.org/2013/05/17/handling-archived-ftp-resources/ [19:27] found it in the bug tracker [19:29] arkiver: https://support.zendesk.com/hc/en-us/articles/205678598-Screenr-Screencasting-Removal [19:29] zendesk reports screenr shutdown as being july [19:29] not sure why it was postponed [19:30] *** atomotic has joined #archiveteam [19:35] *** zenguy_pc has quit IRC (Read error: Operation timed out) [19:35] *** SimpBrain has quit IRC (Read error: Connection reset by peer) [19:38] *** SimpBrain has joined #archiveteam [19:43] *** xk_id has joined #archiveteam [19:47] *** remsen has quit IRC (Read error: Operation timed out) [19:49] *** Ghost_of_ has quit IRC (Quit: Leaving) [19:51] *** zenguy_pc has joined #archiveteam [19:54] *** xk_id has quit IRC (Ping timeout: 615 seconds) [19:58] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [20:08] <_desu_> WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD [20:08] *** insane_al has quit IRC (Read error: Connection reset by peer) [20:09] _desu_: yahoosucks [20:09] <_desu_> Thanks [20:09] np [20:10] go forth and edit [20:12] *** Ungstein1 has quit IRC (Ping timeout: 252 seconds) [20:13] *** K4k has joined #archiveteam [20:14] *** K4k has quit IRC (Client Quit) [20:23] *** insane_al has joined #archiveteam [20:33] *** bzc6p__ has joined #archiveteam [20:38] *** bzc6p_ has quit IRC (Ping timeout: 615 seconds) [20:41] *** altlabel has quit IRC (Read error: Operation timed out) [20:41] *** primus105 has joined #archiveteam [20:42] *** altlabel has joined #archiveteam [20:42] *** vtyl has joined #archiveteam [20:43] *** primus104 has quit IRC (Read error: Operation timed out) [20:44] *** lytv has quit IRC (Read error: Operation timed out) [20:44] *** xk_id has joined #archiveteam [20:46] *** primus has quit IRC (Remote host closed the connection) [20:46] *** bwn has quit IRC (Read error: Operation timed out) [20:48] *** primus104 has joined #archiveteam [20:53] *** xk_id has quit IRC (Read error: Operation timed out) [20:54] *** primus105 has quit IRC (Read error: Operation timed out) [20:54] *** bwn has joined #archiveteam [20:55] *** bwn has quit IRC (Client Quit) [20:57] *** bzc6p__ is now known as bzc6p [20:59] *** K4k has joined #archiveteam [21:23] *** afics has quit IRC (Read error: Operation timed out) [21:23] *** cadbury has quit IRC (Read error: Operation timed out) [21:24] *** dcmorton has quit IRC (Read error: Operation timed out) [21:24] *** dcmorton has joined #archiveteam [21:25] *** chazchaz has quit IRC (Read error: Operation timed out) [21:25] *** chazchaz has joined #archiveteam [21:25] *** Elegance has quit IRC (Read error: Operation timed out) [21:26] *** Elegance has joined #archiveteam [21:27] *** schbirid has quit IRC (Leaving) [21:29] *** afics has joined #archiveteam [21:29] *** aaaaaaaaa has quit IRC (Leaving) [21:29] *** cadbury has joined #archiveteam [21:38] *** zenguy_pc has quit IRC (Ping timeout: 272 seconds) [21:40] *** aaaaaaaaa has joined #archiveteam [21:45] *** xk_id has joined #archiveteam [21:51] *** zenguy_pc has joined #archiveteam [21:53] *** bwn has joined #archiveteam [21:55] *** xk_id has quit IRC (Ping timeout: 615 seconds) [22:04] *** Ravenloft has joined #archiveteam [22:06] *** cvb has quit IRC (Ping timeout: 255 seconds) [22:10] *** cvb has joined #archiveteam [22:22] *** insane_al has quit IRC (Leaving) [22:29] *** bwn has quit IRC (Read error: Operation timed out) [22:30] *** skiy has joined #archiveteam [22:30] *** skiy has quit IRC (Temporary D-line 1440 min. - TOR exit node found. Visit http://rbl.efnetrbl.org/?i=193.138.219.228 for info. (2015/11/4) [22:31] *** Ghost_of_ has joined #archiveteam [22:35] *** skiy has joined #archiveteam [22:39] *** skiy has quit IRC (Client Quit) [22:45] *** remsen has joined #archiveteam [22:46] *** xk_id has joined #archiveteam [22:53] *** xk_id has quit IRC (Read error: Operation timed out) [22:55] *** bwn has joined #archiveteam [22:56] *** Start has joined #archiveteam [23:05] *** zer0c00l has quit IRC (Leaving.) [23:06] *** insane_al has joined #archiveteam [23:20] *** cvb has quit IRC (Read error: Operation timed out) [23:38] *** zenguy_pc has quit IRC (Ping timeout: 252 seconds) [23:42] *** Ungstein has joined #archiveteam [23:52] *** zenguy_pc has joined #archiveteam