[00:01] *** metal_cam has quit IRC (Read error: Operation timed out) [00:03] *** balrog has quit IRC (Read error: Operation timed out) [00:08] *** balrog has joined #archiveteam [00:08] *** swebb sets mode: +o balrog [00:24] *** metalcamp has quit IRC (Ping timeout: 506 seconds) [00:29] http://news.berkeley.edu/2016/09/13/a-statement-on-online-course-content-and-accessibility/ [00:29] Grab. It. All. [00:50] wow, what the fuck? [00:55] something seems counterproductive about removing content because it's not accessible content [01:13] *** BlueMaxim has joined #archiveteam [02:00] explosion in NYC, 26 injured [02:32] *** JesseW has joined #archiveteam [02:35] *** WinterFox has joined #archiveteam [02:44] Yeah, 5 blocks away from me. [03:04] btw, if people ask about things they can mirror -- do suggest the urlteam material. It's all torrentable from IA (I know because I'm mirroring it). Also if people want to, I *think* the archivebot warcs have torrents generated (although they may be too big...) [03:13] *** tsr_ has joined #archiveteam [03:15] *** gar5645 has joined #archiveteam [03:18] *** tsr_ has quit IRC (Ping timeout: 268 seconds) [03:20] *** gar5645 has quit IRC (Ping timeout: 268 seconds) [03:42] atrocity: not another terrorist attack I hope :/ [03:45] *** ndiddy has quit IRC (Read error: Connection reset by peer) [03:47] Pretty low key if it is [03:47] Video already leaked [04:29] *** maelstrom has quit IRC (Quit: Leaving) [04:51] *** Stiletto has joined #archiveteam [04:52] *** JesseW has quit IRC (Ping timeout: 370 seconds) [04:53] *** Sk1d has quit IRC (Ping timeout: 194 seconds) [04:59] *** Sk1d has joined #archiveteam [05:23] *** Frogging has quit IRC (El Psy Kongroo!) [05:26] *** RichardG_ has joined #archiveteam [05:26] *** RichardG has quit IRC (Read error: Connection reset by peer) [05:30] *** Frogging has joined #archiveteam [07:16] *** metalcamp has joined #archiveteam [07:38] *** schbirid has joined #archiveteam [07:39] *** GLaDOS has quit IRC (Oh crap, I died.) [07:40] *** GLaDOS has joined #archiveteam [07:41] *** oli has quit IRC (Ping timeout: 246 seconds) [07:41] *** oli has joined #archiveteam [08:04] how would one do discovery from urlteam data? [08:07] download everything tagged terroroftinytown from IA?... [08:40] *** odemg has joined #archiveteam [09:08] *** atomotic has joined #archiveteam [09:10] *** odemg has quit IRC (Quit: Leaving) [09:26] *** brayden has quit IRC (Ping timeout: 633 seconds) [09:28] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [09:30] *** brayden has joined #archiveteam [09:30] *** swebb sets mode: +o brayden [10:03] *** VADemon has joined #archiveteam [10:23] *** godane has quit IRC (Read error: Operation timed out) [10:26] *** godane has joined #archiveteam [10:29] *** atomotic has joined #archiveteam [10:41] *** bRick5772 has joined #archiveteam [10:53] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [10:58] *** dashcloud has quit IRC (Read error: Connection reset by peer) [10:58] *** dashcloud has joined #archiveteam [11:00] *** vOYtEC has joined #archiveteam [11:23] *** dashcloud has quit IRC (Read error: Operation timed out) [11:24] can i use the thing to put a site wayback machine? [11:25] this site http://forgottenlanguages-full.forgottenlanguages.org/ [11:27] *** dashcloud has joined #archiveteam [11:32] what is 'the thing' [11:33] * Kksmkrn looks away. [11:41] probably archivebot. I think we can do that [11:41] it's blogspot, I forgot what the rules for that are though. /npr or something? [11:52] /ncr I think [11:56] *** ats has quit IRC (Quit: upgrade part 2) [12:11] i didn't know if mona meant the site or just the video, lol [12:12] just the website [12:14] well I threw it in. [12:23] *** fie_ has joined #archiveteam [12:25] *** fie__ has quit IRC (Ping timeout: 244 seconds) [12:26] *** BlueMaxim has quit IRC (Quit: Leaving) [13:49] *** WinterFox has quit IRC (Read error: Operation timed out) [13:54] *** ats has joined #archiveteam [14:02] *** fie_ has quit IRC (Quit: Leaving) [14:03] *** fie has joined #archiveteam [14:29] *** brayden has quit IRC (Read error: Operation timed out) [15:34] *** dashcloud has quit IRC (Remote host closed the connection) [15:40] *** dashcloud has joined #archiveteam [15:51] *** Aranje has joined #archiveteam [16:05] *** maelstrom has joined #archiveteam [16:22] *** brayden has joined #archiveteam [16:22] *** swebb sets mode: +o brayden [16:29] *** RichardG_ has quit IRC (Read error: Connection reset by peer) [16:29] *** RichardG has joined #archiveteam [17:34] *** ndiddy has joined #archiveteam [18:33] *** JesseW has joined #archiveteam [18:45] *** tomwsmf_ has joined #archiveteam [19:18] *** schbirid has quit IRC (Quit: Leaving) [19:19] *** tomwsmf_ has quit IRC (Read error: Operation timed out) [19:40] *** dashcloud has quit IRC (Read error: Operation timed out) [19:43] *** vOYtEC has quit IRC (Ping timeout: 255 seconds) [19:43] *** octarine has joined #archiveteam [19:44] *** godane has quit IRC (Quit: Leaving.) [19:44] *** godane has joined #archiveteam [19:45] *** dashcloud has joined #archiveteam [19:45] *** ndizzle has joined #archiveteam [19:52] *** ndiddy has quit IRC (Read error: Operation timed out) [19:53] *** ndizzle is now known as ndiddy [20:04] *** ndiddy has quit IRC (Read error: Connection reset by peer) [20:05] hello [20:06] https://github.com/massivedynamic/openftp4 [20:06] *** ndiddy has joined #archiveteam [20:08] *** ndizzle has joined #archiveteam [20:10] mona: already got it, thanks [20:16] *** ndiddy has quit IRC (Read error: Operation timed out) [20:17] *** ndizzle has quit IRC (Read error: Operation timed out) [20:17] *** ndiddy has joined #archiveteam [20:31] *** JesseW has quit IRC (Quit: Leaving.) [20:32] *** JesseW has joined #archiveteam [20:39] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [20:39] *** BartoCH has joined #archiveteam [20:41] *** JesseW has quit IRC (Ping timeout: 370 seconds) [21:04] flickr is now on the tracker [21:04] script will be up soon after this final test [21:27] *** ravetcofx has quit IRC (Read error: Operation timed out) [21:30] *** metalcamp has quit IRC (Read error: Operation timed out) [21:39] *** ravetcofx has joined #archiveteam [21:50] *** bRick5772 has quit IRC (Quit: Leaving.) [21:51] *** dashcloud has quit IRC (Remote host closed the connection) [21:54] *** dashcloud has joined #archiveteam [22:01] *** VADemon has quit IRC (Quit: left4dead) [22:06] *** AlexLehm has joined #archiveteam [22:06] *** AlexLehm has quit IRC (Remote host closed the connection) [22:13] *** AlexLehm has joined #archiveteam [22:22] *** maelstrom has quit IRC (Ping timeout: 244 seconds) [22:28] *** maelstrom has joined #archiveteam [23:01] *** JesseW has joined #archiveteam [23:13] *** AlexLehm has quit IRC (Ping timeout: 260 seconds) [23:15] *** tomwsmf_ has joined #archiveteam [23:27] items for flickr are loaded [23:37] *** kristian_ has joined #archiveteam [23:39] scripts are online [23:39] (for flickr) [23:40] this first run is more like a test run, to see if the deduplication if working well [23:40] and make a good estimate of the total size [23:45] * JesseW has switched over to it on my (single) warrior instance [23:46] let me know if it works correctly on the warrior [23:46] only tested manual [23:48] still waiting for my Yahoo Answers jobs to finish. It doesn't *seem* to be working, though... [23:48] oh hold on, also need to fix something else [23:48] * JesseW really should dig into setting up a warrior test environment [23:48] grab paused for now, new scripts coming up [23:51] Especially the limits at which we can run this will be interesting