[00:07] *** JetBalsa has joined #archiveteam [00:38] *** Akaibu has quit IRC () [01:12] *** bithippo has joined #archiveteam [01:35] OK! Time to make some noise [01:36] *** BlueMaxim has joined #archiveteam [01:39] *** JesseW has joined #archiveteam [02:01] *** bithippo has quit IRC (Quit: Page closed) [02:04] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [02:05] *** Lord_Nigh has joined #archiveteam [02:06] *** philpem has quit IRC (Ping timeout: 260 seconds) [02:08] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [02:13] *** Lord_Nigh has joined #archiveteam [02:24] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [02:28] *** Lord_Nigh has joined #archiveteam [02:28] *** balrog sets mode: +o Lord_Nigh [02:35] *** ikreymer has joined #archiveteam [02:40] hi archiveteam, i wanted to share some good news in the world of web archiving. we have received a grant to build Webrecorder (https://webrecorder.io/) for the next two years: http://rhizome.org/editorial/2016/jan/04/webrecorder-mellon/ we hope to make it into an easy to use tool for anyone to use to archive any content, and especially dynamic content, and create their own personalized web archives [02:40] also, we're hiring a developer to help work on it: https://new-beta.webrecorder.io/static/__shared/jobs/developer.pdf [02:40] AWESOME!! [02:41] of course, the project is open source, so contributions/issues/suggestions welcome as well: https://github.com/webrecorder/webrecorder [02:52] *** JesseW has quit IRC (Leaving.) [02:54] ikreymer: badass [03:05] ikreymer: awesome news! [03:18] *** gibigian1 has quit IRC (Remote host closed the connection) [03:50] *** JesseW has joined #archiveteam [04:00] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [04:04] *** Lord_Nigh has joined #archiveteam [04:20] *** superkuh_ has quit IRC (Remote host closed the connection) [04:45] *** GLaDOS has joined #archiveteam [04:48] *** megaminxw has quit IRC (Quit: Leaving.) [04:55] *** Stiletto has quit IRC () [05:05] *** JetBalsa has quit IRC (Read error: Connection reset by peer) [05:14] *** GLaDOS has quit IRC (Read error: Operation timed out) [05:16] *** VADemon has joined #archiveteam [05:41] *** GLaDOS has joined #archiveteam [05:55] *** megaminxw has joined #archiveteam [06:11] *** brayden has quit IRC (Read error: Connection reset by peer) [07:19] *** brayden has joined #archiveteam [07:19] *** swebb sets mode: +o brayden [07:25] ikreymer: Are you going to stay in SF or move to NY? [07:35] SketchCow: stay in SF, with occasional trips to NY.. i suppose it'll sort of be like the reverse of your work commute :) [08:03] *** Lord_Nigh has quit IRC (Ping timeout: 252 seconds) [08:19] *** Lord_Nigh has joined #archiveteam [08:20] *** Lord_Nigh has quit IRC (Excess Flood) [08:20] *** Lord_Nigh has joined #archiveteam [08:24] *** VADemon_ has joined #archiveteam [08:26] *** schbirid has joined #archiveteam [08:27] *** VADemon has quit IRC (Read error: Operation timed out) [08:46] *** Lord_Nigh has quit IRC (Ping timeout: 252 seconds) [08:47] *** Lord_Nigh has joined #archiveteam [08:48] *** balrog sets mode: +o Lord_Nigh [08:51] Makes sense. [08:51] *** JesseW has quit IRC (Read error: Operation timed out) [09:02] *** Elegance has quit IRC (Ping timeout: 250 seconds) [09:03] *** Elegance has joined #archiveteam [09:16] *** scyther has joined #archiveteam [09:59] *** atomotic has joined #archiveteam [10:10] *** trs80 has quit IRC (Remote host closed the connection) [10:12] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [10:14] *** Lord_Nigh has joined #archiveteam [10:15] *** balrog sets mode: +o Lord_Nigh [10:22] *** arkiver2 has joined #archiveteam [10:28] *** Ghost_of_ has quit IRC (Remote host closed the connection) [10:31] *** arkiver2 has quit IRC (Ping timeout: 260 seconds) [10:32] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [10:38] *** Lord_Nigh has joined #archiveteam [10:38] *** balrog sets mode: +o Lord_Nigh [10:42] *** arkiver2 has joined #archiveteam [10:50] *** arkiver2 has quit IRC (Ping timeout: 260 seconds) [10:50] *** arkiver2 has joined #archiveteam [10:55] *** Lord_Nigh has quit IRC (Ping timeout: 250 seconds) [10:56] *** Lord_Nigh has joined #archiveteam [10:57] *** balrog sets mode: +o Lord_Nigh [11:01] *** Lord_Nigh has quit IRC (Ping timeout: 252 seconds) [11:05] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [11:14] *** Lord_Nigh has joined #archiveteam [11:15] *** balrog sets mode: +o Lord_Nigh [11:26] *** Stiletto has joined #archiveteam [11:27] *** VADemon_ has quit IRC (Read error: Operation timed out) [11:34] *** nertzy has joined #archiveteam [11:48] *** arkiver2 has quit IRC (Quit: Nettalk6 - www.ntalk.de) [12:11] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [12:16] *** bentpins has joined #archiveteam [12:30] ikreymer: Yay! Congratulations [12:37] *** atomotic has joined #archiveteam [12:51] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [13:29] SketchCow: ok if we also get a WARC copy of musicbrainz while finding and archiving external links? [13:48] *** slyphic|a is now known as slyphic [13:52] We need more concurrent on oldfriends! [13:53] *** aliz_ has quit IRC (Remote host closed the connection) [13:59] *** BlueMaxim has quit IRC (Quit: Leaving) [14:09] *** WinterFox has quit IRC (Remote host closed the connection) [14:13] hoi [14:14] on it arkiver [14:15] thanks! [14:18] 10 concurrent per server for now [14:21] *** trs80 has joined #archiveteam [14:33] *** atomotic has joined #archiveteam [14:35] *** gibigiana has joined #archiveteam [14:40] *** nertzy has joined #archiveteam [14:50] *** Start has quit IRC (Quit: Disconnected.) [15:04] *** ikreymer has quit IRC (irc.servercentral.net chat.efnet.org) [15:04] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [15:07] *** atomotic has quit IRC (hub.efnet.us hub.se) [15:07] *** pikhq has quit IRC (hub.efnet.us hub.se) [15:07] *** Kenshin has quit IRC (hub.efnet.us hub.se) [15:07] *** zhongfu has quit IRC (hub.efnet.us hub.se) [15:07] *** signius has quit IRC (hub.efnet.us hub.se) [15:07] *** tjg has quit IRC (hub.efnet.us hub.se) [15:07] *** unstable has quit IRC (hub.efnet.us hub.se) [15:07] *** redlob has quit IRC (hub.efnet.us hub.se) [15:07] *** xhades has quit IRC (hub.efnet.us hub.se) [15:07] *** Rickster has quit IRC (hub.efnet.us hub.se) [15:07] *** bauruine has quit IRC (hub.efnet.us hub.se) [15:07] *** is- has quit IRC (hub.efnet.us hub.se) [15:07] *** sigkell has quit IRC (hub.efnet.us hub.se) [15:07] *** _desu___ has quit IRC (hub.efnet.us hub.se) [15:07] *** Ctrl-S___ has quit IRC (hub.efnet.us hub.se) [15:07] *** beeper has quit IRC (hub.efnet.us hub.se) [15:07] *** Muad-Dib has quit IRC (hub.efnet.us hub.se) [15:07] *** JSharp___ has quit IRC (hub.efnet.us hub.se) [15:07] *** zyphlar_ has quit IRC (hub.efnet.us hub.se) [15:07] *** Vito` has quit IRC (hub.efnet.us hub.se) [15:07] *** kevin has quit IRC (hub.efnet.us hub.se) [15:07] *** Kazzy has quit IRC (hub.efnet.us hub.se) [15:07] *** deathy___ has quit IRC (hub.efnet.us hub.se) [15:07] *** karissa__ has quit IRC (hub.efnet.us hub.se) [15:07] *** VonGuard has quit IRC (hub.efnet.us hub.se) [15:07] *** abartov__ has quit IRC (hub.efnet.us hub.se) [15:07] *** johtso has quit IRC (hub.efnet.us hub.se) [15:07] *** Atluxity has quit IRC (hub.efnet.us hub.se) [15:07] *** gibigiana has quit IRC (hub.efnet.us hub.se) [15:07] *** Lord_Nigh has quit IRC (hub.efnet.us hub.se) [15:07] *** dan- has quit IRC (hub.efnet.us hub.se) [15:07] *** Emcy_ has quit IRC (hub.efnet.us hub.se) [15:07] *** Ravenloft has quit IRC (hub.efnet.us hub.se) [15:07] *** diacope has quit IRC (hub.efnet.us hub.se) [15:07] *** Boppen has quit IRC (hub.efnet.us hub.se) [15:07] *** Rotab has quit IRC (hub.efnet.us hub.se) [15:07] *** Deewiant has quit IRC (hub.efnet.us hub.se) [15:07] *** wyatt8740 has quit IRC (hub.efnet.us hub.se) [15:07] *** Atom__ has quit IRC (hub.efnet.us hub.se) [15:07] *** mutoso has quit IRC (hub.efnet.us hub.se) [15:07] *** Nemo_bis has quit IRC (hub.efnet.us hub.se) [15:07] *** jmtd has quit IRC (hub.efnet.us hub.se) [15:07] *** ats has quit IRC (hub.efnet.us hub.se) [15:07] *** logan has quit IRC (hub.efnet.us hub.se) [15:07] *** rduser has quit IRC (hub.efnet.us hub.se) [15:07] *** sivoais has quit IRC (hub.efnet.us hub.se) [15:07] *** Rye has quit IRC (hub.efnet.us hub.se) [15:07] *** antomatic has quit IRC (hub.efnet.us hub.se) [15:07] *** jk[SVP] has quit IRC (hub.efnet.us hub.se) [15:07] *** joepie91 has quit IRC (hub.efnet.us hub.se) [15:07] *** nekomune has quit IRC (hub.efnet.us hub.se) [15:07] *** Fletcher has quit IRC (hub.efnet.us hub.se) [15:07] *** filippo__ has quit IRC (hub.efnet.us hub.se) [15:07] *** DFJustinZ has quit IRC (hub.efnet.us hub.se) [15:07] *** espes___ has quit IRC (hub.efnet.us hub.se) [15:07] *** useretai- has quit IRC (hub.efnet.us hub.se) [15:07] *** will has quit IRC (hub.efnet.us hub.se) [15:07] *** z00nx has quit IRC (hub.efnet.us hub.se) [15:07] *** mafrasi2 has quit IRC (hub.efnet.us hub.se) [15:07] *** mksplg has quit IRC (hub.efnet.us hub.se) [15:07] *** altlabel has quit IRC (hub.efnet.us hub.se) [15:07] *** Ymgve has quit IRC (hub.efnet.us hub.se) [15:07] *** PurpleSym has quit IRC (hub.efnet.us hub.se) [15:07] *** limebyte has quit IRC (hub.efnet.us hub.se) [15:07] *** Meeh has quit IRC (hub.efnet.us hub.se) [15:07] *** PotcFdk has quit IRC (hub.efnet.us hub.se) [15:07] *** tobbez has quit IRC (hub.efnet.us hub.se) [15:07] *** i0npulse has quit IRC (hub.efnet.us hub.se) [15:07] *** Marc has quit IRC (hub.efnet.us hub.se) [15:07] *** sHATNER has quit IRC (hub.efnet.us hub.se) [15:07] *** brayden has quit IRC (hub.efnet.us hub.se) [15:07] *** RedType has quit IRC (hub.efnet.us hub.se) [15:07] *** afics has quit IRC (hub.efnet.us hub.se) [15:07] *** cadbury has quit IRC (hub.efnet.us hub.se) [15:07] *** SilSte has quit IRC (hub.efnet.us hub.se) [15:07] *** Famicoman has quit IRC (hub.efnet.us hub.se) [15:07] *** [phire] has quit IRC (hub.efnet.us hub.se) [15:07] *** nox has quit IRC (hub.efnet.us hub.se) [15:07] *** Peetz0r has quit IRC (hub.efnet.us hub.se) [15:07] *** ersi has quit IRC (hub.efnet.us hub.se) [15:07] *** wednesday has quit IRC (hub.efnet.us hub.se) [15:07] *** matthusb- has quit IRC (hub.efnet.us hub.se) [15:07] *** Apathy has quit IRC (hub.efnet.us hub.se) [15:13] *** gibigiana has joined #archiveteam [15:13] *** atomotic has joined #archiveteam [15:13] *** Lord_Nigh has joined #archiveteam [15:13] *** brayden has joined #archiveteam [15:13] *** RedType has joined #archiveteam [15:13] *** mafrasi2 has joined #archiveteam [15:13] *** pikhq has joined #archiveteam [15:13] *** dan- has joined #archiveteam [15:13] *** wyatt8740 has joined #archiveteam [15:13] *** afics has joined #archiveteam [15:13] *** cadbury has joined #archiveteam [15:13] *** SilSte has joined #archiveteam [15:13] *** [phire] has joined #archiveteam [15:13] *** Famicoman has joined #archiveteam [15:13] *** Kenshin has joined #archiveteam [15:13] *** zhongfu has joined #archiveteam [15:13] *** Emcy_ has joined #archiveteam [15:13] *** Ravenloft has joined #archiveteam [15:13] *** diacope has joined #archiveteam [15:13] *** Atom__ has joined #archiveteam [15:13] *** mutoso has joined #archiveteam [15:13] *** Nemo_bis has joined #archiveteam [15:13] *** nox has joined #archiveteam [15:13] *** Boppen has joined #archiveteam [15:13] *** signius has joined #archiveteam [15:13] *** jmtd has joined #archiveteam [15:13] *** tjg has joined #archiveteam [15:13] *** unstable has joined #archiveteam [15:13] *** redlob has joined #archiveteam [15:13] *** xhades has joined #archiveteam [15:13] *** ats has joined #archiveteam [15:13] *** Rickster has joined #archiveteam [15:13] *** logan has joined #archiveteam [15:13] *** bauruine has joined #archiveteam [15:13] *** is- has joined #archiveteam [15:13] *** Peetz0r has joined #archiveteam [15:13] *** rduser has joined #archiveteam [15:13] *** ersi has joined #archiveteam [15:13] *** sivoais has joined #archiveteam [15:13] *** sigkell has joined #archiveteam [15:13] *** wednesday has joined #archiveteam [15:13] *** Ctrl-S___ has joined #archiveteam [15:13] *** _desu___ has joined #archiveteam [15:13] *** Rye has joined #archiveteam [15:13] *** beeper has joined #archiveteam [15:13] *** Muad-Dib has joined #archiveteam [15:13] *** hub.se sets mode: +ooo Lord_Nigh brayden ersi [15:13] *** JSharp___ has joined #archiveteam [15:13] *** zyphlar_ has joined #archiveteam [15:13] *** Vito` has joined #archiveteam [15:13] *** kevin has joined #archiveteam [15:13] *** matthusb- has joined #archiveteam [15:13] *** Kazzy has joined #archiveteam [15:13] *** deathy___ has joined #archiveteam [15:13] *** karissa__ has joined #archiveteam [15:13] *** VonGuard has joined #archiveteam [15:13] *** abartov__ has joined #archiveteam [15:13] *** johtso has joined #archiveteam [15:13] *** Atluxity has joined #archiveteam [15:13] *** Rotab has joined #archiveteam [15:13] *** antomatic has joined #archiveteam [15:13] *** Apathy has joined #archiveteam [15:13] *** jk[SVP] has joined #archiveteam [15:13] *** joepie91 has joined #archiveteam [15:13] *** nekomune has joined #archiveteam [15:13] *** mksplg has joined #archiveteam [15:13] *** Fletcher has joined #archiveteam [15:13] *** filippo__ has joined #archiveteam [15:13] *** DFJustinZ has joined #archiveteam [15:13] *** espes___ has joined #archiveteam [15:13] *** altlabel has joined #archiveteam [15:13] *** Ymgve has joined #archiveteam [15:13] *** tobbez has joined #archiveteam [15:13] *** useretai- has joined #archiveteam [15:13] *** PurpleSym has joined #archiveteam [15:13] *** limebyte has joined #archiveteam [15:13] *** Meeh has joined #archiveteam [15:13] *** PotcFdk has joined #archiveteam [15:13] *** will has joined #archiveteam [15:13] *** z00nx has joined #archiveteam [15:13] *** sHATNER has joined #archiveteam [15:13] *** Marc has joined #archiveteam [15:13] *** i0npulse has joined #archiveteam [15:13] *** Deewiant has joined #archiveteam [15:13] *** hub.se sets mode: +o antomatic [15:13] *** swebb sets mode: +o brayden [15:13] *** swebb sets mode: +o ersi [15:13] *** swebb sets mode: +o antomatic [15:17] arkiver: Perhaps we can change the warrior default from google code to oldfriends for a bit? [15:17] *** atomotic has quit IRC (hub.efnet.us hub.se) [15:17] *** pikhq has quit IRC (hub.efnet.us hub.se) [15:17] *** Kenshin has quit IRC (hub.efnet.us hub.se) [15:17] *** zhongfu has quit IRC (hub.efnet.us hub.se) [15:17] *** signius has quit IRC (hub.efnet.us hub.se) [15:17] *** tjg has quit IRC (hub.efnet.us hub.se) [15:17] *** unstable has quit IRC (hub.efnet.us hub.se) [15:17] *** redlob has quit IRC (hub.efnet.us hub.se) [15:17] *** xhades has quit IRC (hub.efnet.us hub.se) [15:17] *** Rickster has quit IRC (hub.efnet.us hub.se) [15:17] *** bauruine has quit IRC (hub.efnet.us hub.se) [15:17] *** is- has quit IRC (hub.efnet.us hub.se) [15:17] *** sigkell has quit IRC (hub.efnet.us hub.se) [15:17] *** _desu___ has quit IRC (hub.efnet.us hub.se) [15:17] *** Ctrl-S___ has quit IRC (hub.efnet.us hub.se) [15:17] *** beeper has quit IRC (hub.efnet.us hub.se) [15:17] *** Muad-Dib has quit IRC (hub.efnet.us hub.se) [15:17] *** JSharp___ has quit IRC (hub.efnet.us hub.se) [15:17] *** zyphlar_ has quit IRC (hub.efnet.us hub.se) [15:17] *** Vito` has quit IRC (hub.efnet.us hub.se) [15:17] *** kevin has quit IRC (hub.efnet.us hub.se) [15:17] *** Kazzy has quit IRC (hub.efnet.us hub.se) [15:17] *** deathy___ has quit IRC (hub.efnet.us hub.se) [15:17] *** karissa__ has quit IRC (hub.efnet.us hub.se) [15:17] *** VonGuard has quit IRC (hub.efnet.us hub.se) [15:17] *** abartov__ has quit IRC (hub.efnet.us hub.se) [15:17] *** johtso has quit IRC (hub.efnet.us hub.se) [15:17] *** Atluxity has quit IRC (hub.efnet.us hub.se) [15:17] *** gibigiana has quit IRC (hub.efnet.us hub.se) [15:17] *** Lord_Nigh has quit IRC (hub.efnet.us hub.se) [15:17] *** dan- has quit IRC (hub.efnet.us hub.se) [15:17] *** Emcy_ has quit IRC (hub.efnet.us hub.se) [15:17] *** Ravenloft has quit IRC (hub.efnet.us hub.se) [15:17] *** diacope has quit IRC (hub.efnet.us hub.se) [15:17] *** Boppen has quit IRC (hub.efnet.us hub.se) [15:17] *** Rotab has quit IRC (hub.efnet.us hub.se) [15:17] *** Deewiant has quit IRC (hub.efnet.us hub.se) [15:17] *** wyatt8740 has quit IRC (hub.efnet.us hub.se) [15:17] *** Atom__ has quit IRC (hub.efnet.us hub.se) [15:17] *** mutoso has quit IRC (hub.efnet.us hub.se) [15:17] *** Nemo_bis has quit IRC (hub.efnet.us hub.se) [15:17] *** jmtd has quit IRC (hub.efnet.us hub.se) [15:17] *** ats has quit IRC (hub.efnet.us hub.se) [15:17] *** logan has quit IRC (hub.efnet.us hub.se) [15:17] *** rduser has quit IRC (hub.efnet.us hub.se) [15:17] *** sivoais has quit IRC (hub.efnet.us hub.se) [15:17] *** Rye has quit IRC (hub.efnet.us hub.se) [15:17] *** antomatic has quit IRC (hub.efnet.us hub.se) [15:17] *** jk[SVP] has quit IRC (hub.efnet.us hub.se) [15:17] *** joepie91 has quit IRC (hub.efnet.us hub.se) [15:17] *** nekomune has quit IRC (hub.efnet.us hub.se) [15:17] *** Fletcher has quit IRC (hub.efnet.us hub.se) [15:17] *** filippo__ has quit IRC (hub.efnet.us hub.se) [15:17] *** DFJustinZ has quit IRC (hub.efnet.us hub.se) [15:17] *** espes___ has quit IRC (hub.efnet.us hub.se) [15:17] *** useretai- has quit IRC (hub.efnet.us hub.se) [15:17] *** will has quit IRC (hub.efnet.us hub.se) [15:17] *** z00nx has quit IRC (hub.efnet.us hub.se) [15:17] *** mafrasi2 has quit IRC (hub.efnet.us hub.se) [15:17] *** mksplg has quit IRC (hub.efnet.us hub.se) [15:17] *** altlabel has quit IRC (hub.efnet.us hub.se) [15:17] *** Ymgve has quit IRC (hub.efnet.us hub.se) [15:17] *** PurpleSym has quit IRC (hub.efnet.us hub.se) [15:17] *** limebyte has quit IRC (hub.efnet.us hub.se) [15:17] *** Meeh has quit IRC (hub.efnet.us hub.se) [15:17] *** PotcFdk has quit IRC (hub.efnet.us hub.se) [15:17] *** tobbez has quit IRC (hub.efnet.us hub.se) [15:17] *** i0npulse has quit IRC (hub.efnet.us hub.se) [15:17] *** Marc has quit IRC (hub.efnet.us hub.se) [15:17] *** sHATNER has quit IRC (hub.efnet.us hub.se) [15:17] *** brayden has quit IRC (hub.efnet.us hub.se) [15:17] *** RedType has quit IRC (hub.efnet.us hub.se) [15:17] *** afics has quit IRC (hub.efnet.us hub.se) [15:17] *** cadbury has quit IRC (hub.efnet.us hub.se) [15:17] *** SilSte has quit IRC (hub.efnet.us hub.se) [15:17] *** Famicoman has quit IRC (hub.efnet.us hub.se) [15:17] *** [phire] has quit IRC (hub.efnet.us hub.se) [15:17] *** nox has quit IRC (hub.efnet.us hub.se) [15:17] *** Peetz0r has quit IRC (hub.efnet.us hub.se) [15:17] *** ersi has quit IRC (hub.efnet.us hub.se) [15:17] *** wednesday has quit IRC (hub.efnet.us hub.se) [15:17] *** matthusb- has quit IRC (hub.efnet.us hub.se) [15:17] *** Apathy has quit IRC (hub.efnet.us hub.se) [15:18] We got enough concurrent now [15:18] ok [15:18] phuzion ^ [15:23] *** gibigiana has joined #archiveteam [15:23] *** atomotic has joined #archiveteam [15:23] *** Lord_Nigh has joined #archiveteam [15:23] *** brayden has joined #archiveteam [15:23] *** RedType has joined #archiveteam [15:23] *** mafrasi2 has joined #archiveteam [15:23] *** pikhq has joined #archiveteam [15:23] *** dan- has joined #archiveteam [15:23] *** wyatt8740 has joined #archiveteam [15:23] *** afics has joined #archiveteam [15:23] *** cadbury has joined #archiveteam [15:23] *** SilSte has joined #archiveteam [15:23] *** [phire] has joined #archiveteam [15:23] *** Famicoman has joined #archiveteam [15:23] *** Kenshin has joined #archiveteam [15:23] *** zhongfu has joined #archiveteam [15:23] *** Emcy_ has joined #archiveteam [15:23] *** Ravenloft has joined #archiveteam [15:23] *** diacope has joined #archiveteam [15:23] *** Atom__ has joined #archiveteam [15:23] *** mutoso has joined #archiveteam [15:23] *** Nemo_bis has joined #archiveteam [15:23] *** nox has joined #archiveteam [15:23] *** Boppen has joined #archiveteam [15:23] *** signius has joined #archiveteam [15:23] *** jmtd has joined #archiveteam [15:23] *** tjg has joined #archiveteam [15:23] *** unstable has joined #archiveteam [15:23] *** redlob has joined #archiveteam [15:23] *** xhades has joined #archiveteam [15:23] *** ats has joined #archiveteam [15:23] *** Rickster has joined #archiveteam [15:23] *** logan has joined #archiveteam [15:23] *** bauruine has joined #archiveteam [15:23] *** is- has joined #archiveteam [15:23] *** Peetz0r has joined #archiveteam [15:23] *** rduser has joined #archiveteam [15:23] *** ersi has joined #archiveteam [15:23] *** sivoais has joined #archiveteam [15:23] *** sigkell has joined #archiveteam [15:23] *** wednesday has joined #archiveteam [15:23] *** Ctrl-S___ has joined #archiveteam [15:23] *** _desu___ has joined #archiveteam [15:23] *** Rye has joined #archiveteam [15:23] *** beeper has joined #archiveteam [15:23] *** Muad-Dib has joined #archiveteam [15:23] *** hub.dk sets mode: +ooo Lord_Nigh brayden ersi [15:23] *** JSharp___ has joined #archiveteam [15:23] *** zyphlar_ has joined #archiveteam [15:23] *** Vito` has joined #archiveteam [15:23] *** kevin has joined #archiveteam [15:23] *** matthusb- has joined #archiveteam [15:23] *** Kazzy has joined #archiveteam [15:23] *** deathy___ has joined #archiveteam [15:23] *** karissa__ has joined #archiveteam [15:23] *** VonGuard has joined #archiveteam [15:23] *** abartov__ has joined #archiveteam [15:23] *** johtso has joined #archiveteam [15:23] *** Atluxity has joined #archiveteam [15:23] *** Rotab has joined #archiveteam [15:23] *** antomatic has joined #archiveteam [15:23] *** Apathy has joined #archiveteam [15:23] *** jk[SVP] has joined #archiveteam [15:23] *** joepie91 has joined #archiveteam [15:23] *** nekomune has joined #archiveteam [15:23] *** mksplg has joined #archiveteam [15:23] *** Fletcher has joined #archiveteam [15:23] *** filippo__ has joined #archiveteam [15:23] *** DFJustinZ has joined #archiveteam [15:23] *** espes___ has joined #archiveteam [15:23] *** altlabel has joined #archiveteam [15:23] *** Ymgve has joined #archiveteam [15:23] *** tobbez has joined #archiveteam [15:23] *** useretai- has joined #archiveteam [15:23] *** PurpleSym has joined #archiveteam [15:23] *** limebyte has joined #archiveteam [15:23] *** Meeh has joined #archiveteam [15:23] *** PotcFdk has joined #archiveteam [15:23] *** will has joined #archiveteam [15:23] *** z00nx has joined #archiveteam [15:23] *** sHATNER has joined #archiveteam [15:23] *** Marc has joined #archiveteam [15:23] *** i0npulse has joined #archiveteam [15:23] *** Deewiant has joined #archiveteam [15:23] *** hub.dk sets mode: +o antomatic [15:23] *** swebb sets mode: +o brayden [15:23] *** swebb sets mode: +o ersi [15:23] *** swebb sets mode: +o antomatic [15:24] *** sep332 has quit IRC (Ping timeout: 615 seconds) [15:44] *** Start has joined #archiveteam [15:47] *** ikreymer has joined #archiveteam [16:09] arkiver: let me know if you feel I should put up more concurrents [16:11] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [16:24] *** megaminxw has quit IRC (Quit: Leaving.) [16:46] tobbez: do you agree with me, on the oldfriends tracker, that it looks like your curve is flatening? [16:46] do you know of anything on your side that would account for that? [16:47] Atluxity: Nope, I assume you just have more workers [16:47] so we are hitting the tracker limit? [16:48] Yeah, had a lot of those messages earlier, at least [16:48] ahh [16:48] ok [16:48] well, like, before 3 hours ago? [16:48] consider there 10 more threads running on oldfriends. [16:49] phuzion: 10 more? [16:49] Atluxity: I just bumped one of my VPSes to 10 threads. [16:50] ok [16:52] tobbez: are you able to check your logs? are you trying to archive a lot of %2c%2c%2c%2c%2c%2c%2c%2c%2c%2c ? [16:52] I started 10*10 right after I saw ark iver's request, then I think you started yours right after [16:52] arkiver: I think we got a bug [16:52] Yeah, there's a lot of that [16:53] yeah, I got 49*10 running, started when I said so here in chat [16:53] but the flatening out is caused by loops like we got now [16:54] given enough time we stall [16:59] Each, lots of comma signs there [17:05] *** Start has quit IRC (Quit: Disconnected.) [17:14] *** atomotic has joined #archiveteam [17:15] *** nertzy has joined #archiveteam [17:16] *** Start has joined #archiveteam [17:39] *** JesseW has joined #archiveteam [17:42] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [17:53] *** JesseW has quit IRC (Leaving.) [17:55] *** philpem has joined #archiveteam [18:14] arkiver: We don't need to scrape musicbrainz to find the external links — we can just read them straight out of the database dumps IA is already mirroring. [18:26] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [18:38] *** Start has quit IRC (Quit: Disconnected.) [18:41] JW_work: let's do that then [18:49] *** Start has joined #archiveteam [18:56] hmm... something happened to the oldfriends grab... [18:56] yeah [18:57] chfoo: can you please send me the logs for oldfriends? [18:57] ah, tracker [18:57] nope, the websites is sending bad data [18:58] should I prepare for new code? [18:58] yeah, I'll fix the loop problem [18:58] does the loop problem only exist with %2c? [18:59] Sleep all day [18:59] archive all night [18:59] YES [18:59] nah, for me and arkiver its "Study all day, and archive all night" [19:01] Yes, but I'm living the dream here. [19:03] http://www.reach-initiative.org/ and http://www.reachresourcecentre.info/ (lots of PDF maps and data) might be nice archival targets [19:03] Sketchcow: do you CURL up in your bed? [19:04] arkiver: unable to find anything else that loops [19:08] *** nertzy has joined #archiveteam [19:17] schbirid: Wow, Reach makes it both easy and not easy [19:19] I'm up for porting it into a collection on archive [19:19] But wow, they link right to the maps and let the maps do the talking? [19:19] *** Start has quit IRC (Quit: Disconnected.) [19:20] i think background info is at the main site, no idea [19:20] Well, let me quickly write something [19:23] *** SadDM has joined #archiveteam [19:23] *** swebb sets mode: +o SadDM [19:25] *** arkiver2 has joined #archiveteam [19:27] this website was talked about on the morning blaze: http://picture-yourself-remembered.com/ [19:33] the guy talking about that website above: https://www.youtube.com/watch?v=0a67Tvvmst8 [19:36] *** Start has joined #archiveteam [19:38] *** ikreymer has quit IRC (Quit: Page closed) [19:53] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [20:01] *** Zom has joined #archiveteam [20:04] Hey people, not sure if you know this but Nihonomaru might be shutting down. Not sure if it's archivable or not but has around 5 million posts so it's not small either. http://forum.nihonomaru.net/forum-announcements.7/thread/i-am-selling-nihonomaru-or-shutting-it-down.452886/ [20:08] *** tjg has quit IRC (Remote host closed the connection) [20:08] *** arkiver2 has quit IRC (Ping timeout: 260 seconds) [20:10] *** tjg has joined #archiveteam [20:12] *** tjg has quit IRC (Remote host closed the connection) [20:12] *** tjg has joined #archiveteam [20:22] *** PepsiMax has joined #archiveteam [20:22] *** PepsiMax has quit IRC (Connection closed) [20:30] *** Ravenloft has quit IRC (Ping timeout: 250 seconds) [20:30] Zom: it's being archived now! [20:30] see http://dashboard.at.ninjawedding.org/ [20:36] I've restarted the oldfriends grab! [20:36] Items will be requeued soon [20:44] *** Start has quit IRC (Quit: Disconnected.) [20:50] *** Start has joined #archiveteam [20:59] *** bentpins has quit IRC (Read error: Connection reset by peer) [21:07] *** Zom has quit IRC (Quit: Page closed) [22:07] *** slyphic is now known as slyphic|a [22:11] *** Jordan_ has joined #archiveteam [22:12] -- OK archiveteamers, I need an assist. [22:12] I'm downloading everything from reachresourcecentre.info, all the maps they have. All PDFs, really. [22:12] I am having a hell of a time finding any, really, ANY metadata for the PDFs when they have them. [22:13] No coding, no obvious way to know what the map is about. It's on the map itself, of course, but locked in a PDF. [22:13] That's GOT to be ridiculous. [22:15] *** Start has quit IRC (Quit: Disconnected.) [22:16] Can anyone find anything linking these? [22:16] I'll do a google. [22:20] any example URL? [22:20] So you want to extract information from inside for exmaple this pdf http://www.reachresourcecentre.info/system/files/resource-documents/reach_ssd_factsheet_malakal_camp_idpintentionnsurvey_18dec2015_2.pdf [22:21] i think the pdf names are the metadata [22:27] SketchCow": pdf2txt will extract text from pdfs [22:28] http://www.reachresourcecentre.info/system/files/resource-documents/reach_ssd_factsheet_malakal_camp_idpintentionnsurvey_18dec2015_2.pdf [22:28] becomes [22:29] http://paste.nerds.io/raw/okokivudep [22:29] with the name on top of the text file [22:30] description would be right under methodology. Maybe searching for often used names for description would get some you some good metadata [22:30] *** scyther has quit IRC (Read error: Connection reset by peer) [22:33] *** nertzy has joined #archiveteam [22:54] *** nertzy has quit IRC (Quit: This computer has gone to sleep) [22:57] Sketchcow: some of the MusicBrainz dumps are missing pieces of the database… please ping your contacts at MusicBrainz about this. [23:02] I got 3244348 external URLs from musicbrainz. We're probably going to do them in packs of 100 URLs through a warrior project [23:15] arkiver: pdf2txt is a command line, right [23:15] yes [23:16] Thank youuuu [23:20] pdfascii is similar and also useful, it preserves page layout rather than trying to linearize like pdf2txt does [23:20] *** Stiletto has quit IRC (Read error: Connection reset by peer) [23:23] *** Stiletto has joined #archiveteam [23:25] *** Stilett0 has joined #archiveteam [23:25] Where is pdfascii? [23:26] pdf2txt also tries to preserve the position of the text [23:26] if you use file.txt is goes linear [23:26] file.html preserves position [23:27] as output file name ^ [23:28] hm, i can't find it. maybe i'm remembering the wrong name. [23:29] http://fos.textfiles.com/test.html [23:29] Like staring into the face of god [23:29] kind of looks ok [23:29] *** Stiletto has quit IRC (Read error: Operation timed out) [23:30] *** Start has joined #archiveteam [23:34] If you're the terminator [23:38] Would it be very important to preserve position? [23:39] There's probably something that preserves position of text better [23:39] It's not important in this case. [23:39] I do like the utility, though. [23:40] *** WinterFox has joined #archiveteam [23:41] *** dashcloud has quit IRC (Read error: Operation timed out) [23:55] *** Stilett0 is now known as Stiletto [23:58] *** BlueMaxim has joined #archiveteam [23:58] *** dashcloud has joined #archiveteam