[00:10] *** Stiletto has quit IRC (Read error: Operation timed out) [00:10] *** Stiletto has joined #archiveteam [00:14] *** _ris has quit IRC () [00:16] *** Emcy has quit IRC (Read error: Operation timed out) [00:45] *** wumpus has joined #archiveteam [00:50] the warrior tracker is throwing 507s and says it wants a human [00:56] arkiver: ping [01:09] *** SN4T14 has quit IRC (Quit: Leaving) [01:16] *** SN4T14 has joined #archiveteam [01:16] *** Honno has quit IRC (Read error: Operation timed out) [01:19] It's better now. [01:19] *** wumpus has quit IRC (Quit: http://chat.efnet.org ) [01:21] *** SN4T14 has quit IRC (Quit: Leaving) [01:23] AFAIK, HTTP 507 is not explicitly sent by any tracker action [01:23] if you're getting that it's from higher up in the stack [01:23] we did have a request backlog that Passenger had problems with [01:29] *** SN4T14 has joined #archiveteam [01:42] *** VADemon has quit IRC (Quit: left4dead) [02:20] *** maseck_ has quit IRC (Remote host closed the connection) [02:23] *** Stiletto has quit IRC (Read error: Operation timed out) [02:23] *** Stiletto has joined #archiveteam [02:28] *** maseck has joined #archiveteam [02:43] *** Stiletto has quit IRC (Read error: Operation timed out) [02:43] *** xXx_ndidd has joined #archiveteam [02:43] *** Stiletto has joined #archiveteam [02:47] *** ndizzle has quit IRC (Ping timeout: 244 seconds) [03:28] *** mutoso has joined #archiveteam [03:58] *** Froggypwn has joined #archiveteam [04:12] *** Sk1d has joined #archiveteam [04:34] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [04:34] *** tomwsmf-a has joined #archiveteam [04:54] *** jut has joined #archiveteam [05:15] *** dan- has quit IRC (Ping timeout: 260 seconds) [05:57] *** ralphdnak has joined #archiveteam [05:57] *** Honno has joined #archiveteam [06:48] *** dan- has joined #archiveteam [06:51] Storing Yahoo! Groups in a MongoDB (csaftoiu’s script): Been there, doesn’t scale. [06:53] PurpleSym: even one group per db? [06:54] Nope. [06:55] The problem is mainly disk space/IO. You *need to* compress the data, even if it’s just lz4/gzip. [06:57] for what access pattern? writing it initially, or reading it later, or? [06:57] *** schbirid has joined #archiveteam [07:00] IO doesn’t matter for writing, the grab is pretty slow. [07:00] But reading 250M vs 1G (with a 0.25 ratio) matters. [07:01] Also, I already got 200G with `xz -9e`, so disk space is definitely becoming a problem at some point. [07:02] Ah, that makes much more sense, yeah. [07:02] I need to head to sleep. g'night all [07:02] Good night. [07:02] Goodnight [07:08] *** JesseW has quit IRC (Ping timeout: 370 seconds) [07:10] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [07:22] *** Stiletto has quit IRC (Read error: Operation timed out) [07:22] *** Stiletto has joined #archiveteam [07:33] *** atomotic has joined #archiveteam [08:04] *** xXx_ndidd has quit IRC (Ping timeout: 244 seconds) [08:09] *** Stiletto has quit IRC (Read error: Operation timed out) [08:10] *** Stiletto has joined #archiveteam [08:12] *** RichardG has quit IRC (Read error: Operation timed out) [08:21] *** dashcloud has quit IRC (Ping timeout: 260 seconds) [08:25] *** dashcloud has joined #archiveteam [08:47] *** Stiletto has quit IRC (Read error: Operation timed out) [08:47] *** Stiletto has joined #archiveteam [08:56] *** Emcy has joined #archiveteam [09:03] is there work atm? [09:07] *** Stiletto has quit IRC (Read error: Operation timed out) [09:07] *** Stiletto has joined #archiveteam [09:35] *** arkiver3 has joined #archiveteam [09:42] not really, no. [09:45] *** kristian_ has joined #archiveteam [09:46] *** arkiver3 has quit IRC (Ping timeout: 244 seconds) [10:09] *** atomotic has quit IRC (Ping timeout: 260 seconds) [10:10] *** Stiletto has quit IRC (Read error: Operation timed out) [10:10] *** Stiletto has joined #archiveteam [10:13] *** dashcloud has quit IRC (Read error: Operation timed out) [10:15] *** dashcloud has joined #archiveteam [10:38] *** installge has joined #archiveteam [10:39] *** installge is now known as gen2 [10:40] uh [10:40] I need the wiki secret word [10:40] or [10:40] WHAT FORSOOTH, PRITHEE TELL ME THE SECRET WORD [10:42] *** Lord_Nigh has quit IRC (Read error: Operation timed out) [10:43] *** Lord_Nigh has joined #archiveteam [10:44] hi gen2 [10:44] I know the secret word, but please, tell me a bit about your quest [10:45] I started a pomf clone and I want to put it on the list [10:45] thanks [10:45] gen2: the secret word is "yahoosucks" [10:46] may all your edits be worth its salt [10:47] thanks [11:30] *** Stiletto has quit IRC (Read error: Operation timed out) [11:30] *** Stiletto has joined #archiveteam [11:59] *** kristian_ has quit IRC (Leaving) [12:12] *** BartoCH has quit IRC (Ping timeout: 260 seconds) [12:19] *** BartoCH has joined #archiveteam [12:22] *** Stiletto has quit IRC (Read error: Operation timed out) [12:22] *** Stiletto has joined #archiveteam [12:45] *** Stiletto has quit IRC (Read error: Operation timed out) [12:45] *** Stiletto has joined #archiveteam [12:49] *** atomotic has joined #archiveteam [13:00] *** Whopper has joined #archiveteam [13:02] *** RichardG has joined #archiveteam [13:32] *** atrocity has joined #archiveteam [13:36] *** RichardG has quit IRC (Read error: Operation timed out) [13:53] *** RichardG has joined #archiveteam [14:14] *** Stiletto has quit IRC (Remote host closed the connection) [14:14] *** Stiletto has joined #archiveteam [14:15] *** WinterFox has quit IRC (Remote host closed the connection) [14:17] *** RichardG_ has joined #archiveteam [14:17] *** RichardG has quit IRC (Read error: Connection reset by peer) [14:32] *** dashcloud has quit IRC (Read error: Operation timed out) [14:37] *** dashcloud has joined #archiveteam [14:43] *** BlueMaxim has quit IRC (Ping timeout: 250 seconds) [14:44] *** BlueMaxim has joined #archiveteam [14:51] *** Stiletto has quit IRC (Read error: Operation timed out) [14:56] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [15:08] *** Stiletto has joined #archiveteam [15:10] *** signius has joined #archiveteam [15:10] *** BlueMaxim has quit IRC (Read error: Operation timed out) [15:11] *** BlueMaxim has joined #archiveteam [15:14] *** signius_ has joined #archiveteam [15:17] *** Stiletto has quit IRC (Read error: Connection reset by peer) [15:18] *** signius has quit IRC (Read error: Operation timed out) [15:27] *** RichardG_ is now known as RichardG [15:30] *** MMovie has quit IRC (Read error: Operation timed out) [15:30] *** MMovie has joined #archiveteam [15:59] *** JesseW has joined #archiveteam [16:08] *** Stiletto has joined #archiveteam [16:11] *** atomotic has joined #archiveteam [16:14] *** jut has quit IRC (Leaving) [16:25] *** JesseW has quit IRC (Ping timeout: 370 seconds) [16:40] Do we need a small project for gawker? Or did someone already save that site? [16:45] *** MMovie1 has joined #archiveteam [16:47] *** MMovie has quit IRC (Read error: Operation timed out) [16:52] … [16:52] SilSte: urlteam can always use your help! [16:53] It's not automatic work, but we have literally hundreds of possible URL shorteners to investigate… [16:53] and we can generally use more automatic help too — if you try and notice there aren't any jobs, speak up in the #urlteam channel, and I'll see about increasing the queue size [16:53] arkiver: i think godane was working on it [16:56] *** marvinw has quit IRC (Ping timeout: 246 seconds) [17:04] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [17:05] *** fie_ has joined #archiveteam [17:05] i'm uploading lifehacker.com 2015 sitemap urls [17:06] *** fie has quit IRC (Read error: Operation timed out) [17:06] we are up to 2015 with kotaku.com [17:17] *** dashcloud has quit IRC (Ping timeout: 244 seconds) [17:20] i'm going after io9.com [17:21] *** dashcloud has joined #archiveteam [17:27] *** RichardG has quit IRC (Ping timeout: 258 seconds) [17:51] *** antomati_ has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** luckcolor has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** nertzy3 has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** vOYtEC has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** skrp has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** Igloo has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** MMovie1 has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** Lord_Nigh has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** xioustic has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** GLaDOS has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** bwn has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** godane has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** Coderjoe has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** rossdylan has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** Mayonaise has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** mhazinsk has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** nwf_ has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** aMunster has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** tfgbd_znc has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** phuzion has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** beardicus has quit IRC (ny.us.hub ircd.choopa.net) [17:51] *** MMovie1 has joined #archiveteam [17:51] *** Lord_Nigh has joined #archiveteam [17:51] *** xioustic has joined #archiveteam [17:51] *** GLaDOS has joined #archiveteam [17:51] *** bwn has joined #archiveteam [17:51] *** godane has joined #archiveteam [17:51] *** Coderjoe has joined #archiveteam [17:51] *** antomati_ has joined #archiveteam [17:51] *** rossdylan has joined #archiveteam [17:51] *** Mayonaise has joined #archiveteam [17:51] *** mhazinsk has joined #archiveteam [17:51] *** nwf_ has joined #archiveteam [17:51] *** aMunster has joined #archiveteam [17:51] *** tfgbd_znc has joined #archiveteam [17:51] *** phuzion has joined #archiveteam [17:51] *** beardicus has joined #archiveteam [17:51] *** luckcolor has joined #archiveteam [17:51] *** nertzy3 has joined #archiveteam [17:51] *** vOYtEC has joined #archiveteam [17:51] *** skrp has joined #archiveteam [17:51] *** Igloo has joined #archiveteam [17:51] *** ircd.choopa.net sets mode: +oo antomati_ beardicus [17:51] *** swebb sets mode: +o antomati_ [17:51] *** swebb sets mode: +o beardicus [17:52] *** Mayonaise has quit IRC (Read error: Operation timed out) [17:53] *** Mayonaise has joined #archiveteam [17:55] *** marvinw has joined #archiveteam [17:56] *** Aranje has quit IRC (Quit: Three sheets to the wind) [18:00] *** _ris has joined #archiveteam [18:00] *** Aranje has joined #archiveteam [18:02] *** RichardG has joined #archiveteam [18:05] *** schbirid has quit IRC (Ping timeout: 258 seconds) [18:07] *** fie_ has quit IRC (Read error: Connection reset by peer) [18:07] *** ralphdnak has quit IRC (Read error: Connection reset by peer) [18:07] *** fie_ has joined #archiveteam [18:07] *** ralphdnak has joined #archiveteam [18:42] *** Morbus has joined #archiveteam [18:42] *** tomwsmf-a has joined #archiveteam [18:51] *** ndiddy has joined #archiveteam [18:56] *** DFJustin has quit IRC (Ping timeout: 260 seconds) [18:57] *** DFJustin has joined #archiveteam [18:57] *** swebb sets mode: +o DFJustin [19:41] *** schbirid has joined #archiveteam [20:03] Start: ok [20:03] godane: do you have a full copy of gaweker? [20:03] gawker* [20:10] *** tomwsmf-a has quit IRC (Read error: Operation timed out) [20:27] *** dashcloud has quit IRC (Read error: Operation timed out) [20:30] *** dashcloud has joined #archiveteam [20:40] *** ariscop has quit IRC (Quit: Leaving) [20:45] *** csaftoiu has joined #archiveteam [20:45] *** csaftoiu has quit IRC (Client Quit) [20:57] https://twitter.com/auxfox/status/742419533261090816 [20:57] "58 (Yes, 58) prototype builds and content disks from SpongeBob Squarepants: SuperSponge on PS1." [20:57] ccc SketchCow [21:02] *** Honno has quit IRC (Read error: Operation timed out) [21:02] *** Stilett0 has joined #archiveteam [21:04] *** Stiletto has quit IRC (Ping timeout: 244 seconds) [21:08] *** tomwsmf-a has joined #archiveteam [21:10] *** xXx_ndidd has joined #archiveteam [21:10] *** ndizzle has joined #archiveteam [21:14] *** ndiddy has quit IRC (Ping timeout: 244 seconds) [21:14] *** xXx_ndidd has quit IRC (Ping timeout: 244 seconds) [21:26] *** ariscop has joined #archiveteam [22:40] *** mr-b has quit IRC (Read error: Operation timed out) [22:49] *** mr-b has joined #archiveteam