[00:07] *** odemg has quit IRC (Read error: Operation timed out) [00:16] *** odemg has joined #archiveteam [01:27] *** bwn has quit IRC (Read error: Connection reset by peer) [01:38] *** Mateon1 has quit IRC (Remote host closed the connection) [01:38] *** Mateon1 has joined #archiveteam [01:45] *** bwn has joined #archiveteam [02:02] *** kitties has joined #archiveteam [02:19] *** BlueMax has joined #archiveteam [04:05] *** RichardG_ has quit IRC (Read error: Connection reset by peer) [04:06] *** RichardG has joined #archiveteam [04:17] *** qw3rty116 has joined #archiveteam [04:23] *** qw3rty115 has quit IRC (Read error: Operation timed out) [06:19] *** Pixi has quit IRC (Ping timeout: 255 seconds) [06:25] *** Pixi has joined #archiveteam [06:46] *** ndiddy has quit IRC () [06:56] *** Fletcher has quit IRC (Read error: Operation timed out) [07:17] *** Fletcher has joined #archiveteam [07:24] *** kitties has quit IRC (Connection closed for inactivity) [08:29] *** tomaspark has quit IRC (Read error: Operation timed out) [08:29] *** tomaspark has joined #archiveteam [08:33] *** plue has quit IRC (Ping timeout: 260 seconds) [08:41] *** plue has joined #archiveteam [09:12] *** BlueMax has quit IRC (Leaving) [09:59] *** bwn has quit IRC (Read error: Operation timed out) [10:06] *** bwn has joined #archiveteam [10:54] *** db48x has quit IRC (Read error: Operation timed out) [11:23] *** db48x has joined #archiveteam [11:53] *** wp494_ has joined #archiveteam [11:53] *** bwn has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** qw3rty116 has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** Zialus has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** Mayonaise has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** phq__ has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** twigfoot has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** unlobito has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** FireFly has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** ivan has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** nwf has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** beardicus has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** SirCmpwn has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** Gfy has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** muramasa has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** JAA has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** MMovie has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** aMunster has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** PotcFdk has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** C4K3 has quit IRC (ny.us.hub ircd.choopa.net) [11:53] *** TigerbotH has quit IRC (ny.us.hub ircd.choopa.net) [11:55] *** Gfy_ has joined #archiveteam [11:56] *** wp494 has quit IRC (Ping timeout: 244 seconds) [12:10] *** bwn has joined #archiveteam [12:10] *** qw3rty116 has joined #archiveteam [12:10] *** Zialus has joined #archiveteam [12:10] *** Mayonaise has joined #archiveteam [12:10] *** phq__ has joined #archiveteam [12:10] *** twigfoot has joined #archiveteam [12:10] *** unlobito has joined #archiveteam [12:10] *** ivan has joined #archiveteam [12:10] *** nwf has joined #archiveteam [12:10] *** beardicus has joined #archiveteam [12:10] *** SirCmpwn has joined #archiveteam [12:10] *** JAA has joined #archiveteam [12:10] *** TigerbotH has joined #archiveteam [12:10] *** aMunster has joined #archiveteam [12:10] *** PotcFdk has joined #archiveteam [12:10] *** C4K3 has joined #archiveteam [12:10] *** ircd.choopa.net sets mode: +oo beardicus JAA [12:10] *** swebb sets mode: +o beardicus [12:10] *** swebb sets mode: +o JAA [12:11] *** odemg has quit IRC (Ping timeout: 268 seconds) [12:38] *** khaoohs has quit IRC (Read error: Connection reset by peer) [12:41] *** odemg has joined #archiveteam [13:37] *** Mateon1 has quit IRC (Remote host closed the connection) [13:37] *** Mateon1 has joined #archiveteam [13:37] *** Gfy_ is now known as Gfy [13:57] *** Mateon1 has quit IRC (Read error: Operation timed out) [13:57] *** Mateon1 has joined #archiveteam [16:02] *** MrDignity has quit IRC (Remote host closed the connection) [16:02] *** MrDignity has joined #archiveteam [16:12] *** indrora has quit IRC (Quit: H̢̰̲͈̱̪̣͍̼̦̃ͯ́̉̅̐͌̀ͅe̸ͨ̐͆̋ͤͧͥ̿͒͋̄̐̏̆̔͒͋̑ͮ͝͏͕̠͎̺͕ ͌̉̎͌̊͑̂ͥ̇) [16:36] *** RichardG has quit IRC (Read error: Connection reset by peer) [16:38] *** RichardG has joined #archiveteam [16:45] *** MMovie has joined #archiveteam [16:52] *** muramasa has joined #archiveteam [17:07] *** atrocity has quit IRC (Read error: Operation timed out) [17:13] *** godane has quit IRC (Quit: Leaving.) [17:21] *** Martle has joined #archiveteam [17:25] *** SoniEx2 has joined #archiveteam [17:26] *** SoniEx2 has quit IRC (Client Quit) [17:35] !a http://www.geocities.co.jp/SiliconValley-Sunnyvale/6160/ [17:36] *** godane has joined #archiveteam [17:55] *** atrocity has joined #archiveteam [18:27] Sanqui: I saw that Poema.pl finished, good job and thanks :) [18:27] znak: was a pretty quick job :) [18:33] https://www.craigslist.org/about/FOSTA [18:35] craiglist personals are gone (for the us version of the site) [19:04] *** wp494_ is now known as wp494 [19:04] *** wp494 has quit IRC (Quit: LOUD UNNECESSARY QUIT MESSAGES) [19:05] *** wp494 has joined #archiveteam [19:47] *** tomaspark has quit IRC (Remote host closed the connection) [20:39] *** Evalelynn has joined #archiveteam [20:40] *** RichardG has quit IRC (Read error: Connection reset by peer) [20:40] *** Evalelynn has quit IRC (Client Quit) [20:42] *** RichardG has joined #archiveteam [22:03] *** BlueMax has joined #archiveteam [22:34] *** jschwart has quit IRC (Quit: Konversation terminated!) [22:36] *** REiN^ has joined #archiveteam [22:57] *** Asparagir has joined #archiveteam [23:03] *** bug_ has joined #archiveteam [23:07] I have a question. I'm interested in looking up specific parts of the fanfiction dot net archive scrape in 2012, but only for a couple portions of the archive, and the 50+ gb files on the internet archive are a bit daunting. Is there some sort of master directory that tells you which part of the site is scraped in a specific WARC dump? [23:24] *** icedice has joined #archiveteam [23:25] bug_: There's a CDX file for each WARC, which contains a list of all entries inside the WARC. Among other things, it also contains the offset and length of each record, so you can use HTTP range requests to only download that part of the WARC as well. [23:27] *** Asparagir has quit IRC (Asparagir) [23:28] Ah, thank you! What would the difference between archiveteam-fanfiction-warc-01.cdx.gz and 00000001.tar.megawarc.warc.os.cdx.gz be, in that case, since they're both labeled as CDX? Would it just be the file type (sorry for the questions!) [23:29] bug_: What's the link to the item? Also, let's move this to #archiveteam-bs (this channel is mainly for announcements). [23:36] *** icedice has quit IRC (Quit: Leaving) [23:58] *** balrog has quit IRC (Read error: Operation timed out)