[04:22] <winr4r> who is "Start" on the archive team wiki
[04:22] <winr4r> apparently he downloaded foxytunes
[04:34] <SketchCow> Had a nice chat with Brewster.
[04:34] <SketchCow> It's nice to have a boss/ceo you really love just chit-chatting with
[04:36] <winr4r> aw :)
[04:48] <BlueMax> SketchCow seems to have a man crush
[04:49] <SketchCow> I do like the guy a lot.
[05:53] <SketchCow> First machine reboot in a while!
[05:53] <SketchCow> 1:53am, how did you arrive
[08:07] <Smiley> -rw-r--r-- 1 tim.bowers games 984M Jul  5 09:07 ./bin/ign/storage/pouet/pouet.net_06052013.cdx
[08:07] <Smiley> -rw-r--r-- 1 tim.bowers games 247G Jul  5 09:07 ./bin/ign/storage/pouet/pouet.net_06052013.warc
[08:07] <Smiley> keep on ROLLIN'
[08:07] <Smiley> 2 Months and counting.
[08:10] <omf_> Smiley, have you looked at the cdx file for that warc
[08:11] <omf_> skim off the first 100,000 lines and set it up as a gz file for me to grab, I need to check a hypothesis
[08:12] <Smiley> omf_: not yet, but I can do
[08:13] <Smiley> head -n -10000 ./file.cdx > ./file_for_omf ? :D
[08:13] <Smiley> ooh 100000
[08:14] <Smiley> will take a while I feel D:
[08:14] <omf_> for 100k lines, it should be short
[08:15] <Smiley> wait, you WANT the first 100k?
[08:16] <winr4r> sup timmeh
[08:16] <omf_> 100k is shorthand for 100,000
[08:16] <Smiley> yes
[08:17] <Smiley> i thought you wanted me to strip off the first 100k :P
[08:17] <Smiley> where to put this file d:
[08:17] <omf_> Smiley, looking at your command and my comment I was unclear
[08:18] <Smiley> me too :D
[08:18] <omf_> I want: head -n 100000 ./cdx > new_file_
[08:18] <Smiley> where shall I put this, I doubt many pastebins like 100k lines being pasted.
[08:18] <Smiley> omf_: yeah, I've got it :)
[08:18] <omf_> just stick it in /home on anarchive if you can
[08:19] <Smiley> i can ;)
[08:19] <Smiley> done
[08:21] <omf_> thanks
[08:26] <omf_> Smiley, what are the stats when you: wc blah.cdx
[08:28] <Smiley> well lines was 100,000 :D
[08:28] <Smiley> tim.bowers@timDesktop ~ $ wc ./for_omf  100000  1100001 22557370 ./for_omf
[08:29] <omf_> I mean the original please
[09:14] <Smiley> oh
[09:14] * Smiley calculates
[09:19] <godane> so i'm now backing up 2012 of techcrunch.com
[09:22] <godane> i have 7.4gb of techcrunch.com so far
[09:23] <Smiley> tim.bowers@timDesktop ~ $ wc ./bin/ign/storage/pouet/pouet.net_06052013.cdx  3868315   42551466 1032158108 ./bin/ign/storage/pouet/pouet.net_06052013.cdx
[09:23] <Smiley> omf_:
[09:24] <omf_> I see
[09:32] <godane> the rest of hackaday.com is going up
[09:32] <godane> just the first 6 months of 2013
[10:04] <SketchCow> http://www.flickr.com/photos/textfiles/sets/72157634488809303/with/9215318638/
[10:31] <ersi> Beautifully
[14:18] <balrog> http://web.archive.org/web/*/www.vms2linux.de/ods5fs.html -- wtf? that site has no robots.txt!
[14:41] <Smiley> The requested URL /robots.txt was not found on this server.
[14:42] <Smiley> indeed, but at time of crawling?
[14:50] <godane> i found out when it does have one: http://web.archive.org/web/20110725130646/http://vms2linux.de/robots.txt
[14:50] <godane> and again: http://web.archive.org/web/20111231183927/http://vms2linux.de/robots.txt
[14:51] <godane> that site is very weird
[14:51] <godane> it sometimes has robots.txt and then the next crawl doesn't have it
[14:56] <Smiley> two people uploading and one has deleted it? XD