#archiveteam 2011-11-08,Tue

↑back Search

Time Nickname Message
00:01 πŸ”— yipdw alard: sweet, thanks
00:12 πŸ”— underscor chronomex: Isn't this rad?
00:12 πŸ”— underscor hahaha
00:12 πŸ”— underscor You win the game by idling
00:28 πŸ”— Coderjoe oh boy. another IRC channel in my already-overcrowded channel bar
00:28 πŸ”— underscor Coderjoe: Come on, you know you want to play the game
00:29 πŸ”— Coderjoe what is the "class_name" field?
00:29 πŸ”— underscor Whatever you want
00:29 πŸ”— underscor Mine is "FUCKING ARCHIVIST!" and chronomex's is "cardboard box collector"
00:29 πŸ”— underscor <ATidlebot> chronomex, the cardboard box collector, has attained level 2! Next level in 0 days, 00:13:27.
00:29 πŸ”— chronomex dude this is awesome
00:30 πŸ”— underscor chronomex: hahaha
00:30 πŸ”— chronomex I was wondering what was highlighting me
00:30 πŸ”— chronomex now i know
00:30 πŸ”— underscor chronomex: eventually you'll get to days and weeks of idle between levels
00:31 πŸ”— chronomex I know, I've played this before
00:31 πŸ”— underscor oh awesome
00:31 πŸ”— chronomex I was just working and kept getting highlighted
00:31 πŸ”— chronomex I was like "hmmmm"
00:31 πŸ”— chronomex cos most of the shit my boss tells me to do, he does by irc
00:33 πŸ”— underscor ha
00:33 πŸ”— Coderjoe oh damn
00:33 πŸ”— Coderjoe Cannot write to `listserv.aol.com/cgi-bin/wa?A2=ind0709&L=class8731&D=0&F=P&T=0&P=1717&F=' (No space left on device).
00:33 πŸ”— chronomex ;_;
00:33 πŸ”— db48x22 doh
00:40 πŸ”— Coderjoe most of the volume is being used up in the mobileme grab
00:55 πŸ”— underscor - Discovering urls (XML)... ERROR (1). Ҕ‚
00:55 πŸ”— underscor Anyone else get errors like this?
00:55 πŸ”— underscor Downloading public.me.com/sw1975 Ҕ‚
00:55 πŸ”— underscor Error downloading 'sw1975'.
00:55 πŸ”— underscor Error downloading from public.me.com. Ҕ‚
00:55 πŸ”— underscor Then it craps out
01:09 πŸ”— underscor alard: Need help when you get a chance
01:11 πŸ”— Coderjoe dammit. s3cmd spits out upload updates way too rapidly
01:13 πŸ”— yipdw oh, heh
01:13 πŸ”— yipdw cut: data/j/ju/jun/junko_tuki/web.me.com/wget-discovery.log: Illegal byte sequence
01:13 πŸ”— yipdw so many fun and wonderful things on mobileme
01:14 πŸ”— underscor owO
01:14 πŸ”— underscor I didn't know youtube even allowed stuff like this http://www.youtube.com/watch?v=Nw8_bOPgwPw&feature=related
01:14 πŸ”— yipdw oh ugh, wtf
01:14 πŸ”— underscor (nsfw)
01:14 πŸ”— chronomex I'm at work, what is it?
01:15 πŸ”— yipdw https://gist.github.com/6a38c8e6a896f34de00f <-- said wget-discovery.log
01:15 πŸ”— Coderjoe german televeision program part about collecting dog semen
01:15 πŸ”— chronomex jeepers creepers
01:15 πŸ”— underscor Semen collection from a dog
01:15 πŸ”— chronomex ah
01:16 πŸ”— underscor Payment required lol
01:16 πŸ”— yipdw yeah, I dunno if that shows up in every wget-discovery.log just yet
01:16 πŸ”— Coderjoe i've seen it at least once before
01:24 πŸ”— Coderjoe hmm
01:25 πŸ”— Coderjoe a quick grep is showing 1444 instances
01:56 πŸ”— Coderjoe hmm.
01:56 πŸ”— Coderjoe I wonder if apple is saying that any companies with web spiders are supposed to pay them
01:58 πŸ”— Coderjoe appears to always be robots.txt requests
01:58 πŸ”— Coderjoe er
01:59 πŸ”— Coderjoe strike that
02:03 πŸ”— Coderjoe https://s3-us-west-1.amazonaws.com/archiveteam-cojo/mobileme/payment_required.txt
02:04 πŸ”— DFJustin lol first time I've actually seen that error code in use
02:32 πŸ”— DFJustin http://evangelicaltextualcriticism.blogspot.com/2011/11/robots-and-archives.html
02:40 πŸ”— bsmith093 anyone have an archive of the computing lives podcast the rss feeder link is dead?
02:46 πŸ”— SketchCow I likely have all of them somewhere
02:51 πŸ”— bsmith093 is that podcast archive ( the huge one) online yet?
03:08 πŸ”— SketchCow No
04:31 πŸ”— underscor /j #2,000
12:42 πŸ”— Schbirid oh stupid efnet. k-lines my current ip and the sites the servers tell me where i can request a revoke are either timing out or parked...
12:43 πŸ”— db48x22 heh
12:48 πŸ”— Schbirid if someone wants to grab 3-4 months of daily robots.txt downloading for alexa's top 10k domains, here you go: http://www.quaddicted.com:27500/ (the files*.7z )
12:48 πŸ”— Schbirid i have not look at it for ages so i am not sure what might hide inside
12:48 πŸ”— Schbirid the cronjob is just happily running in the early morning hours ;)
15:44 πŸ”— alard underscor: Still need mobileme help? Or did a re-run fix it?
15:46 πŸ”— void_ as java is not so friendly to me, someone has compiled this? https://github.com/openplanets/wap
15:46 πŸ”— void_ is a gui to inspect content of a warc file
15:46 πŸ”— underscor alard: Hmm, looks like it might be working now
15:46 πŸ”— underscor one sec
15:47 πŸ”— alard I tried to download the public.me.com data of the user you mentioned, but didn't have a problem. (There was no content, though.)
15:48 πŸ”— alard In general, the error numbers you get from the script are the error numbers returned by wget. 1 is a 'general error', so that isn't very helpful.
15:55 πŸ”— underscor Hmm, same problem
15:55 πŸ”— underscor  - Discovering urls (XML)... ERROR (1). Ҕ‚
15:55 πŸ”— underscor Error downloading 'kmisak'.
15:55 πŸ”— underscor Error downloading 'kmisak'. Ҕ‚
15:55 πŸ”— underscor Error downloading from public.me.com. Ҕ‚
15:55 πŸ”— underscor (that's from after it does the wget -m, and starts public
15:58 πŸ”— alard Is there anything in data/k/km/kmi/kmisak/public.me.com/webdav-feed.xml ?
15:59 πŸ”— underscor No
15:59 πŸ”— underscor Oh
15:59 πŸ”— underscor Return code of the script was 6 btw
16:00 πŸ”— alard Ah, yes, that's for 'can't download this user'. The wget exit code is in ERROR (1).
16:00 πŸ”— underscor Aha
16:00 πŸ”— alard Or the curl exit code, to be more precise.
16:00 πŸ”— underscor This is done beautifully
16:01 πŸ”— alard Does this give any interesting information:
16:01 πŸ”— alard Ҁ¦opfind xmlns:DAV="DAV:"><DAV:allprop/></DAV:propfind>' --user-agent 'Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/533.20.25 (KHTML, like Gecko) Version/5.0.4 Safari/533.20.27'
16:01 πŸ”— alard (Sorry, should be one line at the ...)
16:01 πŸ”— alard curl https://public.me.com/ix/kmisak/ -v --request PROPFIND --header 'Content-Type: text/xml; charset=utf-8' --header 'Depth: infinity' --data '<?xml version=1.0 encoding=utf-8?><DAV:propfind xmlns:DAV=DAV:><DAV:allprop/></DAV:propfind>' --user-agent 'Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/533.20.25 (KHTML, like Gecko) Version/5.0.4 Safari/533.20.27'
16:02 πŸ”— underscor ha
16:02 πŸ”— underscor ha
16:02 πŸ”— underscor * Protocol https not supported or disabled in libcurl Ҕ‚62
16:02 πŸ”— underscor curl: (1) Protocol https not supported or disabled in libcurl
16:02 πŸ”— underscor oops
16:02 πŸ”— alard Ah, that's a pity.
16:02 πŸ”— underscor Thanks for helping find it though :)
16:02 πŸ”— alard I thought you had run the scripts successfully before? Did you change anything?
16:51 πŸ”— underscor alard: Different machine
17:47 πŸ”— alard underscor: Ah, I see. (I've added a test for curl+ssl to the script, by the way.)
17:47 πŸ”— yipdw alard: just to clarify: is the mobileme grab project actually officially going, or will there be a big reset-and-then-go action soon?
17:47 πŸ”— yipdw I've hit a few inconsistencies on OS X that I think probably make what I've collected quite questionable
17:48 πŸ”— alard yipdw: No, it's going, slowly. If you've found a few inconsistencies that's something to look into.
17:48 πŸ”— yipdw ok
17:48 πŸ”— alard But I've got to go now, hopefully speak to you later.
17:48 πŸ”— yipdw sure, no problem
17:48 πŸ”— yipdw I'll write up what I've hit so far
17:53 πŸ”— underscor alard: Is there a status page for the tracker?
20:09 πŸ”— alard underscor: Status page: no, though there is a list: http://memac.heroku.com/
20:11 πŸ”— underscor Those are the "last done"?
20:11 πŸ”— alard Yes.
20:11 πŸ”— underscor Oh, it's live too!
20:11 πŸ”— underscor Awesome
20:12 πŸ”— underscor That's great
20:12 πŸ”— alard Apparently you've been quite active.
20:12 πŸ”— underscor Looks like it, heh
20:18 πŸ”— underscor 28GB in 2 hours
20:18 πŸ”— underscor Not shabby
20:49 πŸ”— underscor Hah, you can see where I started the mobileme grab
20:49 πŸ”— underscor http://tracker.archive.org/tracker.png
20:49 πŸ”— underscor http://tracker.archive.org/batcave.png too, for those that are interested
22:10 πŸ”— SketchCow GREETINGS FROM CALIFORNIA
22:18 πŸ”— db48x22 hey SketchCow
22:18 πŸ”— db48x22 where in california are you?
23:00 πŸ”— SketchCow San Francisco.
23:14 πŸ”— alard underscor: http://memac.heroku.com/
23:44 πŸ”— underscor alard: hot damn
23:44 πŸ”— underscor That's AWESOME
irclogger-viewer