[00:04] xmc: yeah, I figure he'd publish his email if he wanted people emailing him. And he clearly doesn't want people contacting him since he disabled the Issues section on the repo =/ [00:04] Does anyone know of a CDX indexer that outputs all records, not just response ones? [01:14] underscor: if you could run hyves-grab on everything that would be great [01:14] underscor: it's throttling per-IP [06:56] ivan`: I don't know of this specifically. [07:47] I'm heading out from Belfast in an hour. I'll be around tonight and it's all about catchup. [08:34] thanks [09:08] SketchCow: looks like the archiveteam_archivebot_go_003 item needs a derive kicked off [09:08] no cdx files have been generated yet [10:19] Can someone try a telnet 1111.wiki-site.com 80 for me? I get: telnet: Unable to connect to remote host: Connection timed out [10:20] They probably blocked my server's IP but I don't understand at what level [10:25] Nemo_bis: Works for me, got an under construction site. [10:39] Via: 1.0 www.wiki-site.com:3128 (squid/2.6.STABLE21) [10:40] yes it works [11:00] oh, at least this guy followed my advice http://www.editthis.info/robots.txt [12:46] Wait, did I show you guys my robots.txt? [12:58] GLaDOS: not that my logs know [12:59] http://tropicraft.net/robots.txt [13:02] O_o [13:32] I created a Python WARC library named pylibwarc, so we now have yet another python warc library. This one does support CDX though, and I'm not sure the others do. https://github.com/odie5533/pylibwarc [13:54] odie5533: Nice work [13:54] thank you [13:58] Added it to http://archiveteam.org/index.php?title=The_WARC_Ecosystem [22:39] heh, vlogbrothers viewing their youtube via wayback machine. [23:46] Hey. [23:47] DFJustin: drive now done [23:47] I mean derive. Kicked off. [23:49] Known bug in ia uploader,. will be fixing shortly. [23:50] yeah I keep finding affected items [23:51] you would think there would be a cron job that runs derives on underived stuff every once in a while though [23:52] Not really. [23:52] I wish! [23:53] hey SketchCow [23:57] IA has cronjobs made out of meat