[03:30] would it be possible for me to have commit access on the puush-grab repo? or should i keep using pull requests? [03:34] chfoo: done [03:36] yipdw: thanks [05:58] is help needed with xanga? [05:58] i totally missed the memo on this [06:11] kennethre: yes [06:11] tho it's a pita [06:11] think posterous but worse. [06:12] haha, wonderful [06:12] how so? [06:17] kennethre: it seems like we get heavily throttled and banned [06:18] spinning things up now [06:18] kennethre: also, in my experience, I've not been able to contact any xanga subdomain in the EC2 US-East region [06:18] er, from that region [06:18] Northern California works, a bi [06:18] t [06:18] ugh, that sucks [06:18] i could run some in europe, but not many [06:18] so I'm not sure if they blocked all traffic from there or what [06:19] you might have better luck; US-East was acting a bit odd when I tried it [06:20] let's see... [06:24] yipdw: appears to maybe be working [06:25] kennethre: hmm, interesting [06:25] oh nvm [06:25] response code 599 wtf [06:25] kennethre: so, another thing that seems to slow down the grabbing is that the xanga-grab script, in some cases, seems to route traffic through a proxy (for cases like that) [06:25] I haven't fully read the Lua script to see precisely what it does [06:25] 599, though, pretty much means "you are banned gtfo" [06:25] i'll try EU [06:27] OSError: out of pty devices [06:27] oh, HTTP 599 in Xangaland actually means something a bit different [06:28] https://github.com/ArchiveTeam/xanga-grab/blob/master/xanga.lua#L238 [06:29] ./wget-lua-local: [Errno 2] No such file or directory [06:29] looks like this wasn't tested on the warrior buildpack maybe [06:30] hmm, which buildpack? [06:30] there's two in the ArchiveTeam organization [06:30] https://github.com/ArchiveTeam/heroku-buildpack-archiveteam-warrior.git [06:30] oh [06:30] interesting [06:31] very odd, i did have a few complete successfully [06:31] might be something on my end [06:31] prob runtime differences in eu and us [06:32] yeah i keep getting OSError: out of pty devices [06:32] huh, I've never seen that before [06:32] oh well [06:32] maybe i can setup some digitalocean boxes later [06:33] ooh, good point [06:33] I forgot they existed [06:33] :D [06:33] maybe they're not banned [06:34] " You agree that you will NOT use DigitalOcean's services to: violate any applicable state and federal law and regulation, including, but not limited to, any copyright, trademark, patent, anti-piracy, or other intellectual property law or regulation, or encourage or enable others to violate any such law or regulation. " [06:34] heh [06:35] might as well write "You agree that you will NOT use DigitalOcean's services" [06:40] hmm [06:52] kennethre: is there any way to get the DigitalOcean dashboard to show your droplet's host SSH key fingerprints? [12:15] mkpty? [13:11] Oh dear, my scrape of The H died [13:11] our ot memory [13:12] *out [13:13] running another one that skips all of the /priceinsight/ directory, that was the killer (lots of filtering options, etc.) [15:55] ouch. http://www.theverge.com/2013/7/30/4570610/instagram-deleting-photos-from-instance-windows-phone-app