[20:32] alard: my xanga downloaders never picked back up when you added in the rest of the users [20:35] db48x: That reminds me, there was something strange with your result. It almost looked as if your IP was blocked. In your warcs, a request to http://user.xanga.com/ was always redirected to http://user.xanga.com/?xm=0, which was then redirected again to http://user.xanga.com/?xm=0. After 20 hops Wget gave up. [20:36] oh dear [20:36] You uploaded a few warcs that did work, strange enough, but most of them were 35kB. [20:36] And it seemed that your downloaders were the only one, I couldn't find that problem in other warcs. [20:39] hmm. I do see that occasionally in this log [20:39] (I've got two that are still running, very slowly) [20:40] 20 redirections exceeded. [20:40] 2013-01-30 17:53:35 URL:http://p2.xanga.com/21/f0/t/21f0d6cdbab14271c0488d6044a63b532124961.jpg [43/43] -> "/home/warrior/xanga-grab/data/161541484-577/minikuku/wget.tmp" [1] [20:40] 2013-01-30 19:40:41 URL:http://p3.xanga.com/38/68/t/3868f6364891975ee37e13a3617ac7e89022633.jpg [43/43] -> "/home/warrior/xanga-grab/data/161541484-577/minikuku/wget.tmp" [1] [20:40] 2013-01-31 15:18:37 URL:http://pe.xanga.com/e8/f8/t/e8f8921068a52b364bab698f9b757a2b13170251.jpg [43/43] -> "/home/warrior/xanga-grab/data/161541484-577/minikuku/wget.tmp" [1] [20:43] Yes, 20 redirections exceeded looks like the problem. (The URL that triggered the error isn't printed, I think.) [20:43] yea, that's slightly annoying :) [20:44] this one has two of those out of 924 lines in the log [20:44] and 14 instances where it can't resolve a domain name [20:44] So that looks like a healthy result. [20:44] Shall I unblock you for a moment? [20:45] sure, I'll let it run one thread and see what the result looks like [20:47] this looks like it's going well so far [20:53] no redirections that time [20:55] No, that looks fine. [21:35] ran dozen through, do any of them look wrong? [22:06] I think they look fine.