[07:16] underscor: where are my dumps? :) [07:20] underscor: also, not related to Wikia, would you believe that I can't tell if someone else grabbed the 800 wikis you claimed a year ago for https://code.google.com/p/wikiteam/wiki/TaskForce ? [07:21] (they're still listed as todos) [07:23] Nemo_bis, need some power downloading [07:26] omf_: is that a question? [07:26] I need my 2 TB disk sent to repairment :[ [07:26] Yeah you asked a while back from help downloading and now I can [07:27] Oh, thanks. That was for Wikia dumps, which underscor has already downloaded, but we always have more. :) [07:28] omf_: what about running some dumgenerator.py instances to refresh our dumps of that list? [07:28] how much hard drsk space do I need for that? [07:31] I got 20gb free right now [07:56] omf_: wikis are rather small, usually it isn't more than few MB each and sometimes a few GB [07:56] for my batch of 5000 wikis, I think I downloaded about 1 TB and then uploaded all at once because it was easier [07:57] you can do e.g. 10 parallel downloads with launcher.py batches of 10 wikis each, then check the downloads, use uploader.py for the same batche(s), delete everything and restart