#wikiteam 2013-06-05,Wed

↑back Search

Time Nickname Message
07:16 🔗 Nemo_bis underscor: where are my dumps? :)
07:20 🔗 Nemo_bis underscor: also, not related to Wikia, would you believe that I can't tell if someone else grabbed the 800 wikis you claimed a year ago for https://code.google.com/p/wikiteam/wiki/TaskForce ?
07:21 🔗 Nemo_bis (they're still listed as todos)
07:23 🔗 omf_ Nemo_bis, need some power downloading
07:26 🔗 Nemo_bis omf_: is that a question?
07:26 🔗 Nemo_bis I need my 2 TB disk sent to repairment :[
07:26 🔗 omf_ Yeah you asked a while back from help downloading and now I can
07:27 🔗 Nemo_bis Oh, thanks. That was for Wikia dumps, which underscor has already downloaded, but we always have more. :)
07:28 🔗 Nemo_bis omf_: what about running some dumgenerator.py instances to refresh our dumps of that list?
07:28 🔗 omf_ how much hard drsk space do I need for that?
07:31 🔗 omf_ I got 20gb free right now
07:56 🔗 Nemo_bis omf_: wikis are rather small, usually it isn't more than few MB each and sometimes a few GB
07:56 🔗 Nemo_bis for my batch of 5000 wikis, I think I downloaded about 1 TB and then uploaded all at once because it was easier
07:57 🔗 Nemo_bis you can do e.g. 10 parallel downloads with launcher.py batches of 10 wikis each, then check the downloads, use uploader.py for the same batche(s), delete everything and restart

irclogger-viewer