| Time |
Nickname |
Message |
|
07:16
🔗
|
Nemo_bis |
underscor: where are my dumps? :) |
|
07:20
🔗
|
Nemo_bis |
underscor: also, not related to Wikia, would you believe that I can't tell if someone else grabbed the 800 wikis you claimed a year ago for https://code.google.com/p/wikiteam/wiki/TaskForce ? |
|
07:21
🔗
|
Nemo_bis |
(they're still listed as todos) |
|
07:23
🔗
|
omf_ |
Nemo_bis, need some power downloading |
|
07:26
🔗
|
Nemo_bis |
omf_: is that a question? |
|
07:26
🔗
|
Nemo_bis |
I need my 2 TB disk sent to repairment :[ |
|
07:26
🔗
|
omf_ |
Yeah you asked a while back from help downloading and now I can |
|
07:27
🔗
|
Nemo_bis |
Oh, thanks. That was for Wikia dumps, which underscor has already downloaded, but we always have more. :) |
|
07:28
🔗
|
Nemo_bis |
omf_: what about running some dumgenerator.py instances to refresh our dumps of that list? |
|
07:28
🔗
|
omf_ |
how much hard drsk space do I need for that? |
|
07:31
🔗
|
omf_ |
I got 20gb free right now |
|
07:56
🔗
|
Nemo_bis |
omf_: wikis are rather small, usually it isn't more than few MB each and sometimes a few GB |
|
07:56
🔗
|
Nemo_bis |
for my batch of 5000 wikis, I think I downloaded about 1 TB and then uploaded all at once because it was easier |
|
07:57
🔗
|
Nemo_bis |
you can do e.g. 10 parallel downloads with launcher.py batches of 10 wikis each, then check the downloads, use uploader.py for the same batche(s), delete everything and restart |