| Time |
Nickname |
Message |
|
09:35
🔗
|
Nemo_bis |
emijrp: my replacement hdd arrived, I'll have to stop everything and reinstall OS today |
|
09:36
🔗
|
Nemo_bis |
it would be nice to have the upload but not overwrite existing files feature, to resume (not necessary of course) |
|
09:36
🔗
|
emijrp |
it doesnt overwrite if you conservate the log |
|
21:44
🔗
|
Nemo_bis |
ok, upload restarted |
|
21:45
🔗
|
emijrp |
nemo is happy |
|
21:50
🔗
|
Nemo_bis |
emijrp: yes because the reupload filter is working reasonably well, it's even finding some forgotten dumps http://archive.org/details/wiki-enanarchopediaorg |
|
21:50
🔗
|
Nemo_bis |
emijrp: btw I'm not sure the Citizendium dump is perfect, does it contain all the revisions it should? |
|
21:51
🔗
|
Nemo_bis |
I never verified |
|
21:51
🔗
|
emijrp |
i checked integrity and looks ok |
|
21:51
🔗
|
emijrp |
how is the anarcho wiki smaller a month later? |
|
21:52
🔗
|
Nemo_bis |
emijrp: did you compare it with their special:statistics ? |
|
21:52
🔗
|
Nemo_bis |
that's the point, for a while I've been running a broken dumpgenerator I'm afraid |
|
21:52
🔗
|
emijrp |
yes, and it seems ok for me |
|
21:52
🔗
|
Nemo_bis |
good |
|
21:52
🔗
|
Nemo_bis |
http://archive.org/details/wiki-enanarchopediaorg it also doesn't manage to update last-updated-date |
|
21:55
🔗
|
emijrp |
metadata is not changed |
|
21:56
🔗
|
emijrp |
probably need a special flag in curl |
|
22:00
🔗
|
Nemo_bis |
emijrp: yes, let me check |
|
22:03
🔗
|
Nemo_bis |
emijrp: should be --header 'x-archive-ignore-preexisting-bucket:1' but I'm not completely sure |
|
22:04
🔗
|
underscor |
is there a list of wikis we need to dump? |
|
22:04
🔗
|
underscor |
I have some spare boxen I'd like to use to help |
|
22:05
🔗
|
emijrp |
underscor: http://code.google.com/p/wikiteam/wiki/TaskForce |
|
22:07
🔗
|
Nemo_bis |
(to start with :p) |
|
22:07
🔗
|
Nemo_bis |
emijrp: why don't you try to rerun Pavlo's crawler? we'll soon need more wikis to download, that list was really old :) |
|
22:08
🔗
|
emijrp |
i will check, but it uses yahoo api and dont know if that still works |
|
22:09
🔗
|
Nemo_bis |
hm |
|
22:10
🔗
|
Nemo_bis |
you might need someone with an old key or something |
|
22:10
🔗
|
underscor |
Are we going to repeat these at some point? |
|
22:10
🔗
|
underscor |
or do we have a plan in place for that? |
|
22:11
🔗
|
emijrp |
yearly... |
|
22:12
🔗
|
emijrp |
many wikis will dead, others will born, and the index needs to be updated |
|
22:12
🔗
|
underscor |
ah, okay |
|
22:12
🔗
|
underscor |
when did we start? |
|
22:12
🔗
|
underscor |
I forgot |
|
22:12
🔗
|
underscor |
haha |
|
22:13
🔗
|
emijrp |
start what? |
|
22:14
🔗
|
Nemo_bis |
April |
|
22:14
🔗
|
Nemo_bis |
for these TaskForce wikis |
|
22:15
🔗
|
emijrp |
we had a big leap waiting for the uploader script being coded by gnomes |
|
22:15
🔗
|
underscor |
aha |
|
22:16
🔗
|
underscor |
yeah, I remember Nemo_bis (I think) complaining about that |
|
22:16
🔗
|
underscor |
hahaha |
|
22:16
🔗
|
underscor |
ok, so once these launcher.pys finish their pieces of a list, what do I do next? |
|
22:17
🔗
|
emijrp |
upload |
|
22:17
🔗
|
emijrp |
it is explained at the bottom |
|
22:17
🔗
|
emijrp |
i dont know if move that section above the table |
|
22:18
🔗
|
underscor |
oh, found it! |
|
22:18
🔗
|
emijrp |
have to go |
|
22:18
🔗
|
underscor |
would it be helpful just to have a set of s3 keys for wikiteam uploader? |
|
22:19
🔗
|
underscor |
I can get a special "group" account type thing like we used for mobileme |
|
22:26
🔗
|
underscor |
Nemo_bis: any idea why this happened? |
|
22:26
🔗
|
underscor |
http://hastebin.com/xifamifuka.coffee |
|
22:26
🔗
|
underscor |
chronomex: is4 SketchCow soultcer +o? |
|
22:27
🔗
|
Nemo_bis |
underscor: what a horrible pastebin |
|
22:27
🔗
|
underscor |
yeah, the syntax selector fucked itself |
|
22:28
🔗
|
Nemo_bis |
no, I mainly hate the JS |
|
22:30
🔗
|
Nemo_bis |
omg they even boast about i "the leegant pastebin" sigh |
|
22:31
🔗
|
Nemo_bis |
underscor: try now |
|
22:31
🔗
|
underscor |
like, redownload launcher.py? |
|
22:31
🔗
|
Nemo_bis |
underscor: yes |
|
22:32
🔗
|
underscor |
kk |
|
22:32
🔗
|
underscor |
File "launcher.py", line 98 |
|
22:32
🔗
|
underscor |
IndentationError: unexpected indent |
|
22:32
🔗
|
underscor |
^ |
|
22:32
🔗
|
underscor |
alex@angstrom:/remote/storage5$ python launcher.py list066-ah |
|
22:32
🔗
|
underscor |
os.system('7z a -ms=off ../%s-history.xml.7z %s-history.xml %s-titles.txt index.html Special:Version.html errors.log' % (prefix, prefix, prefix)) |
|
22:32
🔗
|
underscor |
SketchCow: <3 |
|
22:33
🔗
|
underscor |
oh wait |
|
22:33
🔗
|
underscor |
dammit, SketchCow |
|
22:33
🔗
|
underscor |
:P |
|
22:34
🔗
|
underscor |
Nemo_bis: ^ |
|
22:37
🔗
|
Nemo_bis |
underscor: can't you just fix it? you're the programmer :p https://code.google.com/p/wikiteam/source/browse/trunk/batchdownload/launcher.py |
|
22:38
🔗
|
underscor |
Nemo_bis: I don't have svn set up here |
|
22:38
🔗
|
underscor |
you just have an extra space |
|
22:38
🔗
|
underscor |
on line 98 |
|
22:38
🔗
|
underscor |
oh wait |
|
22:38
🔗
|
underscor |
I can just edit online |
|
22:38
🔗
|
underscor |
WOAH |
|
22:45
🔗
|
Nemo_bis |
yes |
|
23:26
🔗
|
Nemo_bis |
underscor: how is it going? |