[05:40] kyan: have you tried uploader.py ? [15:08] Nemo_bis, I haven't found any clear documentation on that script… I tried running it, and it said "Uploading frathwikicom-20131015-complete.7z", and then it exited. I couldn't find any uploaded file in the Internet Archive… [16:55] kyan: you need to put the index.php (or api.php?) urls in a text file and use its filename as argument, iirc [16:56] best used after launcher.py which already creates the archives with correct filenames [17:24] Nemo_bis, I tried running launcher.py mylist.txt. It ran fine, but didn't seem to create any 7z file. Running uploader.py mylist.txt — like before — said "Uploading http://alcts.ala.org/crgwiki/api.php", and seemed to exit ok, but I don't see the upload here: http://archive.org/search.php?query=mediatype%3Atexts&sort=-publicdate [17:26] let me check what's going on, it's been a while since I last used them [17:26] kyan: have you changed this line? https://code.google.com/p/wikiteam/source/browse/trunk/uploader.py#45 [17:26] I should probably reverse it [17:27] yes, I changed it to "collection = 'opensource'" [17:33] kyan: first things first; the search engine can take a while, check your uploads at https://archive.org/catalog.php?history=1&justme=1 [17:35] Nemo_bis, Cool, thanks! I didn't know I could do that. I don't see the uploads there either though… [17:44] kyan: it's working for me :( [17:46] https://archive.org/details/wiki-wikitoolserverorg_w [17:46] Ah, well! Such is the way of the computer [17:46] kyan: are you sure your keys.txt file is correct? check http://www.archive.org/account/s3.php [17:47] I'm using Python 2.7.3, I hope it's not the problem [17:50] Huh, keys.txt seems to be right. I tried destroying the old keys and getting new ones, but it still didn't work. I'm using Python 2.6.6 [17:50] IIRC it worked with 2.6, I doubt that's the problem [17:51] If that was the problem it would be ironic… I just downgraded from 2.7 because of compatibility issues with something else XD [17:52] :) [17:52] probably something is failing in the metadata retrieval [17:55] Ah, got it to upload [17:55] kyan: ah, important, do you have dumpgenerator in same dir? [17:55] oh, nice, what was the problem [17:58] Yes, but for some reason the 7zip failed when I ran launcher.py. Then, when I ran 7zip manually to generate the file, the filename ended with -complete.7z (which wasn't matched by the criteria on line 85 http://code.google.com/p/wikiteam/source/browse/trunk/uploader.py#85 ) So the 7z file never got added to the list of dumps to upload. [17:59] ^^ [17:59] Ah, the docs are wrong [18:01] Thanks for being so patient, you're helping me find out all the small bottlenecks [18:03] No problem! :) I'm going to try running it on a few more small wikis and see if I can reproduce the 7zip issue. [18:03] Thank you for all of your help! [18:27] Are old versions of images archived by dumpgenerator.py? [18:55] kyan: Uh. I don't know. I think so. [18:56] File a bug if they're not, please. [21:24] Ops, please. [22:30] Citadel: ^ spread the @