#wikiteam 2013-10-16,Wed

↑back Search

Time Nickname Message
05:40 πŸ”— Nemo_bis kyan: have you tried uploader.py ?
15:08 πŸ”— kyan Nemo_bis, I haven't found any clear documentation on that scriptҀ¦ I tried running it, and it said "Uploading frathwikicom-20131015-complete.7z", and then it exited. I couldn't find any uploaded file in the Internet ArchiveҀ¦
16:55 πŸ”— Nemo_bis kyan: you need to put the index.php (or api.php?) urls in a text file and use its filename as argument, iirc
16:56 πŸ”— Nemo_bis best used after launcher.py which already creates the archives with correct filenames
17:24 πŸ”— kyan Nemo_bis, I tried running launcher.py mylist.txt. It ran fine, but didn't seem to create any 7z file. Running uploader.py mylist.txt Ҁ” like before Ҁ” said "Uploading http://alcts.ala.org/crgwiki/api.php", and seemed to exit ok, but I don't see the upload here: http://archive.org/search.php?query=mediatype%3Atexts&sort=-publicdate
17:26 πŸ”— Nemo_bis let me check what's going on, it's been a while since I last used them
17:26 πŸ”— Nemo_bis kyan: have you changed this line? https://code.google.com/p/wikiteam/source/browse/trunk/uploader.py#45
17:26 πŸ”— Nemo_bis I should probably reverse it
17:27 πŸ”— kyan yes, I changed it to "collection = 'opensource'"
17:33 πŸ”— Nemo_bis kyan: first things first; the search engine can take a while, check your uploads at https://archive.org/catalog.php?history=1&justme=1
17:35 πŸ”— kyan Nemo_bis, Cool, thanks! I didn't know I could do that. I don't see the uploads there either thoughҀ¦
17:44 πŸ”— Nemo_bis kyan: it's working for me :(
17:46 πŸ”— Nemo_bis https://archive.org/details/wiki-wikitoolserverorg_w
17:46 πŸ”— kyan Ah, well! Such is the way of the computer
17:46 πŸ”— Nemo_bis kyan: are you sure your keys.txt file is correct? check http://www.archive.org/account/s3.php
17:47 πŸ”— Nemo_bis I'm using Python 2.7.3, I hope it's not the problem
17:50 πŸ”— kyan Huh, keys.txt seems to be right. I tried destroying the old keys and getting new ones, but it still didn't work. I'm using Python 2.6.6
17:50 πŸ”— Nemo_bis IIRC it worked with 2.6, I doubt that's the problem
17:51 πŸ”— kyan If that was the problem it would be ironicҀ¦ I just downgraded from 2.7 because of compatibility issues with something else XD
17:52 πŸ”— Nemo_bis :)
17:52 πŸ”— Nemo_bis probably something is failing in the metadata retrieval
17:55 πŸ”— kyan Ah, got it to upload
17:55 πŸ”— Nemo_bis kyan: ah, important, do you have dumpgenerator in same dir?
17:55 πŸ”— Nemo_bis oh, nice, what was the problem
17:58 πŸ”— kyan Yes, but for some reason the 7zip failed when I ran launcher.py. Then, when I ran 7zip manually to generate the file, the filename ended with -complete.7z (which wasn't matched by the criteria on line 85 http://code.google.com/p/wikiteam/source/browse/trunk/uploader.py#85 ) So the 7z file never got added to the list of dumps to upload.
17:59 πŸ”— Nemo_bis ^^
17:59 πŸ”— Nemo_bis Ah, the docs are wrong
18:01 πŸ”— Nemo_bis Thanks for being so patient, you're helping me find out all the small bottlenecks
18:03 πŸ”— kyan No problem! :) I'm going to try running it on a few more small wikis and see if I can reproduce the 7zip issue.
18:03 πŸ”— kyan Thank you for all of your help!
18:27 πŸ”— kyan Are old versions of images archived by dumpgenerator.py?
18:55 πŸ”— Nemo_bis kyan: Uh. I don't know. I think so.
18:56 πŸ”— Nemo_bis File a bug if they're not, please.
21:24 πŸ”— SketchCow Ops, please.
22:30 πŸ”— xmc Citadel: ^ spread the @

irclogger-viewer