[05:36] Not really, emijrp did most of the coding, I just refactor a bit [05:38] danneh_: yes, that's the single most common problem and I used bad manners with it: https://code.google.com/p/wikiteam/issues/detail?id=26#c10 [05:40] (But if you do that, you'll skip most wikis in that list as I did. ;) ) [05:43] To understand what's going on you need to visit the wiki's Special:Export in your browser and try to export any page. If export is broken, it's not a bug. More often, the URL used by the script is wrong in some way because the wiki is not following a standard URL structure. [08:41] Ah, I see [08:41] Thanks for explaining, I'll look into it and try to see exactly what's going on [09:28] Nemo_bis: Huh, changing it from http to https for that valve dev wiki fixed it for me... weird [09:28] Even though http is valid, and is the proper default [09:42] sob [20:20] creepypasta wiki dump is stuck [20:20] An error has occurred while retrieving "Creepypasta_Wiki:Chat/Logs/06_November_2013" [20:20] have it in a shell loop, same thing over and over [20:27] how many times has it tried to grab that page? [20:27] exmic: the page may be too big [20:28] danneh_: few hundred times [20:28] Nemo_bis: probably [20:28] for instance wikihow is impossible to download because we drive varnish crazy [20:29] usually what I do is do special:export manually and remove the title from automatic list [20:29] most wikis don't know how to configure special:export so there is no limit :P [20:30] eek http://creepypasta.wikia.com/wiki/Creepypasta_Wiki:Chat/Logs/06_November_2013?action=history [20:35] heh [20:35] I'll do that later then [20:35] Sadly Wikia is not one of those stupid sysadmins, they interrupt the connection [20:36] That might be the reason the script fails, otherwise it would reduce the number of revisions it asks [20:36] arsewipes [20:36] Can you file a bug? [20:37] later, I'm at work and really should be actually working [20:37] Sure, I didn't say now :P [22:08] Just wondering, are you guys working on the dumpgenerator rewrite? Last commit to it says the main guy's no longer working on it [22:10] danneh_: nope, nobody is working on it [22:12] Nemo_bis: Fair enough. Whenever I get some time, I might look into it, see if I can either finish it off or integrate the ideas into the main dumpgenerator.py [22:13] danneh_: wow :) [22:16] aha, this sorta stuff is fun, especially when it's all just a single script to worry about