Time |
Nickname |
Message |
05:36
🔗
|
Nemo_bis |
Not really, emijrp did most of the coding, I just refactor a bit |
05:38
🔗
|
Nemo_bis |
danneh_: yes, that's the single most common problem and I used bad manners with it: https://code.google.com/p/wikiteam/issues/detail?id=26#c10 |
05:40
🔗
|
Nemo_bis |
(But if you do that, you'll skip most wikis in that list as I did. ;) ) |
05:43
🔗
|
Nemo_bis |
To understand what's going on you need to visit the wiki's Special:Export in your browser and try to export any page. If export is broken, it's not a bug. More often, the URL used by the script is wrong in some way because the wiki is not following a standard URL structure. |
08:41
🔗
|
danneh_ |
Ah, I see |
08:41
🔗
|
danneh_ |
Thanks for explaining, I'll look into it and try to see exactly what's going on |
09:28
🔗
|
danneh_ |
Nemo_bis: Huh, changing it from http to https for that valve dev wiki fixed it for me... weird |
09:28
🔗
|
danneh_ |
Even though http is valid, and is the proper default |
09:42
🔗
|
Nemo_bis |
sob |
20:20
🔗
|
exmic |
creepypasta wiki dump is stuck |
20:20
🔗
|
exmic |
An error has occurred while retrieving "Creepypasta_Wiki:Chat/Logs/06_November_2013" |
20:20
🔗
|
exmic |
have it in a shell loop, same thing over and over |
20:27
🔗
|
danneh_ |
how many times has it tried to grab that page? |
20:27
🔗
|
Nemo_bis |
exmic: the page may be too big |
20:28
🔗
|
exmic |
danneh_: few hundred times |
20:28
🔗
|
exmic |
Nemo_bis: probably |
20:28
🔗
|
Nemo_bis |
for instance wikihow is impossible to download because we drive varnish crazy |
20:29
🔗
|
Nemo_bis |
usually what I do is do special:export manually and remove the title from automatic list |
20:29
🔗
|
Nemo_bis |
most wikis don't know how to configure special:export so there is no limit :P |
20:30
🔗
|
Nemo_bis |
eek http://creepypasta.wikia.com/wiki/Creepypasta_Wiki:Chat/Logs/06_November_2013?action=history |
20:35
🔗
|
exmic |
heh |
20:35
🔗
|
exmic |
I'll do that later then |
20:35
🔗
|
Nemo_bis |
Sadly Wikia is not one of those stupid sysadmins, they interrupt the connection |
20:36
🔗
|
Nemo_bis |
That might be the reason the script fails, otherwise it would reduce the number of revisions it asks |
20:36
🔗
|
exmic |
arsewipes |
20:36
🔗
|
Nemo_bis |
Can you file a bug? |
20:37
🔗
|
exmic |
later, I'm at work and really should be actually working |
20:37
🔗
|
Nemo_bis |
Sure, I didn't say now :P |
22:08
🔗
|
danneh_ |
Just wondering, are you guys working on the dumpgenerator rewrite? Last commit to it says the main guy's no longer working on it |
22:10
🔗
|
Nemo_bis |
danneh_: nope, nobody is working on it |
22:12
🔗
|
danneh_ |
Nemo_bis: Fair enough. Whenever I get some time, I might look into it, see if I can either finish it off or integrate the ideas into the main dumpgenerator.py |
22:13
🔗
|
Nemo_bis |
danneh_: wow :) |
22:16
🔗
|
danneh_ |
aha, this sorta stuff is fun, especially when it's all just a single script to worry about |