#wikiteam 2014-06-30,Mon

↑back Search

Time Nickname Message
01:00 πŸ”— balrog Nemo_bis: it seems wikis are now disabling Special:Export too
01:00 πŸ”— balrog which breaks screenscraping
01:00 πŸ”— balrog at least the way the script does it
01:10 πŸ”— xmc what fucks
01:10 πŸ”— xmc any idea why?
05:36 πŸ”— Nemo_bis balrog: "now"? It's not a new thing, any specific wiki in your mind?
16:30 πŸ”— balrog Nemo_bis: http://wikirtishchevo.shoutwiki.com/wiki/БлуТСбная:Экспорт
16:30 πŸ”— Nemo_bis balrog: all of shoutwiki?
16:30 πŸ”— balrog not sure if /all/
16:31 πŸ”— balrog let me check a couple more
16:31 πŸ”— Nemo_bis It's new since january for that wiki https://archive.org/details/wiki-wikirtishchevoshoutwikicom_w
16:32 πŸ”— balrog Nemo_bis: seems like all of shoutwiki, indeed
16:32 πŸ”— Nemo_bis O_o
16:32 πŸ”— balrog I checked like five wikis
16:32 πŸ”— balrog no Special:Export on any
16:33 πŸ”— Nemo_bis http://blog.shoutwiki.com/2012/06/new-feature-instant-database-dumps/ no longer
16:33 πŸ”— balrog isn't that something else?
16:33 πŸ”— balrog hah, 404
16:34 πŸ”— Nemo_bis Yes, I was being optimistic "maybe they disabled Special:Export because it was superseded by regular server-side dumps"
16:34 πŸ”— balrog :/
16:35 πŸ”— Nemo_bis Well, no need to worry now, I'll poke/beat them in 6 months from now when our dumps start rotting and updates will be very needed
16:36 πŸ”— Nemo_bis In the meanwhile we can ger (more) ready with https://github.com/WikiTeam/wikiteam/issues/44
16:36 πŸ”— Nemo_bis * get
17:08 πŸ”— cmx hey Nemo_bis, would you be so kind as to add me to the wikiteam github org?
17:08 πŸ”— cmx username 'chronomex
17:08 πŸ”— cmx '
17:10 πŸ”— Nemo_bis cmx: thanks for asking but I have no such power, ask emijrp
17:10 πŸ”— cmx ok
17:10 πŸ”— cmx will do
17:22 πŸ”— balrog time to port this thing to requests
17:22 πŸ”— balrog it's nowhere near as difficult as any of you think
17:22 πŸ”— balrog just one concern
17:22 πŸ”— balrog what's the best way to handle cookies?
17:22 πŸ”— balrog a global variable for the cookiejar?
21:57 πŸ”— balrog Nemo_bis: are you around?
21:57 πŸ”— Nemo_bis balrog: yes but going to bed soonish
21:57 πŸ”— balrog ah ok
21:57 πŸ”— balrog so far: ported to Requests; fixed more unicode bugs
21:57 πŸ”— Nemo_bis balrog: did you find an answer for the cookies?
21:57 πŸ”— Nemo_bis whee :)
21:57 πŸ”— balrog No, I was asking what's recommended
21:58 πŸ”— balrog Requests requires the cookiejar to be passed when you call requests.post() or get()
21:58 πŸ”— Nemo_bis I was trying to think if a global cookie could have pollute anything
21:58 πŸ”— balrog Not sure what's the cleanest way to do that
21:58 πŸ”— balrog would be a global cookiejar
21:58 πŸ”— Nemo_bis It would be cleared from one dump to the next anyway, right?
21:58 πŸ”— balrog yes of course
21:58 πŸ”— balrog it would only exist while the session is running
21:58 πŸ”— Nemo_bis Yep
21:59 πŸ”— balrog I was just wondering if there's a cleaner way to do it than with a python global variable
21:59 πŸ”— balrog passing it in the config dict looks messy too
21:59 πŸ”— balrog but would work; thing is, is it ok to add stuff to that dict?
21:59 πŸ”— Nemo_bis Consider we already pass around a global "config" I guess this won't be much worse
21:59 πŸ”— balrog my question is: add it to the global 'config' or add a global var
21:59 πŸ”— Nemo_bis Better not, because sometimes we pass it from one script/"class" to the other
22:00 πŸ”— balrog hmm what do you mean?
22:00 πŸ”— Nemo_bis Global var looks better
22:00 πŸ”— balrog oh, config gets passed from altogether different scripts?
22:00 πŸ”— Nemo_bis I mean when launcher.py calls dumpgenerator.py and stuff like that, IIRC
22:00 πŸ”— balrog ah ok
22:00 πŸ”— Nemo_bis Though I may misremember
22:04 πŸ”— balrog hmm or I can just use a session maybe
22:04 πŸ”— balrog would that be better?
22:05 πŸ”— Nemo_bis I wouldn't nitpick too much, global variable is ok.
22:05 πŸ”— balrog keep-alive works within a session
22:05 πŸ”— balrog which is a great thing since it reduces server load greatly
22:05 πŸ”— Nemo_bis That sounds nice
22:13 πŸ”— balrog can you tell emijrp what I'm doing?
22:13 πŸ”— balrog I don't want to duplicate work
22:19 πŸ”— Nemo_bis He's already working on other stuff
22:20 πŸ”— balrog like?
22:20 πŸ”— balrog I see him pushing stuff to the repo
22:20 πŸ”— Nemo_bis I mean, non-intersecting work
22:20 πŸ”— Nemo_bis Except perhaps some of the unicode fixes :)
22:23 πŸ”— Nemo_bis I added a note on https://github.com/WikiTeam/wikiteam/issues/104
irclogger-viewer