#newsgrabber 2017-06-26,Mon

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
arkiverjrwr: nice
did you find anything interesting in there for newsbuddy?
[00:26]
jrwrsome [00:26]
arkivernice :D [00:26]
jrwrbut only if we get busy
like 300k hits a hour busy
[00:26]
arkiverwe will probably never reach that
but I hope at some point we'll have a hundred or more people creating sites and contributing
but we'll see
[00:27]
jrwrYa
Also the API for mediawiki is super simple
so pywikipedia toolkit will be of use to you
[00:27]
arkiverI'll look into that
can it do automated image uploads?
[00:28]
jrwrYes [00:28]
arkivernice [00:28]
jrwrYou can do ANYTHING the web interface can
and then more
[00:28]
arkivernice
I'm thinking of updating the graphs once a week
[00:29]
jrwrsupports about 10 diff formats for output [00:29]
arkiversounds good [00:29]
jrwrthe reversion system has API support to see waiting content [00:29]
arkiverah
and for new pages?
or updated ages
pages*
[00:29]
jrwrall of that
since new pages are un-reviewed
[00:30]
arkiveryeah, but then they need to be found by the bot before they are reviewed by us [00:30]
jrwrYa
there are queues in the API that show you all un-reviewed pages
and un-reviewed reversions
[00:30]
arkiveryep [00:31]
jrwryou can pull both sides of the page as well
reviewed and unreviewed
[00:31]
arkiverwill look into it
thanks
late here now, so
arkiver is afk
good night!
[00:31]
jrwrarkiver: https://wiki.newsbuddy.net/api.php?action=query&list=unreviewedpages&urnamespace=0&urfilterlevel=0 [00:33]
and then this https://en.wikipedia.org/w/api.php?action=query&list=oldreviewedpages
my bad https://wiki.newsbuddy.net/api.php?action=query&list=oldreviewedpages
[00:38]
............................. (idle for 2h20mn)
***midas1 has quit IRC (Read error: Operation timed out)
kurt has quit IRC (Read error: Operation timed out)
midas1 has joined #newsgrabber
randomdes has quit IRC (Read error: Operation timed out)
randomdes has joined #newsgrabber
[02:58]
kurt has joined #newsgrabber [03:13]
............. (idle for 1h4mn)
blitzed has quit IRC (Quit: Leaving) [04:17]
..................................................................................................................... (idle for 9h40mn)
pnJay has joined #newsgrabber [13:57]
pnJaywhat is safe concurrent for this project? [13:58]
..... (idle for 22mn)
IglooAs much as you can take really
It's not one website that's being targetted
It's loads
Bandwidth/CPU/IO is the issue here
[14:20]
pnJayExcellent, thanks! [14:29]
..... (idle for 21mn)
***blitzed has joined #newsgrabber [14:50]
................................................................... (idle for 5h33mn)
arkiverI might not be able to work a lot on this or other projects in this and next week
after these two weeks I'll have a lot of time again
[20:23]
HCross2No problem [20:26]
....... (idle for 34mn)
***pnJay has quit IRC (Quit: Leaving) [21:00]
........................ (idle for 1h58mn)
kyan_ has joined #newsgrabber
kyan has quit IRC (Read error: Operation timed out)
[22:58]
......... (idle for 44mn)
Crusher_ has joined #newsgrabber [23:44]
Crusher_ has quit IRC (Read error: Connection reset by peer) [23:49]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)