#newsgrabber 2018-03-04,Sun

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
***odemg has quit IRC (Read error: Operation timed out) [00:11]
odemg has joined #newsgrabber [00:16]
blitzed has joined #newsgrabber
odemg has quit IRC (Ping timeout: 250 seconds)
[00:27]
odemg has joined #newsgrabber [00:42]
........................................... (idle for 3h32mn)
qw3rty112 has joined #newsgrabber [04:14]
qw3rty111 has quit IRC (Read error: Operation timed out) [04:20]
........................................................ (idle for 4h39mn)
HCross2im kicking off a couple of crawls for http://newswars.com and https://www.prisonplanet.com in light of the InfoWars and Alex Jones debacle [08:59]
................... (idle for 1h30mn)
***odemg has quit IRC (Ping timeout: 633 seconds) [10:29]
odemg has joined #newsgrabber
odemg has quit IRC (Connection closed)
odemg has joined #newsgrabber
[10:37]
................................................. (idle for 4h2mn)
medowari am limited by deduplication. Is that disk-based or cpu based? [14:40]
Kazuh
that's a good question.. are you maxing out on anything?
also worth noting you can run more than one dedupe concurrently now
[14:54]
medowarmaxing out CPU with big files, otherwise... nothing.... thats why im asking... but not sure about disk, cant really tell
i know, im running 2 concurrent
I noticed, that with more than 2, the scripts freeze at some time
at some point
some after 30k tasks, some after 3k
with 2 running stable at currently 40k tasks.
[15:02]
***odemg has quit IRC (Read error: Operation timed out) [15:07]
odemg has joined #newsgrabber [15:19]
.......... (idle for 48mn)
Kazmy disco is down atm, just migrating it off onto different storage [16:07]
........................................... (idle for 3h34mn)
***JSharp has joined #newsgrabber [19:41]
........... (idle for 52mn)
SmileyG has joined #newsgrabber
Smiley has quit IRC (Read error: Connection reset by peer)
odemg has quit IRC (Read error: Operation timed out)
[20:33]
odemg has joined #newsgrabber [20:45]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)