#newsgrabber 2017-11-20,Mon

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
***trvz has quit IRC (Ping timeout: 260 seconds)
trvz has joined #newsgrabber
[00:27]
........................................................................................................ (idle for 8h39mn)
kyonko|2 has joined #newsgrabber [09:10]
..................................................... (idle for 4h24mn)
KazOVH IPv6 seems to be working again this morning.. wtf [13:34]
....... (idle for 31mn)
IglooI think their IPv6 stack is a bit shonky
I've turned it off on all my stuff
[14:05]
..... (idle for 22mn)
KazI usually do, but it broke wpull/youtube-dl for me [14:27]
IglooIt also seriously breaks Windows servers now too
as they do a lot of their internal stuff over v6
[14:40]
Kazat least BT have got it working.. [14:53]
IglooI wonder if Plusnet ever will (not that I really want it as i'd have to put some sort of firewall in place) [14:54]
........ (idle for 35mn)
***dd0a13f37 has joined #newsgrabber [15:29]
............... (idle for 1h13mn)
KazI've just requeued jobs over 48h old
wanted to see what the distribution of failed jobs was looking like
[16:42]
........ (idle for 38mn)
JensRex>700.000 failed jobs :D [17:21]
Kazyeah, guess that's been building up for a while
the 10k we have 'out' at the minute is weirdly high, but it's mainly me, Fletcher and RequiesCat
[17:26]
JensRexLast few days I've been experimenting, and I'm now running only 1 concurrency per pipeline. Otherwise the pipeline seems to shit its pants quite quickly.
I just copied the NewsGrabber dir multiple times, and run pipelines in different ttys.
I'm not sure how to use gnu screen with virtualenv.
[17:33]
.... (idle for 18mn)
I'm tempted to map www.delicious.com to 0.0.0.0 in /etc/hosts.
I've seen it stall there many times now, for who knows what reason.
[17:52]
....... (idle for 31mn)
Kazno need to copy the newsgrabber dir, you can run it multiple times from one dir [18:23]
***dd0a13f37 has quit IRC (Quit: Connection closed for inactivity) [18:28]
............ (idle for 58mn)
JensRexBut if i need to stop a pipeline, they all stop. [19:26]
Kaztrue
i'm at the point where everything runs itself, I don't touch it unless it really breaks. pipelines stop/start every so often. Reducing the session timeout to 3600 seconds has cleared up the *really* stuck jobs
https://s.kurt.gg/1a6V460X.png everything just hums along
[19:30]
JensRexI would still like to know why there’s a 48hr timeout.
arkiver: *trigger*
[19:33]
arkiverI'll respond in a few hours
can't respond at the oment
moment*
[19:35]
JensRexnp [19:36]
.............................................. (idle for 3h46mn)
***kyan has joined #newsgrabber [23:22]
....... (idle for 30mn)
jrwr has joined #newsgrabber [23:52]
jrwrstupid freenode
wait
EFNET
[23:53]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)