#newsgrabber 2018-03-26,Mon

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
anonymoosall 3 hosts are about pretty much the same for me. master and storage are about 140-150ms minimum and drive is about 150-160ms minimum. all 3 fluctuates a lot, but that probably because my network is fully loaded by P2P and AT scripts. [00:14]
I think we should add a timeout to the requests.get(list_url) call in WgetArgs.realize(). We can even catch the Timeout exception and retry up to a certain retry count limit.
I had issues with dedupe getting stuck because my router was too weak and dropped connections. I added a timeout to the requests.get call in the dedupe code when I moved it to a separate file, although I don't remember if I did this before or after I upgraded my router. The dedupe code does 10 retries.
Doing the same for WgetArgs.realize() might fix the WgetDownload stall mls was seeing
[00:23]
a while ago I also saw WgetDownload getting stuck, presumably due to a master server issue, so I added a 3600s timeout to the requests.get call in WgetArgs.realize(), and I haven't seen the issue since. I didn't implement retries though [00:32]
.................................... (idle for 2h56mn)
***JAA has quit IRC (Read error: Operation timed out)
JAA has joined #newsgrabber
svchost01 sets mode: +ov JAA JAA
svchost02 sets mode: +ov JAA JAA
[03:28]
qw3rty118 has joined #newsgrabber [03:37]
qw3rty117 has quit IRC (Read error: Operation timed out) [03:43]
........................................................................................ (idle for 7h19mn)
mls has left [11:02]
............................. (idle for 2h20mn)
mls has joined #newsgrabber [13:22]
....... (idle for 33mn)
JAA has quit IRC (Read error: Operation timed out)
JAA has joined #newsgrabber
svchost02 sets mode: +ov JAA JAA
svchost01 sets mode: +ov JAA JAA
[13:55]
....... (idle for 32mn)
Martle has quit IRC (Quit: Leaving) [14:27]
.......................................... (idle for 3h27mn)
odemg has quit IRC (Read error: Connection reset by peer) [17:54]
.... (idle for 15mn)
odemg has joined #newsgrabber [18:09]
....................... (idle for 1h50mn)
JAA has quit IRC (Read error: Operation timed out)
JAA has joined #newsgrabber
svchost01 sets mode: +ov JAA JAA
svchost02 sets mode: +ov JAA JAA
[19:59]
........................... (idle for 2h12mn)
underscor has quit IRC (No Ping reply in 180 seconds.)
underscor has joined #newsgrabber
[22:14]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)