#newsgrabber 2017-12-21,Thu

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
***BnAboyZ has joined #newsgrabber [01:19]
.............................................................. (idle for 5h8mn)
kimmer1 has joined #newsgrabber
midas2 has quit IRC (Ping timeout: 1212 seconds)
kimmer12 has quit IRC (Ping timeout: 633 seconds)
[06:27]
midas2 has joined #newsgrabber [06:47]
........... (idle for 54mn)
odemg has quit IRC (Read error: Operation timed out) [07:41]
odemg has joined #newsgrabber [07:46]
............... (idle for 1h11mn)
HCross2rebooting master first.. im going to fix things today [08:57]
***newsbuddy has joined #newsgrabber [09:08]
newsbuddyHello! I've just been (re)started. Follow my newsgrabs in #newsgrabberbot [09:08]
HCross2going to let the queues die down a bit and some packing/uploading happen then I will sort the disco [09:15]
***newsbuddy has quit IRC (Read error: Connection reset by peer) [09:21]
.... (idle for 19mn)
Igloo\o/
I'm around today HCross2
[09:40]
HCross2Hello
just resetting all the megawarc queues now
[09:45]
hang on.. ive been an idiot again [09:57]
there we go
megawarc factory is doing its thing
%Cpu(s): 19.6 us, 10.0 sy, 0.0 ni, 52.1 id, 18.2 wa, 0.0 hi, 0.0 si, 0.0 st
[10:10]
.... (idle for 15mn)
jrwr: do you have access to the news wiki? [10:25]
................. (idle for 1h22mn)
UPLOADS ARE UNDERWAY [11:47]
.... (idle for 17mn)
IglooOH GOOD MORE DELAYS TO FOS [12:04]
HCross2Igloo: this is going straight to S3
bypassing FOS
[12:07]
IglooOh fair enough [12:07]
HCross2Very very slowly.. because IO is out the window
3x4TB HDDs all working their socks off
[12:07]
We need more IO [12:19]
IglooThere is the NVME host HCross2
You could ship the warcs to it and megawarc it there. But the problem is the upload to IA
[12:29]
HCross2Upload isn't too bad from this server
I'm talking to a couple of people in Los Angeles at the moment seeing what they can do
[12:29]
IglooThe one in Canada (on OVH) gets 500-600MB/s [12:30]
KazHCross2: maybe stick netdata on master? [12:30]
IglooBut sometimes just drops massively [12:31]
HCross2Kaz: I tried... But it threw up and didn't load at all
The server is under huge disk load ATM, I don't want to give it anything else to do
[12:31]
Kazlol [12:32]
HCross2I'm going to get disk usage down a few TB then think about sorting discovery and grabbers [12:33]
KazI've turned off the target on tracker for now [12:34]
HCross2Rsync won't be on after the reboot anyway [12:34]
Kazah fair enough [12:37]
HCross2Uploads are going slowly but I think that's more due to lack of io because of the packing [12:38]
................................................... (idle for 4h12mn)
***dd0a13f37 has joined #newsgrabber [16:50]
.......... (idle for 45mn)
HCross2https://usercontent.irccloud-cdn.com/file/TafDF32L/image.png [17:35]
........... (idle for 53mn)
Kazinstall htop [18:28]
........ (idle for 36mn)
HCross2that is htop [19:04]
Kazhrm
yeah, doesn't look ideal
[19:13]
HCross2its uploading slowly
I spoke to VMHaus again... and they said that if the IA used v6 for upload we could probably get a lot of free bandwidth from them
*IPv6
[19:21]
........ (idle for 35mn)
***BnAboyZ has quit IRC (Quit: The Lounge - https://thelounge.github.io) [19:58]
...... (idle for 26mn)
BnAboyZ has joined #newsgrabber [20:24]
HCross2https://bgp.he.net/net/240e::/24#_netinfo
rofl
[20:30]
...................... (idle for 1h46mn)
Kazwhy would you even.. [22:16]
JAALol [22:19]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)