***: MrRadar2 has quit IRC (Quit: Rebooting)
MrRadar2 has joined #newsgrabber
jrwr: Fuck
Failed Hard Drive on my OVH Box
FUUU
***: svchost01 has quit IRC (Read error: Operation timed out)
jrwr: There it goes
its dead jim, it kernel paniced
***: dxrt has quit IRC (Ping timeout: 360 seconds)
Kaz: how much was on there?
also, raid0? or just one drive
jrwr: raid1 but both drives failed, the FS is toast
not a ton, mostly just running services
I had backups
Kaz: ouch
I don't know what's going on with ovh.. I've still got access to rbx1, which expired nearly a month ago
jrwr: LOL
dont ever tell them
Kaz: no plans to :D
it's just sitting doing newsgrabber until it finally dies
***: BnARobin_ has joined #newsgrabber
BnARobin has quit IRC (Read error: Operation timed out)
octothorp has quit IRC (Remote host closed the connection)
octothorp has joined #newsgrabber
Kimmer has quit IRC (Read error: Connection reset by peer)
BnAboyZ: Is it normal for the dedupe service to have 0 records added?
Many of its latest status updates report 0 added, but looks like something that is only happeling the last 1-2 days
***: BnARobin has joined #newsgrabber
BnARobin_ has quit IRC (Read error: Operation timed out)
dxrt has joined #newsgrabber
Kaz: so, ou rbiggest issue here atm is that we're pulling more in than we can deal with
we need more warriors
***: qw3rty12 has joined #newsgrabber
medowar: more warriors? Do warriors do the dedup?
and is the warrior3 available in any other format like docker?
or manual installation?
I tried running the newsgrabber scripts manually, but it fails due to missing Warcio/failed import of it.
***: N1N3 has joined #newsgrabber
Kaz: medowar: if you run it again it'll work
i think someone was working on docker for warrior3, no idea though
https://github.com/ArchiveTeam/warrior-dockerfile
medowar: Kaz: Nope, get that error on startup https://pastebin.com/qmyeJ8jb
Kaz: hmm
do you have the warcio dir in there?
BnAboyZ: Is there any IP restriction on newsgrabber? I could start some computation at home. I have some computing resources and a 500/500Mbps line, but I only have 1 IP because it's a residential line
Kaz: go nuts
medowar: any issues with uploads to master? Seems like upload is not starting.
Kaz: shouldn't be.. but there's only 20mbit/s incoming there at the moment
medowar: yeah, now went through in 1 sec, but took like 2 min to start.
Kaz: i've just had one go straight through without delay
i'll keep an eye on my pipelines
medowar: issue might be ipv6 related. Cant get a connection on v6, v4 works fine.
Kaz: are you on ovh?
ah, master is
ovh's ipv6 is fucked
medowar: i am too. So linux eyeball prefers ipv6 over v4
so you might not be, so you wont see the issue
same reason why startup is extreme slow.
Kaz: i am, but disabled ipv6 long ago because OVH was intermittently failing to pass ipv6 traffic
medowar: well, hetzner works perfectly fine for 3 years now, so.. *hint hint*
ok, up and running with 20 instances now. Lets see how it works out. Fixed v6 for now with a hosts entry
***: robogoat has joined #newsgrabber
Aoede has quit IRC (Quit: ZNC - http://znc.in)
Aoede has joined #newsgrabber
BnARobin_ has joined #newsgrabber
BnARobin has quit IRC (Read error: Operation timed out)
BnARobin_ has quit IRC (Remote host closed the connection)
BnARobin has joined #newsgrabber
BnARobin has quit IRC (Remote host closed the connection)
BnARobin has joined #newsgrabber
Caz has joined #newsgrabber
Kimmer has joined #newsgrabber
HCross2: Let me know if v6 gives you any more grief and I'll ticket
^ MTR's would be helpful
Kaz: HCross2: don't bother. i've done that dance with them and they just ignore it
MTRs check out fine, connections will establish but not pass any further traffic
HCross2: You annoyed the network mailing lists?
Kaz: route is the same on OVHs side no matter what
HCross2: I'll try them
Kaz: I decided it wasn't worth the effort
HCross2: Hm
Looks like OVH are blocking my connections to my crypto pool
Bollocks. It was nicely helping to pay the bill too