#newsgrabber 2018-05-30,Wed

Logs of this channel are not protected. You can protect them by a password.

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)


WhoWhatWhen
***anonymoos has quit IRC (Ping timeout: 260 seconds) [01:57]
....... (idle for 31mn)
anonymoos has joined #newsgrabber [02:28]
.......... (idle for 47mn)
qw3rty118 has joined #newsgrabber [03:15]
qw3rty117 has quit IRC (Read error: Operation timed out) [03:21]
.... (idle for 18mn)
odemg has quit IRC (Ping timeout: 260 seconds) [03:39]
odemg has joined #newsgrabber [03:51]
........... (idle for 52mn)
JAA has quit IRC (Read error: Operation timed out)
JAA has joined #newsgrabber
JAA has quit IRC (Read error: Operation timed out)
JAA has joined #newsgrabber
[04:43]
............... (idle for 1h14mn)
HCrossNo thanks. I'll stick to playing Osu on my surface
arkiver: heads up.. odemg and I are working on a potential replacement for master.. because it's showing its age now
Disk io is utterly atrocious
[06:02]
...................................... (idle for 3h7mn)
arkiverHCross: nice! any more info on the possible new server? [09:09]
........................................................................... (idle for 6h10mn)
HCrossNot yet, am waiting on odemg [15:19]
........ (idle for 37mn)
odemgarkiver, HCross this is what I'm working on getting, https://i.imgur.com/lerK3KY.png however that at public price is close to £400/month, and we've only got £100 at most to work with, may need to bring down the cpu and ram by half. I spoke to them on the phone about it this morning, asked to call back late tonight for what they can offer for £100, but it'll be close to that anyways. [15:56]
HCrossHmm. Can those disks support the io we need [15:56]
Feel free if you want me to speak to them as well [16:02]
odemgHCross, well we're only using older sata3 disks now right? I can change up the config I just didn't know how much storage was needed, could throw in some ssd cache and raid0 the disks also [16:16]
HCross, but I don't see a problem with them, it's 1Gbit the disks are going to hold up fine, I presume the webserver root isn't huge just serving text files so run that off the ssd and then do rsync to/from the hdds [16:22]
HCrossIt's the gzip packing that does it
ATM were on 3x4tb HDDs
And occasionally the packer does consume all io
In raid 0
[16:23]
................ (idle for 1h15mn)
odemg: not sure how much you know about the innards of megawarc.. my idea would be to receive inbound warcs onto an SSD, pack them up on the SSD then dump the finished files onto HDD for queuing for upload [17:38]
...... (idle for 25mn)
KazI feel like in this case having one server doing *all* the work is a lot more expensive that lots of *cheaper* servers doing less work
nothing's wrong with multiple ovh boxes (especially if the price to beat is £400/mo)
and at least that way the upload is spread out a bit too
also, splitting off most of master's work to a different machine would be ideal, then at least we can have dedicated machines to abuse disks on
[18:03]
HCrosseh true, but it means more things to manage and coordinate [18:17]
Kazthere's tradeoffs whichever way you go
with a normal megawarc factory setup, should be fairly easy to get to a point where everything comes up nicely at boot, and any issues can be resolved by just bouncing the box
[18:20]
..... (idle for 20mn)
HCrossodemg: fired up osu for the first time in 2 years... 260x streak on my first round :) [18:40]
.................... (idle for 1h39mn)
***matthusby has joined #newsgrabber [20:19]
odemgHCross, I haven't played osu in so long osu to mean now means oregon state uni
HCross, so is a 250GB ssd okay or will you need a TB?
[20:28]
HCrossBoth [20:28]
odemgI mean 1TB ssd + 8TB hdd [20:29]
HCrossThat'll work
I got you mixed up with jrwr on the osu thing
[20:29]
odemgread up, I didn't check and just presumed current only had a 6TB disk, no idea where I got that idea from but okay
I just got home, settling then calling them, I'll go over details with you ffirst
Kaz, price isn't going to be £400/month, getting a deal on beefier hardware and keeping it under £100/month
also ovh isn't going to let us get more than 1Gbit for a reasonable price, if we hold off on setup for a week we will be able to get a deal on unmetered 1Gbit premium on a 10Gbit port, allowing us to do this... https://the-eye.eu/10G_SON.mp4
[20:29]
Kazah okay, nice
whats the connection to IA look like over those links?
[20:46]
odemgfrom prague 30MB/s single connection, from paris around 40MB/s
I've had over 300MB/s into wave though so idk
HCross, do you have need for more than 5 ips?
[20:50]
HCrossNo
Our current server is paid up until the end of June
[20:51]
odemgplenty of time the neg then [20:52]
HCrossYeah [20:53]
odemgit;s been okay since that hacky nginx restarter xD or at least you have to pay less attention to it and it's not stalling everyones scripts
HCross, will you be migrating any data over or just starting fresh?
[20:53]
HCrossI'll probably just restart
And take an image of the OVH box incase
[20:55]
odemg: can you ask them if they offer BGP sessions as well please
That's not crucial tho
[21:07]
......... (idle for 43mn)
IglooI wouldn't bother building a routing table
As you've only got them as upstream
Let them handle it
I've been doing some background work as well, I might be able to build out at work
Where we have hardware in LDEX and M247, I can put us on the back of 10Gbit pipes
But i need to get it approved first. We can have as much rack space as we want and build our own hardware.
So we can go striped NVME for the incoming / packing then a bunch 4TB spinners (8 or so) for the storage on RAID 10. It'd be stupid fast.
[21:53]
HCrossThat'd be nice
Although I've experienced m247. It's painfully bad
Their support fail to diagnose a peak time congestion issue
[21:58]
IglooYeah
We have our own peers
So, Don't use the M247 network ;-)
[21:59]
HCrossOh good [22:01]
....... (idle for 32mn)
***Kaz sets mode: +oooo chfoo dxrt Igloo ivan
Kaz sets mode: +oo odemg medowar
Kaz sets mode: +o JAA
[22:33]
Kazirccloud really needs to learn how to set modes [22:34]
..... (idle for 20mn)
odemgIgloo, if we end up going down that route what is the network and rack space going to cost us? I could provide 16TB in nvme and 200TB in disks if we're going colo... [22:54]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)