Time |
Nickname |
Message |
01:53
🔗
|
|
DogsRNice has quit IRC (Read error: Connection reset by peer) |
03:19
🔗
|
|
cfarquhar has quit IRC (Read error: Operation timed out) |
03:19
🔗
|
|
cfarquhar has joined #archiveteam-ot |
03:31
🔗
|
|
odemg has quit IRC (Ping timeout: 265 seconds) |
03:43
🔗
|
|
odemg has joined #archiveteam-ot |
05:03
🔗
|
|
dhyan_nat has joined #archiveteam-ot |
06:12
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
06:47
🔗
|
|
dhyan_nat has quit IRC (Read error: Operation timed out) |
06:51
🔗
|
|
ColdIce has joined #archiveteam-ot |
06:54
🔗
|
Fusl |
i have a couple of servers at home idling around, at least two of them completely empty and ready to be loaded with whatever projects i can do. both have pretty decent cpus, one of them has 80gb memory, four 1.2TB SSHD drives, four shitty 480GB SSDs, two ZFS pools, one for SSHD and one for SSD, the other one has 48gb memory, three 4tb drives, one 3tb drive, all HDDs in a mergerfs "raid0" mount. i'm looking |
06:54
🔗
|
Fusl |
for a large project to run, doesn't necessarily have to be archiveteam related but should not cause much upload bandwidth either, i only have 100 mbit/s up. IA.BAK is out, too unstable and it's a half dead project. urlteam not really useful on two ip addresses and is already running + happily getting my two ips banned on the commercial url shorteners. newsgrabber uses too much upload bandwidth. anyone got |
06:54
🔗
|
Fusl |
an idea what else i can try helping at with those idlers? |
06:56
🔗
|
Fusl |
side note: both those servers are on the telegraf grafana dashboard, they under my username and called kaede and mariko |
06:57
🔗
|
Flashfire |
Any BOINC projects might work. if enigma has any work that is an interesting project |
06:57
🔗
|
Flashfire |
there is also SETI@home of course |
06:57
🔗
|
Fusl |
i never claimed that those are power efficient cpus |
06:57
🔗
|
Fusl |
they are not. not at all. |
06:57
🔗
|
Fusl |
xeon x5650 and xeon e5620 |
06:58
🔗
|
Flashfire |
ah ok so nothing high CPU intensive |
06:58
🔗
|
Flashfire |
If you set one up on just one BOINC project that interests you with only 30% CPU allocation |
06:58
🔗
|
Fusl |
yeah, i mean, if it can't be avoided like IA.BAK sometimes uses lots of cpu when running the checksum, thats okay but only if the entire system is used otherwise and not just for cpu stuff |
07:34
🔗
|
Fusl_ |
https://hyperallergic.com/503528/recorder-marion-stokes-documentary/ |
07:41
🔗
|
|
BlueMax has joined #archiveteam-ot |
08:02
🔗
|
Flashfire |
I wonder if Godane will end up with some of those tapes |
08:02
🔗
|
Igloo |
Fusl can I suggest maybe the new home for the newsbuddy master? |
08:02
🔗
|
Igloo |
Doesn't do much upload, a little ingress |
08:03
🔗
|
Igloo |
Unless you want a set and leave kinda deal? |
08:03
🔗
|
Igloo |
(Current master is overpowered for running just the control aspect, and upload to IA is useless for the rest) |
08:09
🔗
|
Fusl_ |
Igloo: i can give youbssh access to a vm on both machines id you want and set up port forwardings to them |
08:09
🔗
|
Fusl_ |
if you want to run it as newsbuddy master |
08:09
🔗
|
Fusl_ |
but i personally prefer set and forget |
08:09
🔗
|
|
BlueMax has quit IRC (Quit: Leaving) |
08:11
🔗
|
Igloo |
Understood, I am currently working on a brand new warrior; which is a docker manager |
08:11
🔗
|
Igloo |
that would be ideal |
08:11
🔗
|
Igloo |
But it's going to take some time |
09:44
🔗
|
|
Ryz has quit IRC (Remote host closed the connection) |
10:12
🔗
|
godane |
Flashfire: i have not got any of those tapes yet |
10:13
🔗
|
godane |
first i need to be able to grab close caption from vhs tapes which i have not been able to do yet |
10:14
🔗
|
godane |
or know how to do |
10:15
🔗
|
godane |
2nd problem is i think there uploaded in run here: https://archive.org/details/stokes0357 |
10:16
🔗
|
godane |
my videos are encoded into mpeg2 or about 90 minutes per disk in size |
10:16
🔗
|
godane |
those quicktime videos are raw dump of the video tape |
10:43
🔗
|
|
chirlu has quit IRC (Read error: Operation timed out) |
11:29
🔗
|
VoynichCr |
if i code a ircbot for snscrape, could anyone run it on his server? |
11:32
🔗
|
VoynichCr |
i mean, my server hasnt python 3.6 (snscrape requirement), so i can't run it myself |
12:02
🔗
|
jut |
I could I have a server sitting mostly idle |
12:09
🔗
|
|
VoynichCr has quit IRC (Connection closed) |
12:12
🔗
|
kiska |
I could as well |
12:42
🔗
|
|
n00b422 has joined #archiveteam-ot |
12:43
🔗
|
n00b422 |
tried to test the bot, and got banned because i was in hetzner ip range |
12:47
🔗
|
|
n00b422 is now known as VoynicSad |
12:50
🔗
|
VoynicSad |
can i get unbanned by user@host or efnet bans whole ranges and forget about it? |
12:54
🔗
|
|
dhyan_nat has joined #archiveteam-ot |
13:24
🔗
|
JAA |
VoynicSad: What's the IP? |
13:25
🔗
|
JAA |
There was a spam wave a while ago, and I think we had to ban a few IP ranges there. |
13:26
🔗
|
JAA |
If you weren't able to connect to EFnet at all (as opposed to being unable to join the channel), then you'll need to use a different server. |
13:26
🔗
|
JAA |
a different EFnet server* |
13:33
🔗
|
VoynicSad |
JAA: check pm |
13:42
🔗
|
|
icedice has joined #archiveteam-ot |
14:07
🔗
|
Igloo |
did you get this working VoynicSad ? I did start writing one |
14:08
🔗
|
VoynicSad |
Igloo: yes, i had a very simple version, though i didn't test it |
14:32
🔗
|
|
VoynicSad has quit IRC (Quit: Page closed) |
15:14
🔗
|
jrwr |
arkiver: How does the ingress to IA from me doing? |
15:14
🔗
|
jrwr |
for GPlus :) |
15:20
🔗
|
JAA |
#googleminus ? |
15:24
🔗
|
* |
jrwr digs in the tabs he has in his IRC client |
15:25
🔗
|
jrwr |
I am in far too many servers/channels |
15:28
🔗
|
jrwr |
Ah, I am in that channel |
15:58
🔗
|
Igloo |
Anyone know what the hurricane electric peering into IA is? |
15:58
🔗
|
Igloo |
Is it more than 4G? |
15:59
🔗
|
kiska |
Apparently its 40G, from what I heard |
15:59
🔗
|
Igloo |
OVH CA through HE (all appears to be 100G) is realising a glorious 30Mbps today |
16:00
🔗
|
kiska |
Did we crash another haproxy? xD |
16:01
🔗
|
Igloo |
Sometimes as low as 1.5Mbps |
16:01
🔗
|
Igloo |
:P |
16:01
🔗
|
Igloo |
Dunno, Somethings b0rk |
16:03
🔗
|
jrwr |
We do like to make things explode around here |
16:07
🔗
|
JAA |
We're IA's QA testing department, so to say. |
16:07
🔗
|
Kaz |
yeah that link isn't going to be your problem |
16:09
🔗
|
kiska |
We blew up many haproxies during g- :P |
16:11
🔗
|
Igloo |
https://pastebin.com/373t3RQ6 |
16:12
🔗
|
kiska |
Ooops sorry, HE is 100G |
16:12
🔗
|
Igloo |
*into* IA? |
16:12
🔗
|
Igloo |
Well shit, That traceroute is 100G throughout then |
16:12
🔗
|
Igloo |
So It should be flying |
16:12
🔗
|
Kaz |
well, no guarantee that the IA side is 100G, unless someone's done enough weathermap digging to work that out |
16:12
🔗
|
kiska |
Except that HAProxies are somewhat dead xD |
16:13
🔗
|
Igloo |
IA side is doing around 5G at the minute |
16:13
🔗
|
Igloo |
But then I don't watch it to see it going up |
16:14
🔗
|
JAA |
It's doing 3.8 Gb/s into IA at the moment and marked as 1-10 % load. |
16:15
🔗
|
kiska |
Internet to IA is et interface, so should be 100G interface |
16:15
🔗
|
kiska |
IA(Internet) to Paul is an ae interface so should be 40G(I think) |
16:16
🔗
|
Kaz |
HE link on IA side could be 40G |
16:16
🔗
|
Kaz |
push the link over 4g and you'll be able to tell |
16:17
🔗
|
kiska |
According to the documentation: "et—100-Gigabit Ethernet interfaces (10, 40, and 100-Gigabit Ethernet interface for PTX Series Packet Transport Routers only)." |
16:17
🔗
|
kiska |
So xD |
16:17
🔗
|
Kaz |
did you just quote what I sent you back to me |
16:17
🔗
|
kiska |
Yep xD |
16:17
🔗
|
Kaz |
I'm reading that as 'could be 10,40,100' anyway |
16:17
🔗
|
kiska |
But its also not discord :O |
16:18
🔗
|
Kaz |
it's not 10, because weathermap should show the link being hotter |
16:18
🔗
|
kiska |
Damn fat fingers |
16:18
🔗
|
Igloo |
If it was 10, it would be 38% |
16:18
🔗
|
Igloo |
Not 1-10 |
16:19
🔗
|
Igloo |
So, I would suggest it's 100G |
16:19
🔗
|
Igloo |
Or at least the weathermap has been configured to be so |
16:19
🔗
|
Igloo |
OVH just came back and said "use our internal proof server to check you're geting your speed". Which ofcourse works fine ¬_¬ |
16:20
🔗
|
Kaz |
can't rule out 40G until the link goes over 4g though, was my point |
16:21
🔗
|
kiska |
I doubt we'd be able to push anywhere near that link capability anyway |
16:21
🔗
|
JAA |
How would pushing 4 Gb/s rule out a 40 Gb/s connection? |
16:21
🔗
|
JAA |
Even 4 GB/s is still below 40 Gb/s. |
16:22
🔗
|
Kaz |
because that'll tip weathermap over 10%, and thus update the colour |
16:22
🔗
|
JAA |
Ah |
16:22
🔗
|
JAA |
Yeah, right. |
16:22
🔗
|
Kaz |
I guess to be same, call it 4400MBit/s, so 11% |
16:22
🔗
|
Kaz |
s/same/safe |
16:25
🔗
|
Igloo |
Either way, tracing it through the weathermaps it should be running a damn site faster. |
16:26
🔗
|
|
Stilettoo is now known as Stiletto |
16:34
🔗
|
Igloo |
It could be IA ingress having a fit |
16:34
🔗
|
Igloo |
as another host (in the UK) is also being slow as |
16:35
🔗
|
Igloo |
Sorry not UK, Germany I think |
17:03
🔗
|
Igloo |
Just to close this out; i've tried from yet another server, this time in Helsinki. |
17:03
🔗
|
Igloo |
Again, reaaaaaaaaaally slow |
17:03
🔗
|
Igloo |
So assuming an IA problem. |
17:10
🔗
|
ivan |
Igloo: are you using BBR |
17:10
🔗
|
Igloo |
BBR? |
17:11
🔗
|
kiska |
https://www.archiveteam.org/index.php?title=Internet_Archive#Upload_speed |
17:11
🔗
|
ivan |
https://cloud.google.com/blog/products/gcp/tcp-bbr-congestion-control-comes-to-gcp-your-internet-just-got-faster |
17:12
🔗
|
ivan |
you mostly need net.core.default_qdisc=fq net.ipv4.tcp_congestion_control=bbr |
17:13
🔗
|
Igloo |
I'll enable it and see |
17:14
🔗
|
|
icedice2 has joined #archiveteam-ot |
17:15
🔗
|
Igloo |
One of them was already ivan |
17:15
🔗
|
|
wp494 has quit IRC (Read error: Operation timed out) |
17:15
🔗
|
Igloo |
That was actually the worst server |
17:15
🔗
|
|
wp494 has joined #archiveteam-ot |
17:20
🔗
|
|
icedice has quit IRC (Read error: Operation timed out) |
18:01
🔗
|
|
icedice2 has quit IRC (Leaving) |
18:02
🔗
|
|
icedice has joined #archiveteam-ot |
18:28
🔗
|
|
systwi has quit IRC (Read error: Operation timed out) |
18:33
🔗
|
|
systwi has joined #archiveteam-ot |
18:35
🔗
|
|
icedice has quit IRC (Leaving) |
18:35
🔗
|
|
icedice has joined #archiveteam-ot |
18:49
🔗
|
|
systwi_ has joined #archiveteam-ot |
18:50
🔗
|
systwi_ |
Can anyone read this? |
18:50
🔗
|
|
systwi_ has quit IRC (Client Quit) |
18:51
🔗
|
|
systwi_ has joined #archiveteam-ot |
18:51
🔗
|
|
systwi has quit IRC (Read error: Operation timed out) |
18:52
🔗
|
|
systwi_ has quit IRC (Client Quit) |
18:54
🔗
|
|
systwi has joined #archiveteam-ot |
18:55
🔗
|
kiska |
yeah why? |
19:09
🔗
|
|
systwi has quit IRC (Read error: Operation timed out) |
20:00
🔗
|
SketchCow |
Just to mention, we did two major hardware upgrades of networking recently. |
20:06
🔗
|
Igloo |
Seems since then access to s3 has been a bit off SketchCow |
20:10
🔗
|
SketchCow |
Possibly |
20:10
🔗
|
Igloo |
I'll leave it a while and see what happens then :) Thankyou for letting us know |
20:14
🔗
|
|
VoynichCr has joined #archiveteam-ot |
20:30
🔗
|
|
Odd0002_ has joined #archiveteam-ot |
20:33
🔗
|
|
Odd0002 has quit IRC (Read error: Operation timed out) |
20:33
🔗
|
|
Odd0002_ is now known as Odd0002 |
20:39
🔗
|
|
Stranger_ has joined #archiveteam-ot |
20:52
🔗
|
|
Hani111 has joined #archiveteam-ot |
20:57
🔗
|
|
Hani has quit IRC (Ping timeout: 615 seconds) |
20:57
🔗
|
|
Hani111 is now known as Hani |
22:12
🔗
|
|
dhyan_nat has quit IRC (Read error: Operation timed out) |
22:48
🔗
|
|
Stranger_ has left |
23:09
🔗
|
|
killsushi has joined #archiveteam-ot |