#archiveteam-ot 2019-06-10,Mon

↑back Search

Time Nickname Message
01:53 🔗 DogsRNice has quit IRC (Read error: Connection reset by peer)
03:19 🔗 cfarquhar has quit IRC (Read error: Operation timed out)
03:19 🔗 cfarquhar has joined #archiveteam-ot
03:31 🔗 odemg has quit IRC (Ping timeout: 265 seconds)
03:43 🔗 odemg has joined #archiveteam-ot
05:03 🔗 dhyan_nat has joined #archiveteam-ot
06:12 🔗 BlueMax has quit IRC (Quit: Leaving)
06:47 🔗 dhyan_nat has quit IRC (Read error: Operation timed out)
06:51 🔗 ColdIce has joined #archiveteam-ot
06:54 🔗 Fusl i have a couple of servers at home idling around, at least two of them completely empty and ready to be loaded with whatever projects i can do. both have pretty decent cpus, one of them has 80gb memory, four 1.2TB SSHD drives, four shitty 480GB SSDs, two ZFS pools, one for SSHD and one for SSD, the other one has 48gb memory, three 4tb drives, one 3tb drive, all HDDs in a mergerfs "raid0" mount. i'm looking
06:54 🔗 Fusl for a large project to run, doesn't necessarily have to be archiveteam related but should not cause much upload bandwidth either, i only have 100 mbit/s up. IA.BAK is out, too unstable and it's a half dead project. urlteam not really useful on two ip addresses and is already running + happily getting my two ips banned on the commercial url shorteners. newsgrabber uses too much upload bandwidth. anyone got
06:54 🔗 Fusl an idea what else i can try helping at with those idlers?
06:56 🔗 Fusl side note: both those servers are on the telegraf grafana dashboard, they under my username and called kaede and mariko
06:57 🔗 Flashfire Any BOINC projects might work. if enigma has any work that is an interesting project
06:57 🔗 Flashfire there is also SETI@home of course
06:57 🔗 Fusl i never claimed that those are power efficient cpus
06:57 🔗 Fusl they are not. not at all.
06:57 🔗 Fusl xeon x5650 and xeon e5620
06:58 🔗 Flashfire ah ok so nothing high CPU intensive
06:58 🔗 Flashfire If you set one up on just one BOINC project that interests you with only 30% CPU allocation
06:58 🔗 Fusl yeah, i mean, if it can't be avoided like IA.BAK sometimes uses lots of cpu when running the checksum, thats okay but only if the entire system is used otherwise and not just for cpu stuff
07:34 🔗 Fusl_ https://hyperallergic.com/503528/recorder-marion-stokes-documentary/
07:41 🔗 BlueMax has joined #archiveteam-ot
08:02 🔗 Flashfire I wonder if Godane will end up with some of those tapes
08:02 🔗 Igloo Fusl can I suggest maybe the new home for the newsbuddy master?
08:02 🔗 Igloo Doesn't do much upload, a little ingress
08:03 🔗 Igloo Unless you want a set and leave kinda deal?
08:03 🔗 Igloo (Current master is overpowered for running just the control aspect, and upload to IA is useless for the rest)
08:09 🔗 Fusl_ Igloo: i can give youbssh access to a vm on both machines id you want and set up port forwardings to them
08:09 🔗 Fusl_ if you want to run it as newsbuddy master
08:09 🔗 Fusl_ but i personally prefer set and forget
08:09 🔗 BlueMax has quit IRC (Quit: Leaving)
08:11 🔗 Igloo Understood, I am currently working on a brand new warrior; which is a docker manager
08:11 🔗 Igloo that would be ideal
08:11 🔗 Igloo But it's going to take some time
09:44 🔗 Ryz has quit IRC (Remote host closed the connection)
10:12 🔗 godane Flashfire: i have not got any of those tapes yet
10:13 🔗 godane first i need to be able to grab close caption from vhs tapes which i have not been able to do yet
10:14 🔗 godane or know how to do
10:15 🔗 godane 2nd problem is i think there uploaded in run here: https://archive.org/details/stokes0357
10:16 🔗 godane my videos are encoded into mpeg2 or about 90 minutes per disk in size
10:16 🔗 godane those quicktime videos are raw dump of the video tape
10:43 🔗 chirlu has quit IRC (Read error: Operation timed out)
11:29 🔗 VoynichCr if i code a ircbot for snscrape, could anyone run it on his server?
11:32 🔗 VoynichCr i mean, my server hasnt python 3.6 (snscrape requirement), so i can't run it myself
12:02 🔗 jut I could I have a server sitting mostly idle
12:09 🔗 VoynichCr has quit IRC (Connection closed)
12:12 🔗 kiska I could as well
12:42 🔗 n00b422 has joined #archiveteam-ot
12:43 🔗 n00b422 tried to test the bot, and got banned because i was in hetzner ip range
12:47 🔗 n00b422 is now known as VoynicSad
12:50 🔗 VoynicSad can i get unbanned by user@host or efnet bans whole ranges and forget about it?
12:54 🔗 dhyan_nat has joined #archiveteam-ot
13:24 🔗 JAA VoynicSad: What's the IP?
13:25 🔗 JAA There was a spam wave a while ago, and I think we had to ban a few IP ranges there.
13:26 🔗 JAA If you weren't able to connect to EFnet at all (as opposed to being unable to join the channel), then you'll need to use a different server.
13:26 🔗 JAA a different EFnet server*
13:33 🔗 VoynicSad JAA: check pm
13:42 🔗 icedice has joined #archiveteam-ot
14:07 🔗 Igloo did you get this working VoynicSad ? I did start writing one
14:08 🔗 VoynicSad Igloo: yes, i had a very simple version, though i didn't test it
14:32 🔗 VoynicSad has quit IRC (Quit: Page closed)
15:14 🔗 jrwr arkiver: How does the ingress to IA from me doing?
15:14 🔗 jrwr for GPlus :)
15:20 🔗 JAA #googleminus ?
15:24 🔗 * jrwr digs in the tabs he has in his IRC client
15:25 🔗 jrwr I am in far too many servers/channels
15:28 🔗 jrwr Ah, I am in that channel
15:58 🔗 Igloo Anyone know what the hurricane electric peering into IA is?
15:58 🔗 Igloo Is it more than 4G?
15:59 🔗 kiska Apparently its 40G, from what I heard
15:59 🔗 Igloo OVH CA through HE (all appears to be 100G) is realising a glorious 30Mbps today
16:00 🔗 kiska Did we crash another haproxy? xD
16:01 🔗 Igloo Sometimes as low as 1.5Mbps
16:01 🔗 Igloo :P
16:01 🔗 Igloo Dunno, Somethings b0rk
16:03 🔗 jrwr We do like to make things explode around here
16:07 🔗 JAA We're IA's QA testing department, so to say.
16:07 🔗 Kaz yeah that link isn't going to be your problem
16:09 🔗 kiska We blew up many haproxies during g- :P
16:11 🔗 Igloo https://pastebin.com/373t3RQ6
16:12 🔗 kiska Ooops sorry, HE is 100G
16:12 🔗 Igloo *into* IA?
16:12 🔗 Igloo Well shit, That traceroute is 100G throughout then
16:12 🔗 Igloo So It should be flying
16:12 🔗 Kaz well, no guarantee that the IA side is 100G, unless someone's done enough weathermap digging to work that out
16:12 🔗 kiska Except that HAProxies are somewhat dead xD
16:13 🔗 Igloo IA side is doing around 5G at the minute
16:13 🔗 Igloo But then I don't watch it to see it going up
16:14 🔗 JAA It's doing 3.8 Gb/s into IA at the moment and marked as 1-10 % load.
16:15 🔗 kiska Internet to IA is et interface, so should be 100G interface
16:15 🔗 kiska IA(Internet) to Paul is an ae interface so should be 40G(I think)
16:16 🔗 Kaz HE link on IA side could be 40G
16:16 🔗 Kaz push the link over 4g and you'll be able to tell
16:17 🔗 kiska According to the documentation: "et—100-Gigabit Ethernet interfaces (10, 40, and 100-Gigabit Ethernet interface for PTX Series Packet Transport Routers only)."
16:17 🔗 kiska So xD
16:17 🔗 Kaz did you just quote what I sent you back to me
16:17 🔗 kiska Yep xD
16:17 🔗 Kaz I'm reading that as 'could be 10,40,100' anyway
16:17 🔗 kiska But its also not discord :O
16:18 🔗 Kaz it's not 10, because weathermap should show the link being hotter
16:18 🔗 kiska Damn fat fingers
16:18 🔗 Igloo If it was 10, it would be 38%
16:18 🔗 Igloo Not 1-10
16:19 🔗 Igloo So, I would suggest it's 100G
16:19 🔗 Igloo Or at least the weathermap has been configured to be so
16:19 🔗 Igloo OVH just came back and said "use our internal proof server to check you're geting your speed". Which ofcourse works fine ¬_¬
16:20 🔗 Kaz can't rule out 40G until the link goes over 4g though, was my point
16:21 🔗 kiska I doubt we'd be able to push anywhere near that link capability anyway
16:21 🔗 JAA How would pushing 4 Gb/s rule out a 40 Gb/s connection?
16:21 🔗 JAA Even 4 GB/s is still below 40 Gb/s.
16:22 🔗 Kaz because that'll tip weathermap over 10%, and thus update the colour
16:22 🔗 JAA Ah
16:22 🔗 JAA Yeah, right.
16:22 🔗 Kaz I guess to be same, call it 4400MBit/s, so 11%
16:22 🔗 Kaz s/same/safe
16:25 🔗 Igloo Either way, tracing it through the weathermaps it should be running a damn site faster.
16:26 🔗 Stilettoo is now known as Stiletto
16:34 🔗 Igloo It could be IA ingress having a fit
16:34 🔗 Igloo as another host (in the UK) is also being slow as
16:35 🔗 Igloo Sorry not UK, Germany I think
17:03 🔗 Igloo Just to close this out; i've tried from yet another server, this time in Helsinki.
17:03 🔗 Igloo Again, reaaaaaaaaaally slow
17:03 🔗 Igloo So assuming an IA problem.
17:10 🔗 ivan Igloo: are you using BBR
17:10 🔗 Igloo BBR?
17:11 🔗 kiska https://www.archiveteam.org/index.php?title=Internet_Archive#Upload_speed
17:11 🔗 ivan https://cloud.google.com/blog/products/gcp/tcp-bbr-congestion-control-comes-to-gcp-your-internet-just-got-faster
17:12 🔗 ivan you mostly need net.core.default_qdisc=fq net.ipv4.tcp_congestion_control=bbr
17:13 🔗 Igloo I'll enable it and see
17:14 🔗 icedice2 has joined #archiveteam-ot
17:15 🔗 Igloo One of them was already ivan
17:15 🔗 wp494 has quit IRC (Read error: Operation timed out)
17:15 🔗 Igloo That was actually the worst server
17:15 🔗 wp494 has joined #archiveteam-ot
17:20 🔗 icedice has quit IRC (Read error: Operation timed out)
18:01 🔗 icedice2 has quit IRC (Leaving)
18:02 🔗 icedice has joined #archiveteam-ot
18:28 🔗 systwi has quit IRC (Read error: Operation timed out)
18:33 🔗 systwi has joined #archiveteam-ot
18:35 🔗 icedice has quit IRC (Leaving)
18:35 🔗 icedice has joined #archiveteam-ot
18:49 🔗 systwi_ has joined #archiveteam-ot
18:50 🔗 systwi_ Can anyone read this?
18:50 🔗 systwi_ has quit IRC (Client Quit)
18:51 🔗 systwi_ has joined #archiveteam-ot
18:51 🔗 systwi has quit IRC (Read error: Operation timed out)
18:52 🔗 systwi_ has quit IRC (Client Quit)
18:54 🔗 systwi has joined #archiveteam-ot
18:55 🔗 kiska yeah why?
19:09 🔗 systwi has quit IRC (Read error: Operation timed out)
20:00 🔗 SketchCow Just to mention, we did two major hardware upgrades of networking recently.
20:06 🔗 Igloo Seems since then access to s3 has been a bit off SketchCow
20:10 🔗 SketchCow Possibly
20:10 🔗 Igloo I'll leave it a while and see what happens then :) Thankyou for letting us know
20:14 🔗 VoynichCr has joined #archiveteam-ot
20:30 🔗 Odd0002_ has joined #archiveteam-ot
20:33 🔗 Odd0002 has quit IRC (Read error: Operation timed out)
20:33 🔗 Odd0002_ is now known as Odd0002
20:39 🔗 Stranger_ has joined #archiveteam-ot
20:52 🔗 Hani111 has joined #archiveteam-ot
20:57 🔗 Hani has quit IRC (Ping timeout: 615 seconds)
20:57 🔗 Hani111 is now known as Hani
22:12 🔗 dhyan_nat has quit IRC (Read error: Operation timed out)
22:48 🔗 Stranger_ has left
23:09 🔗 killsushi has joined #archiveteam-ot

irclogger-viewer