#archiveteam-ot 2018-12-20,Thu

↑back Search

Time Nickname Message
00:17 🔗 bithippo has quit IRC (Textual IRC Client: www.textualapp.com)
00:20 🔗 s4t has joined #archiveteam-ot
00:26 🔗 s4t has quit IRC (Quit: s4t)
01:01 🔗 Stilett0 has quit IRC ()
01:12 🔗 Stiletto has joined #archiveteam-ot
01:27 🔗 Stiletto has quit IRC ()
01:35 🔗 ubahn has joined #archiveteam-ot
01:35 🔗 Stiletto has joined #archiveteam-ot
02:42 🔗 ubahn has quit IRC (Quit: ubahn)
02:44 🔗 ubahn has joined #archiveteam-ot
03:10 🔗 ubahn has quit IRC (ubahn)
03:33 🔗 degauss has quit IRC (Quit: gtg 73)
04:10 🔗 odemg has quit IRC (Ping timeout: 265 seconds)
04:22 🔗 odemg has joined #archiveteam-ot
04:56 🔗 Mateon1 has quit IRC (Ping timeout: 265 seconds)
04:56 🔗 Mateon1 has joined #archiveteam-ot
06:34 🔗 kiska1 has quit IRC (Ping timeout (120 seconds))
06:34 🔗 wmvhater has quit IRC (Ping timeout (120 seconds))
06:36 🔗 wmvhater has joined #archiveteam-ot
06:36 🔗 kiska1 has joined #archiveteam-ot
07:30 🔗 wp494 has quit IRC (Read error: Operation timed out)
07:31 🔗 wp494 has joined #archiveteam-ot
07:32 🔗 svchfoo3 sets mode: +o wp494
07:51 🔗 surewhyno has joined #archiveteam-ot
08:20 🔗 teej_ psi: You can also use grab-site.
08:20 🔗 teej_ Goodnight.
08:20 🔗 psi Hm?
08:20 🔗 psi Did you mean to ping s4t
08:21 🔗 teej_ psi: Oh. Whoops. I'm sorry.
08:21 🔗 teej_ s4t: You can also use grab-site.
08:21 🔗 teej_ Great. They left.
08:21 🔗 teej_ Oh well.
08:22 🔗 teej_ Goodnight.
09:05 🔗 jspiros has quit IRC (Read error: Operation timed out)
09:06 🔗 jspiros has joined #archiveteam-ot
10:37 🔗 anarcat has quit IRC (Read error: Operation timed out)
10:37 🔗 anarcat has joined #archiveteam-ot
11:29 🔗 surewhyno has quit IRC (Quit: leaving)
11:46 🔗 BlueMax has quit IRC (Quit: Leaving)
12:08 🔗 degauss has joined #archiveteam-ot
12:28 🔗 _niklas has joined #archiveteam-ot
13:23 🔗 sardine has joined #archiveteam-ot
13:28 🔗 sardine1 has joined #archiveteam-ot
13:31 🔗 sardine has quit IRC (Read error: Operation timed out)
14:23 🔗 VerifiedJ has joined #archiveteam-ot
15:30 🔗 JAA SpiderOak is discontinuing their "unlimited" plans because they figured out they can't actually provide unlimited storage for that price. Duh.
16:04 🔗 anarcat backblaze still is "unlimited"
16:04 🔗 anarcat but i suspect their fineprint limits that severely
16:11 🔗 JAA Nope, someone on /r/DataHoarder posted an exchange with the Backblaze support a while ago where they said that a few hundred TB are not a problem for them.
16:11 🔗 JAA But I've heard that restoring from Backblaze is terrible. Also, there's still no Linux support.
16:12 🔗 JAA Here's that DH post: https://old.reddit.com/r/DataHoarder/comments/6vzu3d/backblaze_casually_told_me_backing_up_282tb/
16:14 🔗 svchfoo3 has quit IRC (Read error: Operation timed out)
16:14 🔗 kbtoo_ has quit IRC (Read error: Connection reset by peer)
16:16 🔗 kbtoo has joined #archiveteam-ot
16:21 🔗 ubahn has joined #archiveteam-ot
16:27 🔗 wp494 has quit IRC (Ping timeout: 268 seconds)
16:27 🔗 wp494 has joined #archiveteam-ot
16:28 🔗 svchfoo1 sets mode: +o wp494
16:34 🔗 sardine1 what the heck is a "run-pipeline" and how do I get it into bash
16:34 🔗 sardine1 I'm really confused there's absolutely nothing that explains what this means
16:34 🔗 sardine1 (https://github.com/ArchiveTeam/terroroftinytown-client-grab)
16:35 🔗 _niklas run-pipeline is a command in the seesaw python package
16:35 🔗 _niklas (which was written specifically for this)
16:36 🔗 _niklas it's little more than a wrapper around the pipeline.py in there
17:25 🔗 m007a83_ has joined #archiveteam-ot
17:28 🔗 m007a83_ has quit IRC (Client Quit)
17:29 🔗 m007a83_ has joined #archiveteam-ot
17:30 🔗 m007a83 has quit IRC (Read error: Operation timed out)
17:30 🔗 m007a83_ is now known as m007a83
17:53 🔗 Dj-Wawa has joined #archiveteam-ot
18:06 🔗 ubahn has quit IRC (Quit: ubahn)
18:23 🔗 sardine1 has quit IRC (Quit: Leaving.)
18:45 🔗 psi this is nice. i like this https://usercontent.irccloud-cdn.com/file/gUmSD9Qe/image.png
18:48 🔗 Jens has quit IRC (Remote host closed the connection)
18:49 🔗 Jens has joined #archiveteam-ot
19:15 🔗 ubahn has joined #archiveteam-ot
19:20 🔗 schbirid has quit IRC (Remote host closed the connection)
19:26 🔗 pnJay what setup is that psi
19:26 🔗 pnJay idk much about docker
19:26 🔗 psi Portainer
19:27 🔗 psi It connects to the Docker daemon over TCP with TLS and allows you to manage multiple machines at once
19:28 🔗 pnJay Whoa. Rad.
19:36 🔗 ubahn has quit IRC (ubahn)
19:43 🔗 psi Also, I just found out Certbot exists. That certainly makes things a lot easier to HTTPS
19:48 🔗 teej_ yano: So why do you burn the Google credit?
19:48 🔗 teej_ Why not save it?
19:48 🔗 teej_ is now known as t3
19:52 🔗 yano t3: it only lasts for 365 days
19:52 🔗 yano and it's $300 per google account
19:52 🔗 yano actually, i just found out that my one google account has a balance I owe
19:52 🔗 yano but it's only $45
19:52 🔗 yano i couldn't afford to run all of these for a whole month
19:53 🔗 yano each of them are anywhere from $200 to $300/mo
19:53 🔗 yano "You'll be charged when your balance reaches $100.00 or 30 days after your last automatic payment, whichever comes first."
19:57 🔗 t3 yano: So make sure you're not charged.
19:57 🔗 yano t3: yeah, i'm setting up alerts
19:57 🔗 yano and my other 3 google accounts still have money left
19:57 🔗 yano the one has $90 left, $26 left, and $45 left
19:59 🔗 _niklas how time-accurate are those alerts
20:00 🔗 _niklas if they update that once a day like some cloud providers do (with regular billing information)...
20:00 🔗 yano _niklas: it looks like once an hour
20:01 🔗 yano and that's not ad, considering each machine is $0.45/hr
20:01 🔗 yano *not bad
20:01 🔗 _niklas billing alerts may up differently than the numbers you see on the web console
20:02 🔗 _niklas I believe aws's do, in your benefit
20:05 🔗 yano does this work anymore? https://gist.github.com/JustAnotherArchivist/f4617c902626377532692a341794f273
20:10 🔗 yano wait, got it
20:10 🔗 t3 It didn't work for me on macOS.
20:11 🔗 t3 Have you ever seen a ninja wedding?
20:11 🔗 t3 Or a fart website?
20:16 🔗 yano lol:
20:16 🔗 yano # ./tumblr-monitor.sh | sort -k 4,4n
20:16 🔗 yano -su: fork: Cannot allocate memory
20:17 🔗 yano oops
20:48 🔗 tuluu has quit IRC (Ping timeout: 260 seconds)
21:30 🔗 t3 MrRadar2: Oh.
21:30 🔗 t3 So why not have many more folders?
21:30 🔗 MrRadar2 Well, that's the solution
21:30 🔗 MrRadar2 Split your files up in to folders
21:30 🔗 t3 What's the difference?
21:30 🔗 t3 I thought files and directories are the same.
21:31 🔗 _niklas the data structures are typically chosen to handle the typical case well
21:31 🔗 MrRadar2 If a folder has 100 sub-folders, and those sub-folders have 100 more sub-folders which each have 100 files you have 1 million files
21:31 🔗 MrRadar2 However each time you access each folder the FS only needs to look at 100 items, so you only need to look at 300 items to find any given file
21:32 🔗 t3 Oh... now it makes sense.
21:32 🔗 MrRadar2 Whereas if you just had 1,000,000 files in a single folder it may need to look through all of them to find the one you're looking for
21:33 🔗 MrRadar2 Yeah, it's the power of tree-style data structures
21:33 🔗 t3 MrRadar2: Why not have a file system that chunks data alphabetically, so if you're looking at a file with string "myfile.txt", then it will look through "m", and then find the ones with "y" and so on?
21:33 🔗 t3 Wouldn't that be much more efficient?
21:34 🔗 MrRadar2 File systems do do things like that (I'm not an expect on them myself so I couldn't tell you the details) but that runs into the issue that when you're adding stuff it can become expensive to keep all the data sorted
21:35 🔗 t3 MrRadar2: Oh. That makes sense.
21:36 🔗 t3 This is complicated stuff.
21:36 🔗 MrRadar2 Yep. :) There's a reason why people are always writing new file systems
22:11 🔗 edisded The google free credit is supposed to let you know before you start actually getting charged
22:11 🔗 edisded At least it does here in Canada
22:19 🔗 BlueMax has joined #archiveteam-ot
22:36 🔗 dataorc has joined #archiveteam-ot
22:50 🔗 s4t has joined #archiveteam-ot
22:54 🔗 BlueMax has quit IRC (Quit: Leaving)
22:58 🔗 s4t has quit IRC (Quit: s4t)
23:17 🔗 VerifiedJ has quit IRC (Quit: Leaving)
23:28 🔗 t3 edisded: Okay.

irclogger-viewer