[00:35] *** BlueMax has quit IRC (Read error: Connection reset by peer) [00:56] *** retnl has joined #archiveteam-ot [01:29] How much spare space should I keep on a 6TB HDD that is not my system drive? [01:30] icedice: depends on the filesystem and how much rewriting you plan to do [01:31] NTFS [01:32] at least 100GB I guess [01:32] you can see how bad defragmentation gets when near full with defrag [01:32] s/de// [01:35] Ok, I looked around a bit online and most seem to say that at the very least 10%, preferably 15%, and 20% if you want to be cautious [01:35] But that's probably calculated to normie HDD capacities and not 6TB HDDs [01:35] So I guess I'd get away with less percentages than that [01:35] yes [01:36] *** cfarquhar has quit IRC (Read error: Operation timed out) [01:36] 19.3% free space left [01:37] So I should have some time to do a digital detox eventually of a bunch of old stuff that I don't need anymore [01:40] https://old.reddit.com/r/DataHoarder/comments/2kns0j/how_much_free_space_does_everyone_leave_on/ [01:44] *** cfarquhar has joined #archiveteam-ot [02:28] *** kbtoo has joined #archiveteam-ot [02:32] *** schbirid2 has joined #archiveteam-ot [02:32] *** SketchCo1 has joined #archiveteam-ot [02:33] *** marked has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** kbtoo__ has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** Oddly has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** schbirid has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** SketchCow has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** zino has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** chirlu has quit IRC (west.us.hub irc.Prison.NET) [02:33] *** betamax has quit IRC (west.us.hub irc.Prison.NET) [02:34] *** Oddly2 has joined #archiveteam-ot [02:34] *** chirlu` has joined #archiveteam-ot [02:35] *** zino_ has joined #archiveteam-ot [02:35] *** betamax_ has joined #archiveteam-ot [02:51] *** marked has joined #archiveteam-ot [02:52] *** marked has quit IRC (west.us.hub irc.Prison.NET) [02:52] Netsplit rejoin before netsplit quit? [02:53] EFNet surprises me every day. [03:03] I still don't understand how netsplits work [03:03] makes no sense to me [03:05] *** marked has joined #archiveteam-ot [03:13] *** mr_archiv has quit IRC (Ping timeout: 615 seconds) [03:15] *** odemg has quit IRC (Ping timeout: 615 seconds) [03:15] *** dhyan_nat has joined #archiveteam-ot [03:22] *** odemg has joined #archiveteam-ot [03:22] *** odemg has quit IRC (Connection closed) [03:52] ealgase: I'll explain it. [03:53] So your client connects to an IRC server. [03:53] There are many servers on the network. [03:54] I might be connected to a different IRC server on the EFnet network. [03:54] When you send messages, the data is transferred between servers to the other servers on the network. [03:55] When a connection between two servers is lost, it is called a net split. [03:55] ah ok [03:55] why would the connection be lost? [03:56] All of the people on your server connection would stay online and everyone else would appear to go offline. [03:57] Likewise, everyone on the server I am on would appear to stay online, and everyone from the other side would appear to go offline. [03:57] *** mr_archiv has joined #archiveteam-ot [03:57] That is why it is called net-split. [03:57] ah ok [03:57] https://en.wikipedia.org/wiki/Netsplit [03:57] that does make sense [03:57] Yeah... or you could have just read the Wikipedia article. [03:58] "why would the connection be lost", heh [03:58] well I mean, I guess I'm not understanding what type of connection this is [03:58] It's just a TCP connection. More or less the same thing as between our clients and the server(s). [03:58] Ah, that makes sense [03:59] I was thinking more of the email method which doesn't require a persistent connection [03:59] Yeah, that would neither scale nor be real-time. [04:00] Pretty sure that Matrix uses a model like that [04:01] also, one question I've had about irc for a while is [04:01] what keeps, say, freenode and efnet seperate? [04:02] do they blacklist each other? [04:02] No connection between the servers, plain and simple. [04:02] ah ok, so they're just not connected [04:03] Pretty sure that the servers need to be whitelisted in some way in order to be able to connect to a network. [04:03] That makes sense [04:03] So you can't simply run your own EFNet server. [04:03] You can, but not that simply. [04:03] And presumably neither would the EFNet folks want to have the Freenode servers in the network nor the other way around. [04:04] It would create all sorts of headaches due to channel and nick collisions, different policies, absence of NickServ/ChanServ on EFNet, etc. [04:06] Right. The servers must be configured the same or similar way for there to be fewer conflicts. [04:08] ok, but it's not *impossible* for them to federate, they just choose not to [04:08] Theoretically, it could be done. [04:08] https://en.wikipedia.org/wiki/EFnet was the original IRC network before they started splitting [04:08] I'm sure there are some bridges as well for individual channels. [04:09] hah TIL "Eris-Free Network" [04:10] Yup because eris.berkeley.edu was misbehaving. [04:11] honestly I'm too young for IRC, because my friend's parents *met* over IRC [04:14] *** ColdIce has quit IRC (Remote host closed the connection) [04:14] *** ColdIce has joined #archiveteam-ot [04:26] *** MR9K4 has quit IRC (Read error: Operation timed out) [04:26] *** ivan has quit IRC (Write error: Broken pipe) [04:26] *** dxrt_ has quit IRC (Write error: Broken pipe) [04:26] *** ealgase has quit IRC (Read error: Operation timed out) [04:26] *** Stiletto has quit IRC (Read error: Operation timed out) [04:26] *** kiska1 has quit IRC (Read error: Operation timed out) [04:26] *** paul2520 has quit IRC (Write error: Broken pipe) [04:26] *** chfoo has quit IRC (Read error: Operation timed out) [04:26] *** MR9K4 has joined #archiveteam-ot [04:26] *** gandalf has quit IRC (Read error: Operation timed out) [04:26] *** chfoo has joined #archiveteam-ot [04:26] *** Fusl sets mode: +o chfoo [04:26] *** gandalf has joined #archiveteam-ot [04:27] *** robogoat has quit IRC (Read error: Operation timed out) [04:27] *** ivan has joined #archiveteam-ot [04:27] *** Stiletto has joined #archiveteam-ot [04:27] *** mal_ has quit IRC (Write error: Broken pipe) [04:27] *** Odd0002 has quit IRC (Read error: Operation timed out) [04:27] *** ats has quit IRC (Read error: Operation timed out) [04:27] *** Odd0002 has joined #archiveteam-ot [04:28] *** jspiros has quit IRC (Read error: Operation timed out) [04:28] *** svchfoo3 sets mode: +o ivan [04:30] *** benjins has quit IRC (Read error: Operation timed out) [04:30] *** robogoat has joined #archiveteam-ot [04:32] No one is too young. [04:32] But I understand how you feel. [04:32] *** benjins has joined #archiveteam-ot [04:33] I actually got used to it. I like this better than other messaging platforms because I like clean CLI stuff. [04:35] *** ats has joined #archiveteam-ot [04:36] *** ealgase has joined #archiveteam-ot [04:36] ugh [04:36] choopa just went down :( [04:37] so now I've had to reconnect with a different homeserver [04:40] Welcome to EFnet. [04:40] Where netsplits, disconnects, and other oddities are the norm. [04:41] ealgase: That's fine. [04:42] JAA: I am the only one on #mastodown. [04:43] t3: We have a broader Fediverse channel at #fedisperse. [04:43] Is #mastodown no longer needed? [04:44] Don't think so. [04:44] Okay. I will disconnect from that channel. [04:45] ("Part" is the correct term on IRC.) [04:45] You connect and disconnect to/from a server, and you join and part channels. [04:46] Right. [04:47] I will part. [04:47] I have parted. [04:49] I would have had having parted. [04:49] I use the term "leave" the channel [04:50] Yeah, some clients do that as well, but the IRC command for it is "PART". [04:50] I just took a look at my logs: "(Write error: Broken pipe)" O_o [04:57] *** jspiros has joined #archiveteam-ot [04:57] *** BlueMax has joined #archiveteam-ot [05:09] Don't break pipes. [05:09] Data flows through pipes. [05:16] *** retnl has quit IRC (Quit: Connection closed for inactivity) [05:22] *** SketchCo1 is now known as SketchCow [05:25] *** kiska1 has joined #archiveteam-ot [05:25] *** Fusl sets mode: +o kiska1 [05:34] *** dxrt_ has joined #archiveteam-ot [05:34] *** dxrt sets mode: +o dxrt_ [05:37] *** mal_ has joined #archiveteam-ot [05:47] *** paul2520 has joined #archiveteam-ot [06:07] *** deevious has quit IRC (Quit: deevious) [06:43] *** deevious has joined #archiveteam-ot [07:02] *** godane has quit IRC (Ping timeout: 268 seconds) [07:20] *** godane has joined #archiveteam-ot [08:11] *** logchfoo4 starts logging #archiveteam-ot at Thu May 09 08:11:48 2019 [08:11] *** logchfoo4 has joined #archiveteam-ot [09:01] *** phiresky has joined #archiveteam-ot [09:01] *** Laverne has joined #archiveteam-ot [09:01] *** kiskabak has joined #archiveteam-ot [09:01] *** Fusl sets mode: +o kiskabak [09:03] *** Gfy has joined #archiveteam-ot [11:03] *** BlueMax has quit IRC (Quit: Leaving) [11:09] *** wp494 has quit IRC (Read error: Operation timed out) [11:10] *** wp494 has joined #archiveteam-ot [12:04] *** godane has quit IRC (Ping timeout: 246 seconds) [12:10] *** icedice has joined #archiveteam-ot [12:11] *** Zerote has joined #archiveteam-ot [12:19] *** godane has joined #archiveteam-ot [12:32] *** icedice has quit IRC (Quit: Leaving) [13:26] i saw IA bought 6 petabytes recently [13:32] Time to fill that up! [13:32] xD [13:38] Soo, what about that SoundCloud project? :-) [13:47] I like where you're going... [13:47] I've done 5TB this week due to some big bot jobs [13:47] Time for another GoogleMinus size project? [14:59] *** Ravenloft has quit IRC (Read error: Connection reset by peer) [15:09] reddit [15:09] youtube [15:16] lol YT [15:34] I know YT was a joke, but just to entertain the thought, rough estimate says we'd need a combined 144 gbit/s just to keep up with new uploads (2017 stats) [15:36] 1500 hetzner cloud servers is my limit, each can do a 2-40 gbit/s :P [15:38] IA's 6PBs would cover roughly 4 days of uploads :D [15:39] nice. gotta get them to upgrade their storage i gues [15:49] That sounds about right. [16:02] i still want a distributed soundcloud archive :] [16:02] I mean, we can revive #soundbutt if there is enough interest. [16:48] *** dhyan_nat has quit IRC (Ping timeout: 268 seconds) [17:03] IA has 50PB+ [17:03] so if we delete everything else [17:03] we could cover around a month [17:04] I think trying to get all of mediafire might be a project of decent size [17:04] plus I have a great idea for the name: #mediadire [17:05] how about #mediaonfire? :P [17:06] ooh, that's pretty good [17:08] Imgur would be another fun site to grab [17:08] or maybe [17:08] all of blogger [17:08] #imgone [17:09] those two already exist, but aren't saved [17:15] GitHub [17:15] #getgit [17:16] (We really missed an opportunity there for #gitgud or #gitrekt.) [17:20] lol [17:33] *** dhyan_nat has joined #archiveteam-ot [17:47] *** icedice has joined #archiveteam-ot [19:07] *** dhyan_nat has quit IRC (Read error: Operation timed out) [19:21] *** Dimtree has quit IRC () [19:40] *** killsushi has joined #archiveteam-ot [20:31] Telegram Desktop has a feature to export full channels/groups (all messages, images, files, videos, gifs, etc). JFYI [21:25] unfortunately i think this feature isn't available via API, so we can't automatize channel grabs [21:28] where's the option? [21:29] Telegram Desktop > Any channel > Triple dots ... > Export chat history [21:31] Very powerful, but GUI only [21:31] ah ok [21:31] that's pretty cool [21:32] I just downloaded full history for https://t.me/PropagandaPosters [21:32] there are plenty of interesting channels in Telegram [21:34] telegram is pretty interesting overall [21:34] they have an extension of the venture capital business model [21:34] see, the VC model is "lose money but figure out how to make it later" [21:35] the telegram model is "lose money forever because the founder is a multibillionaire" [21:55] *** BlueMax has joined #archiveteam-ot [22:06] mixcloud is another thing i would like to archive at one point [22:06] lots of user created content there [22:25] *** Mateon1 has quit IRC (Remote host closed the connection) [22:28] *** Mateon1 has joined #archiveteam-ot [22:28] *** BlueMax has quit IRC (Read error: Connection reset by peer) [22:32] *** icedice has quit IRC (Quit: Leaving) [22:58] *** killsushi has quit IRC (Quit: Leaving) [23:16] *** dhyan_nat has joined #archiveteam-ot [23:55] *** dhyan_nat has quit IRC (Read error: Operation timed out)