#archiveteam-ot 2019-01-02,Wed

↑back Search

Time Nickname Message
00:04 🔗 JAA jason0597: I think throwing HDDs into cold storage for 10 to 20 years will end in data loss unless you use very high redundancy.
00:06 🔗 jason0597 JAA: why is that?
00:06 🔗 JAA Also, there's not only aging (e.g. lubricant drying out) to consider but also the interface. I know I'd have a hard time trying to read any IDE drive nowadays. Although the hardware for that is pretty easy to get even nowadays, it's still something to keep in mind. SATA won't stay around forever.
00:07 🔗 JAA If you want cold storage for a few decades, look into tapes.
00:07 🔗 JAA They're designed for exactly that use case.
00:07 🔗 JAA LTO is typically rated for 30 years storage in a cool and dry location.
00:08 🔗 jason0597 i thought about tape but the equipment to read/write to it is quite expensive and it only makes sense if you have tens of terabytes to store
00:09 🔗 JAA Personally though, I'd never go the full "time capsule" route. Instead, I'd make sure from time to time (e.g. once per year) that the data is still intact. And keep multiple copies so it's possible to recover if one goes bad.
00:09 🔗 JAA Yeah, that's true.
00:09 🔗 jason0597 https://www.amazon.co.uk/Seagate-Barracuda-internal-silver-ST2000DM006-x/dp/B01ICLGJF8/ref=sr_1_3?s=computers&ie=UTF8&qid=1546387768&sr=1-3&keywords=2tb+hard+drive
00:09 🔗 jason0597 was thinking of a couple of these
00:10 🔗 JAA If you do check on the data once per year or every few years, you can also plan ahead when you see things like interface changes and migrate in time instead of having to hunt down ancient hardware later.
00:10 🔗 jason0597 true
00:10 🔗 benjins Have newer file systems like btrfs been tested for long-term storage?
00:12 🔗 BlueMax has quit IRC (Read error: Connection reset by peer)
00:13 🔗 jason0597 on another note, is there some standardised way to archive an entire youtube channel? (videos, descriptions, ratings, comments, etc)
00:13 🔗 hook54321 benjins: how long has btrfs been around?
00:14 🔗 benjins Like 5-10 years?
00:14 🔗 hook54321 Then at a maximum it has been tested for 5-10 years.
00:15 🔗 benjins ha, true
00:16 🔗 hook54321 However, I doubt many institutions that deal with extremely important data have adopted it.
00:22 🔗 JAA Btrfs was first released almost 10 years ago. Linux 2.6.29 in March 2009 according to Wikipedia.
00:23 🔗 JAA I wouldn't be terribly worried about not being able to read from Btrfs in a decade or two, but I'd still stick to ext* for such storage probably.
00:24 🔗 JAA Btrfs and ZFS obviously have the huge advantage of being able to detect bit rot. You'd have to deal with that manually when using more or less any other file system.
00:25 🔗 JAA So it comes down to "will I be able to pop a disk with Btrfs written today into a machine in a decade and read from it?".
00:25 🔗 kode54 had someone who followed me on Mastodon, their only post thus far had been a question about a Dropbox replacement
00:25 🔗 hook54321 My concern with it is that it hasn't been around as long, so I'm thinking it might be more likely to have bugs.
00:25 🔗 kode54 apparently, Dropbox for Linux only supports ext4 now, for dumb reasons
00:26 🔗 kode54 (it wants xattrs, and doesn't know how to expect those on any other fs)
00:26 🔗 JAA hook54321: Oh sure, there might be bugs. But the on-disk format is stable since a few years ago, so it should be possible to read a Btrfs file system for decades to come.
00:26 🔗 kode54 said person was reporting how Dropbox refuses to work with their encrypted ext4
00:27 🔗 hook54321 Oh. Hmm. I mean like, I've seen stuff been considered stable... until another bug is found in it.
00:27 🔗 * hook54321 shrugd
00:27 🔗 kode54 I was going to suggest NextCloud, but then they'd need their own server to host it
00:27 🔗 hook54321 *shrugs
00:27 🔗 JAA Yeah, right. Still, I'd be surprised if that meant it would be impossible to mount old file systems, even if there are bugs in the on-disk format or something like that.
00:28 🔗 hook54321 Ah
00:30 🔗 kode54 FS drivers usually include support for several, if not all, old versions going forward, if only for read support
00:30 🔗 kode54 if they don't intend to support old writing, they'll provide a means to upgrade the FS data that needs upgrading
00:31 🔗 kode54 ZFS handily notifies you if your storage is missing any new functionality and offer to let you upgrade to match your current system software
00:31 🔗 kode54 I don't know what Btrfs does in that regard, as I haven't been using that for very long
00:51 🔗 JAA Well, there's this: https://btrfs.wiki.kernel.org/index.php/FAQ#How_do_I_upgrade_to_the_2.6.31_format.3F
00:52 🔗 JAA And also this: https://btrfs.wiki.kernel.org/index.php/Status#On-disk_format
00:53 🔗 JAA "If a backward compatibility is not possible to maintain, a bit in the filesystem superblock denotes that and the level of incompatibility (full, read-only mount possible)."
00:53 🔗 JAA As expected :-)
00:54 🔗 jason0597 has quit IRC (Remote host closed the connection)
00:58 🔗 Mateon1 has quit IRC (Ping timeout: 260 seconds)
00:58 🔗 Mateon1 has joined #archiveteam-ot
00:59 🔗 ubahn has quit IRC (Quit: ubahn)
01:04 🔗 ubahn has joined #archiveteam-ot
01:44 🔗 Despatche has quit IRC (Quit: Error: Connection reset by peer)
02:19 🔗 bithippo has joined #archiveteam-ot
02:30 🔗 ubahn has quit IRC (Quit: ubahn)
02:39 🔗 paul2520 I setup a warrior on a spare laptop. Set it to run on ArchiveTeam's choice. Has been running for ~3 hrs with "No item received." from the wiki, the best I can tell is that my IP might be blocked due to my ISP?
02:41 🔗 paul2520 I'll let it run overnight & check back in the morning.
02:41 🔗 Flashfire paul2520 Switch to url team
02:41 🔗 Flashfire The current project is out of items
02:49 🔗 ubahn has joined #archiveteam-ot
02:51 🔗 Kaz fixed
02:52 🔗 ubahn has quit IRC (Client Quit)
02:57 🔗 JAA So Twitter launched the redesign they were testing a few months ago (July according to my logs), it seems. Or at least I get that redesign currently. Now they also have a fucking "join Twitter now!!!" thing that pops up when you scroll down. Meh... And of course it breaks snscrape.
02:59 🔗 BlueMax has joined #archiveteam-ot
03:03 🔗 JAA They also send weird invalid HTML now (no closing </body> and </html> tags) and use React. Depends on the UA though; you get a different response with curl.
03:07 🔗 VerfiedJ has quit IRC (Quit: Leaving)
04:38 🔗 bithippo has quit IRC (Read error: Operation timed out)
04:43 🔗 adinbied has joined #archiveteam-ot
04:44 🔗 adinbied has quit IRC (Client Quit)
04:48 🔗 odemg has quit IRC (Ping timeout: 265 seconds)
05:00 🔗 odemg has joined #archiveteam-ot
05:30 🔗 Stilett0 has joined #archiveteam-ot
05:31 🔗 adinbied has joined #archiveteam-ot
05:37 🔗 Stiletto has quit IRC (Ping timeout: 600 seconds)
05:40 🔗 adinbied has quit IRC (Quit: Left Channel.)
06:07 🔗 wp494 has quit IRC (Read error: Operation timed out)
06:10 🔗 wp494 has joined #archiveteam-ot
06:27 🔗 m007a83 has quit IRC (Quit: Fuck you Comcast)
06:27 🔗 m007a83 has joined #archiveteam-ot
08:14 🔗 macrosoft has joined #archiveteam-ot
08:21 🔗 macrosof1 has joined #archiveteam-ot
08:31 🔗 macrosoft has quit IRC (Ping timeout: 600 seconds)
08:37 🔗 hook54321 has quit IRC (Quit: Connection closed for inactivity)
09:48 🔗 BlueMax has quit IRC (Quit: Leaving)
12:09 🔗 exoire has quit IRC (Read error: Operation timed out)
12:37 🔗 vitzli has joined #archiveteam-ot
13:04 🔗 vitzli has quit IRC (Quit: Leaving)
13:19 🔗 macrosof1 has quit IRC (Ping timeout: 600 seconds)
13:20 🔗 paul2520 thanks Flashfire / Kaz. Looks like it's been running for url team
13:21 🔗 paul2520 this is exciting -- glad I can be using that machine for something & contributing to the work y'all do!
13:21 🔗 Kaz glad it's working now, cheers for letting us know!
14:03 🔗 hook54321 has joined #archiveteam-ot
15:09 🔗 wp494 has quit IRC (Read error: Operation timed out)
15:13 🔗 wp494 has joined #archiveteam-ot
16:28 🔗 justas has joined #archiveteam-ot
16:48 🔗 justas is now known as jut
17:18 🔗 VerfiedJ has joined #archiveteam-ot
17:55 🔗 ubahn has joined #archiveteam-ot
18:14 🔗 Joseph_ has joined #archiveteam-ot
18:16 🔗 VerfiedJ has quit IRC (Ping timeout: 252 seconds)
18:41 🔗 ubahn has quit IRC (Quit: ubahn)
18:46 🔗 ubahn has joined #archiveteam-ot
19:36 🔗 ubahn has quit IRC (Quit: ubahn)
20:18 🔗 ubahn has joined #archiveteam-ot
20:48 🔗 ubahn has quit IRC (Quit: ubahn)
21:19 🔗 benjinsmi has joined #archiveteam-ot
21:20 🔗 ubahn has joined #archiveteam-ot
21:21 🔗 benjins has quit IRC (Read error: Operation timed out)
21:23 🔗 dxrt_ has quit IRC (Ping timeout (120 seconds))
21:23 🔗 dxrt_ has joined #archiveteam-ot
21:23 🔗 dxrt sets mode: +o dxrt_
22:31 🔗 ubahn has quit IRC (Quit: ubahn)
22:32 🔗 benjinsmi has quit IRC (Quit: Leaving)
22:32 🔗 benjins has joined #archiveteam-ot
22:33 🔗 BlueMax has joined #archiveteam-ot
22:47 🔗 ubahn has joined #archiveteam-ot
22:59 🔗 Mateon1 has quit IRC (Ping timeout: 260 seconds)
22:59 🔗 Mateon1 has joined #archiveteam-ot
23:02 🔗 exoire has joined #archiveteam-ot
23:19 🔗 Stiletto has joined #archiveteam-ot
23:20 🔗 Stilett0 has quit IRC (Read error: Operation timed out)
23:29 🔗 Joseph_ has quit IRC (Quit: Leaving)
23:51 🔗 ubahn has quit IRC (Quit: ubahn)

irclogger-viewer