#internetarchive.bak 2019-12-04,Wed

↑back Search

Time Nickname Message
01:12 🔗 robogoat How do we get this to be maintained?
01:13 🔗 robogoat Sorry, what is unmaintained? The ipfs stuff, or something else?
01:14 🔗 JAA IPFS was never used here.
01:15 🔗 JAA According to the wiki, the IPFS devs proposed using it for this project, but that never happened.
01:19 🔗 robogoat But internetarchive.bak _is_ maintained in general?
01:20 🔗 JAA Nope
01:20 🔗 JAA At least according to Kaz above.
01:20 🔗 JAA I only came here 24 hours ago.
01:20 🔗 JAA I know the project hasn't really been active in years though.
01:21 🔗 JAA So yeah, unmaintained.
02:02 🔗 robogoat Is it worth trying to kick it and see if it will start?
02:02 🔗 robogoat The website is up....
02:32 🔗 Kaz it is not
02:32 🔗 Kaz (to your first point)
04:15 🔗 iabak-reg has quit IRC (Remote host closed the connection)
04:31 🔗 iabak-reg has joined #internetarchive.bak
05:12 🔗 robogoat Kaz: is it worth trying an alternative?
05:13 🔗 Kaz I think you're underestimating the scale of such a project
05:14 🔗 robogoat I am certainly not disagreeing with you that it is a project of significant scale.
05:14 🔗 robogoat But you only eat an elephant one bite at a time.
05:15 🔗 robogoat It very well may be beyond me or any rag-tag band I could get together.
05:15 🔗 robogoat That said, it seems unlikely you have a basis to judge my technical skills or resources.
05:22 🔗 Kaz your resources aside, the way to 'fix' this project is to throw away the current implementation and start again with a new idea
05:22 🔗 Kaz which someone has to run, maintain, etc
05:23 🔗 robogoat What would you say is the primary issue with the current implementation?
05:23 🔗 robogoat It seems to be registering data.
05:24 🔗 Kaz human maintenance overhead doesn't scale, restores have never been tested fully, hard to monitor, somewhat slow
05:24 🔗 Kaz that's just off the top of my head, as this hasn't been running for years
05:24 🔗 Kaz not to mention that it's needlessly complex with a combo of bash, perl, haskell all around the place
05:25 🔗 robogoat Yeah, there are some other projects which seem to fill this kind of niche.
05:25 🔗 robogoat Something like dat: https://dat.foundation/
05:27 🔗 Kaz probably
05:28 🔗 Kaz except we'd need to scale to (currently) 60PB
05:28 🔗 Kaz and most tools fall over at that point
05:28 🔗 robogoat Many do, it's true.
05:29 🔗 robogoat What happened to the previous maintainer?
05:29 🔗 robogoat Just wandered away?
05:29 🔗 robogoat Or is it you?
05:31 🔗 Kaz there was a team of us
05:31 🔗 Kaz it became too much work, other projects came up, it basically got forgotten
05:32 🔗 robogoat Gotcha.
05:33 🔗 robogoat I understand that there are a couple of copies of the archive, I wonder if they are still kept up-to-date.
05:37 🔗 robogoat I was under the impression that ia.bak was relatively curated.
05:37 🔗 robogoat The current page lists 107TB or something,
05:37 🔗 robogoat Which is a couple orders of magnitude off 60PB
05:38 🔗 robogoat But could help with "endangered" content.
05:38 🔗 Kaz it's lying to you
05:38 🔗 Kaz the stats are broken
05:41 🔗 robogoat Gotcha.
05:43 🔗 robogoat So totally borked
05:50 🔗 Kaz indeed
09:14 🔗 JAA Would be good to mention that on the wiki page and remove the project from the homepage then.
09:14 🔗 JAA Kaz: Any idea since when this has been broken?
09:15 🔗 JAA Also, what's the deal with shard 13? :>
10:27 🔗 Kaz lets say.. december 2016
10:28 🔗 Kaz as for SHARD13.. https://www.irccloud.com/pastebin/HolEgD4J/
10:28 🔗 Kaz I think we forgot to make a shard 13
10:35 🔗 JAA Someone superstitious? :-)
10:37 🔗 Kaz Honestly, I think we just forgot how to count
11:44 🔗 kiska18 has quit IRC (Ping timeout (120 seconds))
11:47 🔗 kiska18 has joined #internetarchive.bak
18:57 🔗 antomati_ is now known as antomatic
20:54 🔗 patrickod has quit IRC (Ping timeout: 255 seconds)
20:58 🔗 patrickod has joined #internetarchive.bak
23:51 🔗 wp494 has quit IRC (Quit: LOUD UNNECESSARY QUIT MESSAGES)
23:56 🔗 wp494 has joined #internetarchive.bak

irclogger-viewer