#internetarchive.bak 2015-05-27,Wed

↑back Search

Time Nickname Message
00:16 🔗 db48x done
00:17 🔗 db48x what are they cooking?
00:20 🔗 db48x oops, gotta run
00:24 🔗 beardicus has quit IRC (Quit: Sleep.)
00:45 🔗 iabak-reg 03registrar 05master 7719088 06other 10SHARD6/pubkeys registration of laeos on SHARD6
00:48 🔗 primus104 has quit IRC (Leaving.)
01:18 🔗 Atluxity has quit IRC (Ping timeout: 360 seconds)
01:43 🔗 Atluxity has joined #internetarchive.bak
01:50 🔗 iabak-reg 03registrar 05master 512db07 06other 10SHARD7/pubkeys registration of mariusz on SHARD7
02:25 🔗 hendi_ has joined #internetarchive.bak
02:33 🔗 hendi has quit IRC (Ping timeout: 512 seconds)
02:34 🔗 iabak-reg 03registrar 05master c2f9e0c 06other 10SHARD6/pubkeys registration of rob.hoare.iabak on SHARD6
04:26 🔗 trs80 blog post on r/sysadmin https://www.reddit.com/r/sysadmin/comments/37eyn3/the_backing_up_of_the_internet_archive_continues/
04:41 🔗 SketchCow https://www.reddit.com/r/DataHoarder/comments/37ayq5/the_backing_up_of_the_internet_archive_continues/ has more comments.
05:10 🔗 tpw_rules lol the bit about torrents sounds like somebody who thinks everything needs blockchain tech
05:10 🔗 tpw_rules have you considered putting the internet archive into the blockchain?
05:11 🔗 db48x heh
05:12 🔗 SketchCow Brewster buys in too.
05:12 🔗 db48x it is tempting, as every item already has a torrent with IA as a webseed
05:12 🔗 SketchCow At some point, in the future, IA.BAK might have alternate ways to provide certain data.
05:12 🔗 db48x or we could do it in parrallel
05:12 🔗 SketchCow The volunteer pool would need to be ultra-ridiculous, though.
05:12 🔗 db48x yes
05:12 🔗 db48x and every torrent you join has a constant traffic overhead
05:13 🔗 SketchCow http://ipfs.io/
05:13 🔗 db48x more than the daily sync we're doing
05:13 🔗 db48x yes, that's another option we discussed, and an interesting one
05:13 🔗 db48x it's too new though; perhaps in a few months
05:13 🔗 tpw_rules SketchCow: that sounds really warm and fuzzy
05:13 🔗 tpw_rules in a slightly perogative way
05:14 🔗 SketchCow The problem with folks is they want all or nothing.
05:14 🔗 tpw_rules also it's still not compatible with windows
05:14 🔗 SketchCow That's how you lose.
05:14 🔗 tpw_rules ?
05:14 🔗 SketchCow Hey, everybody, tomorrow go from the unix kernel to new bungiekernel.
05:14 🔗 SketchCow mv;mv
05:15 🔗 tpw_rules i don't follow
05:15 🔗 SketchCow bungiekernel uses amazing new things made mostly because Snowden was right and fuck the government
05:15 🔗 SketchCow install bungiekernel tomorrow
05:15 🔗 SketchCow tomorrow
05:15 🔗 tpw_rules are you saying ipfs is trying to do too much at once?
05:15 🔗 SketchCow I'm saying it's a concern when someone goes "and now, switch to this suite of crazy"
05:16 🔗 tpw_rules oh i just got to the part where it's a replacement for the entire internet
05:16 🔗 tpw_rules imo the internet is probably our greatest tech achivement. we need to burn down the web and start over, but not the internet
05:18 🔗 SketchCow I told Brew the solution is a new URI
05:18 🔗 SketchCow Fill that babycakes with all sorts of crazytown
05:18 🔗 SketchCow archive:// was mine
05:18 🔗 SketchCow Maybe Archive Team will do it
05:18 🔗 SketchCow (Please don't do it yet)
05:18 🔗 trs80 the current git-annex solution only downloads from the internet archive right?
05:18 🔗 tpw_rules yes
05:18 🔗 SketchCow Yes
05:19 🔗 SketchCow "only"
05:19 🔗 SketchCow http://upload.wikimedia.org/wikipedia/commons/1/1b/Internet_Archive_Googly_Eyes_05.jpg
05:19 🔗 SketchCow "only"
05:19 🔗 tpw_rules what happened to the rack in the focal point? it doesn't have its quota of blinkenlights on
05:20 🔗 trs80 not asking if it backs up other things, but that the transfer isn't p2p
05:20 🔗 tpw_rules i think it can be, but it isn't now
05:20 🔗 SketchCow Regarding blinkies, that's just dumb luck
05:21 🔗 tpw_rules were they all blunk off for half a second or do they only come on when that server is busy reading them?
05:21 🔗 SketchCow It depends what's on there.
05:21 🔗 SketchCow Might be that holds nothing but dormant webpages
05:21 🔗 SketchCow And nobody's hunting
05:21 🔗 SketchCow or I took 20 pictures and we got them
05:21 🔗 SketchCow etc.
05:21 🔗 SketchCow I mean, that's my picture
05:21 🔗 tpw_rules i like it tho
05:22 🔗 tpw_rules "There are no pages that link to this file." that's a sad state of affairs
05:22 🔗 SketchCow Over it
05:23 🔗 tpw_rules welp good night. tomorrow comes a couple more TB added to the pursuit of science
05:25 🔗 SketchCow Excellent.
05:32 🔗 db48x closure: hey, I was rereading the DETACHED_PROCESS docs
05:35 🔗 zz_CyberJ is now known as CyberJaco
05:39 🔗 iabak-reg 03registrar 05master 7e72af5 06other 10SHARD6/pubkeys registration of ryan on SHARD6
05:41 🔗 db48x hmm, maybe not
05:53 🔗 iabak-reg 03registrar 05master 2583e4f 06other 10SHARD6/pubkeys registration of tomhiggins on SHARD6
06:07 🔗 iabak-reg 03registrar 05master d0b50e3 06other 10SHARD3/pubkeys registration of tomhiggins on SHARD3
06:22 🔗 iabak-reg 03registrar 05master 9d587ab 06other 10SHARD6/pubkeys registration of martin on SHARD6
06:31 🔗 iabak-reg 03registrar 05master 83bfbe0 06other 10SHARD7/pubkeys registration of martin on SHARD7
06:34 🔗 garyrh CHOO CHOO.
06:59 🔗 midas has quit IRC (Read error: Operation timed out)
07:02 🔗 dirt has quit IRC (Read error: Operation timed out)
07:02 🔗 dirt has joined #internetarchive.bak
07:02 🔗 Lord_Nigh has quit IRC (Read error: Operation timed out)
07:02 🔗 sep332 has quit IRC (Read error: Operation timed out)
07:02 🔗 S[h]O[r]T has quit IRC (Read error: Operation timed out)
07:02 🔗 ivan` has quit IRC (Read error: Operation timed out)
07:02 🔗 midas has joined #internetarchive.bak
07:03 🔗 mariusz has quit IRC (Read error: Operation timed out)
07:04 🔗 Lord_Nigh has joined #internetarchive.bak
07:04 🔗 toad1 has quit IRC (Read error: Operation timed out)
07:04 🔗 CyberJaco is now known as zz_CyberJ
07:05 🔗 laxity has quit IRC (Read error: Operation timed out)
07:05 🔗 laxity has joined #internetarchive.bak
07:06 🔗 marvinw has quit IRC (Read error: Operation timed out)
07:07 🔗 Control-S has quit IRC (Read error: Operation timed out)
07:08 🔗 SketchCow Yes!
07:25 🔗 marvinw has joined #internetarchive.bak
07:29 🔗 ivan`_ has joined #internetarchive.bak
07:33 🔗 primus104 has joined #internetarchive.bak
07:47 🔗 lufix has quit IRC (Ping timeout: 240 seconds)
07:58 🔗 Senji SHARD5 has a few undownloadable files
08:01 🔗 sep332 has joined #internetarchive.bak
08:01 🔗 S[h]O[r]T has joined #internetarchive.bak
08:01 🔗 svchfoo3 sets mode: +o sep332
08:02 🔗 Ctrl-S has joined #internetarchive.bak
08:04 🔗 toad1 has joined #internetarchive.bak
08:24 🔗 mariusz has joined #internetarchive.bak
08:40 🔗 chfoo has quit IRC (Read error: Connection timed out)
08:41 🔗 chfoo has joined #internetarchive.bak
08:54 🔗 Senji Also a number of files that fail fsck
09:05 🔗 atomotic has joined #internetarchive.bak
09:32 🔗 Senji2 has quit IRC (Ping timeout: 186 seconds)
09:38 🔗 Senji2 has joined #internetarchive.bak
09:38 🔗 hendi_ http://iabak.archiveteam.org/client/6f38316ed92859c10cb126f7b3d1e617760a13fa.html is stuck at 40GB, whereas I already downloaded ~100GB. Any idea why?
09:41 🔗 Senji Maybe your iabak-hourlysync has died so syncs aren't happening?
09:42 🔗 Senji Alternatively you're downloading some big files right now; the amount you've downloaded will only update for complete files
09:43 🔗 Lord http://iabak.archiveteam.org/client/bb403f1155a8074b5169164c4096d48087259db7.html i have the same problem
09:44 🔗 hendi_ might be the cron, I'll have a look
09:44 🔗 Senji db48x: is e7971e21-be65-4882-b99d-ad7ecabae125 going to expire (shard 2) ?
09:49 🔗 Senji db48x and closure who might be able to give better answers probably won't be in for a while; I think they're on east coast US
10:01 🔗 garyrh has quit IRC (http://bnc4free.com/)
10:04 🔗 garyrh has joined #internetarchive.bak
10:12 🔗 DFJustin has quit IRC (Read error: Connection reset by peer)
10:13 🔗 DFJustin has joined #internetarchive.bak
10:13 🔗 db48x which shard is it for?
10:14 🔗 svchfoo3 sets mode: +o DFJustin
10:14 🔗 db48x oh, nvm
10:14 🔗 db48x it's not on the expire list: http://iabak.archiveteam.org/stats/ALL.expireleaderboard
10:16 🔗 db48x and you can always run git annex sync manually if you want to make sure it's synced
10:16 🔗 Zero_Dogg How often do the leaderboards update?
10:17 🔗 db48x every 10 minutes
10:17 🔗 Zero_Dogg hrm, guess mine is missing since it doesn't have much data yet then
10:18 🔗 Senji db48x: yes it is, it's the fourth line down
10:19 🔗 db48x no, that's 92b4...
10:19 🔗 Senji db48x: it's not actually every 10 minutes; it's closer to every half hour -- looks as if it takes longer than ten minutes to me
10:20 🔗 db48x the stats run every 10 minutes
10:20 🔗 Senji db48x: err, there's no 92b4 on my list at all
10:20 🔗 Zero_Dogg db48x: and the id is the annex uuid?
10:21 🔗 zottelbey has joined #internetarchive.bak
10:21 🔗 db48x Zero_Dogg: yes
10:21 🔗 Zero_Dogg strange that mine isn't showing yet then, oh well
10:23 🔗 Senji db48x: http://www.chiark.greenend.org.uk/~jdamery/tmp/2015-05-27T11:21:48Z.png <-- this is what I'm getting for ALL.expireleaderboard-raw
10:24 🔗 Senji db48x: if the stats run every 10 minutes why are most of the files in http://iabak.archiveteam.org/stats/ at least 20 minutes old? :)
10:25 🔗 db48x dunno
10:26 🔗 db48x ok, if I log into the server
10:27 🔗 db48x and look at ALL.expireleaderboard, 924b... is the fourth one
10:27 🔗 db48x All.expireleaderboard-raw looks like your screenshot, far as I can tell
10:28 🔗 Senji There isn't a 924b in http://iabak.archiveteam.org/stats/ALL.leaderboard-raw at all
10:29 🔗 db48x hmm, indeed
10:30 🔗 db48x ah, it's in http://iabak.archiveteam.org/stats/ALL.warningleaderboard
10:31 🔗 db48x and ALL.leaderboard
10:31 🔗 db48x but not the -raw files
10:42 🔗 db48x anyway, the ones on celebdil will probably expire
10:42 🔗 db48x the drive they were on died
10:49 🔗 Senji Oh dear :(. I'm just trying to grab files that are likely to expire down below 4 copies on my shard2; since that drive has space :)
10:50 🔗 db48x yep, those would be a good choice :)
11:04 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
11:42 🔗 mariusz1 has joined #internetarchive.bak
11:55 🔗 mariusz1 is now known as weles
11:58 🔗 atomotic has joined #internetarchive.bak
12:18 🔗 iabak-reg 03registrar 05master 417ee0e 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:19 🔗 iabak-reg 03registrar 05master 84411fe 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:19 🔗 iabak-reg 03registrar 05master d3608a1 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:19 🔗 iabak-reg 03registrar 05master 5c2df46 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:20 🔗 iabak-reg 03registrar 05master a5abd41 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:20 🔗 iabak-reg 03registrar 05master 3914597 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:20 🔗 iabak-reg 03registrar 05master f0f4e13 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:20 🔗 Kazzy ok
12:20 🔗 iabak-reg 03registrar 05master a4d51d8 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:21 🔗 iabak-reg 03registrar 05master 8077ffd 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:21 🔗 iabak-reg 03registrar 05master c0b6c73 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:21 🔗 iabak-reg 03registrar 05master 9110028 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:22 🔗 iabak-reg 03registrar 05master 23b5c8f 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:22 🔗 iabak-reg 03registrar 05master fd92f5f 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:22 🔗 iabak-reg 03registrar 05master 8d659df 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:22 🔗 iabak-reg 03registrar 05master d08a237 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:23 🔗 iabak-reg 03registrar 05master e237bca 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:23 🔗 iabak-reg 03registrar 05master a91a69a 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:23 🔗 iabak-reg 03registrar 05master ade5409 06other 10SHARD7/pubkeys registration of foxington on SHARD7
12:23 🔗 iabak-reg 03registrar 05master 692c125 06other 10SHARD7/pubkeys registration of foxington on SHARD7
12:24 🔗 iabak-reg 03registrar 05master ecfe711 06other 10SHARD7/pubkeys registration of foxington on SHARD7
12:24 🔗 iabak-reg 03registrar 05master 93c9b86 06other 10SHARD7/pubkeys registration of foxington on SHARD7
12:24 🔗 iabak-reg 03registrar 05master 8090e5b 06other 10SHARD7/pubkeys registration of foxington on SHARD7
12:24 🔗 iabak-reg 03registrar 05master b271986 06other 10SHARD7/pubkeys registration of foxington on SHARD7
12:29 🔗 Senji WTF?
12:29 🔗 ppiixx foxington really wants to backup shards 6 and 7
12:29 🔗 Kazzy i can't tell if that's him being dumb
12:30 🔗 Kazzy or some shitty attempt on an attack
12:31 🔗 Senji Aha, Kazzy - 16086358-eb18-4a77-a644-ab32bec3a768 on shard2 is getting clsoe to expiry
12:32 🔗 Kazzy it's dead and gone
12:33 🔗 Senji Good thing it's getting expired then I guess :)
12:33 🔗 Kazzy fucked up my setup in multiple ways, decided to delete everything and restart, so i'm registered now too
12:33 🔗 iabak-reg 03registrar 05master 2687c7c 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:34 🔗 iabak-reg 03registrar 05master 956cb96 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:34 🔗 iabak-reg 03registrar 05master a3aad18 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:34 🔗 iabak-reg 03registrar 05master 32010ab 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:35 🔗 Senji Stoppit foxington
12:35 🔗 iabak-reg 03registrar 05master 366af0a 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:35 🔗 iabak-reg 03registrar 05master b59b793 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:35 🔗 iabak-reg 03registrar 05master 2d01074 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:35 🔗 Zero_Dogg there's a chance the registration might need some flood protection
12:36 🔗 iabak-reg 03registrar 05master 8ca02a5 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:36 🔗 iabak-reg 03registrar 05master 875cbfc 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:36 🔗 iabak-reg 03registrar 05master d940895 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:36 🔗 iabak-reg 03registrar 05master f0bf09d 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:37 🔗 iabak-reg 03registrar 05master aceeda7 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:37 🔗 iabak-reg 03registrar 05master 1d5c666 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:37 🔗 iabak-reg 03registrar 05master abfc389 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:38 🔗 iabak-reg 03registrar 05master efebad9 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:38 🔗 iabak-reg 03registrar 05master 7260be3 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:38 🔗 iabak-reg 03registrar 05master 87c520a 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:39 🔗 iabak-reg 03registrar 05master ebe19fe 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:39 🔗 iabak-reg 03registrar 05master 96c6f2e 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:39 🔗 iabak-reg 03registrar 05master ce6c7b0 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:39 🔗 iabak-reg 03registrar 05master 5bbe0f8 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:40 🔗 iabak-reg 03registrar 05master b6a70f8 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:40 🔗 iabak-reg 03registrar 05master f961960 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:40 🔗 iabak-reg 03registrar 05master 599665d 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:41 🔗 iabak-reg 03registrar 05master bf3c604 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:41 🔗 iabak-reg 03registrar 05master da74651 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:41 🔗 iabak-reg 03registrar 05master 5730aed 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:47 🔗 iabak-reg 03registrar 05master af046ed 06other 10SHARD6/pubkeys registration of foxington on SHARD6
12:51 🔗 sankin has joined #internetarchive.bak
13:14 🔗 iabak-reg 03registrar 05master 418868b 06other 10SHARD6/pubkeys registration of zottelbeyer on SHARD6
13:51 🔗 iabak-reg 03registrar 05master fc40300 06other 10SHARD1/pubkeys registration of sean.palmer on SHARD1
13:51 🔗 sep332 oops lol
13:56 🔗 beardicus has joined #internetarchive.bak
14:02 🔗 Kazzy has quit IRC (Read error: Operation timed out)
14:03 🔗 Kazzy has joined #internetarchive.bak
14:03 🔗 svchfoo3 sets mode: +o Kazzy
14:03 🔗 Lord has quit IRC (Read error: Operation timed out)
14:04 🔗 Lord_ has joined #internetarchive.bak
14:15 🔗 sep332 ah man now i have 3 shard1's with identical uuid's
14:15 🔗 sep332 and 2 shard4's
14:23 🔗 closure sep332: how the hell?
14:23 🔗 sep332 well i re-registered shard1 yesterday when ssh wasn't working
14:24 🔗 sep332 and then accidentally re-re-registered half an hour ago
14:24 🔗 sep332 not sure about shar4 to be honest
14:24 🔗 sep332 http://iabak.archiveteam.org/client/6e28b08f9eb940d4bf6f8ab579852aa28b1f81c1.html
14:25 🔗 closure well, don't care how many times you registered, it's the number of repositories on disk with the same uuid that matters
14:25 🔗 closure should always be exactly 1
14:27 🔗 sep332 they're all on the same disk, you can see they all have identical sizes etc
14:28 🔗 closure well no, I couldn't tell that from the stats page
14:41 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
14:42 🔗 sep332 that last one was when i fat-fingered and sent the same registration URL as I sent yesterday. identical, right out of my browser history
14:48 🔗 SketchCow ALL HAIL
14:53 🔗 sep332 HAIL
14:53 🔗 sep332 (what are we hailing)
14:54 🔗 Start has quit IRC (Disconnected.)
14:55 🔗 SketchCow Endless, I mean endless, re-registration.
14:56 🔗 SketchCow Anyway, we'll have the non-registered people weeded out soon.
15:03 🔗 ryang_ has joined #internetarchive.bak
15:04 🔗 ryang has quit IRC (Read error: Operation timed out)
15:04 🔗 ryang_ is now known as ryang
15:38 🔗 iabak-reg 03registrar 05master 759ecf5 06other 10SHARD3/pubkeys registration of jdamery+iabak on SHARD3
15:38 🔗 Senji I have no idea how these two failed to get registered
15:46 🔗 iabak-reg 03registrar 05master 4cef507 06other 10SHARD1/pubkeys registration of jdamery+iabak on SHARD1
15:46 🔗 iabak-reg 03registrar 05master 13d67d7 06other 10SHARD3/pubkeys registration of jdamery+iabak on SHARD3
15:50 🔗 primus104 has quit IRC (Read error: Operation timed out)
15:55 🔗 primus104 has joined #internetarchive.bak
15:56 🔗 Start has joined #internetarchive.bak
15:58 🔗 weles I don't know about anyone else, but my problem is not disk space but bandwidth, at one location I can get only 700KB/s from IA, at the other one 3MB/s but even with that it takes a while to download anything substantial
15:59 🔗 Senji Umm, does twatson52 really have 3-and-a-bit copies of shard1?
15:59 🔗 Senji weles: yeah, that's why we're doing multiple simultaneous downloads :)
16:00 🔗 Senji weles: see ANNEXGETOPTS in README.md
16:02 🔗 weles Senji: I need some bandwith left for work and play:)
16:06 🔗 weles also, I don't think wget currently is setup to request gzip'ed files, and it's not even enabled on IA for some pages, but maybe that should be the default for the resources that can be gziped during transfer?
16:07 🔗 Senji In theory all the large objects are in a compressed format already
16:14 🔗 weles i didn't check but I see some tar files that may or may not be gziped.. (no .gz nor .tgz ) extension
16:16 🔗 weles also some pdfs and a lot of xml. some of them may be too small to get any benefits, but maybe worth considering for the larger files
16:16 🔗 Beardface to clarify 'echo "-J10" > $IA.BAK/ANNEXGETOPTS ?
16:18 🔗 Senji Most of the xml is a few KB
16:18 🔗 sep332 weles: i checked some of the big tar files. all the ones I've see are full of pictures or other zip files
16:19 🔗 Beardface err what i wrote would set it for 10 concurrent grabs?
16:21 🔗 weles sep332: yes, xml files are around 4k, but if we could get them down to 1k it would save few kb. we maybe be saving few kb, but we still have few PB to go, so even 1% saving may be worth it..
16:35 🔗 tpw_rules Senji: sort of
16:35 🔗 tpw_rules i had to erase two and a bit repos due to various circumstances
16:36 🔗 tpw_rules in like 30 days they'll all expire and then it will be correct again
16:45 🔗 Start has quit IRC (Disconnected.)
16:53 🔗 Start has joined #internetarchive.bak
16:56 🔗 Start has quit IRC (Client Quit)
17:10 🔗 sep332 has quit IRC (Read error: Operation timed out)
17:10 🔗 chfoo has quit IRC (Read error: Operation timed out)
17:10 🔗 S[h]O[r]T has quit IRC (Read error: Operation timed out)
17:11 🔗 chfoo has joined #internetarchive.bak
17:13 🔗 sankin has quit IRC (Read error: Operation timed out)
17:14 🔗 mariusz has quit IRC (Read error: Operation timed out)
17:14 🔗 toad1 has quit IRC (Read error: Operation timed out)
17:15 🔗 weles has quit IRC (Read error: Operation timed out)
17:15 🔗 Ctrl-S has quit IRC (Read error: Operation timed out)
17:45 🔗 iabak-reg 03registrar 05master b7bdaea 06other 10SHARD6/pubkeys registration of internetarchive.bak on SHARD6
17:48 🔗 Ash has joined #internetarchive.bak
18:06 🔗 mariusz has joined #internetarchive.bak
18:09 🔗 sankin has joined #internetarchive.bak
18:09 🔗 sep332 has joined #internetarchive.bak
18:09 🔗 svchfoo3 sets mode: +o sep332
18:10 🔗 S[h]O[r]T has joined #internetarchive.bak
18:12 🔗 toad1 has joined #internetarchive.bak
18:12 🔗 Ctrl-S has joined #internetarchive.bak
18:15 🔗 zz_CyberJ is now known as CyberJaco
18:16 🔗 atomotic has joined #internetarchive.bak
18:22 🔗 Control-S has joined #internetarchive.bak
18:29 🔗 Ctrl-S has quit IRC (Ping timeout: 600 seconds)
18:29 🔗 Control-S is now known as Ctrl-S
18:35 🔗 mariusz2 has joined #internetarchive.bak
18:51 🔗 ivan`_ is now known as ivan`
19:00 🔗 primus105 has joined #internetarchive.bak
19:04 🔗 primus104 has quit IRC (Read error: Operation timed out)
19:12 🔗 Senji Hmm, now cd41d710-fe02-4616-ab4f-0222da836a74 is on my graphs twice
19:24 🔗 Start has joined #internetarchive.bak
19:25 🔗 Start has quit IRC (Client Quit)
19:27 🔗 Start has joined #internetarchive.bak
19:34 🔗 Start_ has joined #internetarchive.bak
19:39 🔗 Start has quit IRC (Ping timeout: 370 seconds)
19:40 🔗 iabak-reg 03registrar 05master ba265a6 06other 10SHARD7/pubkeys registration of rob.hoare.iabak on SHARD7
19:41 🔗 Start has joined #internetarchive.bak
19:47 🔗 Start_ has quit IRC (Ping timeout: 370 seconds)
19:53 🔗 Start has quit IRC (Disconnected.)
19:55 🔗 SketchCow So, honestly, you should be able to take weeks to download your pieces of a shard and that's entirely fine
19:58 🔗 Start has joined #internetarchive.bak
20:00 🔗 beardicus there was another dl speed complaint in the HN comments. probably a mindset mismatch if you think your long-term archiving of data NEEDS MOAR SPEEDS.
20:03 🔗 mariusz has quit IRC (Ping timeout: 483 seconds)
20:04 🔗 atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…)
20:14 🔗 Start_ has joined #internetarchive.bak
20:16 🔗 zottelbey has quit IRC (Remote host closed the connection)
20:20 🔗 Start has quit IRC (Ping timeout: 370 seconds)
20:22 🔗 Start_ has quit IRC (Disconnected.)
20:32 🔗 hendi_ has quit IRC (Ping timeout: 512 seconds)
20:58 🔗 tpw_rules beardicus: but then you can't measure your e-peen as effectively :'(
20:58 🔗 sankin has quit IRC (Leaving.)
21:14 🔗 VADemon has joined #internetarchive.bak
21:38 🔗 Start has joined #internetarchive.bak
22:10 🔗 laxity hi, does it make sense to participate if i can only guarantee to host the data for about a year?
22:12 🔗 DFJustin sure, it's designed to be no-commitment
22:12 🔗 laxity great, thanks :)
22:14 🔗 tpw_rules is it possible to put in request to archive specific things so that i can listen to them
22:14 🔗 Senji There's nothing stopping you from running git annex commands manually
22:15 🔗 tpw_rules no i mean to be entered into the archive itself
22:15 🔗 tpw_rules they're not there yet
22:16 🔗 DFJustin https://archive.org/upload/
22:16 🔗 tpw_rules i want car talk from npr
22:23 🔗 toad2 has joined #internetarchive.bak
22:25 🔗 Senji closure: much better :)
22:28 🔗 closure oh did that really work?
22:29 🔗 tpw_rules is anybody else downloading really slowly today?
22:29 🔗 toad1 has quit IRC (Read error: Operation timed out)
22:34 🔗 Senji closure: well, it worked for my duplicated shard1 at least
23:15 🔗 Kazzy tpw_rules: are you using concurrent downloads?
23:37 🔗 CyberJaco is now known as zz_CyberJ
irclogger-viewer