#internetarchive.bak 2015-04-13,Mon

↑back Search

Time Nickname Message
00:00 🔗 balrog has joined #internetarchive.bak
01:28 🔗 beardicus has joined #internetarchive.bak
01:57 🔗 beardicus has quit IRC (Quit: Sleep.)
04:30 🔗 svchfoo2 has quit IRC (Read error: Connection reset by peer)
04:33 🔗 svchfoo2 has joined #internetarchive.bak
04:40 🔗 raylee has quit IRC (Ping timeout: 240 seconds)
04:45 🔗 svchfoo2 has quit IRC (Ping timeout: 240 seconds)
04:47 🔗 Atluxity has quit IRC (Ping timeout: 360 seconds)
04:47 🔗 Atluxity has joined #internetarchive.bak
04:49 🔗 svchfoo2 has joined #internetarchive.bak
04:49 🔗 svchfoo1 sets mode: +o svchfoo2
04:51 🔗 raylee has joined #internetarchive.bak
05:27 🔗 wp494 has quit IRC (Ping timeout: 740 seconds)
05:32 🔗 wp494 has joined #internetarchive.bak
05:35 🔗 zottelbey has joined #internetarchive.bak
06:59 🔗 niyaje4 has joined #internetarchive.bak
07:35 🔗 atomotic has joined #internetarchive.bak
07:46 🔗 wp494 has quit IRC (LOUD UNNECESSARY QUIT MESSAGES)
07:56 🔗 niyaje4 has quit IRC (Ping timeout: 600 seconds)
08:30 🔗 niyaje4 has joined #internetarchive.bak
09:28 🔗 niyaje4 has quit IRC (Ping timeout: 600 seconds)
09:40 🔗 wp494 has joined #internetarchive.bak
10:18 🔗 beardicus has joined #internetarchive.bak
11:12 🔗 atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…)
12:00 🔗 atomotic has joined #internetarchive.bak
13:02 🔗 Start has quit IRC (Disconnected.)
13:04 🔗 Start has joined #internetarchive.bak
13:04 🔗 svchfoo1 sets mode: +o Start
13:23 🔗 sankin has joined #internetarchive.bak
13:43 🔗 Start has quit IRC (Read error: Connection reset by peer)
14:59 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
15:11 🔗 Start has joined #internetarchive.bak
15:19 🔗 toad2 has joined #internetarchive.bak
15:27 🔗 toad1 has quit IRC (Read error: Operation timed out)
15:51 🔗 Start has quit IRC (Disconnected.)
15:59 🔗 Start has joined #internetarchive.bak
16:02 🔗 berndj has quit IRC (Read error: Operation timed out)
16:40 🔗 Start has quit IRC (Disconnected.)
16:55 🔗 Start has joined #internetarchive.bak
17:06 🔗 Start has quit IRC (Disconnected.)
17:47 🔗 garyrh has quit IRC (hub.se irc.ac.za)
18:43 🔗 Start has joined #internetarchive.bak
18:45 🔗 SketchCow Hi, it's time for jason questions!
18:46 🔗 SketchCow 1. Have we begun hurting Shard1 to see responsiveness by the clients?
18:46 🔗 SketchCow 2. Should we be adding more shards, for people offering more than 6tb of space?
18:46 🔗 SketchCow 3. Should we be forcing central registration now?
18:59 🔗 garyrh has joined #internetarchive.bak
18:59 🔗 svchfoo1 sets mode: +o garyrh
19:01 🔗 closure 2, yes I was thinking the same
19:01 🔗 closure 3, yes but someone has to write it
19:01 🔗 closure 1, still waiting for some clients to upgrade from a buggy version that is preventing this from working
19:05 🔗 SketchCow Good on all.
19:05 🔗 SketchCow I gave you some collections to add. need them again?
19:07 🔗 closure I didn't see that
19:07 🔗 Start has quit IRC (Disconnected.)
19:13 🔗 closure btw, I don't know if you saw this guy http://iabak.archiveteam.org/stats/ALL.leaderboard
19:23 🔗 pikhq I'm surprised how high up I am on there.
19:25 🔗 closure SketchCow: what were the collections?
19:26 🔗 SketchCow I saw that! Obviously it helps me when the stuff is graphical, but it's great to see it.
19:27 🔗 closure graphical version needs work, but it shows that only 2 people are working on SHARD2 right now
19:27 🔗 closure http://iabak.archiveteam.org:8080/render/?width=1060&height=717&_salt=1428872058.728&target=keepLastValue%28highestAverage%28iabak.shardstats.leaderboard.*.shard2%2C10%29%29&from=-24hours
19:28 🔗 Start has joined #internetarchive.bak
19:33 🔗 atomotic has joined #internetarchive.bak
19:33 🔗 Kazzy i'm pulling slowly from IA on shard2.. maybe 300KB/s
19:33 🔗 closure yeah, I see a few slow pulls on closer inspection
19:33 🔗 db48x I'm e7971
19:36 🔗 db48x probably won't be going up any more though
19:36 🔗 Kazzy any idea who e3faaa97 is?
19:39 🔗 * pikhq is ca3d2663; wheee.
19:40 🔗 db48x Kazzy: oh, that's on shard1; looks like one of closure's
19:40 🔗 Kazzy ah right, just seemed weird as it has no user/host etc on the leaderboard
19:40 🔗 db48x Kazzy: you can run "git annex info" to see information about what other users there are
19:41 🔗 closure that is an interesting case.. that one does not show up in uuid.log
19:41 🔗 closure so I don't know who it is, or how they got initialized w/o that
19:41 🔗 db48x oh, I misread the number
19:41 🔗 db48x yea, that is odd
19:41 🔗 closure they are, however, sending activity pings
19:42 🔗 closure so still out there
19:42 🔗 closure (this is why we need registration)
19:42 🔗 db48x maybe that info got removed?
19:43 🔗 closure no, I checked all versions
19:43 🔗 closure aha, it's midas
19:43 🔗 * closure found it in another log ;)
19:44 🔗 closure midas: curious how you managed that trick :)
19:44 🔗 db48x closure: one of mine failed with this error: https://pastebin.mozilla.org/8829881
19:45 🔗 closure btw, you can run this to set your repo's description to something else: git annex describe . my name here
19:45 🔗 closure db48x: that's an overlap with someone else pushing at the same time
19:45 🔗 db48x I thought it might be
19:45 🔗 db48x perhaps it should retry?
19:45 🔗 closure it'll automatically clear up
19:45 🔗 closure I have a more robust method that the assistant uses, and I'm considering enabling it here too
19:47 🔗 Start has quit IRC (Disconnected.)
19:48 🔗 midas did what closure ?
19:48 🔗 db48x I guess we can keep an eye on it
19:48 🔗 db48x I wonder why mine has such a large jump in it
19:49 🔗 db48x did I download one file that was 250+ GB?
19:49 🔗 closure midas: somehow ended up with your repo not having a known description
19:49 🔗 db48x or did I have a long string of failures to commit?
19:49 🔗 SN4T14__ has joined #internetarchive.bak
19:49 🔗 midas lol
19:51 🔗 closure db48x: or, maybe it sped up a whole lot one hour
19:51 🔗 beardicus found out why i'm not on the map: freegeoip has got nothin' for my IP.
19:52 🔗 beardicus sends back coordinates for kentucky i think (wrong), and no postcode.
19:52 🔗 beardicus oh, no... kansas city.
19:53 🔗 SN4T14_ has quit IRC (Ping timeout: 306 seconds)
19:55 🔗 db48x closure: I wish!
19:57 🔗 zottelbey has quit IRC (Remote host closed the connection)
20:03 🔗 atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…)
20:03 🔗 closure http://iabak.archiveteam.org/stats/SHARD1.expireleaderboard
20:04 🔗 db48x http://iabak.archiveteam.org:8080/render/?width=1060&height=717&_salt=1428955433.602&target=secondYAxis%28keepLastValue%28iabak.shardstats.filestransfered.shard2%29%29&target=highestAverage%28keepLastValue%28iabak.shardstats.leaderboard.*.shard2%29%2C10%29&hideLegend=false
20:04 🔗 closure so, that's looking better.. we see some repos that were never used and can be expired, and some repos that we need to get in touch with the owners, who are apparently not running iabak
20:05 🔗 db48x closure: we need to make it easier to keep syncing regularly even when not running iabak itself
20:05 🔗 closure yes, need a cron job or something
20:05 🔗 closure what is the second Y axis there?
20:05 🔗 closure oh, I see
20:06 🔗 closure it wasn't just 1 file then was it
20:06 🔗 db48x nope
20:06 🔗 atomotic has joined #internetarchive.bak
20:10 🔗 SketchCow closure - Let me give you some, and make enough for it to be a sizeable shard.
20:10 🔗 closure you might go for 2 shards
20:11 🔗 SketchCow https://archive.org/details/usfederalcourts
20:13 🔗 closure oh, that's the 13 million file one. 130 shards..
20:14 🔗 SketchCow Oh, is THAT what held you back.
20:14 🔗 SketchCow OK, let's hold off on that.
20:17 🔗 SketchCow https://archive.org/details/78rpm
20:17 🔗 SketchCow https://archive.org/details/gutenberg
20:19 🔗 closure 78rpm .. nice, 100k files
20:20 🔗 db48x heh
20:21 🔗 closure gutenburg is 600k
20:24 🔗 SketchCow :)
20:26 🔗 closure so, let's see how big a shard of just records would be
20:34 🔗 closure . o O ( another shard my inner packrat wants a copy of all of )
20:36 🔗 DFJustin gutenberg is mirrored lots of other places
20:45 🔗 closure 1.47 terabytes of 78's!!!
20:45 🔗 closure and, that actually came out to 95k files, so we could add another 5-15k files
20:46 🔗 DFJustin oldtimeradio?
20:46 🔗 closure wait, I'm reading the wrong thing
20:53 🔗 yipdw closure: re: buggy clients -- what version should we be running right now?
20:53 🔗 yipdw I'm on 5.20150409-gd3d92ab, just want to confirm that that's fine
20:53 🔗 yipdw also I guess I can shove the right version in the topic or something
20:54 🔗 sankin has quit IRC (Leaving.)
21:03 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
21:30 🔗 berndj has joined #internetarchive.bak
21:46 🔗 niyaje4 has joined #internetarchive.bak
22:08 🔗 closure ok, real number for 78rpm: 240gb
22:08 🔗 closure which is fine, if we can find some big files to round it out
22:47 🔗 SketchCow oldtimeradio is a good one too
22:47 🔗 SketchCow It's one of our most popular sets
22:48 🔗 Start has joined #internetarchive.bak
22:49 🔗 svchfoo3 sets mode: +o Start

irclogger-viewer