[00:05] <db48x> none of us have the disk to hold all of them
[00:05] <db48x> there will be about 2000 shards totalling 15 or more petabytes
[00:07] <pikhq> If you do have the disk for all of them then, well, you should totally mirror all of them.
[00:11] <tpw_rules> is there any effort to keep their density similar?
[00:14] <GitHub132/#internetarchive.bak> IA.BAK/server 801d4b3 Joey Hess: cleanup
[00:14] <GitHub132/#internetarchive.bak> IA.BAK/server c37ff94 Joey Hess: fixs
[00:14] <GitHub132/#internetarchive.bak> [IA.BAK] joeyh pushed 2 new commits to server: http://git.io/venVI
[00:14] <db48x> tpw_rules: we haven't quite gotten that far; shards are created manually
[00:14] <GitHub30/#internetarchive.bak> IA.BAK/server e4c35cb Joey Hess: fix
[00:14] <GitHub30/#internetarchive.bak> [IA.BAK] joeyh pushed 1 new commit to server: http://git.io/venVY
[00:16] <closure> here's the overview: http://teamarchive1.fnf.archive.org/ia.bak/ALL.html
[00:17] <db48x> oops, I only have 12 megs left on this disk :P
[00:18] *** tpw_rules looks at hard drive with 10 megs total space
[00:23] <GitHub148/#internetarchive.bak> [IA.BAK] joeyh pushed 1 new commit to server: http://git.io/venwk
[00:23] <GitHub148/#internetarchive.bak> IA.BAK/server 8986f6b Joey Hess: add a tarball of all stats
[00:31] <GitHub106/#internetarchive.bak> IA.BAK/server b24c38e Joey Hess: avoid auto gc
[00:31] <GitHub106/#internetarchive.bak> IA.BAK/server efbadce Joey Hess: use stats tarball
[00:31] <GitHub106/#internetarchive.bak> [IA.BAK] joeyh pushed 2 new commits to server: http://git.io/venrk
[00:32] *** ohhdemgir has quit (Quit: Leaving)
[00:33] <GitHub3/#internetarchive.bak> IA.BAK/server 63bab27 Joey Hess: reorg
[00:33] <GitHub3/#internetarchive.bak> [IA.BAK] joeyh pushed 1 new commit to server: http://git.io/venrC
[00:40] <GitHub87/#internetarchive.bak> IA.BAK/server 228ec8f Joey Hess: try adding db48x's tooltip
[00:40] <GitHub87/#internetarchive.bak> [IA.BAK] joeyh pushed 1 new commit to server: http://git.io/venom
[00:41] <db48x> whoa
[00:41] <db48x> I just sat down to do that :D
[00:41] <closure> seems to work, but renders a bit strangely here
[00:42] <db48x> looks like it isn't given a background color automatically
[00:42] <db48x> give it a style rule like .charts-tooltip { background-color: white; }
[00:43] <closure> PR?
[00:43] <db48x> momentarily
[00:47] <GitHub89/#internetarchive.bak> [IA.BAK] db48x pushed 1 new commit to server: http://git.io/venK9
[00:47] <GitHub89/#internetarchive.bak> IA.BAK/server 7fdd6a7 Daniel Brooks: style the tooltips
[00:51] <db48x> better; needs padding
[00:52] <GitHub190/#internetarchive.bak> IA.BAK/server 698961b Joey Hess: fix
[00:52] <GitHub190/#internetarchive.bak> IA.BAK/server fa37253 Joey Hess: Merge remote-tracking branch 'origin/server' into server
[00:52] <GitHub190/#internetarchive.bak> [IA.BAK] joeyh pushed 2 new commits to server: http://git.io/ven6G
[00:53] *** kyan (~kyan@[redacted]) has joined #internetarchive.bak
[00:55] <GitHub147/#internetarchive.bak> IA.BAK/server b17ad43 Daniel Brooks: padding and border tweaks to the tooltip
[00:55] <GitHub147/#internetarchive.bak> [IA.BAK] db48x pushed 1 new commit to server: http://git.io/ven6o
[00:56] *** beardicus has quit (Quit: My MacBook Pro has gone to sleep. ZZZzzz…)
[01:04] <db48x> closure: would you be averse to installing Graphite on this server?
[01:07] <closure> wouldn't mind, if you're going to do the programming
[01:07] <db48x> great :)
[01:07] <closure> you want an account?
[01:08] <db48x> sure, that'd make it easier
[01:08] *** db48x generates a key
[01:10] <closure> note that I'm admining the server via the scripts in git, and a propellor configuration. so that the setup is replicatable
[01:10] <db48x> excellent
[01:17] <closure> so, if you need to change something, let me know, or see /usr/local/propellor/config.hs
[01:17] <closure> /usr/local/IA.bak is the git repo
[01:38] *** hatsefla1 (~hatseflat@[redacted]) has joined #internetarchive.bak
[01:38] *** hatseflat has quit (Read error: Connection reset by peer)
[01:42] *** hater has quit (Ping timeout: 606 seconds)
[01:42] *** hater (0jf7zn7ETh@[redacted]) has joined #internetarchive.bak
[01:45] *** hater has quit (Read error: Operation timed out)
[02:01] *** hater (3pX9jgiIWz@[redacted]) has joined #internetarchive.bak
[03:19] *** SN4T14_ has quit (ircd.choopa.net irc.eversible.com)
[03:19] *** destrudo has quit (ircd.choopa.net irc.eversible.com)
[03:19] *** yipdw has quit (ircd.choopa.net irc.eversible.com)
[03:19] *** Cameron_D has quit (ircd.choopa.net irc.eversible.com)
[03:19] *** ersi has quit (ircd.choopa.net irc.eversible.com)
[03:19] *** svchfoo3 has quit (ircd.choopa.net irc.eversible.com)
[03:21] *** SN4T14 (~SN4T14@[redacted]) has joined #internetarchive.bak
[03:23] *** Cameron_D (~cameron@[redacted]) has joined #internetarchive.bak
[03:23] *** SN4T14_ (~SN4T14@[redacted]) has joined #internetarchive.bak
[03:23] *** destrudo (~destrudo@[redacted]) has joined #internetarchive.bak
[03:23] *** ersi (~ersi@[redacted]) has joined #internetarchive.bak
[03:23] *** irc.eversible.com gives channel operator status to yipdw ersi
[03:23] *** yipdw (~yipdw@[redacted]) has joined #internetarchive.bak
[03:24] *** svchfoo3 (~chfoo3@[redacted]) has joined #internetarchive.bak
[03:27] *** ersi has quit (Read error: Connection reset by peer)
[03:27] *** ersi (~ersi@[redacted]) has joined #internetarchive.bak
[03:29] *** svchfoo1 gives channel operator status to ersi
[03:30] *** SN4T14_ has quit (Ping timeout: 512 seconds)
[03:36] *** svchfoo3 has quit (Client Quit)
[03:37] *** svchfoo3 (~chfoo3@[redacted]) has joined #internetarchive.bak
[03:37] *** svchfoo1 gives channel operator status to svchfoo3
[03:41] *** niyaje3 has quit (Read error: Operation timed out)
[03:45] *** niyaje3 (~niyaje@[redacted]) has joined #internetarchive.bak
[03:49] *** niyaje4 (~niyaje@[redacted]) has joined #internetarchive.bak
[03:57] *** niyaje3 has quit (Read error: Operation timed out)
[04:17] <SketchCow> closure: Good code changes
[04:33] *** svchfoo2 has quit (Quit: Closing)
[04:34] *** svchfoo2 (~chfoo2@[redacted]) has joined #internetarchive.bak
[04:35] *** svchfoo3 gives channel operator status to svchfoo2
[04:42] <GitHub57/#internetarchive.bak> IA.BAK/server b200ee4 Joey Hess: bugfix
[04:42] <GitHub57/#internetarchive.bak> IA.BAK/server eec3ebf Joey Hess: Merge remote-tracking branch 'origin/server' into server
[04:42] <GitHub57/#internetarchive.bak> [IA.BAK] joeyh pushed 2 new commits to server: http://git.io/vecvf
[07:53] *** zottelbey (~zottelbey@[redacted]) has joined #internetarchive.bak
[12:59] <Senji> It's going to take aaaages to fill up my disk at this speed :)
[14:01] *** antomatic has quit ()
[14:05] *** antomatic (~antomatic@[redacted]) has joined #internetarchive.bak
[14:53] <SketchCow> We'll make it easier, no worries.
[15:51] <midas> http://dit.serveert.me.uk:8081/munin/serveert.me.uk/dit.serveert.me.uk/iabak.html I like
[16:28] <Senji> I've got about 100gb in 20 hours, and load 13
[16:30] <tpw_rules> yeah i have that problem when a lot of the annexes are attacking one server
[16:30] <tpw_rules> how big is the second shard?
[16:57] <closure> http://iabackup.archiveteam.org/ia.bak/SHARD2.html
[16:58] <closure> so, I just implemented the final git-annex support for expiring cients that have not fscked their repository recently
[16:59] <tpw_rules> that sounds inappropriate
[17:03] <closure> it's the "fsck or fsck you" feature
[19:25] *** garyrh has quit (Write error: Broken pipe)
[19:35] *** garyrh (garyrh@[redacted]) has joined #internetarchive.bak
[19:36] *** svchfoo1 gives channel operator status to garyrh
[19:48] *** SN4T14_ (~SN4T14@[redacted]) has joined #internetarchive.bak
[19:53] *** SN4T14 has quit (Ping timeout: 306 seconds)
[20:47] *** svchfoo2 has quit (Ping timeout: 240 seconds)
[20:50] *** svchfoo2 (~chfoo2@[redacted]) has joined #internetarchive.bak
[20:50] *** svchfoo1 gives channel operator status to svchfoo2
[21:26] *** zottelbey has quit (Remote host closed the connection)
[21:28] *** niyaje4 has quit (Ping timeout: 600 seconds)
[22:51] <SketchCow> Love the graphics.