[00:05] made frontpage again: https://news.ycombinator.com/item?id=9459505 [00:40] 03registrar 05master 4557918 06other 10SHARD3/pubkeys registration of primus1024 on SHARD3 [00:41] 03registrar 05master 5c865e2 06other 10SHARD4/pubkeys registration of primus1024 on SHARD4 [00:52] 03registrar 05master 76f1c67 06other 10SHARD3/pubkeys registration of ross on SHARD3 [00:54] yay, HN bump [00:55] (christ, second time I've been on HN today) [01:02] closure: Defintely consider expiring people now. [01:12] 03registrar 05master 0d4bd2e 06other 10SHARD4/pubkeys registration of ross on SHARD4 [01:31] *** primus104 has quit IRC (Leaving.) [01:36] 03registrar 05master 46b95ff 06other 10SHARD1/pubkeys registration of ross on SHARD1 [01:37] 03registrar 05master 30b11ea 06other 10SHARD3/pubkeys registration of sunny on SHARD3 [01:42] 03registrar 05master 1758951 06other 10SHARD2/pubkeys registration of ross on SHARD2 [02:01] Oh yes! [02:04] *** kyan has joined #internetarchive.bak [04:19] *** zottelbey has joined #internetarchive.bak [04:30] *** kyan has quit IRC (Read error: Connection reset by peer) [06:28] *** kyan has joined #internetarchive.bak [06:47] *** niyaje4 has joined #internetarchive.bak [06:49] *** Moor has joined #internetarchive.bak [06:51] I think lots of people's iabak-hourlysync may have crashed out -- mine has, and it would explain why the graphs have gone so horizontal lately. [06:53] Is the percentage-graph on the site the percentage of the entire Internet Archive? Or just of the collections that are currently included? [06:54] Just crrently included [06:54] That makes sense with the sudden drop five days ago. [06:55] Still: Holy --bleep-- what the --bleep--ing --bleep--. Wow. [06:59] The drop is us adding more collections. [07:09] Yeah, that's what I guessed. I love the priorities in terms of "which collections should we start with". [07:21] *** atomotic has joined #internetarchive.bak [07:22] *** primus104 has joined #internetarchive.bak [08:04] *** niyaje4 has quit IRC (Ping timeout: 600 seconds) [08:14] *** primus104 has quit IRC (Leaving.) [08:33] *** marvinw has quit IRC (Read error: Operation timed out) [08:35] 03registrar 05master 27e1f00 06other 10SHARD3/pubkeys registration of sunny on SHARD3 [08:52] *** marvinw has joined #internetarchive.bak [09:06] 03registrar 05master 5a668c0 06other 10SHARD4/pubkeys registration of yipdw on SHARD4 [09:36] Senji: or lots of folk have filled up their disks [09:38] 03registrar 05master 122d8bf 06other 10SHARD2/pubkeys registration of sunny on SHARD2 [09:43] 03registrar 05master 79bac51 06other 10SHARD1/pubkeys registration of sunny on SHARD1 [09:47] 03registrar 05master f335027 06other 10SHARD4/pubkeys registration of sunny on SHARD4 [10:10] *** niyaje4 has joined #internetarchive.bak [11:16] *** niyaje4 has quit IRC (Ping timeout: 600 seconds) [11:24] *** primus104 has joined #internetarchive.bak [11:24] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [11:54] Can someone help me with setting limits to ia.bak? It seems in my case it doesn't obey git config annex.diskreserve 300GB and keeps downloading. [11:55] I've tried to run this command in parent directory and in each shard directory. It doesn't make any difference [11:59] primus: can you show me the result of git config --get annex.diskreserve? [12:00] (in a shard directory; setting this in the IA.BAK directory won't affect anything) [12:25] *** atomotic has joined #internetarchive.bak [12:42] My apologies for late reply. It says 300GB so it seems it's set. df -h shows 280GB free though (yesterday it showed about 295 GB) [12:43] indeed [12:43] could you try exiting the iabak process(es) and restarting them? [12:43] Sorry for making it an issue ... i'm testing that limits work before i set it to leave 150 GB free and let it work and forget about it [12:44] sure, just a second please [12:45] just to make sure i do it correctly ... i check processes with ps -a and kill them with kill #process [12:46] sure, or just hit control-c in their terminal [12:46] if i do that, the processes stay alive (i mean iabak-hourly and iabak-helper etc) [12:48] ahh, you were correct, now it's obeying diskreserve [12:48] i must have done something wrong since it didn't work before. Thank you for your help. [12:49] you're welcome [13:19] 03registrar 05master c270d68 06other 10SHARD3/pubkeys registration of ianjcalvert on SHARD3 [13:22] 03registrar 05master fd9ffed 06other 10SHARD4/pubkeys registration of phuzion on SHARD4 [13:25] :) [13:28] Well that's one disk full. Time to find more... [13:28] *** sankin has joined #internetarchive.bak [13:30] sep332: :D [13:41] realeyes: ping? [13:44] *** primus104 has quit IRC (Leaving.) [13:53] *** Start has quit IRC (Disconnected.) [13:56] does anyone here want to test out a new feature? [14:05] DESCRIBE NEW FEATURE [14:06] it automagically installs a systemd unit or a cronjob that regularly fscks your backup [14:06] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [14:06] sounds horrible :-) [but I can see how some people would like it] [14:07] heh [14:10] Senji: why does that sound horrible to you? [14:10] I'm a controlfreak. I want my cronjob to run when I want it to, with the environment I want, etc :) [14:11] Particularly since fsck seems to be quite resource intensive [14:13] Cronjobs aren't that hard to set up, if you're happy with command-line *nix [14:14] yea [14:25] *** chazchaz has quit IRC (Ping timeout: 369 seconds) [14:30] *** chazchaz has joined #internetarchive.bak [14:30] yay religion [14:32] *** VADemon has joined #internetarchive.bak [14:35] Senji: so, want to help me test it? [14:38] *** Start has joined #internetarchive.bak [14:40] Senji: sounds like you'd be ideal for the job [14:51] I guess I could give it a go :) [14:52] excellent [14:53] if you pull from my fork (https://github.com/db48x/IA.BAK/), and checkout the cronjob branch, you'll find a new script called install-fsck-service [14:57] *** Start has quit IRC (Disconnected.) [14:57] if you run it, it should just do the right thing and not give you a duplicate cron job (although it may not recognize one already have) [14:59] That seems to work for me [15:00] Why are you outputting to a logfile rather than letting cron do its mailing thing? :) [15:02] because it'll output a 100k lines every time it runs (unless it runs out of time, in which case next time it'll pick up where it left off last time) [15:21] Senji appears to be a rather resistant test subject [15:28] Resistant? [15:28] i'll get the chains [15:29] does anyone here have a machine using systemd? [15:38] *** Start has joined #internetarchive.bak [15:51] *** Start has quit IRC (Disconnected.) [15:57] newegg knows me too well http://www.newegg.com/Product/ComboBundleDetails.aspx?ItemList=Combo.2311200 [16:02] *** Start has joined #internetarchive.bak [16:12] *** destrudo has quit IRC (Read error: Operation timed out) [16:26] db48x: yeah [16:26] yipdw: excellent; could you give it a try? it should create a user unit and timer for you [16:27] sure [16:27] thanks [16:27] I don't need to sudo for this, is that right [16:27] nope [16:27] neat [16:27] * yipdw knows about 16 kB of systemd [16:27] heh [16:30] db48x: it looks ok file-wise -> https://gist.github.com/yipdw/ba2702139477f5b987fa [16:30] reading up on systemctl [16:30] I'd like to make sure it knows [16:31] cool [16:31] *** primus104 has joined #internetarchive.bak [16:31] what does systemctl --user status iabak-cronjob.service say? [16:31] https://gist.github.com/yipdw/ba2702139477f5b987fa#file-gistfile2-txt [16:32] cool, and the timer? [16:32] https://gist.github.com/yipdw/ba2702139477f5b987fa#file-gistfile3-txt [16:32] it looks okay here [16:33] yea, looks good [16:33] unfortunately my laptop has almost zero free disk so I can't actually run iabak; I'll check this out on another systemd system that does have space [16:33] fair enough [16:33] now I get to figure out how to uninstall :P [16:33] you can just delete the files [16:33] no systemdctl disable required? [16:34] er systemctl [16:34] enable/disable is just adding/removing the symlink [16:34] oh [16:34] neat [16:34] actually this systemd setup is way better for my user-specific services like all my friggin spipeds [16:35] * yipdw will convert [16:35] come to the dark side, we have cookies [16:35] heh [16:35] yes, I'm enjoying it [16:35] plus, you can do journalctl --user-unit=iabak-cronjob and see just the log entries created by this one service [16:36] ah good [16:45] *** Start has quit IRC (Disconnected.) [16:52] *** primus104 has quit IRC (Leaving.) [16:53] *** garyrh has quit IRC (Remote host closed the connection) [17:18] *** kyan has quit IRC (Read error: Connection reset by peer) [17:19] *** garyrh has joined #internetarchive.bak [18:56] *** primus104 has joined #internetarchive.bak [19:46] *** atomotic has joined #internetarchive.bak [19:49] *** atomotic has quit IRC (Client Quit) [20:13] *** Moor has quit IRC (Read error: Operation timed out) [20:27] *** Start has joined #internetarchive.bak [20:35] *** Infreq has quit IRC (Remote host closed the connection) [20:52] *** DFJustin has quit IRC (Read error: Connection reset by peer) [20:52] *** DFJustin has joined #internetarchive.bak [20:52] *** svchfoo2 sets mode: +o DFJustin [21:02] *** sankin has quit IRC (Leaving.) [21:20] *** Start has quit IRC (Disconnected.) [21:51] *** Moor has joined #internetarchive.bak [22:07] *** Moor has quit IRC (Read error: Operation timed out) [22:09] *** chfoo has quit IRC (Remote host closed the connection) [22:16] *** chfoo has joined #internetarchive.bak [22:29] *** Moor has joined #internetarchive.bak [23:06] *** Moor has quit IRC (Read error: Operation timed out) [23:47] *** Start has joined #internetarchive.bak [23:54] *** zLog has joined #internetarchive.bak