[01:09] *** ohhdemgir has quit IRC (Read error: Operation timed out) [01:32] *** ohhdemgir has joined #internetarchive.bak [01:47] on HN frontpage again [02:04] is it less impossible this time? [02:26] nope [03:12] *** primus104 has quit IRC (Leaving.) [06:08] *** zz_CyberJ is now known as CyberJaco [06:12] 03registrar 05master f33b28c 06other 10SHARD7/pubkeys registration of accounts on SHARD7 [06:52] *** hendi has joined #internetarchive.bak [07:17] *** primus104 has joined #internetarchive.bak [07:22] *** wp494 has quit IRC (Ping timeout: 740 seconds) [07:24] *** wp494 has joined #internetarchive.bak [07:39] *** CyberJaco is now known as zz_CyberJ [07:47] *** aike has joined #internetarchive.bak [11:34] 03registrar 05master b3ab561 06other 10SHARD7/pubkeys registration of derp on SHARD7 [11:39] *** trs80 has quit IRC (Ping timeout: 186 seconds) [11:41] *** trs80 has joined #internetarchive.bak [12:19] *** mariusz has joined #internetarchive.bak [13:08] *** sankin has joined #internetarchive.bak [14:39] *** Start has quit IRC (Quit: Disconnected.) [14:44] *** bpye_ has joined #internetarchive.bak [15:39] *** primus104 has quit IRC (Leaving.) [16:00] *** Start has joined #internetarchive.bak [16:27] *** db48x has joined #internetarchive.bak [16:45] *** Start has quit IRC (Disconnected.) [16:48] *** db48x has quit IRC (Quit: ERC (IRC client for Emacs 24.5.1)) [16:49] *** Start has joined #internetarchive.bak [16:50] *** db48x has joined #internetarchive.bak [17:35] It will always be impossible. [17:36] So, I am worried we're not easily able to make up for expired SHARD3 saving. [17:36] I really think new clients should go back and prioritize that data. [17:36] There are no new clients [17:37] All of the registers I've seen in the last week have been new shards for existing users [17:40] Currently an actually new user has equal chance of being assigned to 3 7 or 8; 9 isn't available it's just been set up [17:41] There is, incidently, no more than 0.8TB of shard3 missing -- because I have that much of it and have all the missing files (so I can't get any more) [17:42] *** Start has quit IRC (Disconnected.) [17:43] well, can someone tell my wft I'm out ouf touch on shard 3 when I had the script running just yesterday? [17:43] mariusz: it's a bug in the tracker [17:44] You'll appear "out of touch" or "expired" until the expire runs a day after you first get some data [17:44] I don't think that applies to me , I first run this two weeks ago [17:45] mariusz: ahh, so you might have been actually out of touch before yesterday? [17:45] could be the expire hasn't run since you ran the script [17:45] I'm not sure which TZ it runs in [17:45] not really. [17:46] I run it every few days, plus I just noticed that IOT on shard 8 as well [17:47] might be one for closure or db48x to look at then (naming them so they see it later) [17:48] ok. I would hate if shard 8 expired with 1TB. [17:49] *** zz_CyberJ is now known as CyberJaco [17:49] If you cd into one of the shard directories and do: PATH=../git-annex.linux/:$PATH git annex sync [17:49] do you get an error message [17:52] nope [17:53] *should* be working then, unless there's a problem at the expireserver end [17:57] hm, when I run iabak it returns with "try making some of these repositories available: 0000*1 -- web [17:57] Is that on shard3? [17:58] There's some files in shard3 with URLs that git-annex can't download [17:58] yeapyeap [17:59] That's a known bug and shiouldnt affect you being expired :-) [18:00] If for some reason this expiry thing is not fixed, I can redownload everything, but it would be better if it was fixed:) [18:01] You can do better than redownloading in practice; but hopefulyl it'll be fixed [18:07] *** Start-mob has joined #internetarchive.bak [18:08] when was the last time it ran fsck on that shard? [18:10] no idea. isnt that in the cron job? [18:11] yes, take a look in the log [18:14] all of your shards are showing up as having last run the fsck 14+ days ago: http://iabak.archiveteam.org/client/b0ff65d1f0fea3cc160a3dded7dc46dd9d79bd06.html [18:14] no dates in iaback-cronjob.log and the date of the file is from June 3rd [18:14] well, that was 14 days ago :) [18:16] run ./install-fsck-service and see what it says [18:16] well, let me run it manually, but crontab -e shows that is should run at 02 02 * * * [18:16] * db48x nods [18:16] *** Start-mob has quit IRC (Ping timeout: 370 seconds) [18:16] "you've already got the cron...." [18:17] ok. was your ever computer turned on at 2am during the last two weeks? [18:17] yeah [18:18] did cron email you to tell you that the job had failed? [18:18] note that your system might not be configured to deliver this email anywhere but root's spool file, in /var/spool/mail/root [18:19] "sudo less /var/spool/mail/root" is the quickest way to check [18:20] there is a date in that file for me, though it overwrites the whole file on running so if it is dated 3rd that is when it ran :) [18:20] nothing in spool, this is run in a vm with minimal stuff [18:20] is it running cron? ;) [18:21] yeah, cron under root reports some basic logrotate crap [18:22] i'm running that cronjob manually. shard 3 done, now checking shard6 [18:23] is the logrotate working? is 'cron' actually running? [18:25] yes, with pid 798 and i've got bunch of syslog.{1-9}.gz files [18:27] does cron log anything when it runs jobs? [18:28] i'm running one , will let you know when it's done [18:30] db48x: depends on how it is configured [18:31] default is to log though [18:33] in crontab it redirects output to ~/iab/iabak-cronjob.log [18:34] i mean cron itself [18:34] by default it should be logging that it ran iabak [18:34] syslog.1:Jun 18 02:02:01 micro CRON[3781]: (ia) CMD (/big/ia/backup/IA.BAK/iabak-cronjob >/big/ia/backup/IA.BAK/iabak-cronjob.log 2>&1) [18:36] nothing in syslog about this job. there are some run by root [18:37] it probably is some issue with the cron job. [18:38] after running that cronjob, how long should it take for iabak website to notice? [18:39] 10 minutes [18:40] ok, it's done, for shard3 and 6 [18:52] nothing:/ [18:55] *** Start has joined #internetarchive.bak [18:57] *** primus104 has joined #internetarchive.bak [19:26] *** Start has quit IRC (Disconnected.) [19:32] *** Start has joined #internetarchive.bak [19:35] *** hendi has quit IRC (Ping timeout: 258 seconds) [19:36] *** primus104 has quit IRC (Leaving.) [19:41] *** Start has quit IRC (Disconnected.) [19:44] *** Start has joined #internetarchive.bak [19:50] *** Start has quit IRC (Ping timeout: 370 seconds) [20:04] *** mariusz has quit IRC (Read error: Operation timed out) [20:19] *** primus104 has joined #internetarchive.bak [20:58] *** sankin has quit IRC (Leaving.) [22:47] *** closure has quit IRC (Ping timeout: 306 seconds) [22:47] *** iabak-reg has quit IRC (Ping timeout: 306 seconds) [22:55] *** CyberJaco is now known as zz_CyberJ [22:58] *** closure has joined #internetarchive.bak [22:58] *** svchfoo3 sets mode: +o closure [22:58] *** iabak-reg has joined #internetarchive.bak