Time |
Nickname |
Message |
01:09
🔗
|
|
ohhdemgir has quit IRC (Read error: Operation timed out) |
01:32
🔗
|
|
ohhdemgir has joined #internetarchive.bak |
01:47
🔗
|
closure |
on HN frontpage again |
02:04
🔗
|
tpw_rules |
is it less impossible this time? |
02:26
🔗
|
yipdw |
nope |
03:12
🔗
|
|
primus104 has quit IRC (Leaving.) |
06:08
🔗
|
|
zz_CyberJ is now known as CyberJaco |
06:12
🔗
|
iabak-reg |
03registrar 05master f33b28c 06other 10SHARD7/pubkeys registration of accounts on SHARD7 |
06:52
🔗
|
|
hendi has joined #internetarchive.bak |
07:17
🔗
|
|
primus104 has joined #internetarchive.bak |
07:22
🔗
|
|
wp494 has quit IRC (Ping timeout: 740 seconds) |
07:24
🔗
|
|
wp494 has joined #internetarchive.bak |
07:39
🔗
|
|
CyberJaco is now known as zz_CyberJ |
07:47
🔗
|
|
aike has joined #internetarchive.bak |
11:34
🔗
|
iabak-reg |
03registrar 05master b3ab561 06other 10SHARD7/pubkeys registration of derp on SHARD7 |
11:39
🔗
|
|
trs80 has quit IRC (Ping timeout: 186 seconds) |
11:41
🔗
|
|
trs80 has joined #internetarchive.bak |
12:19
🔗
|
|
mariusz has joined #internetarchive.bak |
13:08
🔗
|
|
sankin has joined #internetarchive.bak |
14:39
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
14:44
🔗
|
|
bpye_ has joined #internetarchive.bak |
15:39
🔗
|
|
primus104 has quit IRC (Leaving.) |
16:00
🔗
|
|
Start has joined #internetarchive.bak |
16:27
🔗
|
|
db48x has joined #internetarchive.bak |
16:45
🔗
|
|
Start has quit IRC (Disconnected.) |
16:48
🔗
|
|
db48x has quit IRC (Quit: ERC (IRC client for Emacs 24.5.1)) |
16:49
🔗
|
|
Start has joined #internetarchive.bak |
16:50
🔗
|
|
db48x has joined #internetarchive.bak |
17:35
🔗
|
SketchCow |
It will always be impossible. |
17:36
🔗
|
SketchCow |
So, I am worried we're not easily able to make up for expired SHARD3 saving. |
17:36
🔗
|
SketchCow |
I really think new clients should go back and prioritize that data. |
17:36
🔗
|
Senji |
There are no new clients |
17:37
🔗
|
Senji |
All of the registers I've seen in the last week have been new shards for existing users |
17:40
🔗
|
Senji |
Currently an actually new user has equal chance of being assigned to 3 7 or 8; 9 isn't available it's just been set up |
17:41
🔗
|
Senji |
There is, incidently, no more than 0.8TB of shard3 missing -- because I have that much of it and have all the missing files (so I can't get any more) |
17:42
🔗
|
|
Start has quit IRC (Disconnected.) |
17:43
🔗
|
mariusz |
well, can someone tell my wft I'm out ouf touch on shard 3 when I had the script running just yesterday? |
17:43
🔗
|
Senji |
mariusz: it's a bug in the tracker |
17:44
🔗
|
Senji |
You'll appear "out of touch" or "expired" until the expire runs a day after you first get some data |
17:44
🔗
|
mariusz |
I don't think that applies to me , I first run this two weeks ago |
17:45
🔗
|
Senji |
mariusz: ahh, so you might have been actually out of touch before yesterday? |
17:45
🔗
|
Senji |
could be the expire hasn't run since you ran the script |
17:45
🔗
|
Senji |
I'm not sure which TZ it runs in |
17:45
🔗
|
mariusz |
not really. |
17:46
🔗
|
mariusz |
I run it every few days, plus I just noticed that IOT on shard 8 as well |
17:47
🔗
|
Senji |
might be one for closure or db48x to look at then (naming them so they see it later) |
17:48
🔗
|
mariusz |
ok. I would hate if shard 8 expired with 1TB. |
17:49
🔗
|
|
zz_CyberJ is now known as CyberJaco |
17:49
🔗
|
Senji |
If you cd into one of the shard directories and do: PATH=../git-annex.linux/:$PATH git annex sync |
17:49
🔗
|
Senji |
do you get an error message |
17:52
🔗
|
mariusz |
nope |
17:53
🔗
|
Senji |
*should* be working then, unless there's a problem at the expireserver end |
17:57
🔗
|
mariusz |
hm, when I run iabak it returns with "try making some of these repositories available: 0000*1 -- web |
17:57
🔗
|
Senji |
Is that on shard3? |
17:58
🔗
|
Senji |
There's some files in shard3 with URLs that git-annex can't download |
17:58
🔗
|
mariusz |
yeapyeap |
17:59
🔗
|
Senji |
That's a known bug and shiouldnt affect you being expired :-) |
18:00
🔗
|
mariusz |
If for some reason this expiry thing is not fixed, I can redownload everything, but it would be better if it was fixed:) |
18:01
🔗
|
Senji |
You can do better than redownloading in practice; but hopefulyl it'll be fixed |
18:07
🔗
|
|
Start-mob has joined #internetarchive.bak |
18:08
🔗
|
db48x |
when was the last time it ran fsck on that shard? |
18:10
🔗
|
mariusz |
no idea. isnt that in the cron job? |
18:11
🔗
|
db48x |
yes, take a look in the log |
18:14
🔗
|
db48x |
all of your shards are showing up as having last run the fsck 14+ days ago: http://iabak.archiveteam.org/client/b0ff65d1f0fea3cc160a3dded7dc46dd9d79bd06.html |
18:14
🔗
|
mariusz |
no dates in iaback-cronjob.log and the date of the file is from June 3rd |
18:14
🔗
|
db48x |
well, that was 14 days ago :) |
18:16
🔗
|
db48x |
run ./install-fsck-service and see what it says |
18:16
🔗
|
mariusz |
well, let me run it manually, but crontab -e shows that is should run at 02 02 * * * |
18:16
🔗
|
* |
db48x nods |
18:16
🔗
|
|
Start-mob has quit IRC (Ping timeout: 370 seconds) |
18:16
🔗
|
mariusz |
"you've already got the cron...." |
18:17
🔗
|
db48x |
ok. was your ever computer turned on at 2am during the last two weeks? |
18:17
🔗
|
mariusz |
yeah |
18:18
🔗
|
db48x |
did cron email you to tell you that the job had failed? |
18:18
🔗
|
db48x |
note that your system might not be configured to deliver this email anywhere but root's spool file, in /var/spool/mail/root |
18:19
🔗
|
db48x |
"sudo less /var/spool/mail/root" is the quickest way to check |
18:20
🔗
|
ppiixx |
there is a date in that file for me, though it overwrites the whole file on running so if it is dated 3rd that is when it ran :) |
18:20
🔗
|
mariusz |
nothing in spool, this is run in a vm with minimal stuff |
18:20
🔗
|
ppiixx |
is it running cron? ;) |
18:21
🔗
|
mariusz |
yeah, cron under root reports some basic logrotate crap |
18:22
🔗
|
mariusz |
i'm running that cronjob manually. shard 3 done, now checking shard6 |
18:23
🔗
|
ppiixx |
is the logrotate working? is 'cron' actually running? |
18:25
🔗
|
mariusz |
yes, with pid 798 and i've got bunch of syslog.{1-9}.gz files |
18:27
🔗
|
db48x |
does cron log anything when it runs jobs? |
18:28
🔗
|
mariusz |
i'm running one , will let you know when it's done |
18:30
🔗
|
ppiixx |
db48x: depends on how it is configured |
18:31
🔗
|
ppiixx |
default is to log though |
18:33
🔗
|
mariusz |
in crontab it redirects output to ~/iab/iabak-cronjob.log |
18:34
🔗
|
ppiixx |
i mean cron itself |
18:34
🔗
|
ppiixx |
by default it should be logging that it ran iabak |
18:34
🔗
|
ppiixx |
syslog.1:Jun 18 02:02:01 micro CRON[3781]: (ia) CMD (/big/ia/backup/IA.BAK/iabak-cronjob >/big/ia/backup/IA.BAK/iabak-cronjob.log 2>&1) |
18:36
🔗
|
mariusz |
nothing in syslog about this job. there are some run by root |
18:37
🔗
|
mariusz |
it probably is some issue with the cron job. |
18:38
🔗
|
mariusz |
after running that cronjob, how long should it take for iabak website to notice? |
18:39
🔗
|
db48x |
10 minutes |
18:40
🔗
|
mariusz |
ok, it's done, for shard3 and 6 |
18:52
🔗
|
mariusz |
nothing:/ |
18:55
🔗
|
|
Start has joined #internetarchive.bak |
18:57
🔗
|
|
primus104 has joined #internetarchive.bak |
19:26
🔗
|
|
Start has quit IRC (Disconnected.) |
19:32
🔗
|
|
Start has joined #internetarchive.bak |
19:35
🔗
|
|
hendi has quit IRC (Ping timeout: 258 seconds) |
19:36
🔗
|
|
primus104 has quit IRC (Leaving.) |
19:41
🔗
|
|
Start has quit IRC (Disconnected.) |
19:44
🔗
|
|
Start has joined #internetarchive.bak |
19:50
🔗
|
|
Start has quit IRC (Ping timeout: 370 seconds) |
20:04
🔗
|
|
mariusz has quit IRC (Read error: Operation timed out) |
20:19
🔗
|
|
primus104 has joined #internetarchive.bak |
20:58
🔗
|
|
sankin has quit IRC (Leaving.) |
22:47
🔗
|
|
closure has quit IRC (Ping timeout: 306 seconds) |
22:47
🔗
|
|
iabak-reg has quit IRC (Ping timeout: 306 seconds) |
22:55
🔗
|
|
CyberJaco is now known as zz_CyberJ |
22:58
🔗
|
|
closure has joined #internetarchive.bak |
22:58
🔗
|
|
svchfoo3 sets mode: +o closure |
22:58
🔗
|
|
iabak-reg has joined #internetarchive.bak |