| Time |
Nickname |
Message |
|
00:14
🔗
|
iabak-reg |
03registrar 05master 7fb51d5 06other 10SHARD7/pubkeys registration of koos303 on SHARD7 |
|
00:21
🔗
|
|
zottelbey has joined #internetarchive.bak |
|
00:45
🔗
|
Senji |
grr, I don't like wget -q --show-progress |
|
00:49
🔗
|
|
primus104 has quit IRC (Read error: Operation timed out) |
|
00:53
🔗
|
Senji |
closure: you've broken git annex sync :-( -- it's telling ssh to find id_rsa in .git/annex/id_rsa; but it has a CWD of .git at that point so it can't find it. |
|
00:55
🔗
|
Senji |
(I have patched this with a .git symlink in my .git |
|
00:55
🔗
|
Senji |
(so I can git while I git)) |
|
00:59
🔗
|
closure |
er? I haven't changed anything |
|
00:59
🔗
|
|
primus104 has joined #internetarchive.bak |
|
00:59
🔗
|
closure |
also, why would it have a cwd of .git? Not normal afaik |
|
01:02
🔗
|
Senji |
http://pastebin.ubuntu.com/11422109/ is what I'm seeing |
|
01:03
🔗
|
Senji |
It stopped working sometime in the last, umm 18 hours or so |
|
01:07
🔗
|
closure |
others seem to be sending info fine, so unless someone else reports the same problem, my guess is that something is broken on your system |
|
01:08
🔗
|
Senji |
I'm not sure what could be broken to cause the symptoms; since it's all using the shimmed versions. I guess I could delete git-annex.linux and re-download it |
|
01:13
🔗
|
closure |
I would expect this to happen if you ran something that runs git-annex sync in .git; not otherwise |
|
01:17
🔗
|
|
zottelbey has quit IRC (Remote host closed the connection) |
|
01:19
🔗
|
Senji |
If I try running sync manually I get: http://pastebin.ubuntu.com/11422289/ |
|
01:30
🔗
|
closure |
well, I don't reproduce that in a test bench |
|
01:36
🔗
|
|
beardicus has quit IRC (Quit: Sleep.) |
|
01:46
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
02:16
🔗
|
Senji |
Hmm, I've fixed it; but I'm none the wiser |
|
02:18
🔗
|
Senji |
Sorry for the accusation, and thanks ofr the help :( |
|
02:24
🔗
|
iabak-reg |
03registrar 05master fd6a0e6 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:24
🔗
|
iabak-reg |
03registrar 05master 4ace711 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:24
🔗
|
iabak-reg |
03registrar 05master ddc6196 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:24
🔗
|
iabak-reg |
03registrar 05master 84e24ab 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master 6acfd6a 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master b734417 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master 803d9e0 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master b538019 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master 2b08f10 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master 27a0e08 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master e94f871 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master caf06d3 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master 813d153 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master c32b854 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:25
🔗
|
iabak-reg |
03registrar 05master fcbc71e 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master 048de9c 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master 3a2e4f2 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master ebe57f3 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master 2702eff 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master 31ccd48 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master 4464db0 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master 15f4118 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master 208c6e2 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master 41c7cf4 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master aa1bda5 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:26
🔗
|
iabak-reg |
03registrar 05master f041e54 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master e4cbad4 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 7ac4322 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 2710dd4 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master ed5f6af 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 1686f10 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 038cfbe 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 5bed1b6 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 8119509 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 74cd0a5 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 827c932 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master ca585ad 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:27
🔗
|
iabak-reg |
03registrar 05master 86869bc 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master da6b1c6 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master a5af782 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master 490d36d 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master 16dd0fc 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master c1b1a8f 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master 7fa4b2e 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master 5c45aae 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master 4d149b8 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master 0f4f95a 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master dfcb63f 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:28
🔗
|
iabak-reg |
03registrar 05master 86327b3 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master dcb996c 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master a39019a 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master 7ef33ab 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master 4ae72b5 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master 124be77 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
yipdw |
wtf |
|
02:29
🔗
|
iabak-reg |
03registrar 05master ee1e546 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master 4aae463 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master 9d6ae0c 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master 68fecb8 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master 4b72197 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:29
🔗
|
iabak-reg |
03registrar 05master 85e261b 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 509fa01 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 8369fc7 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 181c574 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 19e4a8f 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 8792cb6 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
yipdw |
is this normal or is this someone running a loop where they didn't mean to |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 67f8a37 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 4712a84 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 887a866 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 8c5f436 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 70c92f2 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:30
🔗
|
iabak-reg |
03registrar 05master 302cdf7 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 74b57b3 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master cdc78d0 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 5ad37d3 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 9c0dd4b 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 6b1ab53 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master e71b577 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 3bd9d6e 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 7d5e2fe 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 6866d9f 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 086fc5b 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:31
🔗
|
iabak-reg |
03registrar 05master 41f1a0c 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master 4cf09c6 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master eca90fe 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master 48516b3 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master cef952c 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master 2c9a2f9 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master 1a970c4 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master a80dc7b 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master 6703cea 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master 3bd1fc5 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master 50a435a 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:32
🔗
|
iabak-reg |
03registrar 05master 38eb938 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master a602266 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master 690ef61 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master ca3ec0e 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master 96b7fb7 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master 675f6bc 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master 2b32309 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master 544da70 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master 1a7774c 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master 2970c93 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master 033c2e2 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:33
🔗
|
iabak-reg |
03registrar 05master a2f6af7 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master faf03f5 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master 2c2f3e2 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master 660596d 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master f42406d 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master b8ce916 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master d04dad2 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master f0315ce 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master ada33f9 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:34
🔗
|
iabak-reg |
03registrar 05master dfc9244 06other 10SHARD7/pubkeys registration of bas+at on SHARD7 |
|
02:35
🔗
|
pikhq |
That seems really abusive. |
|
02:53
🔗
|
closure |
Senji: my best guess is you had a background ssh, used for connection caching, that was somehow started in .git .. and was used by the git-annex processes that were not themselves in .git |
|
02:54
🔗
|
closure |
hmm, that bas+at.. I noticed gitlab was down about an hour ago |
|
02:54
🔗
|
closure |
probably caused his reg to fail, and he retried until it worked |
|
03:02
🔗
|
closure |
oh, also, checkssh() retries on its wn |
|
03:12
🔗
|
closure |
SketchCow: http://iabak.archiveteam.org/SHARD8.html |
|
03:15
🔗
|
tpw_rules |
already? good lord |
|
04:52
🔗
|
|
SketchCow has quit IRC (Remote host closed the connection) |
|
05:23
🔗
|
|
SketchCow has joined #internetarchive.bak |
|
05:23
🔗
|
|
svchfoo3 sets mode: +o SketchCow |
|
05:27
🔗
|
|
SketchCow has quit IRC (Read error: Operation timed out) |
|
05:58
🔗
|
|
zz_CyberJ is now known as CyberJaco |
|
06:03
🔗
|
lhobas_ |
That was me, while I was asleep |
|
06:03
🔗
|
lhobas_ |
No malicious intent, was a long running iabak process |
|
06:03
🔗
|
lhobas_ |
Think we've found a race condition ;) |
|
06:06
🔗
|
db48x |
fun :) |
|
06:11
🔗
|
lhobas_ |
not really sure why iabak tried to checkout shard7, I ran out of disk space in shard6 |
|
07:00
🔗
|
|
SketchCow has joined #internetarchive.bak |
|
07:01
🔗
|
|
svchfoo3 sets mode: +o SketchCow |
|
07:07
🔗
|
|
SketchCow has quit IRC (Read error: Connection reset by peer) |
|
07:18
🔗
|
|
CyberJaco is now known as zz_CyberJ |
|
07:25
🔗
|
|
SketchCow has joined #internetarchive.bak |
|
07:26
🔗
|
|
svchfoo3 sets mode: +o SketchCow |
|
07:37
🔗
|
|
primus104 has joined #internetarchive.bak |
|
07:50
🔗
|
|
hendi_ has joined #internetarchive.bak |
|
08:22
🔗
|
|
zottelbey has joined #internetarchive.bak |
|
08:30
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
09:02
🔗
|
midas |
almost 100 clients \o/ |
|
09:02
🔗
|
midas |
and we passed the 3M GET |
|
09:37
🔗
|
|
atomotic has joined #internetarchive.bak |
|
09:41
🔗
|
|
atomotic has quit IRC (Client Quit) |
|
10:03
🔗
|
|
primus104 has joined #internetarchive.bak |
|
10:12
🔗
|
|
zottelbey has quit IRC (Remote host closed the connection) |
|
10:12
🔗
|
iabak-reg |
03registrar 05master c360d83 06other 10SHARD7/pubkeys registration of sunny on SHARD7 |
|
10:18
🔗
|
|
atomotic has joined #internetarchive.bak |
|
10:22
🔗
|
iabak-reg |
03registrar 05master 911218f 06other 03SHARD8/pubkeys registration of sunny on SHARD8 |
|
10:40
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
10:56
🔗
|
closure |
lhobas: I wonder if your shard had annex.diskreserve set? |
|
10:56
🔗
|
closure |
iabak checks if the shard it's finished (or failed to finish) has that set, and if so, checks available disk space before starting a new shard |
|
10:56
🔗
|
closure |
but if not set, it doesn't check disk space |
|
10:57
🔗
|
closure |
or, perhaps you don't have the numfmt tool, which it uses in the disk space check.. |
|
11:10
🔗
|
lhobas_ |
closure: I did have annex.diskreserve=300G set, also copied over automatically from shard to shard, not quite sure what happened |
|
11:10
🔗
|
lhobas_ |
tmux scrollbuffer overflowed, did not keep logs :/ |
|
11:11
🔗
|
closure |
take a look at the iabak-helper function stillhavespace |
|
11:12
🔗
|
lhobas_ |
no numfmt to be found on the dumb Mac OS, ofc :') |
|
11:12
🔗
|
closure |
that'd be it, then |
|
11:16
🔗
|
lhobas_ |
homebrew, the resident package manager for Mac OS, does offer gnu coreutils as a package, yet prefixes the utils with 'g' to prevent collisions |
|
11:17
🔗
|
lhobas_ |
would it be worth it to add some instructions in the README to install that package, and try 'gnumfmt'? |
|
11:29
🔗
|
|
atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) |
|
11:41
🔗
|
|
atomotic has joined #internetarchive.bak |
|
12:20
🔗
|
|
atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) |
|
12:40
🔗
|
|
atomotic has joined #internetarchive.bak |
|
12:47
🔗
|
|
sankin has joined #internetarchive.bak |
|
12:53
🔗
|
|
mariusz has joined #internetarchive.bak |
|
13:12
🔗
|
|
primus104 has joined #internetarchive.bak |
|
13:47
🔗
|
|
Start has quit IRC (Disconnected.) |
|
13:49
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
13:59
🔗
|
|
beardicus has joined #internetarchive.bak |
|
14:01
🔗
|
iabak-reg |
03registrar 05master 4eeb776 06other 10SHARD7/pubkeys registration of nicolas on SHARD7 |
|
14:11
🔗
|
iabak-reg |
03registrar 05master 5243387 06other 10SHARD7/pubkeys registration of relstnl on SHARD7 |
|
14:12
🔗
|
iabak-reg |
03registrar 05master b8b6ed4 06other 10SHARD8/pubkeys registration of relstnl on SHARD8 |
|
14:13
🔗
|
tpw_rules |
bug: it seems that if the fsck cron job downloads a new git annex standalone, it crashes the iabak scripts running |
|
14:14
🔗
|
closure |
hmm, I guess that's because git-annex is rm -rf's out from under the script |
|
14:14
🔗
|
closure |
please file it on github |
|
14:15
🔗
|
tpw_rules |
k |
|
14:23
🔗
|
tpw_rules |
is it wrong to paste like 15 lines of log in the bug or should i put it on pastebin |
|
14:33
🔗
|
* |
closure pastes 15 lines anywhere |
|
14:34
🔗
|
mariusz |
closure: is iabak running annex in direct mode? |
|
14:36
🔗
|
closure |
no |
|
14:37
🔗
|
closure |
well, it might if run on a filesystem that doesn't support symlinks |
|
14:40
🔗
|
mariusz |
oh ok. I was asking because I was wondering about bad actors, where bad actor is not user like me, but someone gaining access to the "main" repo and somehow requesting every copy to be deleted.. Possible? |
|
15:15
🔗
|
db48x |
https://github.com/ArchiveTeam/IA.BAK/blob/server/hooks/update |
|
15:15
🔗
|
db48x |
:) |
|
15:20
🔗
|
Senji |
Incidently I'm now a happy git annex user outside of iabak too :-) |
|
15:23
🔗
|
db48x |
awesome :) |
|
15:24
🔗
|
db48x |
closure: so for the bug that tpw just reported, I think taking a shared lock on .iabak-install-git-annex every time we run git annex is the way we have to go |
|
15:49
🔗
|
|
VADemon has joined #internetarchive.bak |
|
15:51
🔗
|
|
primus104 has quit IRC (Leaving.) |
|
15:57
🔗
|
Senji |
Is there a git annex command for "make numcopies satisified for all files and I don't care how you do it"? |
|
16:37
🔗
|
SketchCow |
IABAK Broke 100 Clients!! |
|
16:39
🔗
|
pikhq |
Hurrah. |
|
16:42
🔗
|
SketchCow |
closure: It appears that the "size of virtual drive" number is off. |
|
16:46
🔗
|
db48x |
hmm: |
|
16:46
🔗
|
db48x |
error: Untracked working tree file 'computermagazines/64er_magazine/64er_magazine_archive.torrent' would be overwritten by merge. |
|
16:46
🔗
|
db48x |
fatal: read-tree failed |
|
16:49
🔗
|
|
lysol has joined #internetarchive.bak |
|
16:52
🔗
|
iabak-reg |
03registrar 05master 93d8e2c 06other 10SHARD8/pubkeys registration of derek on SHARD8 |
|
16:53
🔗
|
lysol |
that's me! |
|
16:53
🔗
|
db48x |
:) |
|
16:56
🔗
|
SketchCow |
Welcome! |
|
17:01
🔗
|
|
Kenshin has quit IRC (Remote host closed the connection) |
|
17:10
🔗
|
|
Kenshin has joined #internetarchive.bak |
|
17:10
🔗
|
|
svchfoo1 sets mode: +o Kenshin |
|
17:19
🔗
|
closure |
Senji: git annex get --auto |
|
17:21
🔗
|
Senji |
'git annex get --auto' will get any files that are short on numcopies to here; but what I want to do is make any files that are here copied to other repos such that they have enough copies |
|
17:24
🔗
|
Senji |
so I can do 'git annex copy --to <somewhere> --auto' but then I have to care about what <somewhere>s are available |
|
17:30
🔗
|
iabak-reg |
03registrar 05master 42782ff 06other 10SHARD7/pubkeys registration of internetarchive.bak on SHARD7 |
|
17:32
🔗
|
mariusz |
does any one know what will happen when client's iabak is downloading data, but the shard is put into maintenance mode? Like with current shard6 it will most likely be done before I'm our of space, will the system automatically switch to shard7 or should I just restart the app at some point ? |
|
17:32
🔗
|
Senji |
Once there's nothing more to download it will checkout another random active shard |
|
17:33
🔗
|
Senji |
I think that'll be a random selection out of { shard7 } at the moment :) |
|
17:36
🔗
|
mariusz |
good, I will leave my comp at work running :) |
|
17:49
🔗
|
|
Control-S has joined #internetarchive.bak |
|
17:55
🔗
|
|
Ctrl-S has quit IRC (Read error: Operation timed out) |
|
17:55
🔗
|
|
Control-S is now known as Ctrl-S |
|
18:15
🔗
|
closure |
Senji: ah, use git annex sync --content |
|
18:17
🔗
|
|
zottelbey has joined #internetarchive.bak |
|
18:19
🔗
|
|
mks has quit IRC (Read error: Operation timed out) |
|
18:20
🔗
|
SketchCow |
closure: We should discuss what's working and what's not |
|
18:20
🔗
|
hendi_ |
what's the plan for disaster recovery, i.e. IA goes down... emaling everyone and hope that at least for each file respond, and upload their files somehow somewhere? |
|
18:21
🔗
|
SketchCow |
hendi_: Yes |
|
18:21
🔗
|
SketchCow |
That is the current plan. |
|
18:21
🔗
|
SketchCow |
It needs refinement |
|
18:21
🔗
|
SketchCow |
But yes |
|
18:21
🔗
|
|
hendi_ has left Leaving |
|
18:21
🔗
|
tpw_rules |
huh git locked up on me |
|
18:22
🔗
|
SketchCow |
Also: Nuke takes out SF, we all go to closure's cabins bringing offering of guns and butter |
|
18:22
🔗
|
|
hendi_ has joined #internetarchive.bak |
|
18:22
🔗
|
SketchCow |
it's foolproof |
|
18:22
🔗
|
hendi_ |
(wrong key...) |
|
18:22
🔗
|
hendi_ |
okay, thanks for the answer |
|
18:22
🔗
|
db48x |
heh |
|
18:23
🔗
|
|
primus104 has joined #internetarchive.bak |
|
18:24
🔗
|
db48x |
the plan is fancier than that, but that is all we've implemented so far |
|
18:26
🔗
|
SketchCow |
Yes, we're still working out bugs and avoiding using assumptions as data |
|
18:27
🔗
|
db48x |
yep |
|
18:27
🔗
|
tpw_rules |
blah i don't think syncing is scaling very well |
|
18:29
🔗
|
SketchCow |
What matters to me is that three verified, known copies of the collections added so far are in physical locations away from the IA property. |
|
18:29
🔗
|
SketchCow |
That is legions better than 90 days ago. |
|
18:31
🔗
|
|
hendi_ has quit IRC (Ping timeout: 512 seconds) |
|
18:31
🔗
|
SketchCow |
People in this channel have generally heard this from me thematically, but I generally believe that instead of "How should it be done" we are better off with "what the fuck did we just do" |
|
18:32
🔗
|
tpw_rules |
lol somebody in shard8 is running as root |
|
18:32
🔗
|
SketchCow |
When this project was proposed, I had academics and other folks say "no u are doing it wrong u need to xxxxxxxxx" |
|
18:32
🔗
|
SketchCow |
I'd rather we find out where flaws are. How many bugfixes to git-annex has this caused? |
|
18:33
🔗
|
db48x |
several, yes |
|
18:39
🔗
|
pikhq |
And frankly it seems like as though git-annex is a decent fit for this, even if it has needed bug fixes or features added for it. :) |
|
18:39
🔗
|
Senji |
tpw_rules: I think shard6 is going to turn out to be an unusually busy shard by number of users |
|
18:41
🔗
|
Senji |
Remember that in the long term there are going to be hundreds of shards :) |
|
18:41
🔗
|
db48x |
thousands |
|
18:44
🔗
|
SketchCow |
I believe the number was ... 1440? |
|
18:44
🔗
|
db48x |
1770, if ever one has 100k files |
|
18:44
🔗
|
SketchCow |
But bear in mind ALSO that means ALL public data |
|
18:45
🔗
|
SketchCow |
Some of which, meh |
|
18:45
🔗
|
SketchCow |
I'd feel bad making people use that stuff |
|
18:45
🔗
|
db48x |
heh |
|
18:46
🔗
|
SketchCow |
In the long, long term (which the way we're doing things, what, July?) we might have encrypted shards. |
|
18:46
🔗
|
SketchCow |
But not definite |
|
18:47
🔗
|
sep332 |
to back up non-public data? |
|
18:50
🔗
|
mariusz |
SketchCow: currently each shard has some specific data, bundled together, stored at IA+3 places.. it will be harder to do but maybe it would also be good to have mixed shards stored at at least few places.. so when user dedicates the hd space, they will get some data from every shard that exists, just to spread the risks even firther |
|
18:50
🔗
|
mariusz |
*further |
|
18:52
🔗
|
mariusz |
so instead of dedicating 10tb of storage space to just one shard, i will be dedicating 10tb/1770 to each |
|
18:59
🔗
|
SketchCow |
I suspect that will happen |
|
19:12
🔗
|
|
mks has joined #internetarchive.bak |
|
19:15
🔗
|
db48x |
ok, I've got a patch that does shared locks |
|
19:15
🔗
|
db48x |
seems to work |
|
19:21
🔗
|
db48x |
oh, except for that bug |
|
19:55
🔗
|
iabak-reg |
03registrar 05master 43b7600 06other 10SHARD8/pubkeys registration of db48x iabak on SHARD8 |
|
20:10
🔗
|
|
mariusz has quit IRC (Ping timeout: 483 seconds) |
|
20:13
🔗
|
iabak-reg |
03registrar 05master d39c4da 06other 10SHARD7/pubkeys registration of db48x iabak on SHARD7 |
|
20:16
🔗
|
iabak-reg |
03registrar 05master ee09fd1 06other 10SHARD6/pubkeys registration of db48x iabak on SHARD6 |
|
20:26
🔗
|
|
sankin has quit IRC (Leaving.) |
|
20:59
🔗
|
iabak-reg |
03registrar 05master b2c689f 06other 10SHARD7/pubkeys registration of ia.bak on SHARD7 |
|
21:08
🔗
|
|
zottelbey has quit IRC (Remote host closed the connection) |
|
21:48
🔗
|
closure |
bear in mind that my estimate for the size of all the git repo data is somewhere in the 500 gb - 1 tb range .. |
|
21:52
🔗
|
db48x |
closure: I just saw that if it runs out of space while downloading a shard it will still go on to another new shard |
|
21:52
🔗
|
closure |
there's a check, but it may be broken, or perhaps doesn't notice if it was almost out of space and so gave up |
|
21:56
🔗
|
lhobas_ |
(confirmed broken on Mac OS) |
|
22:02
🔗
|
db48x |
closure: shared locks: https://github.com/db48x/IA.BAK/commit/db62b2275f249d2252c9866df3e3596449214d60 |
|
22:04
🔗
|
closure |
been up since 5 am, so *pass* ... |
|
22:04
🔗
|
db48x |
ok :) |
|
22:10
🔗
|
Senji |
Hmm, maybe I want to shim the shimmed wget |
|
22:12
🔗
|
Senji |
What I want is the functionality of multiple simultaneous downloads but with progress bars for each of them |
|
22:12
🔗
|
Senji |
Which could be done with tmux panes |
|
22:12
🔗
|
db48x |
git annex nearly has that |
|
22:12
🔗
|
closure |
still waiting on my progress bar guy to fix around 5 needed issues |
|
22:13
🔗
|
Senji |
Oh, great :-) |
|
22:14
🔗
|
Senji |
I'll stick with multiple single downloads for now then |