| Time |
Nickname |
Message |
|
00:46
🔗
|
|
kyan has joined #internetarchive.bak |
|
01:06
🔗
|
iabak-reg |
03registrar 05master 28b2d63 06other 10SHARD16/pubkeys registration of corin.thorpe on SHARD16 |
|
03:50
🔗
|
|
VADemon has quit IRC (Quit: left4dead) |
|
04:21
🔗
|
|
Frogging has quit IRC (Read error: Operation timed out) |
|
04:21
🔗
|
|
Frogging has joined #internetarchive.bak |
|
04:23
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
04:25
🔗
|
|
Start has joined #internetarchive.bak |
|
04:25
🔗
|
|
Start has quit IRC (Client Quit) |
|
04:25
🔗
|
|
Start has joined #internetarchive.bak |
|
04:25
🔗
|
|
Start has quit IRC (Client Quit) |
|
04:26
🔗
|
|
Start has joined #internetarchive.bak |
|
04:26
🔗
|
|
Start has quit IRC (Client Quit) |
|
04:27
🔗
|
|
Start has joined #internetarchive.bak |
|
04:27
🔗
|
|
Start has quit IRC (Client Quit) |
|
04:28
🔗
|
|
Start has joined #internetarchive.bak |
|
05:16
🔗
|
|
kyan has quit IRC (Remote host closed the connection) |
|
05:33
🔗
|
|
joepie91 has quit IRC (Read error: Operation timed out) |
|
05:40
🔗
|
|
joepie91 has joined #internetarchive.bak |
|
05:46
🔗
|
|
ivan has quit IRC (Leaving) |
|
05:46
🔗
|
|
marvinw has joined #internetarchive.bak |
|
06:20
🔗
|
|
Start has quit IRC (Remote host closed the connection) |
|
06:22
🔗
|
|
Start has joined #internetarchive.bak |
|
06:36
🔗
|
|
marvinw has quit IRC (west.us.hub irc.colosolutions.net) |
|
06:38
🔗
|
|
marvinw_ has joined #internetarchive.bak |
|
07:57
🔗
|
iabak-reg |
03registrar 05master 3e07262 06other 10SHARD19/pubkeys registration of corin.thorpe on SHARD19 |
|
10:07
🔗
|
|
atomotic has joined #internetarchive.bak |
|
11:53
🔗
|
iabak-reg |
03registrar 05master c88bd72 06other 10SHARD12/pubkeys registration of wo_2iabak on SHARD12 |
|
12:12
🔗
|
db48x |
SketchCow: I got distracted last night. Do you know what his question was? |
|
12:17
🔗
|
iabak-reg |
03registrar 05master fd33b82 06other 10SHARD17/pubkeys registration of wo_2iabak on SHARD17 |
|
12:18
🔗
|
iabak-reg |
03registrar 05master 1e22941 06other 10SHARD15/pubkeys registration of wo_2iabak on SHARD15 |
|
12:20
🔗
|
iabak-reg |
03registrar 05master 112d0d2 06other 10SHARD6/pubkeys registration of wo_2iabak on SHARD6 |
|
12:32
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
12:57
🔗
|
iabak-reg |
03registrar 05master bfd346d 06other 10SHARD14/pubkeys registration of wo_2iabak on SHARD14 |
|
12:58
🔗
|
db48x |
oh, I found a log |
|
13:00
🔗
|
iabak-reg |
03registrar 05master 14e004b 06other 10SHARD11/pubkeys registration of wo_2iabak on SHARD11 |
|
13:04
🔗
|
db48x |
fusl: that's not a problem I've personally seen before |
|
13:05
🔗
|
db48x |
in principle I can see it happening if you started iabak running without a reservation and then after it had started on several shards added one in |
|
13:05
🔗
|
db48x |
because of the way it looks for the reservation setting, if you didn't set the same reservation setting in all your shards, you could end up with new shards getting the wrong setting |
|
13:25
🔗
|
iabak-reg |
03registrar 05master c578f88 06other 10SHARD16/pubkeys registration of wo_2iabak on SHARD16 |
|
13:26
🔗
|
iabak-reg |
03registrar 05master 3b6c1eb 06other 10SHARD18/pubkeys registration of wo_2iabak on SHARD18 |
|
13:27
🔗
|
iabak-reg |
03registrar 05master 8633742 06other 10SHARD5/pubkeys registration of wo_2iabak on SHARD5 |
|
13:29
🔗
|
db48x |
closure: to continue our conversation from where I lost the thread, I agree that reimplementing all of the command parsing is a bad idea |
|
13:31
🔗
|
db48x |
closure: but if all of these commands accept input on stdin the way fromkey and registerurl do, then extending that to a universal batch command seems trvial |
|
13:31
🔗
|
db48x |
trivial |
|
13:31
🔗
|
db48x |
it just looks for the command name at the beginning of the line, strips it off, and feeds the rest to the named command |
|
13:33
🔗
|
db48x |
of course I say trivial, but I'm not even sure how to add a new command |
|
13:44
🔗
|
* |
db48x facepalms |
|
13:45
🔗
|
db48x |
it wants libmagic, not libmagick |
|
14:00
🔗
|
iabak-reg |
03registrar 05master 1f12fc9 06other 10SHARD19/pubkeys registration of wo_2iabak on SHARD19 |
|
14:58
🔗
|
db48x |
closure: I must be doing something wrong; I can't get this to work: |
|
14:58
🔗
|
db48x |
command "fromkey" SectionPlumbing "adds a file using a specific key" |
|
14:58
🔗
|
db48x |
- (paramPair paramKey paramPath) |
|
14:58
🔗
|
db48x |
+ (paramRepeating (paramPair paramKey paramPath)) |
|
14:58
🔗
|
db48x |
(withParams seek) |
|
15:10
🔗
|
db48x |
I expected it to at least modify the help output, and to at least use the first two args and then throw away the others |
|
15:39
🔗
|
|
VADemon has joined #internetarchive.bak |
|
15:48
🔗
|
|
atomotic has joined #internetarchive.bak |
|
17:24
🔗
|
|
FluffyFox has joined #internetarchive.bak |
|
17:27
🔗
|
|
svchfoo1 has quit IRC (Read error: Operation timed out) |
|
17:27
🔗
|
|
MrRadar has quit IRC (Read error: Operation timed out) |
|
17:27
🔗
|
|
Frogging has quit IRC (Read error: Operation timed out) |
|
17:27
🔗
|
|
FluffyFox is now known as Frogging |
|
17:28
🔗
|
|
Cameron_D has quit IRC (Ping timeout: 370 seconds) |
|
17:28
🔗
|
|
thelsdj has quit IRC (Read error: Operation timed out) |
|
17:34
🔗
|
|
hawc145 has joined #internetarchive.bak |
|
17:44
🔗
|
|
HCross has quit IRC (ny.us.hub irc.servercentral.net) |
|
17:44
🔗
|
|
kula has quit IRC (ny.us.hub irc.servercentral.net) |
|
17:44
🔗
|
|
LightBulb has quit IRC (ny.us.hub irc.servercentral.net) |
|
17:50
🔗
|
|
svchfoo1 has joined #internetarchive.bak |
|
17:50
🔗
|
|
kula has joined #internetarchive.bak |
|
17:50
🔗
|
|
thelsdj_ has joined #internetarchive.bak |
|
17:50
🔗
|
|
LightBulb has joined #internetarchive.bak |
|
17:50
🔗
|
|
svchfoo3 sets mode: +o svchfoo1 |
|
17:51
🔗
|
|
MrRadar has joined #internetarchive.bak |
|
17:51
🔗
|
|
Cameron_D has joined #internetarchive.bak |
|
17:51
🔗
|
|
svchfoo3 sets mode: +o Cameron_D |
|
18:09
🔗
|
fusl |
db48x: it even had 100G in the configuration file and didnt care about it |
|
18:11
🔗
|
closure |
db48x: unfortunately that is a almost-but-not-quite vestigial help usage generator, but does not influence the actual option parser |
|
18:11
🔗
|
closure |
(can help more later) |
|
18:13
🔗
|
closure |
db48x: probably will be easier for me to add the batch stuff, since I know how the existing interface to do it works.. I assume you just want fromkey --batch .. |
|
18:38
🔗
|
|
atomotic has quit IRC (Quit: My MacBook has gone to sleep. ZZZzzz…) |
|
18:59
🔗
|
|
hawc145 is now known as HCross |
|
19:01
🔗
|
|
atomotic has joined #internetarchive.bak |
|
19:23
🔗
|
db48x |
closure: ah |
|
19:24
🔗
|
db48x |
closure: I use rmurl as well; it'd be nice to feed that on stdin too |
|
19:25
🔗
|
db48x |
fusl: odd. was there any funny business going on with partitions and filesystems? |
|
19:35
🔗
|
Frogging |
I'm getting a lot of Unable to access these remotes: web |
|
19:35
🔗
|
Frogging |
is there something wrong with the items? something wrong with IA? maybe it's my system? |
|
19:35
🔗
|
Frogging |
this is one that failed get MD5-s2777--03ff1b7e5fd583a8f2c41ce2d363d494 (from web...) |
|
20:10
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
20:16
🔗
|
iabak-reg |
03registrar 05master dcbd879 06other 10SHARD19/pubkeys registration of peter on SHARD19 |
|
20:31
🔗
|
db48x |
Frogging: you'll get one of three error messages |
|
20:31
🔗
|
db48x |
that all look quite similar |
|
20:32
🔗
|
db48x |
either it couldn't actually make an http connection (unlikely, we hope), or it downloaded the file but downloaded something that didn't match was is recorded in the repository (you'll see that it "failed to verify" the file; it just means that the file was changed since we made the shard) |
|
20:33
🔗
|
db48x |
or you'll see that it could connect to IA but the file wasn't found (a 404 error), in which case the file exists on the IA and in our backup, but has gone dark; IA is no longer distributing it |
|
21:07
🔗
|
Frogging |
I think it was a 404. I'll look more closely next time |
|
21:37
🔗
|
|
VADemon has quit IRC (Quit: left4dead) |
|
21:37
🔗
|
db48x |
Frogging: that's ok then; it's expected |
|
21:37
🔗
|
Frogging |
all right |
|
21:37
🔗
|
db48x |
items go dark from time to time, and they get modified from time to time |
|
21:37
🔗
|
db48x |
(new metadata is pretty common, for instance) |
|
21:38
🔗
|
db48x |
Frogging: shorltly we'll have an automated process that goes into IA and finds these and other changes and updates the repositories |
|
21:38
🔗
|
db48x |
the dark files will no longer be listed as being accessible from IA, so it won't try to download them |
|
21:39
🔗
|
db48x |
modified files will be updated in our backups more frequently, so that will come up less often as well |
|
21:39
🔗
|
db48x |
and new items will be added to our backups to match what has been added to IA since they were first created |
|
21:56
🔗
|
|
svchfoo1 has quit IRC (Read error: Operation timed out) |
|
21:57
🔗
|
SketchCow |
db48x: Is there information fusl can give you with his filled items to help? |
|
22:00
🔗
|
|
Cameron_D has quit IRC (Ping timeout: 370 seconds) |
|
22:01
🔗
|
|
MrRadar has quit IRC (Ping timeout: 370 seconds) |
|
22:01
🔗
|
|
thelsdj_ has quit IRC (Ping timeout: 370 seconds) |
|
22:01
🔗
|
|
kula_ has joined #internetarchive.bak |
|
22:02
🔗
|
|
kula has quit IRC (Read error: Operation timed out) |
|
22:07
🔗
|
|
kula has joined #internetarchive.bak |
|
22:08
🔗
|
|
thelsdj_ has joined #internetarchive.bak |
|
22:09
🔗
|
|
Cameron_D has joined #internetarchive.bak |
|
22:10
🔗
|
|
svchfoo3 sets mode: +o Cameron_D |
|
22:10
🔗
|
|
svchfoo1 has joined #internetarchive.bak |
|
22:11
🔗
|
|
svchfoo3 sets mode: +o svchfoo1 |
|
22:12
🔗
|
|
MrRadar has joined #internetarchive.bak |
|
22:18
🔗
|
iabak-reg |
03registrar 05master 4beef4c 06other 10SHARD18/pubkeys registration of peter on SHARD18 |
|
22:19
🔗
|
iabak-reg |
03registrar 05master 54691d9 06other 10SHARD5/pubkeys registration of peter on SHARD5 |
|
22:19
🔗
|
|
kula_ has quit IRC (Read error: Operation timed out) |
|
22:30
🔗
|
iabak-reg |
03registrar 05master 25c5ffb 06other 10SHARD16/pubkeys registration of peter on SHARD16 |
|
22:31
🔗
|
iabak-reg |
03registrar 05master 6e2e540 06other 10SHARD17/pubkeys registration of peter on SHARD17 |
|
22:32
🔗
|
iabak-reg |
03registrar 05master fa66028 06other 10SHARD12/pubkeys registration of peter on SHARD12 |
|
22:40
🔗
|
iabak-reg |
03registrar 05master 8103a48 06other 10SHARD14/pubkeys registration of peter on SHARD14 |
|
22:42
🔗
|
iabak-reg |
03registrar 05master f632f37 06other 10SHARD15/pubkeys registration of peter on SHARD15 |
|
22:43
🔗
|
iabak-reg |
03registrar 05master d73d478 06other 10SHARD6/pubkeys registration of peter on SHARD6 |
|
22:55
🔗
|
iabak-reg |
03registrar 05master 68b82b5 06other 10SHARD11/pubkeys registration of peter on SHARD11 |
|
23:03
🔗
|
iabak-reg |
03registrar 05master 77b4cd4 06other 10SHARD10/pubkeys registration of peter on SHARD10 |