[00:29] *** Start has joined #internetarchive.bak [01:55] It seems my ia.bak doesn't obey the "git config annex.diskreserve 300GB" command. I ran it in each shard directory I have. Does anyone have any idea what I might be doing wrong? [01:58] *** primus104 has quit IRC (Leaving.) [05:58] *** SketchCow has quit IRC (Ping timeout: 1221 seconds) [06:01] *** svchfoo3 has quit IRC (west.us.hub irc.eversible.com) [06:01] *** primus has quit IRC (west.us.hub irc.eversible.com) [06:01] *** ersi has quit IRC (west.us.hub irc.eversible.com) [06:01] *** espes___ has quit IRC (west.us.hub irc.eversible.com) [06:01] *** bpye has quit IRC (west.us.hub irc.eversible.com) [06:01] *** ohhdemgir has quit IRC (west.us.hub irc.eversible.com) [06:01] *** serapeum has quit IRC (west.us.hub irc.eversible.com) [06:01] *** destrudo has quit IRC (west.us.hub irc.eversible.com) [06:01] *** Cameron_D has quit IRC (west.us.hub irc.eversible.com) [06:05] *** destrudo_ has joined #internetarchive.bak [06:05] *** ersi_ has joined #internetarchive.bak [06:09] *** bpye_ has joined #internetarchive.bak [06:12] *** SketchCow has joined #internetarchive.bak [06:12] *** svchfoo1 sets mode: +o SketchCow [06:16] *** espes__ has joined #internetarchive.bak [06:30] *** serapeum has joined #internetarchive.bak [06:33] *** primus has joined #internetarchive.bak [06:45] *** destrudo_ is now known as destrudo [06:45] *** ohhdemgir has joined #internetarchive.bak [06:47] *** Cameron_D has joined #internetarchive.bak [07:07] *** niyaje4 has joined #internetarchive.bak [07:20] *** niyaje4 has quit IRC (Ping timeout: 600 seconds) [07:27] *** primus104 has joined #internetarchive.bak [07:34] 03registrar 05master 9f1cd36 06other 10SHARD3/pubkeys registration of primus1024 on SHARD3 [07:34] 03registrar 05master 4a1f463 06other 10SHARD4/pubkeys registration of primus1024 on SHARD4 [07:40] *** atomotic has joined #internetarchive.bak [07:42] It looks like some items have local path instead of web address: http://pastebin.com/pw74WVK2 [07:45] interesting, that's actually part of the filename on IA: https://archive.org/download/AmigaFormat1994BuyersGuide1994FuturePublishingGBSupplementIssue054300dpi [08:00] primus: do a git annex whereis on that file and see what the url is [08:01] thanks, i have to go out atm, I'll do it when i come back if that's ok. [08:04] sure [08:26] *** primus104 has quit IRC (Leaving.) [09:01] *** cloudmons has quit IRC (ircd.choopa.net irc.mzima.net) [10:04] There's a bad file in shard2 :-( - fsck 1880_census/10thcensus0024unit/10thcensus0024unit_archive.torrent Bad file size (54 B larger); moved to .git/annex/bad/MD5-s40260--c37ad5ccd5ae9fd7354fa74693119d7d [10:04] failed [10:05] only in your copy :) [10:05] do a git annex get on that file to download it again, then compare the two [10:06] I only just did download that file, 'cos noticed shard2 had a file that wasn't entirely backed up [10:07] I shall try getting it again again though, it's not large :) [10:09] Yes, it's consistently getting as the same wrong file with 54 bytes too many [10:10] 03registrar 05master bfd412b 06other 10SHARD4/pubkeys registration of paul.chambers on SHARD4 [10:15] weird [10:16] git annex info --bytes says that it should be 40260 bytes, but the file is actually 40314 [10:17] *** primus104 has joined #internetarchive.bak [10:18] even weirder, the mtime on the file (as given by the metadata on archive.org) is march 13th, and the file was added to annex on april 3 [10:18] 3rd [10:19] it's possible that the file changed but the mtime didn't [10:19] But that's not supposed to happen [10:21] the md5 of the file as currently downloaded from IA is ce18e897499ea244e96557b4f35f6b19, which matches what's in the metadata [10:22] but it doesn't match the key in the annex repository, which is MD5-s40260--c37ad5ccd5ae9fd7354fa74693119d7d [10:28] *** raylee has quit IRC (Ping timeout: 240 seconds) [10:33] *** raylee has joined #internetarchive.bak [10:39] *** atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…) [11:31] *** atomotic has joined #internetarchive.bak [11:47] *** atomotic has quit IRC (hub.se efnet.port80.se) [11:47] *** serapeum has quit IRC (hub.se efnet.port80.se) [11:47] *** bpye_ has quit IRC (hub.se efnet.port80.se) [11:47] *** Kazzy has quit IRC (hub.se efnet.port80.se) [11:47] *** Muad-Dib has quit IRC (hub.se efnet.port80.se) [11:47] *** GLaDOS has quit IRC (hub.se efnet.port80.se) [11:47] *** antomati_ has quit IRC (hub.se efnet.port80.se) [11:47] *** jbenet_ has quit IRC (hub.se efnet.port80.se) [11:47] *** Lord_Nigh has quit IRC (hub.se efnet.port80.se) [11:47] *** balrog has quit IRC (hub.se efnet.port80.se) [11:47] *** svchfoo2 has quit IRC (hub.se efnet.port80.se) [11:47] *** ppiixx has quit IRC (hub.se efnet.port80.se) [11:47] *** Vito` has quit IRC (hub.se efnet.port80.se) [11:47] *** lhobas has quit IRC (hub.se efnet.port80.se) [11:47] *** mattl has quit IRC (hub.se efnet.port80.se) [11:47] *** mrfoo has quit IRC (hub.se efnet.port80.se) [12:04] *** atomotic has joined #internetarchive.bak [12:04] *** serapeum has joined #internetarchive.bak [12:04] *** bpye_ has joined #internetarchive.bak [12:04] *** Kazzy has joined #internetarchive.bak [12:04] *** Muad-Dib has joined #internetarchive.bak [12:04] *** GLaDOS has joined #internetarchive.bak [12:04] *** mattl has joined #internetarchive.bak [12:04] *** antomati_ has joined #internetarchive.bak [12:04] *** jbenet_ has joined #internetarchive.bak [12:04] *** Lord_Nigh has joined #internetarchive.bak [12:04] *** balrog has joined #internetarchive.bak [12:04] *** svchfoo2 has joined #internetarchive.bak [12:04] *** ppiixx has joined #internetarchive.bak [12:04] *** Vito` has joined #internetarchive.bak [12:04] *** lhobas has joined #internetarchive.bak [12:04] *** mrfoo has joined #internetarchive.bak [12:04] *** efnet.port80.se sets mode: +ooo Kazzy GLaDOS svchfoo2 [12:56] *** sankin has joined #internetarchive.bak [13:16] *** sankin has quit IRC (Leaving.) [13:48] *** sankin has joined #internetarchive.bak [14:01] *** rhetoricX has joined #internetarchive.bak [15:15] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [15:54] *** svchfoo3 has joined #internetarchive.bak [15:55] *** svchfoo2 sets mode: +o svchfoo3 [16:21] this business with the different md5sums is because the census does not reflect changes made to the IA after the census was taken. [16:21] c37ad5ccd5ae9fd7354fa74693119d7d 40260 1880_census https://archive.org/download/10thcensus0024unit/10thcensus0024unit_archive.torrent [16:28] ah [16:38] *** primus105 has joined #internetarchive.bak [16:41] *** primus104 has quit IRC (Read error: Operation timed out) [16:56] *** primus104 has joined #internetarchive.bak [16:59] closure: why doesn't git annex get verify the checksum of the file when it downloads it? [17:03] *** primus105 has quit IRC (Read error: Operation timed out) [17:27] *** Start has quit IRC (Disconnected.) [17:42] *** rhetoricX has quit IRC (Quit: Leaving) [18:20] *** SketchCo1 has joined #internetarchive.bak [18:24] *** ersi has joined #internetarchive.bak [18:24] *** svchfoo2 sets mode: +o ersi [18:24] *** svchfoo3 sets mode: +o ersi [18:25] *** SketchCow has quit IRC (hub.efnet.us irc.colosolutions.net) [18:25] *** ersi_ has quit IRC (hub.efnet.us irc.colosolutions.net) [18:25] *** swebb has quit IRC (hub.efnet.us irc.colosolutions.net) [18:30] *** swebb_ has joined #internetarchive.bak [18:40] *** swebb_ is now known as swebb [19:02] *** kyan has joined #internetarchive.bak [19:06] *** SketchCo1 is now known as sketchcow [19:18] *** svchfoo1 has quit IRC (Quit: Closing) [19:19] *** svchfoo1 has joined #internetarchive.bak [19:20] *** svchfoo2 sets mode: +o svchfoo1 [19:20] *** svchfoo3 sets mode: +o svchfoo1 [19:31] *** Start has joined #internetarchive.bak [20:22] *** Start has quit IRC (Disconnected.) [20:58] *** sankin has quit IRC (Leaving.) [21:49] *** Start-mob has joined #internetarchive.bak [21:56] *** Start-mob has quit IRC (Ping timeout: 370 seconds) [22:48] *** Start has joined #internetarchive.bak [22:49] *** trs80 has quit IRC (Ping timeout: 186 seconds) [23:09] *** trs80 has joined #internetarchive.bak [23:29] *** primus104 has quit IRC (Leaving.) [23:35] *** kyan has quit IRC (Read error: Connection reset by peer)