#internetarchive.bak 2016-12-02,Fri

↑back Search

Time Nickname Message
00:07 🔗 thelsdj has quit IRC (ny.us.hub irc.servercentral.net)
00:07 🔗 yipdw has quit IRC (ny.us.hub irc.servercentral.net)
00:07 🔗 kula has quit IRC (ny.us.hub irc.servercentral.net)
00:07 🔗 svchfoo1 has quit IRC (ny.us.hub irc.servercentral.net)
00:14 🔗 Start has joined #internetarchive.bak
00:21 🔗 svchfoo1 has joined #internetarchive.bak
00:21 🔗 kula has joined #internetarchive.bak
00:21 🔗 Cameron_D has joined #internetarchive.bak
00:21 🔗 thelsdj has joined #internetarchive.bak
00:21 🔗 MrRadar has joined #internetarchive.bak
00:22 🔗 svchfoo3 sets mode: +o Cameron_D
00:23 🔗 svchfoo3 sets mode: +o svchfoo1
01:17 🔗 Start has quit IRC (Quit: Disconnected.)
01:20 🔗 Start has joined #internetarchive.bak
01:37 🔗 VADemon has quit IRC (Quit: left4dead)
02:27 🔗 Milenko_ has joined #internetarchive.bak
02:28 🔗 Milenko_ Is there a way to force the client to run a checksum on the downloaded data?
02:28 🔗 Milenko_ I'm testing running the client on a FUSE mount and I want to make sure the data is there and available
02:30 🔗 Frogging The README in the repo suggests that you run the iabak script (not the iabak-cronjob script, as it does not verify checksums)
02:30 🔗 Frogging https://github.com/ArchiveTeam/IA.BAK
02:30 🔗 Milenko_ My understanding was that it only does it every 30 days though
02:38 🔗 Frogging indeed it looks like it does --incremental-schedule 30d
02:38 🔗 Frogging https://github.com/ArchiveTeam/IA.BAK/blob/master/iabak-helper#L224
02:38 🔗 thelsdj you can probably just manually run git annex fsck in the shard directory
02:39 🔗 Frogging ^yeah
02:39 🔗 Frogging with --time-limit if you want
02:39 🔗 Frogging https://git-annex.branchable.com/git-annex-fsck/
02:39 🔗 Frogging I'm a little bit confused because it looks like it runs this "fsckme" function regardless of CRONJOB==1
03:01 🔗 Milenko_ manual fsck is running now, will report back in a bit
03:26 🔗 copropha1 is now known as coprophag
04:12 🔗 iabak-reg 03registrar 05master 53b2b27 06other 10SHARD18/pubkeys registration of georgedorn on SHARD18
04:39 🔗 Milenko_ has quit IRC (Ping timeout: 633 seconds)
07:47 🔗 db48x has joined #internetarchive.bak
09:08 🔗 LightBulb has joined #internetarchive.bak
09:08 🔗 LightBulb Is anyone able to help me with the issue "Ran out of shards to download before you ran out of disk space"?
09:12 🔗 yipdw_ is now known as yipdw
09:12 🔗 svchfoo1 sets mode: +o yipdw
09:14 🔗 Senji I'm not one of the "staff" but as I understand it it's a known issue and the only workaround so far is just to rerun iabak
09:19 🔗 hawc145 is now known as HCross
09:34 🔗 HCross has quit IRC (Read error: Connection reset by peer)
09:35 🔗 HCross has joined #internetarchive.bak
09:35 🔗 kurt has quit IRC (Read error: Operation timed out)
09:38 🔗 kurt has joined #internetarchive.bak
10:27 🔗 tpw_rules has quit IRC (Read error: Operation timed out)
10:29 🔗 tpw_rules has joined #internetarchive.bak
10:29 🔗 svchfoo1 sets mode: +o tpw_rules
10:42 🔗 LightBulb Ahh right. I keep rerunning and always get the same result. Disk is sitting at 99% free
11:29 🔗 iabak-reg 03registrar 05master d3d0c79 06other 10SHARD17/pubkeys registration of corin.thorpe on SHARD17
12:54 🔗 VADemon has joined #internetarchive.bak
16:51 🔗 atomotic has joined #internetarchive.bak
17:41 🔗 db48x LightBulb: I've been testing a change that restores the old behavior
17:41 🔗 db48x LightBulb: how much has it actually downloaded?
17:41 🔗 atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
18:09 🔗 owl has joined #internetarchive.bak
18:41 🔗 owl has quit IRC (Read error: Operation timed out)
19:04 🔗 Kaz db48x: mind sending the 'changed' version over? will test it on my local install
19:12 🔗 owl has joined #internetarchive.bak
19:12 🔗 owl has quit IRC (Client Quit)
19:42 🔗 jbenet___ has joined #internetarchive.bak
20:15 🔗 db48x Kaz: even better, I can just push it
20:35 🔗 Kaz that would indeed be better
20:36 🔗 db48x I ran it all night and it seemed to work just fine
20:37 🔗 Kaz running now and thrown another 1TB at it, will see how we go
23:05 🔗 LightBulb db48x - Total directory size of IA.BAK is 4.1G
23:09 🔗 iabak-reg 03registrar 05master e438eee 06other 10SHARD19/pubkeys registration of me on SHARD19
23:10 🔗 Kaz doesn't seem to be playing nicely for me, still
23:10 🔗 Kaz shard10 log: https://static.kurtmclester.com/s/505h3366.png
23:25 🔗 LightBulb db48x - I've just re-cloned the files and it seems to be playing ball now.
23:33 🔗 db48x LightBulb: well, that is a little rediculous
23:34 🔗 db48x or rather, Kaz
23:34 🔗 db48x Kaz: can you run it with -x?
23:56 🔗 Kaz can do tomorrow, I'm about to pass out

irclogger-viewer