[00:02] doh, good questions just as my train is boarding [00:02] the status use your email address [00:02] stats [00:03] *** db48x has quit IRC (Quit: train) [00:04] I have to go to sleep but I'll keep looking into this tomorrow! and on a preperly hardend VM ;) [00:04] properly* [00:04] *** dingo has quit IRC (Quit: Page closed) [00:05] *** cmaldonad has quit IRC (Ping timeout: 255 seconds) [00:06] *** cmaldonad has joined #internetarchive.bak [00:48] *** cmaldonad has quit IRC (Quit: This computer has gone to sleep) [01:00] *** chfoo has quit IRC (Read error: Operation timed out) [01:00] *** chfoo has joined #internetarchive.bak [01:01] *** svchfoo3 sets mode: +o chfoo [01:28] *** cmaldonad has joined #internetarchive.bak [02:06] ok, so systemd has shat itself on the server, is not doing basic init stuff like process reaping [02:07] rebooted, that seems better [03:04] *** Rye has joined #internetarchive.bak [03:07] does anyone have experience running a node on a Raspberry Pi? [03:19] *** Stephen30 has joined #internetarchive.bak [03:47] Verified, someone with up to 1pb of storage is joining the set [03:47] Assuming it goes smoothly and we're not running into any other related speedbumps, that will give us... a boost [03:48] fantastic [03:48] Yes. [03:49] that will probably involve enough shards that the server will need more disk space (or additional server nodes) [03:49] I want to hit boundaries all over, yes [03:49] So, whatever server was providing that hit on 8080 seems not to be up yet. [03:50] yeah, I looked at that, and fixed one problem with graphite, but let's see if db45x can fix the remaining issue [03:50] I think yipdw can do it as well as db [03:51] /dev/sda3 117G 87G 28G 76% / [03:53] 23G of that is junk in my home directory, but yeah, it's filling up [03:53] around 1 gb per shard on the server, more or less (including the extra clone of the repo used for stats generation) [03:55] Interesting. really. [03:55] oops, that df is my laptop :) [03:55] /dev/simfs 80G 48G 33G 60% / [03:55] Do you need us to 1. Find another server 2. Put in cash for a drive expansion [03:56] kenshin might just be able to bump the disk, he's providing the server free [03:56] If we have to throw some cash at Kenshin, I'm sure we can do something [04:07] *** cmaldonad has quit IRC (Quit: This computer has gone to sleep) [04:10] aha, more downgrading "fixed" the graphite server [04:11] we have graphs again. Need moar red. 100x more [04:18] Thank you [04:23] *** thelsdj has quit IRC (Read error: Operation timed out) [04:27] *** thelsdj has joined #internetarchive.bak [04:28] ================================================================ [04:28] https://www.reddit.com/r/DataHoarder/comments/5cxtfl/a_plea_to_datahoarders_to_lend_space_for_the/ [04:28] It is now bringing up requests/questions about our startup scripts. [04:29] Can people step in and begin to help them? [04:29] ================================================================ [04:38] bumped to 120GB for now [04:38] host server runs SSDs so space is a bit of a premium [04:38] closure [04:38] dood [04:59] any suggestions on trying to get this fixed? https://git-annex.branchable.com/bugs/git-annex_won__39__t_execute_on_WD_My_Cloud_NAS/ as far as i can tell its not a known issue with haskell so might need to be reported upstream [05:40] adjusted page size to 32 kb for tonight's build, may fix it [05:41] (in 12 hours or so) [05:45] great, i'll give it a try tomorrow [05:50] they seem to have found a unique way to fuck over their users [05:50] reading elsewhere that the page size might be 64k [05:51] *** Stephen30 has quit IRC (Ping timeout: 268 seconds) [05:51] what was it previously set to or what was the default if it wasn't set? [05:52] i have a Drobo and this: http://www.drobo.com/drobo-solutions/drobo-apps/droboapps-sdk/ says its 16k [05:52] it's 4k everywhere [05:52] except there [05:52] try getconf PAGESIZE [05:52] i don't have getconf, might be somewhere in /proc, looking [05:54] yep, seems to be 16k [06:33] *** kyan has quit IRC (Quit: Leaving) [06:37] *** sevs has quit IRC (Ping timeout: 268 seconds) [07:55] *** phuzion has joined #internetarchive.bak [07:55] *** svchfoo3 sets mode: +o phuzion [08:25] *** jsp234 has quit IRC (Read error: Connection reset by peer) [08:28] *** jsp12345 has joined #internetarchive.bak [09:30] *** CyberJaco is now known as zz_CyberJ [10:28] *** Whopper_ has joined #internetarchive.bak [10:33] *** Whopper has quit IRC (Read error: Operation timed out) [11:40] *** joepie91 has quit IRC (Read error: Operation timed out) [11:41] *** SketchCo3 has joined #internetarchive.bak [11:41] *** joepie91 has joined #internetarchive.bak [11:41] *** sep332_ has quit IRC (Read error: Operation timed out) [11:41] *** randomdes has quit IRC (Write error: Broken pipe) [11:41] *** sep332_ has joined #internetarchive.bak [11:41] *** svchfoo3 has quit IRC (Read error: Operation timed out) [11:41] *** patricko- has quit IRC (Read error: Operation timed out) [11:42] *** patrickod has joined #internetarchive.bak [11:42] *** zz_CyberJ has quit IRC (Read error: Operation timed out) [11:42] *** zz_CyberJ has joined #internetarchive.bak [11:43] *** SketchCow has quit IRC (Read error: Operation timed out) [11:43] *** zz_CyberJ is now known as CyberJaco [11:43] *** Blackout has quit IRC (Read error: Operation timed out) [11:44] *** svchfoo3 has joined #internetarchive.bak [11:45] *** svchfoo1 sets mode: +o svchfoo3 [11:47] *** Start has quit IRC (Ping timeout: 506 seconds) [11:47] *** Blackout has joined #internetarchive.bak [11:48] *** Whopper_ is now known as whopper [11:50] *** randomdes has joined #internetarchive.bak [12:08] *** Start has joined #internetarchive.bak [12:34] *** fusl has joined #internetarchive.bak [13:06] *** Zippit has joined #internetarchive.bak [13:08] Where can I register? [13:17] you run the ./iabak script to register, details on that at http://iabak.archiveteam.org [13:17] Zippit: oh better link http://archiveteam.org/index.php?title=INTERNETARCHIVE.BAK/git-annex_implementation [13:18] I'm already on http://iabak.archiveteam.org/stats/ALL.leaderboard-raw [13:18] Does that imply I'm registed? [13:19] I think so yes [13:19] Cool, just making sure. :) Thanks Jon [13:19] I think it's derived from the email you provided when you ran the script ;there's no account per-se, or password, or 2FA or any of that stuff [13:20] * Jon is not on the leaderboard, for unknown reasons [13:21] I was just wondering why the "Top 25" had different names then the raw list [13:25] I figured I'd had to register somewhere [13:28] Yeah, I think that's something we need to look at in the future, letting people pick a username [13:48] No biggy, as long as my work gets registered. :) [13:48] Not that I download TB's of data and it's for nothing [13:50] afaik it just takes the local pat from your email [13:50] I probably broke something by including a + [13:51] *** TGMMilenk has joined #internetarchive.bak [13:52] *** cmaldonad has joined #internetarchive.bak [14:14] *** cmaldonad has quit IRC (Quit: This computer has gone to sleep) [14:27] *** Mephisto has joined #internetarchive.bak [15:50] *** atomotic has joined #internetarchive.bak [15:53] *** SketchCo3 is now known as SketchCow [15:54] *** svchfoo3 sets mode: +o SketchCow [15:59] So [15:59] We get 1pb of disk space [15:59] But it has a REST API and some interface [16:00] I believe it's worth doing the effort needed to do this [16:00] So I'll probably have someone here, with experience, add this 1pb share to their box [16:05] *** Zippit has quit IRC (Ping timeout: 260 seconds) [16:12] OK, they're registering my account, it'll be granted 1pb of space [16:13] This one? https://storj.io/api.html [16:13] Yes [16:25] Tech Support Request: https://www.reddit.com/r/DataHoarder/comments/5cxtfl/a_plea_to_datahoarders_to_lend_space_for_the/da0vp2j/ [16:26] Well, technically the REST API’s not even required, since they have a CLI tool for up/downloading, which can be configured as “special remote” with some bash magic. [16:27] PurpleSym: indeed, that is the way to do [16:27] just needs a simple shell script.. and some node close to the IP that can push a PB of data onto that network [16:30] by IP I mean IA [16:33] The datahoarders interaction has gone well. [16:33] Just two under the title of "I have a Grand Design Idea" [16:33] And a lot of people offering help [16:56] I'm upgraidin my storage next month :) ill make sure to add some extra disks [16:59] *** komarEX has joined #internetarchive.bak [16:59] hello everyone [17:01] hello [17:02] Heyyyyy [17:02] I have a question regarding iabak scripts [17:02] Go for it [17:03] I have turned them on and now I'm at Resolving deltas just after register on shard4 [17:03] it's doing quite a IO on my disk [17:03] it's not downloading right now right ? [17:03] it's regular git cloneing stuff, big repo so it will take a while [17:04] that's more or less a one-off cost [17:05] right.. I should have took a look on Google before asking here [17:07] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [17:09] for now I guess I will contribute about 700GB [17:09] later on maybe I will throw in additional 2-3TB [17:09] Always appreciated [17:10] is it possible to run same private keys on 2 different machines ? [17:10] *** sep332 has quit IRC (Konversation terminated!) [17:12] komarEX: just give the same email address, the key is per-repo [17:12] closure: oh is it, ok [17:13] *** iabak-reg has joined #internetarchive.bak [17:15] deltas take 360 IOPS of my raid huh [17:15] * closure welcomes iabak-reg back to the channel.. [17:15] ooh, notifications [17:15] 03registrar 05master c494453 06other fast forward [17:15] broke a while ago when the irc server it was using vanished [17:15] I love that guy [18:08] *** kyan has joined #internetarchive.bak [19:38] 03registrar 05master 6108708 06other 10SHARD9/pubkeys registration of mitch on SHARD9 [19:51] *** n00b295 has joined #internetarchive.bak [19:54] gotcha. Then our storage boxes should work well, we support FreeBSD and Linux variants. Config would be: [19:54] -8 core proc [19:55] -64GB RAM [19:55] -2 x 480GB SSD [19:55] -12 x 8TB [19:55] -JBOD setup [19:55] 96tb chunks would be nice [19:55] -20gbps network port [19:55] (Mail from another person) [19:55] *** kyan has quit IRC (Read error: Operation timed out) [20:02] 03registrar 05master 9f54e0f 06other 10SHARD3/pubkeys registration of kevin on SHARD3 [20:02] 03registrar 05master d6be8a4 06other 10SHARD9/pubkeys registration of sevs44936-iabak on SHARD9 [20:05] IA.BAK is at 106 clients [20:06] r/DataHoarders does it's deal [20:07] *** db48x has joined #internetarchive.bak [20:07] each shard is about 1TB right? [20:08] komarEX: most are a bit larger than that [20:09] komarEX: why do you ask? [20:09] It ranges wildly. [20:09] At this juncture, sub 500gb is asking for a lot of people who are only semi-up for dealing with CLI and the rest. [20:09] Plus the increments will be relatively slow [20:12] db48x: curious, eventually there will be a lot of shards :) [20:12] Yes [20:12] YESSSSS [20:12] We know [20:12] A good FAQ question [20:12] komarEX: a fair number of them, yes [20:13] Today backblaze posted Q3 disks summary [20:13] they are at 300PB of storage right now [20:15] *** kyan has joined #internetarchive.bak [20:17] 03registrar 05master 4d27249 06other 10SHARD4/pubkeys registration of chris on SHARD4 [20:18] that's crazy [20:18] 300PB of consumer-grade disks at that. [20:22] *** VADemon has joined #internetarchive.bak [20:25] 03registrar 05master 2e964f0 06other 10SHARD3/pubkeys registration of mitch on SHARD3 [20:25] *** Start has quit IRC (Quit: Disconnected.) [20:27] *** Start has joined #internetarchive.bak [20:28] 03registrar 05master 0e52e56 06other 10SHARD3/pubkeys registration of sevs44936-iabak on SHARD3 [20:33] 03registrar 05master 39b112d 06other 10SHARD12/pubkeys registration of sevs44936-iabak on SHARD12 [20:38] 03registrar 05master d645192 06other 10SHARD14/pubkeys registration of mike on SHARD14 [20:38] 03registrar 05master 1e9b032 06other 10SHARD14/pubkeys registration of iabak on SHARD14 [20:46] 03registrar 05master 81622ee 06other 10SHARD16/pubkeys registration of ojbmmxv on SHARD16 [20:46] *** Zippit has joined #internetarchive.bak [20:47] 03registrar 05master f7af6ff 06other 10SHARD4/pubkeys registration of ojbmmxv on SHARD4 [20:59] I recently started trying to do the backup but when I run iabak it gets to where it pull origin but fails with "fatal: refusing to merge unrelated histories", am I just missing something simple? [21:00] n00b295: can you show us the log? [21:01] *** atomotic has joined #internetarchive.bak [21:05] db48x: I just put the output at http://pastebin.com/qNzHw2pD [21:09] what directory are you in? [21:09] IA.BAK [21:10] is it not a git repository? [21:11] I cloned the git repository like the quickstart showed and then went into it and tried to run the iabak script [21:12] you must have had some problem the first time you ran it, and it's now in a bad state [21:12] n00b295: didn't you by any chance canceled script when you first started it ? [21:13] don't think it got canceled when first started [21:13] should i just start over and try again? [21:13] hm I would say rm -rf and again [21:13] will do [21:15] *** komarEX has left [21:19] 03registrar 05master 2adaeb6 06other 10SHARD3/pubkeys registration of mitch on SHARD3 [21:24] 03registrar 05master ae8ccd1 06other 10SHARD16/pubkeys registration of ojbmmxv on SHARD16 [21:25] I have that unrelated problem too, it consistently does it every single time I start fresh [21:25] unrelated histories problem [21:25] 03registrar 05master 7e43cdd 06other 10SHARD15/pubkeys registration of fusl on SHARD15 [21:27] 03registrar 05master 1c2cf86 06other 10SHARD14/pubkeys registration of abuse on SHARD14 [21:31] Meroje: to make debugging easier, can you edit iabak-helper to include set -x at the top? [21:31] then capture the entire log, starting from scratch [21:31] I tried downgrading to git 1.7 in case it was to do with newer defaults [21:32] 03registrar 05master cdf340a 06other 10SHARD15/pubkeys registration of meroje on SHARD15 [21:33] last command was ./checkoutshard shard15, I will add the flag there too [21:33] 03registrar 05master 07d7940 06other 10SHARD3/pubkeys registration of ojbmmxv on SHARD3 [21:36] 03registrar 05master 7147e88 06other 10SHARD10/pubkeys registration of ojbmmxv on SHARD10 [21:37] 03registrar 05master ef496ac 06other 10SHARD15/pubkeys registration of abuse on SHARD15 [21:39] so, with no shards but existing IA.BAK https://zerobin.lagout.org/?9fa35a9812f4fddd#O39xuzBrnuu3jorIUNLCd+AjERlazntWkEPGCCD/4lI= [21:42] 03registrar 05master 9250d94 06other 10SHARD4/pubkeys registration of mitch on SHARD4 [21:43] 03registrar 05master f41e9de 06other 10SHARD16/pubkeys registration of meroje on SHARD16 [21:44] 03registrar 05master 2e0969c 06other 10SHARD3/pubkeys registration of meroje on SHARD3 [21:45] 03registrar 05master 4f8b4b0 06other 10SHARD4/pubkeys registration of abuse on SHARD4 [21:48] Meroje: hmm [21:50] shard3 failed from the remote "remote: aborting due to possible repository corruption on the remote side.", I'll assume it's unrelated [21:50] Meroje: what filesystem are you using? [21:50] nfs on zfs [21:51] ugh, nfs [21:52] smb was not happy with cp preserving permissions [21:53] this is a question closure can answer [21:53] I don't know how direct-mode and indirect-mode repositories are supposed to interact [21:53] NFS SOLVES EVERYTHING [21:53] but you might try it on a non-crippled filesystem, even if you don't have enough space there to run it long-term [21:53] nfs is a steaming pile of shit [21:54] Meroje: I've got nfs working through zfs, sort of [21:54] Now now [21:54] I might end up running on ext4 and iscsi from that zfs pool [21:54] NFS is to computing like wooden cars are to cars [21:55] Meroje: maproot user set to root, mount via /etc/fstab, sudo ./iabak [21:55] yes that's what I have [21:55] 192.168.1.103:/mnt/red/IABAK /media/kurt/IABAK nfs rw,nfsvers=3,async,hard,intr,noacl 0 0 [21:55] forcing version 3 solved some other issues for me [21:55] *** octobyte has joined #internetarchive.bak [21:55] I will try your fstab options [21:57] now it's doing shard16 again, same unrelated histories error [21:58] if you don't have much in there, delete and start again? [21:58] doing that now [21:58] Hey there, I'm attempting to run the bash scripts provided on the GitHub using FreeBSD on my spare NAS space. I'm unable to begin downloading shards because I *think* my ssh key is being rejected? Not quite sure. I have an RSA 4096 key in my ~/.ssh directory. Getting warning message "Warning: Identity file -i not accessible: No such file or directory." when manually executing ./checkoutshard shard10 [21:58] Sorry for the interrupt [21:58] octobyte: the iabak script creates a key for you to use specifically with iabak [21:59] octobyte: since it couldn't access it, that must have failed [21:59] Ah right, okay. I don't think I saw that key get generated [22:00] 03registrar 05master 2e00748 06other 10SHARD12/pubkeys registration of meroje on SHARD12 [22:00] db48x: Let me run ./iabak from a clean git clone again and I'll pop up a pastebin of the output [22:00] 03registrar 05master 2fee4c7 06other 10SHARD15/pubkeys registration of ojbmmxv on SHARD15 [22:00] well now every new file belongs to root, so cp fails [22:00] Ah there we go [22:01] ojbmmxv is me [22:01] 03registrar 05master a5076ee 06other 10SHARD3/pubkeys registration of meroje on SHARD3 [22:02] Ok something failed on L35 flock.pl. I'm guessing this is just FreeBSD junk not getting added to /bin/ [22:02] is it missing CGI octobyte ? [22:02] Meroje: I had to manually install it for p5 [22:03] "No such file or directory at /root/IA.BAK/flock.pl line 35." [22:03] L35 is opening a file [22:04] "open(FH, '>', $file) || die($!);" [22:04] I don't know a word of perl [22:04] what was the actual error? [22:04] I think the first time .git/annex folder does not exist yet, I get warnings from flock about that [22:04] Let me pastebin everything so you can get a better look, 1 sec [22:05] then something must have failed even further up :P [22:05] 03registrar 05master 5d545a3 06other 10SHARD4/pubkeys registration of octobyt3 on SHARD4 [22:06] git 2.7.4 made a change preventing merging of unrelated histories. [22:07] even in an empty repository? [22:07] http://pastebin.com/raw/FXTANudg [22:07] yes, it's a bad decision [22:07] that might be the exact version I picked when downgrading, whoops [22:07] *** sep332efn has joined #internetarchive.bak [22:07] *** sep332efn is now known as sep332 [22:07] yes [22:08] I'm compiling again then [22:08] so, checkoutshard does make an empty repo and then add a remote and so that's probably triggering that git behavior change [22:09] Mine does make an empty repo, yeah [22:11] but, if there's no master branch at all in the newly inited repo, it should not fall afoul of the unrelated histories check [22:11] there is a master branch [22:12] hmm, is it using direct mode for your repository? [22:12] I never used git annex standalone, how do I get that info ? [22:12] yeah, I think I've reproed it using direct mode [22:13] git annex info | head -n 1 [22:13] repository mode: direct [22:13] closure: has armel nightly build happened yet since you changed page size? [22:14] 03registrar 05master bdb55b0 06other 10SHARD4/pubkeys registration of meroje on SHARD4 [22:14] does iabak work with multiple drives on a single system? or do they need to be in a single volume? [22:14] trying with git 2.7.3 [22:17] thelsdj: I think it failed for an unrelated reason [22:18] 03registrar 05master a597b48 06other 10SHARD16/pubkeys registration of octobyt3 on SHARD16 [22:23] something you can fix and kick off again or do i need to wait to tomorrow or should i follow up with someone else to get the unrelated issue fixed? [22:25] *** atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [22:26] 03registrar 05master 04e9555 06other 10SHARD16/pubkeys registration of octobyt3 on SHARD16 [22:26] couldn't see a way to fix the unrelated histories merge in iabak, so I've fixed it in git-annex [22:26] next daily build will have the fix [22:27] pity, they never added a git config option to disable that check.. [22:27] I'm still having failure with git 1.7.3, I'll wait on the daily build then [22:28] 2.7.3 might still have the check; the version they added it at was somewhere around there [22:28] anyway, iabak pulls down a git-annex tarball that includes its own copy of git [22:29] oh, didn't see that one [22:29] delete that from git-annex.linux and it'll use your system git [22:35] 03registrar 05master 14654dc 06other 10SHARD3/pubkeys registration of octobyt3 on SHARD3 [22:35] Sod it I'll just install a different distro [22:36] Xibalba: each SHARD directory can be put on a different drive [22:37] but unless you manually move them, it only uses the drive where you have cloned the IA.BAK git repo to [22:39] 03registrar 05master 0757c49 06other 10SHARD16/pubkeys registration of meroje on SHARD16 [22:40] now on 2.6.4 [22:41] welp [22:43] *** Mephisto has quit IRC (Read error: Connection reset by peer) [22:56] *** db48x has quit IRC (Read error: Connection reset by peer) [22:57] *** db48x has joined #internetarchive.bak [23:00] still doing it, is it really using the git executable ? [23:01] *** n00b295 has quit IRC (Quit: http://chat.efnet.org ) [23:24] *** n00b108 has joined #internetarchive.bak [23:25] *** n00b108 has quit IRC (Client Quit) [23:29] *** VADemon has quit IRC (Read error: Connection reset by peer) [23:36] 03registrar 05master dc509aa 06other 10SHARD9/pubkeys registration of octobyt3 on SHARD9 [23:36] *** octobyte has quit IRC (Quit: Page closed) [23:48] 03registrar 05master 242a158 06other 10SHARD10/pubkeys registration of mike on SHARD10