| Time |
Nickname |
Message |
|
00:02
🔗
|
db48x |
doh, good questions just as my train is boarding |
|
00:02
🔗
|
db48x |
the status use your email address |
|
00:02
🔗
|
db48x |
stats |
|
00:03
🔗
|
|
db48x has quit IRC (Quit: train) |
|
00:04
🔗
|
dingo |
I have to go to sleep but I'll keep looking into this tomorrow! and on a preperly hardend VM ;) |
|
00:04
🔗
|
dingo |
properly* |
|
00:04
🔗
|
|
dingo has quit IRC (Quit: Page closed) |
|
00:05
🔗
|
|
cmaldonad has quit IRC (Ping timeout: 255 seconds) |
|
00:06
🔗
|
|
cmaldonad has joined #internetarchive.bak |
|
00:48
🔗
|
|
cmaldonad has quit IRC (Quit: This computer has gone to sleep) |
|
01:00
🔗
|
|
chfoo has quit IRC (Read error: Operation timed out) |
|
01:00
🔗
|
|
chfoo has joined #internetarchive.bak |
|
01:01
🔗
|
|
svchfoo3 sets mode: +o chfoo |
|
01:28
🔗
|
|
cmaldonad has joined #internetarchive.bak |
|
02:06
🔗
|
closure |
ok, so systemd has shat itself on the server, is not doing basic init stuff like process reaping |
|
02:07
🔗
|
closure |
rebooted, that seems better |
|
03:04
🔗
|
|
Rye has joined #internetarchive.bak |
|
03:07
🔗
|
Xibalba |
does anyone have experience running a node on a Raspberry Pi? |
|
03:19
🔗
|
|
Stephen30 has joined #internetarchive.bak |
|
03:47
🔗
|
SketchCow |
Verified, someone with up to 1pb of storage is joining the set |
|
03:47
🔗
|
SketchCow |
Assuming it goes smoothly and we're not running into any other related speedbumps, that will give us... a boost |
|
03:48
🔗
|
closure |
fantastic |
|
03:48
🔗
|
SketchCow |
Yes. |
|
03:49
🔗
|
closure |
that will probably involve enough shards that the server will need more disk space (or additional server nodes) |
|
03:49
🔗
|
SketchCow |
I want to hit boundaries all over, yes |
|
03:49
🔗
|
SketchCow |
So, whatever server was providing that hit on 8080 seems not to be up yet. |
|
03:50
🔗
|
closure |
yeah, I looked at that, and fixed one problem with graphite, but let's see if db45x can fix the remaining issue |
|
03:50
🔗
|
SketchCow |
I think yipdw can do it as well as db |
|
03:51
🔗
|
closure |
/dev/sda3 117G 87G 28G 76% / |
|
03:53
🔗
|
closure |
23G of that is junk in my home directory, but yeah, it's filling up |
|
03:53
🔗
|
closure |
around 1 gb per shard on the server, more or less (including the extra clone of the repo used for stats generation) |
|
03:55
🔗
|
SketchCow |
Interesting. really. |
|
03:55
🔗
|
closure |
oops, that df is my laptop :) |
|
03:55
🔗
|
closure |
/dev/simfs 80G 48G 33G 60% / |
|
03:55
🔗
|
SketchCow |
Do you need us to 1. Find another server 2. Put in cash for a drive expansion |
|
03:56
🔗
|
closure |
kenshin might just be able to bump the disk, he's providing the server free |
|
03:56
🔗
|
SketchCow |
If we have to throw some cash at Kenshin, I'm sure we can do something |
|
04:07
🔗
|
|
cmaldonad has quit IRC (Quit: This computer has gone to sleep) |
|
04:10
🔗
|
closure |
aha, more downgrading "fixed" the graphite server |
|
04:11
🔗
|
closure |
we have graphs again. Need moar red. 100x more |
|
04:18
🔗
|
SketchCow |
Thank you |
|
04:23
🔗
|
|
thelsdj has quit IRC (Read error: Operation timed out) |
|
04:27
🔗
|
|
thelsdj has joined #internetarchive.bak |
|
04:28
🔗
|
SketchCow |
================================================================ |
|
04:28
🔗
|
SketchCow |
https://www.reddit.com/r/DataHoarder/comments/5cxtfl/a_plea_to_datahoarders_to_lend_space_for_the/ |
|
04:28
🔗
|
SketchCow |
It is now bringing up requests/questions about our startup scripts. |
|
04:29
🔗
|
SketchCow |
Can people step in and begin to help them? |
|
04:29
🔗
|
SketchCow |
================================================================ |
|
04:38
🔗
|
Kenshin |
bumped to 120GB for now |
|
04:38
🔗
|
Kenshin |
host server runs SSDs so space is a bit of a premium |
|
04:38
🔗
|
Kenshin |
closure |
|
04:38
🔗
|
closure |
dood |
|
04:59
🔗
|
thelsdj |
any suggestions on trying to get this fixed? https://git-annex.branchable.com/bugs/git-annex_won__39__t_execute_on_WD_My_Cloud_NAS/ as far as i can tell its not a known issue with haskell so might need to be reported upstream |
|
05:40
🔗
|
closure |
adjusted page size to 32 kb for tonight's build, may fix it |
|
05:41
🔗
|
closure |
(in 12 hours or so) |
|
05:45
🔗
|
thelsdj |
great, i'll give it a try tomorrow |
|
05:50
🔗
|
closure |
they seem to have found a unique way to fuck over their users |
|
05:50
🔗
|
closure |
reading elsewhere that the page size might be 64k |
|
05:51
🔗
|
|
Stephen30 has quit IRC (Ping timeout: 268 seconds) |
|
05:51
🔗
|
thelsdj |
what was it previously set to or what was the default if it wasn't set? |
|
05:52
🔗
|
thelsdj |
i have a Drobo and this: http://www.drobo.com/drobo-solutions/drobo-apps/droboapps-sdk/ says its 16k |
|
05:52
🔗
|
closure |
it's 4k everywhere |
|
05:52
🔗
|
closure |
except there |
|
05:52
🔗
|
closure |
try getconf PAGESIZE |
|
05:52
🔗
|
thelsdj |
i don't have getconf, might be somewhere in /proc, looking |
|
05:54
🔗
|
thelsdj |
yep, seems to be 16k |
|
06:33
🔗
|
|
kyan has quit IRC (Quit: Leaving) |
|
06:37
🔗
|
|
sevs has quit IRC (Ping timeout: 268 seconds) |
|
07:55
🔗
|
|
phuzion has joined #internetarchive.bak |
|
07:55
🔗
|
|
svchfoo3 sets mode: +o phuzion |
|
08:25
🔗
|
|
jsp234 has quit IRC (Read error: Connection reset by peer) |
|
08:28
🔗
|
|
jsp12345 has joined #internetarchive.bak |
|
09:30
🔗
|
|
CyberJaco is now known as zz_CyberJ |
|
10:28
🔗
|
|
Whopper_ has joined #internetarchive.bak |
|
10:33
🔗
|
|
Whopper has quit IRC (Read error: Operation timed out) |
|
11:40
🔗
|
|
joepie91 has quit IRC (Read error: Operation timed out) |
|
11:41
🔗
|
|
SketchCo3 has joined #internetarchive.bak |
|
11:41
🔗
|
|
joepie91 has joined #internetarchive.bak |
|
11:41
🔗
|
|
sep332_ has quit IRC (Read error: Operation timed out) |
|
11:41
🔗
|
|
randomdes has quit IRC (Write error: Broken pipe) |
|
11:41
🔗
|
|
sep332_ has joined #internetarchive.bak |
|
11:41
🔗
|
|
svchfoo3 has quit IRC (Read error: Operation timed out) |
|
11:41
🔗
|
|
patricko- has quit IRC (Read error: Operation timed out) |
|
11:42
🔗
|
|
patrickod has joined #internetarchive.bak |
|
11:42
🔗
|
|
zz_CyberJ has quit IRC (Read error: Operation timed out) |
|
11:42
🔗
|
|
zz_CyberJ has joined #internetarchive.bak |
|
11:43
🔗
|
|
SketchCow has quit IRC (Read error: Operation timed out) |
|
11:43
🔗
|
|
zz_CyberJ is now known as CyberJaco |
|
11:43
🔗
|
|
Blackout has quit IRC (Read error: Operation timed out) |
|
11:44
🔗
|
|
svchfoo3 has joined #internetarchive.bak |
|
11:45
🔗
|
|
svchfoo1 sets mode: +o svchfoo3 |
|
11:47
🔗
|
|
Start has quit IRC (Ping timeout: 506 seconds) |
|
11:47
🔗
|
|
Blackout has joined #internetarchive.bak |
|
11:48
🔗
|
|
Whopper_ is now known as whopper |
|
11:50
🔗
|
|
randomdes has joined #internetarchive.bak |
|
12:08
🔗
|
|
Start has joined #internetarchive.bak |
|
12:34
🔗
|
|
fusl has joined #internetarchive.bak |
|
13:06
🔗
|
|
Zippit has joined #internetarchive.bak |
|
13:08
🔗
|
Zippit |
Where can I register? |
|
13:17
🔗
|
Jon |
you run the ./iabak script to register, details on that at http://iabak.archiveteam.org |
|
13:17
🔗
|
Jon |
Zippit: oh better link http://archiveteam.org/index.php?title=INTERNETARCHIVE.BAK/git-annex_implementation |
|
13:18
🔗
|
Zippit |
I'm already on http://iabak.archiveteam.org/stats/ALL.leaderboard-raw |
|
13:18
🔗
|
Zippit |
Does that imply I'm registed? |
|
13:19
🔗
|
Jon |
I think so yes |
|
13:19
🔗
|
Zippit |
Cool, just making sure. :) Thanks Jon |
|
13:19
🔗
|
Jon |
I think it's derived from the email you provided when you ran the script ;there's no account per-se, or password, or 2FA or any of that stuff |
|
13:20
🔗
|
* |
Jon is not on the leaderboard, for unknown reasons |
|
13:21
🔗
|
Zippit |
I was just wondering why the "Top 25" had different names then the raw list |
|
13:25
🔗
|
Zippit |
I figured I'd had to register somewhere |
|
13:28
🔗
|
kurt |
Yeah, I think that's something we need to look at in the future, letting people pick a username |
|
13:48
🔗
|
Zippit |
No biggy, as long as my work gets registered. :) |
|
13:48
🔗
|
Zippit |
Not that I download TB's of data and it's for nothing |
|
13:50
🔗
|
Jon |
afaik it just takes the local pat from your email |
|
13:50
🔗
|
Jon |
I probably broke something by including a + |
|
13:51
🔗
|
|
TGMMilenk has joined #internetarchive.bak |
|
13:52
🔗
|
|
cmaldonad has joined #internetarchive.bak |
|
14:14
🔗
|
|
cmaldonad has quit IRC (Quit: This computer has gone to sleep) |
|
14:27
🔗
|
|
Mephisto has joined #internetarchive.bak |
|
15:50
🔗
|
|
atomotic has joined #internetarchive.bak |
|
15:53
🔗
|
|
SketchCo3 is now known as SketchCow |
|
15:54
🔗
|
|
svchfoo3 sets mode: +o SketchCow |
|
15:59
🔗
|
SketchCow |
So |
|
15:59
🔗
|
SketchCow |
We get 1pb of disk space |
|
15:59
🔗
|
SketchCow |
But it has a REST API and some interface |
|
16:00
🔗
|
SketchCow |
I believe it's worth doing the effort needed to do this |
|
16:00
🔗
|
SketchCow |
So I'll probably have someone here, with experience, add this 1pb share to their box |
|
16:05
🔗
|
|
Zippit has quit IRC (Ping timeout: 260 seconds) |
|
16:12
🔗
|
SketchCow |
OK, they're registering my account, it'll be granted 1pb of space |
|
16:13
🔗
|
PurpleSym |
This one? https://storj.io/api.html |
|
16:13
🔗
|
SketchCow |
Yes |
|
16:25
🔗
|
SketchCow |
Tech Support Request: https://www.reddit.com/r/DataHoarder/comments/5cxtfl/a_plea_to_datahoarders_to_lend_space_for_the/da0vp2j/ |
|
16:26
🔗
|
PurpleSym |
Well, technically the REST API’s not even required, since they have a CLI tool for up/downloading, which can be configured as “special remote” with some bash magic. |
|
16:27
🔗
|
closure |
PurpleSym: indeed, that is the way to do |
|
16:27
🔗
|
closure |
just needs a simple shell script.. and some node close to the IP that can push a PB of data onto that network |
|
16:30
🔗
|
closure |
by IP I mean IA |
|
16:33
🔗
|
SketchCow |
The datahoarders interaction has gone well. |
|
16:33
🔗
|
SketchCow |
Just two under the title of "I have a Grand Design Idea" |
|
16:33
🔗
|
SketchCow |
And a lot of people offering help |
|
16:56
🔗
|
Mephisto |
I'm upgraidin my storage next month :) ill make sure to add some extra disks |
|
16:59
🔗
|
|
komarEX has joined #internetarchive.bak |
|
16:59
🔗
|
komarEX |
hello everyone |
|
17:01
🔗
|
Kaz |
hello |
|
17:02
🔗
|
SketchCow |
Heyyyyy |
|
17:02
🔗
|
komarEX |
I have a question regarding iabak scripts |
|
17:02
🔗
|
SketchCow |
Go for it |
|
17:03
🔗
|
komarEX |
I have turned them on and now I'm at Resolving deltas just after register on shard4 |
|
17:03
🔗
|
komarEX |
it's doing quite a IO on my disk |
|
17:03
🔗
|
komarEX |
it's not downloading right now right ? |
|
17:03
🔗
|
closure |
it's regular git cloneing stuff, big repo so it will take a while |
|
17:04
🔗
|
closure |
that's more or less a one-off cost |
|
17:05
🔗
|
komarEX |
right.. I should have took a look on Google before asking here |
|
17:07
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
17:09
🔗
|
komarEX |
for now I guess I will contribute about 700GB |
|
17:09
🔗
|
komarEX |
later on maybe I will throw in additional 2-3TB |
|
17:09
🔗
|
SketchCow |
Always appreciated |
|
17:10
🔗
|
komarEX |
is it possible to run same private keys on 2 different machines ? |
|
17:10
🔗
|
|
sep332 has quit IRC (Konversation terminated!) |
|
17:12
🔗
|
closure |
komarEX: just give the same email address, the key is per-repo |
|
17:12
🔗
|
komarEX |
closure: oh is it, ok |
|
17:13
🔗
|
|
iabak-reg has joined #internetarchive.bak |
|
17:15
🔗
|
komarEX |
deltas take 360 IOPS of my raid huh |
|
17:15
🔗
|
* |
closure welcomes iabak-reg back to the channel.. |
|
17:15
🔗
|
Kaz |
ooh, notifications |
|
17:15
🔗
|
iabak-reg |
03registrar 05master c494453 06other fast forward |
|
17:15
🔗
|
closure |
broke a while ago when the irc server it was using vanished |
|
17:15
🔗
|
SketchCow |
I love that guy |
|
18:08
🔗
|
|
kyan has joined #internetarchive.bak |
|
19:38
🔗
|
iabak-reg |
03registrar 05master 6108708 06other 10SHARD9/pubkeys registration of mitch on SHARD9 |
|
19:51
🔗
|
|
n00b295 has joined #internetarchive.bak |
|
19:54
🔗
|
SketchCow |
gotcha. Then our storage boxes should work well, we support FreeBSD and Linux variants. Config would be: |
|
19:54
🔗
|
SketchCow |
-8 core proc |
|
19:55
🔗
|
SketchCow |
-64GB RAM |
|
19:55
🔗
|
SketchCow |
-2 x 480GB SSD |
|
19:55
🔗
|
SketchCow |
-12 x 8TB |
|
19:55
🔗
|
SketchCow |
-JBOD setup |
|
19:55
🔗
|
SketchCow |
96tb chunks would be nice |
|
19:55
🔗
|
SketchCow |
-20gbps network port |
|
19:55
🔗
|
SketchCow |
(Mail from another person) |
|
19:55
🔗
|
|
kyan has quit IRC (Read error: Operation timed out) |
|
20:02
🔗
|
iabak-reg |
03registrar 05master 9f54e0f 06other 10SHARD3/pubkeys registration of kevin on SHARD3 |
|
20:02
🔗
|
iabak-reg |
03registrar 05master d6be8a4 06other 10SHARD9/pubkeys registration of sevs44936-iabak on SHARD9 |
|
20:05
🔗
|
SketchCow |
IA.BAK is at 106 clients |
|
20:06
🔗
|
komarEX |
r/DataHoarders does it's deal |
|
20:07
🔗
|
|
db48x has joined #internetarchive.bak |
|
20:07
🔗
|
komarEX |
each shard is about 1TB right? |
|
20:08
🔗
|
db48x |
komarEX: most are a bit larger than that |
|
20:09
🔗
|
db48x |
komarEX: why do you ask? |
|
20:09
🔗
|
SketchCow |
It ranges wildly. |
|
20:09
🔗
|
SketchCow |
At this juncture, sub 500gb is asking for a lot of people who are only semi-up for dealing with CLI and the rest. |
|
20:09
🔗
|
SketchCow |
Plus the increments will be relatively slow |
|
20:12
🔗
|
komarEX |
db48x: curious, eventually there will be a lot of shards :) |
|
20:12
🔗
|
SketchCow |
Yes |
|
20:12
🔗
|
SketchCow |
YESSSSS |
|
20:12
🔗
|
SketchCow |
We know |
|
20:12
🔗
|
SketchCow |
A good FAQ question |
|
20:12
🔗
|
db48x |
komarEX: a fair number of them, yes |
|
20:13
🔗
|
komarEX |
Today backblaze posted Q3 disks summary |
|
20:13
🔗
|
komarEX |
they are at 300PB of storage right now |
|
20:15
🔗
|
|
kyan has joined #internetarchive.bak |
|
20:17
🔗
|
iabak-reg |
03registrar 05master 4d27249 06other 10SHARD4/pubkeys registration of chris on SHARD4 |
|
20:18
🔗
|
Frogging |
that's crazy |
|
20:18
🔗
|
phuzion |
300PB of consumer-grade disks at that. |
|
20:22
🔗
|
|
VADemon has joined #internetarchive.bak |
|
20:25
🔗
|
iabak-reg |
03registrar 05master 2e964f0 06other 10SHARD3/pubkeys registration of mitch on SHARD3 |
|
20:25
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
20:27
🔗
|
|
Start has joined #internetarchive.bak |
|
20:28
🔗
|
iabak-reg |
03registrar 05master 0e52e56 06other 10SHARD3/pubkeys registration of sevs44936-iabak on SHARD3 |
|
20:33
🔗
|
iabak-reg |
03registrar 05master 39b112d 06other 10SHARD12/pubkeys registration of sevs44936-iabak on SHARD12 |
|
20:38
🔗
|
iabak-reg |
03registrar 05master d645192 06other 10SHARD14/pubkeys registration of mike on SHARD14 |
|
20:38
🔗
|
iabak-reg |
03registrar 05master 1e9b032 06other 10SHARD14/pubkeys registration of iabak on SHARD14 |
|
20:46
🔗
|
iabak-reg |
03registrar 05master 81622ee 06other 10SHARD16/pubkeys registration of ojbmmxv on SHARD16 |
|
20:46
🔗
|
|
Zippit has joined #internetarchive.bak |
|
20:47
🔗
|
iabak-reg |
03registrar 05master f7af6ff 06other 10SHARD4/pubkeys registration of ojbmmxv on SHARD4 |
|
20:59
🔗
|
n00b295 |
I recently started trying to do the backup but when I run iabak it gets to where it pull origin but fails with "fatal: refusing to merge unrelated histories", am I just missing something simple? |
|
21:00
🔗
|
db48x |
n00b295: can you show us the log? |
|
21:01
🔗
|
|
atomotic has joined #internetarchive.bak |
|
21:05
🔗
|
n00b295 |
db48x: I just put the output at http://pastebin.com/qNzHw2pD |
|
21:09
🔗
|
db48x |
what directory are you in? |
|
21:09
🔗
|
n00b295 |
IA.BAK |
|
21:10
🔗
|
db48x |
is it not a git repository? |
|
21:11
🔗
|
n00b295 |
I cloned the git repository like the quickstart showed and then went into it and tried to run the iabak script |
|
21:12
🔗
|
db48x |
you must have had some problem the first time you ran it, and it's now in a bad state |
|
21:12
🔗
|
komarEX |
n00b295: didn't you by any chance canceled script when you first started it ? |
|
21:13
🔗
|
n00b295 |
don't think it got canceled when first started |
|
21:13
🔗
|
n00b295 |
should i just start over and try again? |
|
21:13
🔗
|
komarEX |
hm I would say rm -rf and again |
|
21:13
🔗
|
n00b295 |
will do |
|
21:15
🔗
|
|
komarEX has left |
|
21:19
🔗
|
iabak-reg |
03registrar 05master 2adaeb6 06other 10SHARD3/pubkeys registration of mitch on SHARD3 |
|
21:24
🔗
|
iabak-reg |
03registrar 05master ae8ccd1 06other 10SHARD16/pubkeys registration of ojbmmxv on SHARD16 |
|
21:25
🔗
|
Meroje |
I have that unrelated problem too, it consistently does it every single time I start fresh |
|
21:25
🔗
|
Meroje |
unrelated histories problem |
|
21:25
🔗
|
iabak-reg |
03registrar 05master 7e43cdd 06other 10SHARD15/pubkeys registration of fusl on SHARD15 |
|
21:27
🔗
|
iabak-reg |
03registrar 05master 1c2cf86 06other 10SHARD14/pubkeys registration of abuse on SHARD14 |
|
21:31
🔗
|
db48x |
Meroje: to make debugging easier, can you edit iabak-helper to include set -x at the top? |
|
21:31
🔗
|
db48x |
then capture the entire log, starting from scratch |
|
21:31
🔗
|
Meroje |
I tried downgrading to git 1.7 in case it was to do with newer defaults |
|
21:32
🔗
|
iabak-reg |
03registrar 05master cdf340a 06other 10SHARD15/pubkeys registration of meroje on SHARD15 |
|
21:33
🔗
|
Meroje |
last command was ./checkoutshard shard15, I will add the flag there too |
|
21:33
🔗
|
iabak-reg |
03registrar 05master 07d7940 06other 10SHARD3/pubkeys registration of ojbmmxv on SHARD3 |
|
21:36
🔗
|
iabak-reg |
03registrar 05master 7147e88 06other 10SHARD10/pubkeys registration of ojbmmxv on SHARD10 |
|
21:37
🔗
|
iabak-reg |
03registrar 05master ef496ac 06other 10SHARD15/pubkeys registration of abuse on SHARD15 |
|
21:39
🔗
|
Meroje |
so, with no shards but existing IA.BAK https://zerobin.lagout.org/?9fa35a9812f4fddd#O39xuzBrnuu3jorIUNLCd+AjERlazntWkEPGCCD/4lI= |
|
21:42
🔗
|
iabak-reg |
03registrar 05master 9250d94 06other 10SHARD4/pubkeys registration of mitch on SHARD4 |
|
21:43
🔗
|
iabak-reg |
03registrar 05master f41e9de 06other 10SHARD16/pubkeys registration of meroje on SHARD16 |
|
21:44
🔗
|
iabak-reg |
03registrar 05master 2e0969c 06other 10SHARD3/pubkeys registration of meroje on SHARD3 |
|
21:45
🔗
|
iabak-reg |
03registrar 05master 4f8b4b0 06other 10SHARD4/pubkeys registration of abuse on SHARD4 |
|
21:48
🔗
|
db48x |
Meroje: hmm |
|
21:50
🔗
|
Meroje |
shard3 failed from the remote "remote: aborting due to possible repository corruption on the remote side.", I'll assume it's unrelated |
|
21:50
🔗
|
db48x |
Meroje: what filesystem are you using? |
|
21:50
🔗
|
Meroje |
nfs on zfs |
|
21:51
🔗
|
db48x |
ugh, nfs |
|
21:52
🔗
|
Meroje |
smb was not happy with cp preserving permissions |
|
21:53
🔗
|
db48x |
this is a question closure can answer |
|
21:53
🔗
|
db48x |
I don't know how direct-mode and indirect-mode repositories are supposed to interact |
|
21:53
🔗
|
SketchCow |
NFS SOLVES EVERYTHING |
|
21:53
🔗
|
db48x |
but you might try it on a non-crippled filesystem, even if you don't have enough space there to run it long-term |
|
21:53
🔗
|
Kaz |
nfs is a steaming pile of shit |
|
21:54
🔗
|
Kaz |
Meroje: I've got nfs working through zfs, sort of |
|
21:54
🔗
|
SketchCow |
Now now |
|
21:54
🔗
|
Meroje |
I might end up running on ext4 and iscsi from that zfs pool |
|
21:54
🔗
|
SketchCow |
NFS is to computing like wooden cars are to cars |
|
21:55
🔗
|
Kaz |
Meroje: maproot user set to root, mount via /etc/fstab, sudo ./iabak |
|
21:55
🔗
|
Meroje |
yes that's what I have |
|
21:55
🔗
|
Kaz |
192.168.1.103:/mnt/red/IABAK /media/kurt/IABAK nfs rw,nfsvers=3,async,hard,intr,noacl 0 0 |
|
21:55
🔗
|
Kaz |
forcing version 3 solved some other issues for me |
|
21:55
🔗
|
|
octobyte has joined #internetarchive.bak |
|
21:55
🔗
|
Meroje |
I will try your fstab options |
|
21:57
🔗
|
Meroje |
now it's doing shard16 again, same unrelated histories error |
|
21:58
🔗
|
Kaz |
if you don't have much in there, delete and start again? |
|
21:58
🔗
|
Meroje |
doing that now |
|
21:58
🔗
|
octobyte |
Hey there, I'm attempting to run the bash scripts provided on the GitHub using FreeBSD on my spare NAS space. I'm unable to begin downloading shards because I *think* my ssh key is being rejected? Not quite sure. I have an RSA 4096 key in my ~/.ssh directory. Getting warning message "Warning: Identity file -i not accessible: No such file or directory." when manually executing ./checkoutshard shard10 |
|
21:58
🔗
|
octobyte |
Sorry for the interrupt |
|
21:58
🔗
|
db48x |
octobyte: the iabak script creates a key for you to use specifically with iabak |
|
21:59
🔗
|
db48x |
octobyte: since it couldn't access it, that must have failed |
|
21:59
🔗
|
octobyte |
Ah right, okay. I don't think I saw that key get generated |
|
22:00
🔗
|
iabak-reg |
03registrar 05master 2e00748 06other 10SHARD12/pubkeys registration of meroje on SHARD12 |
|
22:00
🔗
|
octobyte |
db48x: Let me run ./iabak from a clean git clone again and I'll pop up a pastebin of the output |
|
22:00
🔗
|
iabak-reg |
03registrar 05master 2fee4c7 06other 10SHARD15/pubkeys registration of ojbmmxv on SHARD15 |
|
22:00
🔗
|
Meroje |
well now every new file belongs to root, so cp fails |
|
22:00
🔗
|
octobyte |
Ah there we go |
|
22:01
🔗
|
octobyte |
ojbmmxv is me |
|
22:01
🔗
|
iabak-reg |
03registrar 05master a5076ee 06other 10SHARD3/pubkeys registration of meroje on SHARD3 |
|
22:02
🔗
|
octobyte |
Ok something failed on L35 flock.pl. I'm guessing this is just FreeBSD junk not getting added to /bin/ |
|
22:02
🔗
|
Meroje |
is it missing CGI octobyte ? |
|
22:02
🔗
|
octobyte |
Meroje: I had to manually install it for p5 |
|
22:03
🔗
|
octobyte |
"No such file or directory at /root/IA.BAK/flock.pl line 35." |
|
22:03
🔗
|
octobyte |
L35 is opening a file |
|
22:04
🔗
|
octobyte |
"open(FH, '>', $file) || die($!);" |
|
22:04
🔗
|
octobyte |
I don't know a word of perl |
|
22:04
🔗
|
db48x |
what was the actual error? |
|
22:04
🔗
|
Meroje |
I think the first time .git/annex folder does not exist yet, I get warnings from flock about that |
|
22:04
🔗
|
octobyte |
Let me pastebin everything so you can get a better look, 1 sec |
|
22:05
🔗
|
db48x |
then something must have failed even further up :P |
|
22:05
🔗
|
iabak-reg |
03registrar 05master 5d545a3 06other 10SHARD4/pubkeys registration of octobyt3 on SHARD4 |
|
22:06
🔗
|
closure |
git 2.7.4 made a change preventing merging of unrelated histories. |
|
22:07
🔗
|
db48x |
even in an empty repository? |
|
22:07
🔗
|
octobyte |
http://pastebin.com/raw/FXTANudg |
|
22:07
🔗
|
closure |
yes, it's a bad decision |
|
22:07
🔗
|
Meroje |
that might be the exact version I picked when downgrading, whoops |
|
22:07
🔗
|
|
sep332efn has joined #internetarchive.bak |
|
22:07
🔗
|
|
sep332efn is now known as sep332 |
|
22:07
🔗
|
Meroje |
yes |
|
22:08
🔗
|
Meroje |
I'm compiling again then |
|
22:08
🔗
|
closure |
so, checkoutshard does make an empty repo and then add a remote and so that's probably triggering that git behavior change |
|
22:09
🔗
|
octobyte |
Mine does make an empty repo, yeah |
|
22:11
🔗
|
closure |
but, if there's no master branch at all in the newly inited repo, it should not fall afoul of the unrelated histories check |
|
22:11
🔗
|
Meroje |
there is a master branch |
|
22:12
🔗
|
closure |
hmm, is it using direct mode for your repository? |
|
22:12
🔗
|
Meroje |
I never used git annex standalone, how do I get that info ? |
|
22:12
🔗
|
closure |
yeah, I think I've reproed it using direct mode |
|
22:13
🔗
|
closure |
git annex info | head -n 1 |
|
22:13
🔗
|
Meroje |
repository mode: direct |
|
22:13
🔗
|
thelsdj |
closure: has armel nightly build happened yet since you changed page size? |
|
22:14
🔗
|
iabak-reg |
03registrar 05master bdb55b0 06other 10SHARD4/pubkeys registration of meroje on SHARD4 |
|
22:14
🔗
|
Xibalba |
does iabak work with multiple drives on a single system? or do they need to be in a single volume? |
|
22:14
🔗
|
Meroje |
trying with git 2.7.3 |
|
22:17
🔗
|
closure |
thelsdj: I think it failed for an unrelated reason |
|
22:18
🔗
|
iabak-reg |
03registrar 05master a597b48 06other 10SHARD16/pubkeys registration of octobyt3 on SHARD16 |
|
22:23
🔗
|
thelsdj |
something you can fix and kick off again or do i need to wait to tomorrow or should i follow up with someone else to get the unrelated issue fixed? |
|
22:25
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
22:26
🔗
|
iabak-reg |
03registrar 05master 04e9555 06other 10SHARD16/pubkeys registration of octobyt3 on SHARD16 |
|
22:26
🔗
|
closure |
couldn't see a way to fix the unrelated histories merge in iabak, so I've fixed it in git-annex |
|
22:26
🔗
|
closure |
next daily build will have the fix |
|
22:27
🔗
|
closure |
pity, they never added a git config option to disable that check.. |
|
22:27
🔗
|
Meroje |
I'm still having failure with git 1.7.3, I'll wait on the daily build then |
|
22:28
🔗
|
closure |
2.7.3 might still have the check; the version they added it at was somewhere around there |
|
22:28
🔗
|
closure |
anyway, iabak pulls down a git-annex tarball that includes its own copy of git |
|
22:29
🔗
|
Meroje |
oh, didn't see that one |
|
22:29
🔗
|
closure |
delete that from git-annex.linux and it'll use your system git |
|
22:35
🔗
|
iabak-reg |
03registrar 05master 14654dc 06other 10SHARD3/pubkeys registration of octobyt3 on SHARD3 |
|
22:35
🔗
|
octobyte |
Sod it I'll just install a different distro |
|
22:36
🔗
|
closure |
Xibalba: each SHARD directory can be put on a different drive |
|
22:37
🔗
|
closure |
but unless you manually move them, it only uses the drive where you have cloned the IA.BAK git repo to |
|
22:39
🔗
|
iabak-reg |
03registrar 05master 0757c49 06other 10SHARD16/pubkeys registration of meroje on SHARD16 |
|
22:40
🔗
|
Meroje |
now on 2.6.4 |
|
22:41
🔗
|
Meroje |
welp |
|
22:43
🔗
|
|
Mephisto has quit IRC (Read error: Connection reset by peer) |
|
22:56
🔗
|
|
db48x has quit IRC (Read error: Connection reset by peer) |
|
22:57
🔗
|
|
db48x has joined #internetarchive.bak |
|
23:00
🔗
|
Meroje |
still doing it, is it really using the git executable ? |
|
23:01
🔗
|
|
n00b295 has quit IRC (Quit: http://chat.efnet.org ) |
|
23:24
🔗
|
|
n00b108 has joined #internetarchive.bak |
|
23:25
🔗
|
|
n00b108 has quit IRC (Client Quit) |
|
23:29
🔗
|
|
VADemon has quit IRC (Read error: Connection reset by peer) |
|
23:36
🔗
|
iabak-reg |
03registrar 05master dc509aa 06other 10SHARD9/pubkeys registration of octobyt3 on SHARD9 |
|
23:36
🔗
|
|
octobyte has quit IRC (Quit: Page closed) |
|
23:48
🔗
|
iabak-reg |
03registrar 05master 242a158 06other 10SHARD10/pubkeys registration of mike on SHARD10 |