| Time |
Nickname |
Message |
|
00:05
🔗
|
|
Start-mob has quit IRC (Remote host closed the connection) |
|
00:14
🔗
|
|
serapeum has quit IRC (Ping timeout: 260 seconds) |
|
00:20
🔗
|
db48x |
I back-filled the connections data in graphite: http://iabak.archiveteam.org:8080/render/?width=1060&height=731&_salt=1428538747.86&tz=UTC&target=keepLastValue%28iabak.shardstats.connections.*%29&from=-2weeks |
|
00:24
🔗
|
pikhq |
Still kinda wierd there's so few people on shard2. |
|
00:24
🔗
|
* |
pikhq feels smug for having been on it since it was made "active" |
|
00:32
🔗
|
beardicus |
is that "before it was cool"? |
|
00:35
🔗
|
|
raylee has quit IRC (Ping timeout: 240 seconds) |
|
00:36
🔗
|
pikhq |
Oh, to be in a world where shoving bits on your hard drive was "cool". |
|
00:38
🔗
|
|
raylee has joined #internetarchive.bak |
|
00:44
🔗
|
|
serapeum has joined #internetarchive.bak |
|
00:47
🔗
|
closure |
db48x: nice! |
|
00:47
🔗
|
closure |
I'd be for replacing the current graph in stats page with that |
|
00:47
🔗
|
closure |
and we can get per-shard graphs too.. |
|
00:48
🔗
|
db48x |
indeed |
|
00:48
🔗
|
db48x |
svg output is broken though |
|
00:48
🔗
|
db48x |
I should figure out why |
|
00:48
🔗
|
closure |
that's a png isn't it? |
|
00:49
🔗
|
db48x |
or I could grab some code from a recent project that draws the svg in javascript, based on json |
|
00:49
🔗
|
db48x |
yea |
|
00:49
🔗
|
db48x |
but it's a fixed size |
|
00:49
🔗
|
closure |
http://iabak.archiveteam.org:8080/render/?width=600&height=400&_salt=1428538747.86&tz=UTC&target=keepLastValue%28iabak.shardstats.connections.*%29&from=-2weeks |
|
00:49
🔗
|
closure |
seems not |
|
00:51
🔗
|
db48x |
http://iabak.archiveteam.org:8080/render/?width=600&height=400&_salt=1428538747.86&tz=UTC&target=keepLastValue%28iabak.shardstats.connections.*%29&from=-2weeks&format=svg |
|
00:52
🔗
|
db48x |
what I mean is that any particular width and height we request is fixed; zooming in on it just makes it pixelated |
|
01:08
🔗
|
|
kyan has quit IRC (Quit: This computer has gone to sleep) |
|
01:09
🔗
|
|
kyan has joined #internetarchive.bak |
|
01:57
🔗
|
pikhq |
closure: Hum. With fsck I got 11 files all of which were 67B larger. |
|
01:59
🔗
|
pikhq |
It seems oddly suspicious that all of them would fail in the same way. |
|
02:02
🔗
|
tpw_rules |
https://archive.org/download/Ttscribe/Ttscribe_files.xml is still darked but in the repo |
|
02:20
🔗
|
closure |
well, I have seen resuming of http transfers not work right before, on other web sites. it'd be my first guess |
|
02:25
🔗
|
closure |
could do some comparison of the right content with the one in .git/annex/bad/ and see what happened |
|
02:29
🔗
|
|
Start-mob has joined #internetarchive.bak |
|
02:45
🔗
|
|
Start-mob has quit IRC (Ping timeout: 370 seconds) |
|
02:46
🔗
|
|
xyzzy has quit IRC (Ping timeout: 369 seconds) |
|
02:46
🔗
|
|
Start-mob has joined #internetarchive.bak |
|
03:01
🔗
|
|
underscor has quit IRC (Read error: Operation timed out) |
|
03:04
🔗
|
|
underscor has joined #internetarchive.bak |
|
03:04
🔗
|
|
cloudmons has quit IRC (Read error: Operation timed out) |
|
03:04
🔗
|
|
acridAxid has quit IRC (Read error: Operation timed out) |
|
03:04
🔗
|
|
patrickod has quit IRC (Write error: Broken pipe) |
|
03:05
🔗
|
|
hatseflat has quit IRC (Read error: Operation timed out) |
|
03:05
🔗
|
|
beardicus has quit IRC (My MacBook Pro has gone to sleep. ZZZzzz…) |
|
03:06
🔗
|
|
ryang has quit IRC (Read error: Operation timed out) |
|
03:09
🔗
|
|
Sanqui has quit IRC (Read error: Operation timed out) |
|
03:10
🔗
|
|
ryang has joined #internetarchive.bak |
|
03:11
🔗
|
|
Start-mob has quit IRC (Remote host closed the connection) |
|
03:12
🔗
|
|
patrickod has joined #internetarchive.bak |
|
03:12
🔗
|
|
acridAxid has joined #internetarchive.bak |
|
03:12
🔗
|
|
svchfoo2 sets mode: +o acridAxid |
|
03:16
🔗
|
|
Sanqui has joined #internetarchive.bak |
|
03:19
🔗
|
|
hatseflat has joined #internetarchive.bak |
|
03:24
🔗
|
|
cloudmons has joined #internetarchive.bak |
|
04:21
🔗
|
|
Sanqui has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:21
🔗
|
|
underscor has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:21
🔗
|
|
wp494_ has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:21
🔗
|
|
Start has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:21
🔗
|
|
aschmitz has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:21
🔗
|
|
csssuf has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:21
🔗
|
|
DFJustin has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:21
🔗
|
|
matthusb- has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:21
🔗
|
|
pikhq has quit IRC (ircd.choopa.net ircd.shaw.ca) |
|
04:23
🔗
|
|
Sanqui has joined #internetarchive.bak |
|
04:23
🔗
|
|
underscor has joined #internetarchive.bak |
|
04:23
🔗
|
|
wp494_ has joined #internetarchive.bak |
|
04:23
🔗
|
|
Start has joined #internetarchive.bak |
|
04:23
🔗
|
|
pikhq has joined #internetarchive.bak |
|
04:23
🔗
|
|
DFJustin has joined #internetarchive.bak |
|
04:23
🔗
|
|
csssuf has joined #internetarchive.bak |
|
04:23
🔗
|
|
matthusb- has joined #internetarchive.bak |
|
04:23
🔗
|
|
aschmitz has joined #internetarchive.bak |
|
04:23
🔗
|
|
ircd.shaw.ca sets mode: +ooo Start pikhq DFJustin |
|
04:32
🔗
|
|
niyaje4 has joined #internetarchive.bak |
|
04:35
🔗
|
|
svchfoo2 has quit IRC (Quit: Closing) |
|
04:36
🔗
|
|
svchfoo2 has joined #internetarchive.bak |
|
04:37
🔗
|
|
svchfoo1 sets mode: +o svchfoo2 |
|
07:38
🔗
|
|
zottelbey has joined #internetarchive.bak |
|
07:44
🔗
|
|
Wizardcry has quit IRC (Read error: Connection reset by peer) |
|
07:47
🔗
|
|
GLaDOS has quit IRC (Read error: Operation timed out) |
|
07:49
🔗
|
|
GLaDOS has joined #internetarchive.bak |
|
07:49
🔗
|
|
svchfoo3 sets mode: +o GLaDOS |
|
08:37
🔗
|
|
atomotic has joined #internetarchive.bak |
|
08:52
🔗
|
|
acridAxid has quit IRC (Read error: Operation timed out) |
|
08:56
🔗
|
|
acridAxid has joined #internetarchive.bak |
|
08:56
🔗
|
|
svchfoo3 sets mode: +o acridAxid |
|
09:39
🔗
|
|
niyaje4 has quit IRC (Ping timeout: 600 seconds) |
|
10:50
🔗
|
|
svchfoo2 has quit IRC (Read error: Connection reset by peer) |
|
10:52
🔗
|
|
svchfoo2 has joined #internetarchive.bak |
|
10:52
🔗
|
|
svchfoo1 sets mode: +o svchfoo2 |
|
11:43
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
12:43
🔗
|
|
atomotic has joined #internetarchive.bak |
|
13:08
🔗
|
|
berndj has joined #internetarchive.bak |
|
13:21
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
13:26
🔗
|
|
sankin has joined #internetarchive.bak |
|
13:53
🔗
|
|
Start has quit IRC (Disconnected.) |
|
14:04
🔗
|
|
Start-mob has joined #internetarchive.bak |
|
14:06
🔗
|
|
GLaDOS has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
hatseflat has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
mrfoo has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
lhobas has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
jbenet_ has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
ersi has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
bpye has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
Muad-Dib has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
edsu has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
balrog has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
ppiixx has quit IRC (hub.se efnet.port80.se) |
|
14:06
🔗
|
|
midas has quit IRC (hub.se efnet.port80.se) |
|
14:08
🔗
|
|
bpye_ has joined #internetarchive.bak |
|
14:09
🔗
|
|
GLaDOS- has joined #internetarchive.bak |
|
14:09
🔗
|
|
midas1 has joined #internetarchive.bak |
|
14:10
🔗
|
|
ppiixx has joined #internetarchive.bak |
|
14:10
🔗
|
|
lhobas has joined #internetarchive.bak |
|
14:10
🔗
|
|
mrfoo has joined #internetarchive.bak |
|
14:10
🔗
|
|
jbenet_ has joined #internetarchive.bak |
|
14:10
🔗
|
|
GLaDOS has joined #internetarchive.bak |
|
14:10
🔗
|
|
efnet.port80.se sets mode: +o GLaDOS |
|
14:11
🔗
|
|
GLaDOS has quit IRC (Ping timeout: 258 seconds) |
|
14:11
🔗
|
|
GLaDOS- is now known as GLaDOS |
|
14:11
🔗
|
|
edsu_ has joined #internetarchive.bak |
|
14:11
🔗
|
|
Muad-Dib has joined #internetarchive.bak |
|
14:12
🔗
|
|
Start-mob has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:12
🔗
|
|
Sanqui has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:12
🔗
|
|
underscor has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:12
🔗
|
|
wp494_ has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:12
🔗
|
|
aschmitz has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:12
🔗
|
|
csssuf has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:12
🔗
|
|
DFJustin has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:12
🔗
|
|
matthusb- has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:12
🔗
|
|
pikhq has quit IRC (ircd.shaw.ca irc.shaw.ca) |
|
14:13
🔗
|
|
Start-mob has joined #internetarchive.bak |
|
14:13
🔗
|
|
Sanqui has joined #internetarchive.bak |
|
14:13
🔗
|
|
underscor has joined #internetarchive.bak |
|
14:13
🔗
|
|
aschmitz has joined #internetarchive.bak |
|
14:13
🔗
|
|
matthusb- has joined #internetarchive.bak |
|
14:13
🔗
|
|
csssuf has joined #internetarchive.bak |
|
14:13
🔗
|
|
DFJustin has joined #internetarchive.bak |
|
14:13
🔗
|
|
pikhq has joined #internetarchive.bak |
|
14:13
🔗
|
|
irc.shaw.ca sets mode: +oo DFJustin pikhq |
|
14:13
🔗
|
|
balrog has joined #internetarchive.bak |
|
14:13
🔗
|
|
matthusb- has quit IRC (Ping timeout: 370 seconds) |
|
14:15
🔗
|
|
matthusb- has joined #internetarchive.bak |
|
14:15
🔗
|
|
wp494 has joined #internetarchive.bak |
|
14:15
🔗
|
|
hatseflat has joined #internetarchive.bak |
|
14:15
🔗
|
|
wp494 has quit IRC (Excess Flood) |
|
14:16
🔗
|
|
wp494 has joined #internetarchive.bak |
|
14:16
🔗
|
|
wp494 has quit IRC (Excess Flood) |
|
14:16
🔗
|
|
svchfoo2 sets mode: +o GLaDOS |
|
14:17
🔗
|
|
Start-mob has quit IRC (Ping timeout: 370 seconds) |
|
14:18
🔗
|
|
wp494 has joined #internetarchive.bak |
|
14:21
🔗
|
|
ersi_ has joined #internetarchive.bak |
|
14:35
🔗
|
|
Start has joined #internetarchive.bak |
|
14:54
🔗
|
|
Start has quit IRC (Disconnected.) |
|
14:58
🔗
|
|
Start has joined #internetarchive.bak |
|
15:00
🔗
|
|
Senji has quit IRC (Ping timeout: 506 seconds) |
|
15:34
🔗
|
realeyes |
hi |
|
15:34
🔗
|
realeyes |
i finally have some time for this thing |
|
15:34
🔗
|
sep332 |
hi realeyes |
|
15:34
🔗
|
realeyes |
where is that Scott guy? |
|
15:35
🔗
|
realeyes |
i think thats his name lol |
|
15:35
🔗
|
sep332 |
yeah Jason Scott :) |
|
15:35
🔗
|
sep332 |
his handle is SketchCow |
|
15:35
🔗
|
realeyes |
yeah |
|
15:35
🔗
|
realeyes |
i been meaning to talk to him |
|
15:38
🔗
|
SketchCow |
Hey, buddy. |
|
15:38
🔗
|
SketchCow |
They call him, Scott, aaaaaaaaaaaaa |
|
15:39
🔗
|
SketchCow |
He'll save every one of us |
|
15:39
🔗
|
realeyes |
whats up man? ahhhh my name is Scott too lol |
|
15:39
🔗
|
SketchCow |
https://www.youtube.com/watch?v=cyIIYerdlUA |
|
15:39
🔗
|
SketchCow |
Well, mine's Jason, I just like it when people call me Scott |
|
15:39
🔗
|
realeyes |
Savior of the Universe! |
|
15:39
🔗
|
realeyes |
well, you got me here from twitter |
|
15:39
🔗
|
realeyes |
i have a 16TB ZFS pool |
|
15:39
🔗
|
SketchCow |
Excellent. Hop on the bus. |
|
15:39
🔗
|
realeyes |
and i know the linuxes |
|
15:39
🔗
|
SketchCow |
You can delete the stuff if you need space back. |
|
15:40
🔗
|
realeyes |
no biggie |
|
15:40
🔗
|
realeyes |
whats the end goal here? backup the internet? lol |
|
15:40
🔗
|
SketchCow |
We're trying to make it so people can go "I have x TB" and as it's needed for their other things, they can delete slices. |
|
15:41
🔗
|
realeyes |
interesting. I briefly read about the shards |
|
15:41
🔗
|
SketchCow |
http://archiveteam.org/index.php?title=INTERNETARCHIVE.BAK/git-annex_implementation |
|
15:41
🔗
|
SketchCow |
You want to grab SHARD2 |
|
15:41
🔗
|
SketchCow |
In the future, we'll have better control of new people being assigned stuff easily and obviously. |
|
15:42
🔗
|
realeyes |
how do i 'grab shard2'? |
|
15:43
🔗
|
SketchCow |
So, I'd say, join up using the instructions, and at some point in there, you back up what's needed. |
|
15:43
🔗
|
SketchCow |
I am not sure if knowing which shard to get is needed yet |
|
15:51
🔗
|
db48x |
it's easy; just clone the repository (https://github.com/ArchiveTeam/IA.BAK) and run ./iabak |
|
15:51
🔗
|
|
svchfoo2 has quit IRC (Quit: Closing) |
|
15:51
🔗
|
|
Start has quit IRC (Disconnected.) |
|
15:51
🔗
|
db48x |
it does the rest |
|
15:52
🔗
|
|
svchfoo2 has joined #internetarchive.bak |
|
15:52
🔗
|
|
svchfoo3 sets mode: +o svchfoo2 |
|
15:54
🔗
|
SketchCow |
There we go. |
|
15:55
🔗
|
SketchCow |
(Bear in mind the project is very fluid and the nature is changing very quickly, so of course it's getting smarter.) |
|
15:56
🔗
|
Ctrl-S |
when will it become self aware? |
|
15:56
🔗
|
ppiixx |
who do I give my pubkey to? and how do I tell it how much space it can have? :) |
|
15:56
🔗
|
realeyes |
db48x how do i specify where to put the shard? |
|
15:56
🔗
|
realeyes |
i get i clone it into the disk / folder i want the shard to be in huh |
|
15:57
🔗
|
|
Start has joined #internetarchive.bak |
|
15:57
🔗
|
sep332 |
Ctrl-S: it's already self-aware and is just using us to replicate |
|
15:59
🔗
|
realeyes |
ok i want to sign up for shard2 |
|
16:00
🔗
|
sep332 |
it should be active already. check the repolist file |
|
16:00
🔗
|
realeyes |
its asking me to paste some SSH key |
|
16:00
🔗
|
realeyes |
looks like a pub key |
|
16:01
🔗
|
db48x |
yep, just pastebin that and I'll add it to the repo |
|
16:01
🔗
|
realeyes |
http://hastebin.com/omosufuzek.vbs |
|
16:01
🔗
|
realeyes |
ok |
|
16:01
🔗
|
realeyes |
here is the key: http://hastebin.com/sowiperace.pl |
|
16:02
🔗
|
ppiixx |
and mine http://hastebin.com/sunowuxumo.mel |
|
16:03
🔗
|
realeyes |
let me know when im good to start |
|
16:03
🔗
|
realeyes |
lol ppiixx do you use hastebin already or are you just using it because i pasted it? lol |
|
16:04
🔗
|
realeyes |
i love how the repo is just a series of shell scripts |
|
16:05
🔗
|
realeyes |
seems like .... |
|
16:05
🔗
|
db48x |
realeyes: sometimes the simplest is the best |
|
16:06
🔗
|
realeyes |
git: 'annex' is not a git command. See 'git --help'. |
|
16:06
🔗
|
db48x |
it should have downloaded git-annex |
|
16:07
🔗
|
realeyes |
i had to install it |
|
16:07
🔗
|
realeyes |
via brew |
|
16:07
🔗
|
db48x |
ah, it's probably not new enough then |
|
16:07
🔗
|
db48x |
the version needs to be 201502something |
|
16:07
🔗
|
closure |
I think you're the 1st osx user, expect breakage |
|
16:08
🔗
|
ppiixx |
seems to be happily backing up stuff here |
|
16:08
🔗
|
ppiixx |
ive given it a zfs quoated chunk of disk. i assume it will cope ok when it runs out of space |
|
16:08
🔗
|
db48x |
quite possible |
|
16:08
🔗
|
realeyes |
./iabak-helper: line 88: flock: command not found |
|
16:08
🔗
|
realeyes |
what is the list of software I need? lol |
|
16:08
🔗
|
closure |
it will |
|
16:08
🔗
|
closure |
the rest is probably all from coreutils |
|
16:09
🔗
|
realeyes |
yeah im on osx though |
|
16:09
🔗
|
ppiixx |
ah and it just got around to asking me about diskspace too :) |
|
16:09
🔗
|
ppiixx |
should probably do that up front |
|
16:10
🔗
|
hater |
ppiixx: we have to install git-annex first and then call "git-annex reserve..." - way around would be confusing |
|
16:11
🔗
|
realeyes |
http://hastebin.com/inateboyul.vhdl |
|
16:12
🔗
|
db48x |
the flock error isn't fatal right away |
|
16:12
🔗
|
closure |
realeyes: brew has a coreutils |
|
16:12
🔗
|
realeyes |
oh nice |
|
16:13
🔗
|
db48x |
it just won't be able to sync regularly with the server, so the server won't know that you've downloaded anything |
|
16:13
🔗
|
db48x |
closure: is flock from coreutils or linux-util? |
|
16:13
🔗
|
hater |
db48x: that's why i said "a simple filelock is more portable than using some tool" (flock) |
|
16:14
🔗
|
closure |
ah yeah, it's util-linux |
|
16:15
🔗
|
closure |
(w/o being at all linux-specific afaik) |
|
16:20
🔗
|
db48x |
hater: possibly. implementing something from scratch every time is error-prone though |
|
16:21
🔗
|
closure |
simple lock files lead to dangling locks |
|
16:22
🔗
|
closure |
we could use perl though, it'll work on all the unixes |
|
16:27
🔗
|
hater |
db48x: i thought about a simple "if [ -e .lockfile ] ; then #skip update because it is already updating" |
|
16:28
🔗
|
db48x |
sure, but that's prone to errors where the script exits without deleting the file |
|
16:28
🔗
|
db48x |
the dangling lock |
|
16:29
🔗
|
db48x |
with flock(1) or flock(2), we create a file (if it doesn't exist), and then ask the OS for a lock on that file |
|
16:29
🔗
|
db48x |
only one running program can have a lock on a file at a time |
|
16:30
🔗
|
db48x |
and when that program exits, it's file descriptors are automatically closed, automatically releasing any locks that were still open |
|
16:30
🔗
|
db48x |
its |
|
16:33
🔗
|
db48x |
SHARD2 is making progress: |
|
16:33
🔗
|
db48x |
http://iabak.archiveteam.org:8080/render/?width=1060&height=731&_salt=1428596848.669&from=-1weeks&lineWidth=3&colorList=red%2Corange%2Cgreen%2Cblack&lineMode=staircase&areaMode=stacked&yMax=100&vtitle=%25&yUnitSystem=si&minorY=&target=legendValue%28alias%28keepLastValue%28scale%28divideSeries%28iabak.shardstats.numcopies.0.shard2%2Ciabak.shardstats.filecount.shard2%29%2C100%29%29%2C%22IA%20only%22%29%2C%22last%22%29&targe |
|
16:34
🔗
|
tpw_rules |
good lord that's a scary url |
|
16:34
🔗
|
db48x |
yea |
|
16:34
🔗
|
db48x |
graphite ought to include a built-in url shortener for saved graphs |
|
16:35
🔗
|
tpw_rules |
how do you make them? |
|
16:37
🔗
|
db48x |
visit http://iabak.archiveteam.org:8080/ |
|
16:37
🔗
|
tpw_rules |
oh, funky |
|
16:37
🔗
|
db48x |
it gives you a decent UI for selecting which metrics to graph, how graph them, how to combine or transform them, etc |
|
16:38
🔗
|
db48x |
if you look under User Graphs > db48x you'll see some that I've created |
|
16:38
🔗
|
tpw_rules |
http://t.co/EDlGJ4disb seen this yet? |
|
16:40
🔗
|
db48x |
nah, I don't really pay much attention |
|
16:42
🔗
|
realeyes |
well its still not finding flock eventhough i installed coreutils |
|
16:44
🔗
|
db48x |
realeyes: check to see if there's a linux-util package |
|
16:45
🔗
|
|
Start has quit IRC (Disconnected.) |
|
16:45
🔗
|
realeyes |
there isnt |
|
16:49
🔗
|
ppiixx |
is flock in your path? |
|
16:51
🔗
|
db48x |
ppiixx: on osx, there is no flock |
|
16:53
🔗
|
hater |
flock(1) is unavailable on OS X |
|
16:55
🔗
|
SketchCow |
http://stackoverflow.com/questions/10526651/mac-os-x-equivalent-of-linux-flock1-command |
|
16:56
🔗
|
db48x |
ah, I'd just written my own perl one-liner |
|
16:58
🔗
|
hater |
anyone using osx here? |
|
16:58
🔗
|
tpw_rules |
me |
|
16:58
🔗
|
tpw_rules |
i'm not using ia.bak though |
|
16:58
🔗
|
hater |
tpw_rules: could you try the perl code from the stackoverflow-link? |
|
16:59
🔗
|
hater |
the one-liner |
|
16:59
🔗
|
tpw_rules |
how do i set it up? |
|
17:00
🔗
|
tpw_rules |
it seems to work. i pointed it to some random file and it started, locked, and unlocked |
|
17:00
🔗
|
hater |
tpw_rules: open a terminal; perl <enter> and insert "use Fcntl qw(:flock);" |
|
17:00
🔗
|
hater |
oh |
|
17:00
🔗
|
hater |
so Fcntl is installed by default |
|
17:01
🔗
|
tpw_rules |
it doesn't say anything |
|
17:03
🔗
|
tpw_rules |
i'm running 10.9 |
|
17:09
🔗
|
db48x |
I've got a patch to use perl which I'm testing |
|
17:28
🔗
|
|
Senji has joined #internetarchive.bak |
|
17:34
🔗
|
realeyes |
i love perl |
|
17:35
🔗
|
realeyes |
http://hastebin.com/mowukugaza.vhdl |
|
17:35
🔗
|
realeyes |
i already ran git-annex init |
|
17:35
🔗
|
realeyes |
and it's still complaining about flock |
|
17:35
🔗
|
realeyes |
anyone else trying to grab shards on OSX? |
|
17:49
🔗
|
|
zottelbey has quit IRC (Remote host closed the connection) |
|
17:49
🔗
|
|
Start has joined #internetarchive.bak |
|
17:50
🔗
|
|
zottelbey has joined #internetarchive.bak |
|
17:50
🔗
|
|
Start has quit IRC (Read error: Connection reset by peer) |
|
17:50
🔗
|
|
Start_ has joined #internetarchive.bak |
|
17:59
🔗
|
realeyes |
db48x hit me with the patch br0 |
|
18:29
🔗
|
hater |
realeyes: can you show me what happens a few lines above? the first line of your paste should not be there (afaik) |
|
18:37
🔗
|
|
Start_ has quit IRC (Disconnected.) |
|
18:40
🔗
|
db48x |
realeyes: still testing :) |
|
18:40
🔗
|
db48x |
found a couple of bugs |
|
18:42
🔗
|
|
Start has joined #internetarchive.bak |
|
18:43
🔗
|
|
Start has quit IRC (Read error: Connection reset by peer) |
|
18:43
🔗
|
|
Start has joined #internetarchive.bak |
|
18:46
🔗
|
realeyes |
hater ok hang on |
|
18:47
🔗
|
realeyes |
hater http://hastebin.com/alarikosab.vhdl |
|
18:47
🔗
|
hater |
db48x: i 'rm -rf' my IA.BAK again instead of my broken build (with my ssh key) m( |
|
18:48
🔗
|
|
Start has quit IRC (Client Quit) |
|
18:48
🔗
|
hater |
realeyes: there are more errors: line 6 and 11 |
|
18:49
🔗
|
realeyes |
i didnt see the printf error |
|
18:49
🔗
|
realeyes |
but the flock error is being working on |
|
18:49
🔗
|
hater |
looks like osx's 'find' command does not support the -printf option |
|
18:49
🔗
|
realeyes |
maybe i need to install findutils from brew lol |
|
18:51
🔗
|
realeyes |
yeah i guess the script in git isn't too osx friendly |
|
18:51
🔗
|
hater |
we simply did not test it on osx |
|
18:52
🔗
|
realeyes |
aha |
|
18:53
🔗
|
realeyes |
well, i'll be the guiney pig |
|
19:09
🔗
|
hater |
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxM4ogOUzGDn05jjwlj1f7iER7BhLs7UF1uuJm9qMq+UJOQy8uXXdwgVhy2ZvrKND72kmEunYfccMz11N7daq5XXSUjxw06lVH3uP1OFJ9+3Z7UYXAR4RuasDJrgfgc5kdVSTP0oRRu7bRGRFlkSXPPUZHyP3EvitCQqAV+QRGUg1WhMzHBbXFoJMKWzEIkab3tohL7Huf/yJmlcHfuuMA9dLviX4P41WBCPX8CA4GA7oXsBiL+DaCFX8VLv3XAfKuN/mJOWBZ7N8VOv/jkBPRZ2a72gAOjNpbiRlnoygCi82fJjzfZCas1P2Wy5P2pHaBksLWdro612VZGeuZOvYB proto@blacktea |
|
19:10
🔗
|
hater |
db48x: new ssh key - this time a made 2 backups |
|
19:17
🔗
|
hater |
thx |
|
19:22
🔗
|
|
svchfoo2 has quit IRC (Quit: Closing) |
|
19:23
🔗
|
|
svchfoo2 has joined #internetarchive.bak |
|
19:23
🔗
|
|
svchfoo1 sets mode: +o svchfoo2 |
|
19:49
🔗
|
|
SN4T14__ has joined #internetarchive.bak |
|
19:53
🔗
|
|
SN4T14_ has quit IRC (Ping timeout: 306 seconds) |
|
19:54
🔗
|
|
atomotic has joined #internetarchive.bak |
|
19:55
🔗
|
db48x |
ok |
|
19:55
🔗
|
|
Start-mob has joined #internetarchive.bak |
|
19:55
🔗
|
db48x |
realeyes: if you pull you'll get an updated version which has a substitute for flock(1) |
|
19:56
🔗
|
realeyes |
readlink: illegal option -- f |
|
19:56
🔗
|
* |
db48x facepalms |
|
19:57
🔗
|
db48x |
that's in coreutils; what version do you have? |
|
20:01
🔗
|
|
Start-mob has quit IRC (Remote host closed the connection) |
|
20:01
🔗
|
|
Start-mob has joined #internetarchive.bak |
|
20:06
🔗
|
hater |
we should try to rewrite iabak-helper to be posix-compliant |
|
20:08
🔗
|
hater |
otherwise we are going to have loads of problems porting our script to *bsd (like osx) |
|
20:09
🔗
|
realeyes |
2.14 ‘coreutils’: Multi-call binary |
|
20:09
🔗
|
realeyes |
osx 10.10 |
|
20:13
🔗
|
db48x |
8.22 here :P |
|
20:15
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
20:16
🔗
|
db48x |
do you have realpath instead? |
|
20:21
🔗
|
hater |
8.21 here - there are really systems which have such an old version of coreutils? |
|
20:22
🔗
|
balrog |
OS X doesn't use gnu coreutils |
|
20:23
🔗
|
balrog |
realeyes: what's this and where is that version number from? |
|
20:24
🔗
|
|
Start-mob has quit IRC (Ping timeout: 370 seconds) |
|
20:28
🔗
|
|
Start has joined #internetarchive.bak |
|
20:29
🔗
|
realeyes |
balrog info coreutils |
|
20:29
🔗
|
realeyes |
db48x how would i check? |
|
20:30
🔗
|
balrog |
db48x: no realpath in os x |
|
20:30
🔗
|
db48x |
which realpath, man realpath, etc |
|
20:30
🔗
|
realeyes |
/usr/local/bin/realpath |
|
20:30
🔗
|
balrog |
is that from homebrew? |
|
20:30
🔗
|
realeyes |
not sure |
|
20:30
🔗
|
realeyes |
im on osx using homebrew |
|
20:31
🔗
|
balrog |
it's in /usr/local so it is |
|
20:31
🔗
|
realeyes |
what else you wana know? :) |
|
20:34
🔗
|
hater |
db48x: where is the problem in just using POSIX-compliant tools and options? |
|
20:35
🔗
|
db48x |
nothing |
|
20:36
🔗
|
hater |
then we should rewrite a few things in iabak-helper |
|
20:38
🔗
|
balrog |
another thing: don't use #!/bin/sh if there are bashisms |
|
20:38
🔗
|
balrog |
I don't know if there are but it's not unlikely |
|
20:39
🔗
|
hater |
balrog: there are bashisms |
|
20:39
🔗
|
balrog |
hater: then either fix them or use #!/bin/bash |
|
20:39
🔗
|
balrog |
or the script will probably fail on debian |
|
20:39
🔗
|
hater |
'checkbashisms iabak-helper' |
|
20:39
🔗
|
hater |
line 171 |
|
20:40
🔗
|
closure |
hater: alternatively, someone could rewrite it in a more portable language like python |
|
20:40
🔗
|
hater |
closure: or perl |
|
20:40
🔗
|
* |
hater <3 perl |
|
20:41
🔗
|
hater |
then we could also provide an .exe for windows |
|
20:41
🔗
|
closure |
well, if you do it in perl, I can help maintain it |
|
20:41
🔗
|
closure |
or, haskell (which would make an exe easier ;) |
|
20:41
🔗
|
hater |
D: |
|
20:42
🔗
|
hater |
'learn haskell' is still on my todo-list |
|
20:42
🔗
|
closure |
weird, I am not seeing the bashism |
|
20:45
🔗
|
hater |
closure: http://hastebin.com/muqasiwevo.avrasm |
|
20:45
🔗
|
hater |
checkbashism: http://sourceforge.net/projects/checkbaskisms/ |
|
20:47
🔗
|
closure |
yeah, that's not actually a bashism. You probably have an old/buggy checkbashisms; debian unstable does not find that |
|
20:49
🔗
|
hater |
2.0.0.2-r2 |
|
20:49
🔗
|
closure |
2.15 |
|
20:49
🔗
|
* |
closure winds |
|
20:49
🔗
|
hater |
oh, gentoo repos are outdated |
|
20:50
🔗
|
hater |
that's probably why there is an unstable-flag |
|
20:50
🔗
|
db48x |
http://iabak.archiveteam.org:8080/render/?width=1060&height=731&_salt=1428612514.473&from=-1weeks&areaMode=stacked&yMax=100&vtitle=%25&title=SHARD2%20progress%2C%20%25&target=legendValue%28alias%28color%28keepLastValue%28scale%28divideSeries%28iabak.shardstats.numcopies.0.shard2%2Ciabak.shardstats.filecount.shard2%29%2C100%29%29%2C%22red%22%29%2C%22IA%20only%22%29%2C%22last%22%29&target=legendValue%28alias%28color%28keepL |
|
20:50
🔗
|
hater |
short link.. |
|
20:50
🔗
|
closure |
I learned my bashisms the hard way, by writing a few tens of thousands of lines of posix shell code ;) |
|
20:50
🔗
|
db48x |
closure: ouch |
|
20:51
🔗
|
closure |
why is the progress % going downward? |
|
20:52
🔗
|
closure |
oh, it's the 0 copies files |
|
20:52
🔗
|
db48x |
red is going down and green is going up |
|
20:52
🔗
|
closure |
not seeing the green |
|
20:53
🔗
|
db48x |
did you copy the whole url? |
|
20:53
🔗
|
sep332 |
i'm not seeing green either |
|
20:54
🔗
|
sep332 |
oh i must not have the whole thing |
|
20:54
🔗
|
sep332 |
there's open (('s so it must have been truncated |
|
20:54
🔗
|
db48x |
http://iabak.archiveteam.org:8080/render/?width=1060&height=731&_salt=1428612834.229&from=-1weeks&areaMode=stacked&yMax=100&vtitle=%25&title=SHARD2%20progress%2C%20%25&target=legendValue%28alias%28color%28keepLastValue%28scale%28divideSeries%28diffSeries%28iabak.shardstats.filecount.shard2%2CsumSeries%28iabak.shardstats.numcopies.0.shard2%2Ciabak.shardstats.numcopies.1.shard2%2Ciabak.shardstats.numcopies.2.shard2%29%29%2C |
|
20:55
🔗
|
db48x |
I reordered this one so that the slopes are going up and to the right; should help comprehension |
|
20:56
🔗
|
db48x |
http://tinyurl.com/mxx9xno |
|
21:01
🔗
|
|
sankin has quit IRC (Leaving.) |
|
21:02
🔗
|
db48x |
closure: oops: https://github.com/LittleCerise/IA.BAK/commit/a9e5144df9081508dd2884faeed192b776a04ba5 |
|
21:06
🔗
|
closure |
woah, wtf? |
|
21:07
🔗
|
db48x |
git commit -a, probably |
|
21:07
🔗
|
closure |
that commit added the entire git-annex source tree? |
|
21:07
🔗
|
closure |
git add . I suppose |
|
21:07
🔗
|
closure |
revert time |
|
21:07
🔗
|
closure |
wow, that's a lot of crap to put in history |
|
21:07
🔗
|
db48x |
yea |
|
21:07
🔗
|
closure |
did it get merged? |
|
21:07
🔗
|
db48x |
just a pull request |
|
21:07
🔗
|
closure |
oh, thank goodness! |
|
21:09
🔗
|
db48x |
oh yea, branches |
|
21:10
🔗
|
closure |
is it possible to get a version of the stacked graph for * ? |
|
21:10
🔗
|
closure |
I like the grapgh |
|
21:10
🔗
|
db48x |
not using a wildcard, I think |
|
21:11
🔗
|
closure |
hmm, that worked for the other graph |
|
21:12
🔗
|
db48x |
you can certainly graph iabak.shardstats.numcopies.*.shard2, but this stacked graph divides everything by iabak.shardstats.filecount.shard2 to show a percentage |
|
21:12
🔗
|
closure |
ah, and you can't * that |
|
21:12
🔗
|
db48x |
(after all, the total can change) |
|
21:13
🔗
|
closure |
ok, so only on the per-shard pages I suppose |
|
21:14
🔗
|
db48x |
oh, I could probably do it for ALL as well |
|
21:14
🔗
|
closure |
ah |
|
21:14
🔗
|
db48x |
I thought you meant for all the numcopies of a single shard |
|
21:14
🔗
|
closure |
no, I meant all |
|
21:19
🔗
|
|
Start has quit IRC (Disconnected.) |
|
21:19
🔗
|
db48x |
http://iabak.archiveteam.org:8080/render/?width=1060&height=731&_salt=1428614348.871&from=-1weeks&areaMode=stacked&yMax=100&vtitle=%25&title=Overall%20progress%2C%20%25&target=legendValue%28alias%28color%28keepLastValue%28scale%28divideSeries%28diffSeries%28sumSeries%28iabak.shardstats.filecount.*%29%2CsumSeries%28iabak.shardstats.numcopies.0.*%2Ciabak.shardstats.numcopies.1.*%2Ciabak.shardstats.numcopies.2.*%29%29%2CsumS |
|
21:20
🔗
|
db48x |
some artifacts there |
|
21:32
🔗
|
|
Start-mob has joined #internetarchive.bak |
|
21:35
🔗
|
|
raylee has quit IRC (Ping timeout: 240 seconds) |
|
21:36
🔗
|
|
raylee has joined #internetarchive.bak |
|
21:40
🔗
|
hater |
"File's last status change time" - is that ctime or mtime? |
|
21:45
🔗
|
|
Start-mob has quit IRC (Ping timeout: 370 seconds) |
|
21:56
🔗
|
|
zottelbey has quit IRC (Remote host closed the connection) |
|
23:02
🔗
|
db48x |
hater: what's the context? |
|
23:17
🔗
|
db48x |
no artifacts: |
|
23:17
🔗
|
db48x |
http://iabak.archiveteam.org:8080/render/?width=1060&height=731&_salt=1428621391.124&target=legendValue%28alias%28color%28scale%28divideSeries%28diffSeries%28sumSeries%28keepLastValue%28iabak.shardstats.filecount.*%29%29%2CsumSeries%28keepLastValue%28iabak.shardstats.numcopies.0.*%29%2CkeepLastValue%28iabak.shardstats.numcopies.1.*%29%2CkeepLastValue%28iabak.shardstats.numcopies.2.*%29%29%29%2CsumSeries%28keepLastValue%28 |
|
23:21
🔗
|
|
kyan has quit IRC (Quit: Leaving) |
|
23:31
🔗
|
closure |
db48x: that last url was cut off again |
|
23:33
🔗
|
db48x |
http://tinyurl.com/lcvfyge |
|
23:33
🔗
|
db48x |
probably your client |
|
23:34
🔗
|
|
Start has joined #internetarchive.bak |
|
23:34
🔗
|
|
svchfoo2 sets mode: +o Start |
|
23:37
🔗
|
closure |
hmm, I wonder if the connections graph could be overlaid on the percent graph |
|
23:38
🔗
|
db48x |
sure |
|
23:38
🔗
|
db48x |
you'll want the second y axis |
|
23:39
🔗
|
closure |
demo me |
|
23:45
🔗
|
db48x |
http://tinyurl.com/p6r6kqw |
|
23:46
🔗
|
db48x |
in the UI you click Graph Data, then select a series and apply the Draw in Second Y Axis function to it |
|
23:57
🔗
|
|
niyaje4 has joined #internetarchive.bak |