| Time |
Nickname |
Message |
|
00:05
🔗
|
|
JesseW has joined #archiveteam |
|
00:46
🔗
|
|
maseck_ has joined #archiveteam |
|
00:46
🔗
|
|
maseck has quit IRC (Read error: Operation timed out) |
|
00:57
🔗
|
|
Start has joined #archiveteam |
|
01:00
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
01:07
🔗
|
|
RichardG has joined #archiveteam |
|
01:07
🔗
|
|
RichardG_ has quit IRC (Read error: Connection reset by peer) |
|
01:15
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
01:30
🔗
|
|
trs80 has joined #archiveteam |
|
02:07
🔗
|
|
lesderid has quit IRC (Remote host closed the connection) |
|
02:13
🔗
|
|
vitzli has joined #archiveteam |
|
02:17
🔗
|
|
lesderid has joined #archiveteam |
|
02:44
🔗
|
|
maelstrom has quit IRC (Remote host closed the connection) |
|
02:44
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
|
02:44
🔗
|
|
RichardG has joined #archiveteam |
|
02:51
🔗
|
|
jrwr has quit IRC (Leaving) |
|
03:03
🔗
|
|
Stiletto has joined #archiveteam |
|
03:32
🔗
|
|
RichardG has quit IRC (Read error: Operation timed out) |
|
03:32
🔗
|
|
RichardG has joined #archiveteam |
|
04:20
🔗
|
|
vitzli has quit IRC (Quit: Leaving) |
|
04:24
🔗
|
|
BlueMaxim has joined #archiveteam |
|
04:38
🔗
|
|
RichardG has quit IRC (Ping timeout: 250 seconds) |
|
04:48
🔗
|
|
RichardG has joined #archiveteam |
|
04:52
🔗
|
|
fie has quit IRC (Remote host closed the connection) |
|
04:54
🔗
|
|
RichardG has quit IRC (Ping timeout: 244 seconds) |
|
04:58
🔗
|
|
RichardG has joined #archiveteam |
|
05:05
🔗
|
|
RichardG has quit IRC (Quit: Keyboard not found, press F1 to continue) |
|
05:18
🔗
|
|
Sk1d has quit IRC (Ping timeout: 194 seconds) |
|
05:24
🔗
|
|
Sk1d has joined #archiveteam |
|
05:39
🔗
|
|
RichardG has joined #archiveteam |
|
06:08
🔗
|
|
jsp12345 has quit IRC (Read error: Operation timed out) |
|
06:33
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
|
07:02
🔗
|
|
sivoais_ has quit IRC (Read error: Operation timed out) |
|
07:02
🔗
|
|
sivoais has joined #archiveteam |
|
07:05
🔗
|
|
dxrt- has quit IRC (Quit: Ping timeout (120 seconds)) |
|
07:50
🔗
|
|
chazchaz has quit IRC (Read error: Operation timed out) |
|
07:58
🔗
|
|
chazchaz has joined #archiveteam |
|
07:58
🔗
|
|
swebb sets mode: +o chazchaz |
|
08:03
🔗
|
|
swebb has quit IRC (Read error: Operation timed out) |
|
08:03
🔗
|
|
swebb has joined #archiveteam |
|
08:40
🔗
|
|
godane has left |
|
08:40
🔗
|
|
godane has joined #archiveteam |
|
08:58
🔗
|
|
fjeiwo has joined #archiveteam |
|
08:58
🔗
|
|
fjeiwo has quit IRC (Client Quit) |
|
09:59
🔗
|
|
REiN^ has quit IRC () |
|
10:03
🔗
|
|
DiscantX has joined #archiveteam |
|
10:06
🔗
|
|
DiscantX has quit IRC (Remote host closed the connection) |
|
10:10
🔗
|
|
DiscantX has joined #archiveteam |
|
10:17
🔗
|
|
ravetcofx has quit IRC (Read error: Operation timed out) |
|
10:34
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
|
10:34
🔗
|
|
RichardG has joined #archiveteam |
|
11:09
🔗
|
|
antomati_ is now known as antomatic |
|
11:43
🔗
|
|
GLaDOS has joined #archiveteam |
|
11:50
🔗
|
|
DiscantX has quit IRC (Read error: Operation timed out) |
|
12:00
🔗
|
|
bsmith093 has quit IRC (Ping timeout: 633 seconds) |
|
12:07
🔗
|
|
elvian has joined #archiveteam |
|
12:08
🔗
|
elvian |
hi everyone |
|
12:10
🔗
|
|
BlueMaxim has quit IRC (Quit: Leaving) |
|
12:15
🔗
|
elvian |
I'm interested in joining you guys in your archival effort. I don't have a huge storage space yet (~6TB free at the moment) but I have a fat pipe with unlimited traffic (symetrical 1Gb/s) |
|
12:15
🔗
|
elvian |
I'm still reading through the wiki though atm |
|
12:15
🔗
|
trs80 |
hi elvian |
|
12:15
🔗
|
trs80 |
the quickest way to get started is to fire up a warrior VM |
|
12:17
🔗
|
Yoshimura |
elvian: Interested joining a research effort also? Hit me with PM. |
|
12:19
🔗
|
elvian |
warrior VM, got it. I'll grab the image tonight when I come home and try to convert it to kvm to run it on my unRAID machine. |
|
12:19
🔗
|
arkiver |
awesome :) |
|
12:19
🔗
|
arkiver |
how is your connectivity to IA? |
|
12:19
🔗
|
arkiver |
as in uploadspeed |
|
12:21
🔗
|
BartoCH |
elvian: if you don't like vms, there is also the possibility to run a docker, or just the grab script. |
|
12:21
🔗
|
|
AndroUser has joined #archiveteam |
|
12:21
🔗
|
|
elvian has quit IRC (Read error: Connection reset by peer) |
|
12:22
🔗
|
|
elvian_ has joined #archiveteam |
|
12:22
🔗
|
|
AndroUser has quit IRC (Read error: Connection reset by peer) |
|
12:23
🔗
|
elvian_ |
my upload to the internet archive? I'm not sure, I've never tried to upload anything there |
|
12:26
🔗
|
elvian_ |
I actually assumed they crawled the web on their own, never knew they also relied on individual contributors. Learn something new everyday :) |
|
12:27
🔗
|
arkiver |
they crawl the web on their own |
|
12:27
🔗
|
arkiver |
But the data of the projects we do ends up at IA |
|
12:27
🔗
|
arkiver |
(in the wayback machine) |
|
12:28
🔗
|
elvian_ |
really? I thought you guys were backing up the IA mostly and also running other projects on the side |
|
12:28
🔗
|
elvian_ |
I really need to read that wiki. Anyway, still interested in joining you |
|
12:28
🔗
|
arkiver |
we have a project running to backup IA |
|
12:28
🔗
|
arkiver |
but we also get on dying websites, like vine and panoramio at the moment |
|
12:32
🔗
|
elvian_ |
yeah, that's what interest me more actually. Preserving things before they disappear. I lost all my teenager websites when Lycos closed its hosting in 2009 |
|
12:33
🔗
|
elvian_ |
no big deal but still a shame to see thousands of small websites disappear like that |
|
12:34
🔗
|
trs80 |
what's the panoramio channel? |
|
12:34
🔗
|
arkiver |
#paranormio |
|
12:34
🔗
|
arkiver |
and #vinewhine for vine |
|
12:35
🔗
|
arkiver |
elvian_: for the larger project we often need quite a bit of temporary space, or some machines that can push to IA fast while they also receive content |
|
12:35
🔗
|
arkiver |
sine you have 6 TB and a Gb/s, that might come in handy during those projects |
|
12:37
🔗
|
elvian_ |
happy to share those. However since we're talking about unRAID here, it's going to be single disk performance (though the gigabit connection or the link to IA would most likely be the bottlenecks anyway) |
|
12:47
🔗
|
|
RichardG_ has joined #archiveteam |
|
12:50
🔗
|
|
RichardG has quit IRC (Ping timeout: 255 seconds) |
|
14:05
🔗
|
|
elvian_ has quit IRC (Read error: Connection reset by peer) |
|
14:28
🔗
|
|
bsmith093 has joined #archiveteam |
|
14:41
🔗
|
|
WinterFox has quit IRC (Ping timeout: 506 seconds) |
|
14:57
🔗
|
|
JesseW has joined #archiveteam |
|
15:10
🔗
|
|
Start has quit IRC (Quit: Disconnected.) |
|
15:22
🔗
|
|
Coderjoe has quit IRC (Ping timeout: 190 seconds) |
|
15:49
🔗
|
|
ravetcofx has joined #archiveteam |
|
16:09
🔗
|
|
atomotic has joined #archiveteam |
|
16:21
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
16:50
🔗
|
|
elvian has joined #archiveteam |
|
16:53
🔗
|
|
maseck_ has quit IRC (Remote host closed the connection) |
|
16:55
🔗
|
|
JesseW has quit IRC (Ping timeout: 370 seconds) |
|
16:55
🔗
|
|
kristian_ has joined #archiveteam |
|
16:56
🔗
|
|
atomotic has joined #archiveteam |
|
16:59
🔗
|
|
maseck has joined #archiveteam |
|
17:04
🔗
|
|
elvian has quit IRC (Read error: Connection reset by peer) |
|
17:05
🔗
|
|
elvian has joined #archiveteam |
|
17:07
🔗
|
|
elvian has quit IRC (Read error: Connection reset by peer) |
|
17:11
🔗
|
|
RichardG has joined #archiveteam |
|
17:12
🔗
|
|
RichardG_ has quit IRC (Ping timeout: 255 seconds) |
|
17:15
🔗
|
|
RichardG has quit IRC (Ping timeout: 244 seconds) |
|
17:16
🔗
|
|
RichardG has joined #archiveteam |
|
17:20
🔗
|
|
elvian has joined #archiveteam |
|
17:23
🔗
|
|
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) |
|
17:23
🔗
|
|
dan-- has quit IRC (Read error: Operation timed out) |
|
17:32
🔗
|
|
RichardG has quit IRC (Read error: Operation timed out) |
|
17:34
🔗
|
|
RichardG has joined #archiveteam |
|
17:36
🔗
|
elvian |
the warrior VM is so painless to setup and run, I'm impressed :O |
|
17:36
🔗
|
elvian |
great job guys |
|
17:37
🔗
|
xmc |
:) |
|
17:48
🔗
|
elvian |
I seem to be limited by the download on the Panoramio project. I get a lot of "Tracker rate limiting is active". The upload itself is done in a few seconds for every task |
|
17:49
🔗
|
elvian |
so the warrior is usually blocked on Step 2, waiting for the delay to be done. I assume this is normal. Shame you can't select multiple projects on the worker to work on other things at the same time. |
|
17:51
🔗
|
elvian |
is the best practice in this case to run multiple warriors VM working on different projects? |
|
17:52
🔗
|
|
Asparagir has joined #archiveteam |
|
18:06
🔗
|
zhongfu |
elvian: you could, or you could just get the grab scripts for each project and run those |
|
18:06
🔗
|
zhongfu |
you get way less overhead but you'll have to do stuff like update the scripts manually when a new version's out |
|
18:07
🔗
|
zhongfu |
multiple VMs work too, of course, but that might not be too optimal in terms of resource usage |
|
18:07
🔗
|
zhongfu |
multiple docker containers might be better |
|
18:09
🔗
|
elvian |
actually I just stumbled upon the docker container. Since I have docker on my unRAID, I'll just spin off a few of them, each working on its own project :) |
|
18:13
🔗
|
zhongfu |
i wonder if it'd be a better idea to put the data directory on a tmpfs for systems with more RAM to spare |
|
18:13
🔗
|
zhongfu |
otherwise you might end up hitting the disk with a lot of writes |
|
18:13
🔗
|
zhongfu |
actually, i think this might be something for #archiveteam-bs -- sorry |
|
18:39
🔗
|
|
RichardG has quit IRC (Ping timeout: 244 seconds) |
|
18:40
🔗
|
|
RichardG has joined #archiveteam |
|
18:54
🔗
|
|
jrwr has joined #archiveteam |
|
18:57
🔗
|
|
Asparagir has quit IRC (Asparagir) |
|
19:06
🔗
|
|
Asparagir has joined #archiveteam |
|
19:31
🔗
|
|
maelstrom has joined #archiveteam |
|
19:34
🔗
|
|
sivoais has quit IRC (Ping timeout: 255 seconds) |
|
19:52
🔗
|
|
sivoais has joined #archiveteam |
|
19:52
🔗
|
|
RichardG has quit IRC (Read error: Connection reset by peer) |
|
19:57
🔗
|
|
RichardG_ has joined #archiveteam |
|
19:59
🔗
|
|
RichardG_ has quit IRC (Read error: Connection reset by peer) |
|
20:10
🔗
|
|
RichardG has joined #archiveteam |
|
20:15
🔗
|
|
maelstrom has quit IRC (Remote host closed the connection) |
|
20:22
🔗
|
|
RichardG_ has joined #archiveteam |
|
20:24
🔗
|
|
RichardG has quit IRC (Ping timeout: 370 seconds) |
|
20:37
🔗
|
|
RichardG_ is now known as RichardG |
|
20:47
🔗
|
SketchCow |
OK, we obviously need to get back on track with -bs moves |
|
20:48
🔗
|
Asparagir |
I asked this in #archivebot but will ask here too: |
|
20:48
🔗
|
Asparagir |
Turkey has reached the Let'sCensorThe MediaAndJailOurOpponents phase of its new dystopia. Are there any political party or news media websites (or similar) we should particularly focus on saving there? |
|
20:48
🔗
|
SketchCow |
Motley Fool UK Forums are cosing down |
|
20:48
🔗
|
SketchCow |
http://boards.fool.co.uk/closure-of-the-uk-discussion-boards-13456218.aspx |
|
20:53
🔗
|
|
d_rebel_ is now known as d_rebel |
|
20:56
🔗
|
|
d_rebel has left |
|
21:09
🔗
|
|
BlueMaxim has joined #archiveteam |
|
21:10
🔗
|
antomatic |
"We'd like to thank everyone who made this such a very special place that we're making no effort to preserve it after an architecture change. Software is so hard." |
|
21:10
🔗
|
|
antomatic sets mode: +o Asparagir |
|
21:14
🔗
|
|
jrwr has quit IRC (Remote host closed the connection) |
|
21:16
🔗
|
|
jrwr has joined #archiveteam |
|
21:17
🔗
|
|
jrwr has quit IRC (Remote host closed the connection) |
|
21:18
🔗
|
|
jrwr has joined #archiveteam |
|
21:20
🔗
|
|
Yoshimura has quit IRC (Quit: quit) |
|
21:33
🔗
|
|
Yoshimura has joined #archiveteam |
|
21:40
🔗
|
|
DiscantX has joined #archiveteam |
|
21:40
🔗
|
dashcloud |
Asparagir: check with https://twitter.com/zeynep/ - she's very active with Turkish things |
|
21:44
🔗
|
Asparagir |
dashcloud: Okay. Thanks! |
|
21:54
🔗
|
|
Blackout has quit IRC (Quit: http://www.mibbit.com ajax IRC Client) |
|
21:58
🔗
|
|
Asparagir has quit IRC (Asparagir) |
|
22:01
🔗
|
|
DiscantX has quit IRC (Read error: Operation timed out) |
|
22:16
🔗
|
|
jsp12345 has joined #archiveteam |
|
22:45
🔗
|
|
Aranje has joined #archiveteam |
|
23:14
🔗
|
|
VADemon has joined #archiveteam |
|
23:27
🔗
|
|
kristian_ has quit IRC (Quit: Leaving) |
|
23:42
🔗
|
|
maelstrom has joined #archiveteam |
|
23:46
🔗
|
|
WinterFox has joined #archiveteam |