#archiveteam 2016-03-04,Fri

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
***MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[00:08]
HCross2MrRadar: can you grab it all then for us please? [00:09]
MrRadarMy upload isn't very fast but these films are only in 480p quality so I probably could.
How should I be grabbing them? youtube-dl, grab-site?
[00:10]
HCross2YouTube dl [00:11]
***Stiletto has joined #archiveteam [00:11]
MrRadarPlain files or WARCs? [00:11]
HCross2Plain files [00:11]
MrRadarMP4 preferred, I'd assume?
I'll start it when I get back home. Where should these end up eventually?
[00:12]
HCross2The IA [00:13]
MrRadarBy "eventually" I meant after I grab them, where should I put them? Directly to the IA? [00:14]
HCross2If you can [00:14]
MrRadarIf I uploaded them to the IA under my account, would they ban me for uploading so much copyrighted material? [00:15]
HCross2It would just get darkened I think [00:16]
MrRadarSketchCow (or anyone who knows the IA's policies): can you confirm that?
I'm going AFK for about an hour now
[00:16]
..... (idle for 20mn)
***MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[00:37]
ErkDogOK I really need to change this debian instance to run level 3 instead of 5 but I can't find how to do that anywhere, inittab doesn't exisit /etc/rc.d/rc-sysint.conf /etc/systemd/system/default.target doesn't exist
like none of the things exist
[00:52]
xmcsounds like you got converted to systemd
you're on your own now bub
also this is offtopic, take it to #archiveteam-bs or somewhere else
[00:52]
***MMovie has quit IRC (Read error: Operation timed out) [00:53]
ErkDogugh I found it, and I'm traking to make an archiveteam host work sooooooooooooooooooooooooooo there's that [00:53]
***Ungstein has joined #archiveteam
MMovie has joined #archiveteam
[00:53]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[01:08]
Stiletto has quit IRC ()
nertzy has quit IRC (Read error: Operation timed out)
[01:19]
nertzy has joined #archiveteam
acridAxid has quit IRC (Quit: marauder)
acridAxid has joined #archiveteam
[01:25]
plog99 has quit IRC (Read error: Connection reset by peer)
plog99 has joined #archiveteam
Stiletto has joined #archiveteam
[01:35]
bsmith093 has joined #archiveteam
philpem has quit IRC (Ping timeout: 260 seconds)
[01:44]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[01:54]
.... (idle for 18mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[02:13]
vitzli has joined #archiveteam
JesseW has joined #archiveteam
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
Stiletto has quit IRC (Ping timeout: 258 seconds)
DopefishJ is now known as DFJustin
[02:23]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[02:44]
tomwsmf-a has joined #archiveteam [02:50]
SketchCowOh look, i woke up [02:50]
***Atom__ has joined #archiveteam
mr-b has quit IRC (Read error: Operation timed out)
[02:50]
SketchCowIf you upload a bunch of crazy shit, they will go to me "Is this one of yours?"
And I will hide you in my petticoat
[02:51]
***aMunster has quit IRC (Read error: Operation timed out)
mr-b has joined #archiveteam
rossdylan has quit IRC (Read error: Operation timed out)
lbft_ has quit IRC (Read error: Operation timed out)
closure has quit IRC (Read error: Operation timed out)
remsen has quit IRC (Read error: Operation timed out)
remsen has joined #archiveteam
lbft has joined #archiveteam
Atom has quit IRC (Read error: Operation timed out)
Jonimus has quit IRC (Read error: Operation timed out)
phuzion has quit IRC (Read error: Operation timed out)
phuzion has joined #archiveteam
aMunster has joined #archiveteam
acridAxid has quit IRC (Read error: Operation timed out)
acridAxid has joined #archiveteam
antomati_ has joined #archiveteam
swebb sets mode: +o antomati_
Jonimus has joined #archiveteam
swebb sets mode: +o Jonimus
winr5r has quit IRC (Ping timeout: 634 seconds)
mhazinsk has quit IRC (Ping timeout: 634 seconds)
winr4r has joined #archiveteam
nwf has quit IRC (Ping timeout: 633 seconds)
aMunster has quit IRC (Remote host closed the connection)
lysobit has quit IRC (Read error: Operation timed out)
musalbas has joined #archiveteam
musalbas is now known as lysobit
Swizzle__ has quit IRC (Quit: Leaving)
w0rp has quit IRC (Ping timeout: 633 seconds)
nwf has joined #archiveteam
Mayonaise has quit IRC (Ping timeout: 864 seconds)
w0rp has joined #archiveteam
Stiletto has joined #archiveteam
antomatic has quit IRC (Ping timeout: 865 seconds)
marvinw has quit IRC (Write error: Broken pipe)
marvinw_ has joined #archiveteam
vegbrasil has quit IRC (Ping timeout: 633 seconds)
MMovie has quit IRC (Read error: Operation timed out)
vegbrasil has joined #archiveteam
Mayonaise has joined #archiveteam
aMunster has joined #archiveteam
[02:51]
dashcloudfor youtube-dl, if I'm downloading a whole series of videos from a channel, and it gets stuck or fails before the end, I just need to use -w to keep the existing files in place, and then the rest of the files in the list will be retrieved right? [03:20]
***MMovie has joined #archiveteam
closure has joined #archiveteam
mhazinsk has joined #archiveteam
[03:20]
vitzli has quit IRC (Leaving)
acridAxid has quit IRC (Read error: Operation timed out)
mr-b has quit IRC (Read error: Operation timed out)
SadDM has quit IRC (Read error: Operation timed out)
jspiros has quit IRC (Read error: Operation timed out)
brabo has quit IRC (Read error: Operation timed out)
JesseW has quit IRC (Quit: Leaving.)
Atom__ has quit IRC (Read error: Operation timed out)
matthusb- has quit IRC (Ping timeout: 246 seconds)
remsen has quit IRC (Ping timeout: 246 seconds)
JesseW has joined #archiveteam
wp494 has quit IRC (Ping timeout: 362 seconds)
remsen has joined #archiveteam
acridAxid has joined #archiveteam
JesseW has quit IRC (Client Quit)
mr-b has joined #archiveteam
[03:30]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[03:55]
dashcloudso, to answer this for anyone wondering- that's what you need to do to not have the files overwritten' [04:04]
SketchCowInternet Archive is having a host of issues/problems, so it keeps going up and down. Ironically it's because we're making search and other facilities more robust. [04:12]
***MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[04:12]
bwn has quit IRC (Read error: Operation timed out) [04:26]
bsmith093dashcloud: if it's done with a video, redownloading the whole list will skip that one, use -i to ignore errors [04:33]
***tomwsmf-a has quit IRC (Ping timeout: 258 seconds)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[04:39]
Stiletto has quit IRC (Read error: Operation timed out)
Stiletto has joined #archiveteam
[04:56]
..... (idle for 20mn)
Sk1d has quit IRC (Ping timeout: 250 seconds) [05:17]
Sk1d has joined #archiveteam [05:24]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[05:36]
bwn has joined #archiveteam
Atom has joined #archiveteam
kcaj has quit IRC (Ping timeout: 258 seconds)
kcaj has joined #archiveteam
[05:48]
WinterFox has joined #archiveteam
nwf has quit IRC (Read error: Operation timed out)
JesseW has joined #archiveteam
mr-b has quit IRC (Read error: Operation timed out)
aMunster has quit IRC (Read error: Operation timed out)
vegbrasil has quit IRC (Read error: Operation timed out)
mhazinsk has quit IRC (Read error: Operation timed out)
beardicus has quit IRC (Read error: Operation timed out)
remsen has quit IRC (Ping timeout: 364 seconds)
Mayonaise has quit IRC (Read error: Operation timed out)
Jonimus has quit IRC (Read error: Operation timed out)
Mayonaise has joined #archiveteam
[06:02]
closure has quit IRC (Ping timeout: 633 seconds) [06:18]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[06:24]
vegbrasil has joined #archiveteam
closure has joined #archiveteam
remsen has joined #archiveteam
aMunster has joined #archiveteam
Sk2d has joined #archiveteam
rossdylan has joined #archiveteam
mhazinsk has joined #archiveteam
mr-b has joined #archiveteam
Sk1d has quit IRC (hub.se irc.du.se)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
Jonimus has joined #archiveteam
swebb sets mode: +o Jonimus
nwf has joined #archiveteam
[06:33]
Sk2d is now known as Sk1d
beardicus has joined #archiveteam
JesseW has quit IRC (Quit: Leaving.)
[07:00]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[07:08]
godane has quit IRC (Quit: Leaving.)
godane has joined #archiveteam
jut has joined #archiveteam
[07:18]
..... (idle for 22mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[07:43]
.... (idle for 17mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[08:01]
atomotic has joined #archiveteam [08:11]
schbirid has joined #archiveteam [08:19]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[08:30]
midasSketchCow: http://i.imgur.com/l93g1cv.gif [08:37]
..... (idle for 20mn)
***MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[08:57]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[09:12]
..... (idle for 20mn)
bwn has quit IRC (Read error: Operation timed out) [09:34]
bwn has joined #archiveteam [09:46]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[09:54]
vOYtEC has joined #archiveteam [10:05]
jut has quit IRC (Read error: Connection reset by peer)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[10:11]
jut has joined #archiveteam [10:17]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[10:27]
arkiverDoes someone have a rsync target available with a few GB or space?
We think fotolog might speed up a lot if we use another rsync target for the discovery part of fotolog
First need to test that idea before we make permanent changes, but that's why we'd like to test with a diferent rsync target
So if you have something available, please let me know!!
[10:33]
midashow much you need?
arkiver: dat.serveert.me.uk::fotolog should be up, has about 200GB free atm
tested, should work
[10:39]
***MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[10:50]
PurpleSymI could set up 1 TB as well if needed. [11:02]
arkivermidas: thanks, you and Fletcher both have a target ready
arkiver is afk for 4 hours
We'll add a target after that
[11:06]
***MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[11:07]
arkiverI think we'll use the target with the best IO and CPU
Since we need to deduplicate large lists, which might take some processing power
midas: Fletcher: how is the CPU on your box?
[11:10]
HCross2arkiver: if you want to send some stuff over to that target I sent you last night, feel free. If you want, I can set another target up for you [11:13]
midasarkiver: not that fast
CPU: 4 x Intel Atom (1862.000 MHz)
[11:15]
arkiverFletcher: if you think your box has more processing power we'll go with that rsync
midas: thanks
arkiver is afk for 4 hours
[11:16]
***fpoee has joined #archiveteam
plog99 has quit IRC (Read error: Operation timed out)
vitzli has joined #archiveteam
davidar has quit IRC (Quit: Connection closed for inactivity)
[11:19]
.... (idle for 15mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[11:45]
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com) [11:57]
Froggypwn has quit IRC (Quit: ~ Trillian Astra - www.trillian.im ~) [12:02]
.... (idle for 15mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[12:17]
.... (idle for 18mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
atomotic has joined #archiveteam
[12:36]
matthusb- has joined #archiveteam
SadDM has joined #archiveteam
swebb sets mode: +o SadDM
WinterFox has quit IRC (Remote host closed the connection)
brabo has joined #archiveteam
jspiros has joined #archiveteam
[12:49]
toad2 has joined #archiveteam
toad1 has quit IRC (Read error: Operation timed out)
[13:01]
..... (idle for 20mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
atomotic has quit IRC (Quit: My Mac has gone to sleep. ZZZzzz…)
[13:22]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[13:39]
ersi has quit IRC (Read error: Operation timed out) [13:50]
ersi has joined #archiveteam
swebb sets mode: +o ersi
[13:56]
.... (idle for 19mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[14:15]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[14:30]
.... (idle for 16mn)
atomotic has joined #archiveteam
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[14:48]
.... (idle for 18mn)
MMovie has quit IRC (Read error: Operation timed out)
atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
MMovie has joined #archiveteam
tomwsmf-a has joined #archiveteam
[15:07]
Start has quit IRC (Quit: Disconnected.) [15:17]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
RichardG has quit IRC (Ping timeout: 258 seconds)
[15:23]
Froggypwn has joined #archiveteam
RichardG has joined #archiveteam
philpem has joined #archiveteam
[15:36]
Start has joined #archiveteam [15:48]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[15:54]
SketchCowWe have an insider on BetaArchive. He offers to free it, and needs a place to put what he gets. Who's got a lot (a LOT) of space, so we can ingest it and then put it into the Archive? [16:07]
HCrossHow much is a lot? [16:09]
Atluxityerror, a lot = undef [16:09]
***lysobit has quit IRC (Ping timeout: 260 seconds) [16:12]
SketchCow22tb, ultimately, although we'd be doing it in stages
I have asked for a file listing because I want to understand what exactly this is.
[16:14]
arkiverMaybe Kenshin or zino_ have some space available
Though zino_ is working with us on the FTP project and hold gametrailers, so cino_ might not have the space for it currently
[16:20]
***lysobit has joined #archiveteam
JesseW has joined #archiveteam
[16:25]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[16:32]
scyther has joined #archiveteam [16:41]
MMovie has quit IRC (Read error: Operation timed out)
JesseW has quit IRC (Quit: Leaving.)
MMovie has joined #archiveteam
Zei-Pii has joined #archiveteam
[16:48]
tomwsmf-a has quit IRC (Read error: Operation timed out)
Simpbrai1 has quit IRC (Ping timeout: 260 seconds)
Start has quit IRC (Quit: Disconnected.)
[17:01]
VADemon has joined #archiveteam
Simpbrai_ has joined #archiveteam
[17:14]
tomwsmf-a has joined #archiveteam
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[17:22]
VADemon has quit IRC (Read error: Connection reset by peer) [17:39]
zino_With 8.6T used for GT and 5T mentally allocated for FTP I only have slightly above 12T free on the current machine.
I could hook up a JBOD with another 20T, but that's not going to happen before Easter.
[17:41]
***atomotic has joined #archiveteam [17:45]
SketchCowWell, I seriously doubt this guy is going to upload more than 1-2tv
tb
[17:47]
***pgoetz has joined #archiveteam [17:47]
HCrossI can probably take it, if its just 1-2TB [17:49]
zino_SketchCow: Sent you a PM in case you decide you need to use my machine. [18:01]
***MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[18:04]
AtluxityI want help setting up my machine to be ready as a rsync target
then we can maybe test the speed of it
see if it is usfull as anything more than a archivebot-node
the best would be if we could documents what is needed in the proccess, so others have some place to go in the future
[18:08]
***atomotic has quit IRC (Quit: Textual IRC Client: www.textualapp.com)
scyther has quit IRC (Quit: Leaving)
db48x has joined #archiveteam
[18:10]
zino_I imagine the list would be pretty short:
1. Have bandwidth.
2. Have a computer somewhere where it won't be fiddled with.
3. Have a bit of disk that is raided and monitored so that all the
collected data doesn't go *poof*
Bonus points:
1. Know how to properly set up rsyncd.
[18:19]
***vitzli has quit IRC (Quit: Leaving) [18:21]
Tomcat_ has joined #archiveteam [18:28]
Tomcat_ has quit IRC (Ping timeout: 260 seconds)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[18:33]
Tomcat_ has joined #archiveteam
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[18:48]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[19:04]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[19:16]
Start has joined #archiveteam [19:28]
..... (idle for 20mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
tigerteam has joined #archiveteam
tigerteam has quit IRC (Client Quit)
tigris37 has joined #archiveteam
tigris37 has quit IRC (Client Quit)
[19:48]
JW_work1 has joined #archiveteam
JW_work has quit IRC (Ping timeout: 362 seconds)
[20:01]
lkmlk has joined #archiveteam
lkmlk has quit IRC (Connection closed)
[20:09]
..... (idle for 20mn)
MMovie has quit IRC (Read error: Operation timed out)
bwn has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
WinterFox has joined #archiveteam
Ghost_of_ has joined #archiveteam
[20:29]
Start has quit IRC (Quit: Disconnected.)
bwn has joined #archiveteam
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[20:46]
Start has joined #archiveteam
JW_work has joined #archiveteam
wp494 has joined #archiveteam
JW_work1 has quit IRC (Ping timeout: 362 seconds)
[20:58]
.... (idle for 18mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[21:20]
.... (idle for 18mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
jut has quit IRC (Quit: jut)
[21:40]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
Ghost_of_ has quit IRC (Quit: Leaving)
[21:59]
schbirid has quit IRC (Quit: Leaving)
Start has quit IRC (Quit: Disconnected.)
[22:13]
MMovie has quit IRC (Read error: Operation timed out)
VADemon has joined #archiveteam
MMovie has joined #archiveteam
[22:23]
.... (idle for 18mn)
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
Tomcat_ has quit IRC (Remote host closed the connection)
[22:42]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[23:00]
.... (idle for 16mn)
Start has joined #archiveteam [23:17]
FalconK has quit IRC (Ping timeout: 260 seconds) [23:22]
MMovie has quit IRC (Read error: Operation timed out)
MMovie has joined #archiveteam
[23:36]
philpem has quit IRC (Ping timeout: 260 seconds) [23:43]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)