Time |
Nickname |
Message |
01:22
🔗
|
SketchCow |
Scan and upload |
01:22
🔗
|
SketchCow |
And then send to me or to the archive |
01:22
🔗
|
SketchCow |
problem soollllvvved |
12:23
🔗
|
SketchCow |
FINISHED --2013-12-08 00:32:17-- |
12:23
🔗
|
SketchCow |
Total wall clock time: 12d 23h 16m 38s |
12:23
🔗
|
SketchCow |
Downloaded: 34943 files, 102G in 12d 19h 49m 8s (96.1 KB/s) |
12:23
🔗
|
SketchCow |
You know it, babty |
12:30
🔗
|
SketchCow |
That's ftp.bluefeathertech.com. Good stuff in there. |
12:52
🔗
|
arkiver |
102 GB at 96.1 KB/s?? :P |
12:52
🔗
|
arkiver |
that took you a looong time |
12:54
🔗
|
arkiver |
I'm going start uploading my second pack in a little bit of time |
12:55
🔗
|
arkiver |
165 GB of websites... |
12:55
🔗
|
arkiver |
the full chaosradio.ccc.de |
12:56
🔗
|
arkiver |
and some other small websites |
13:08
🔗
|
arkiver |
uploading now, will take some days to finish... :/ |
13:36
🔗
|
SketchCow |
Yes, I'm uploading all of chaosradio.ccc.de as we speak. |
13:39
🔗
|
arkiver |
:) |
13:39
🔗
|
arkiver |
tell me when you finished it! |
13:39
🔗
|
arkiver |
I'll also give you the link to my warc files when uploaded |
13:39
🔗
|
arkiver |
btw |
13:39
🔗
|
SketchCow |
I was given access to all CCC materials by CCC |
13:39
🔗
|
arkiver |
you're only uploading the audio files right? |
13:40
🔗
|
SketchCow |
https://archive.org/details/ccc_chaosradio |
13:40
🔗
|
SketchCow |
And movie files, etc. |
13:40
🔗
|
arkiver |
ah |
13:40
🔗
|
SketchCow |
WARCs are fine |
13:40
🔗
|
arkiver |
and how many GB's did you got? |
13:42
🔗
|
SketchCow |
root@teamarchive0:/0# du -sh CCC |
13:42
🔗
|
SketchCow |
root@teamarchive0:/0# du -sh CCC |
13:42
🔗
|
SketchCow |
1.7T CCC |
13:42
🔗
|
arkiver |
TB??? |
13:42
🔗
|
SketchCow |
So 1,700 GBs |
13:42
🔗
|
SketchCow |
That I got |
13:43
🔗
|
arkiver |
wow that's a lot for podcasts... |
13:43
🔗
|
arkiver |
yeah |
13:43
🔗
|
arkiver |
looks like they don't offer everything for download on their webiste |
13:43
🔗
|
arkiver |
I only downloaded 164 from their website |
14:05
🔗
|
dashcloud |
SketchCow: can you take a look at this item for me and tell me why my custom metadata isn't all showing? https://archive.org/details/Acsac13Zaddach |
14:06
🔗
|
dashcloud |
Creator seems to treat your input as one blob, and what I need is a separate entry for each author, so I added two First_Author fields, and enough Author fields to cover the rest of the names- I'm only seeing one of each on the item page |
14:06
🔗
|
SketchCow |
Interesting. |
14:06
🔗
|
SketchCow |
Well, the metadata is THERE, that's a fack. |
14:07
🔗
|
dashcloud |
if that's not the correct way, I'll just shove it in the description |
14:10
🔗
|
SketchCow |
I see what you did. |
14:10
🔗
|
SketchCow |
You gave the metadata the same pairs |
14:10
🔗
|
SketchCow |
It handled it regardless |
14:13
🔗
|
dashcloud |
so, what's the proper way to do what I was trying to do? |
14:13
🔗
|
SketchCow |
Good question for me at 6am |
14:13
🔗
|
dashcloud |
sorry! |
14:14
🔗
|
SketchCow |
I'm checking. |
14:20
🔗
|
SketchCow |
Tried something, didn't work. |
14:20
🔗
|
SketchCow |
Write info@archive.org and ask Jeff. |
14:21
🔗
|
SketchCow |
:) |
14:22
🔗
|
dashcloud |
what did you try? I was thinking if they have to pairs have to be different, that adding a number to the end of each would work |
14:22
🔗
|
SketchCow |
Well, that is true |
14:22
🔗
|
SketchCow |
BUT |
14:24
🔗
|
SketchCow |
Basically, there's some way you make all the stuff deal with this properly out of the box. |
14:24
🔗
|
SketchCow |
It's just late and I forget the magic incantation. |
14:24
🔗
|
SketchCow |
I thought it was author[1] and stuff. |
14:24
🔗
|
SketchCow |
But again, now it's all in there. |
14:24
🔗
|
SketchCow |
Just ask, it'll be done. |
14:25
🔗
|
SketchCow |
There's a lot of IA stuff that is all "what the fuck is it doing that way" followed by somehow you get stockholm syndrome and think it makes sense going forward. |
14:25
🔗
|
dashcloud |
okay! thanks! |
14:29
🔗
|
SketchCow |
Huh the thing uploading 46gb .tar files and the thing uploading dozens of 1.4gb .iso files both appear to be slow |
14:30
🔗
|
SketchCow |
You'd think shoving a hard drive at the same time as tons of DVDs would be a zippy, unstoppable process. |
14:30
🔗
|
SketchCow |
It's probably the endlessly unpacking 7zip process also running on the same drive |
15:25
🔗
|
dashcloud |
SketchCow: sent an email off asking for the magic |
16:08
🔗
|
SketchCow |
Great. And I'll chat with Jeff tomorrow to get some insight. |
16:34
🔗
|
SketchCow |
A beloved artist, Zina Nicole Lahr, has died from a fall during climbing |
16:34
🔗
|
SketchCow |
I've saved her main website, but she's everywhere. If someone feels like throwing all her stuff at archivebot, that would be nice. |
18:58
🔗
|
balrog |
SketchCow: there's also http://www.youtube.com/user/NormallyOddFilms ... not sure how to archive that |
19:08
🔗
|
arkiver |
yeah |
19:09
🔗
|
arkiver |
how do we download youtube channels as warc.gz files? |
20:12
🔗
|
DFJustin |
dashcloud: for multiple authors, you can add a "creator" field for each author |
20:12
🔗
|
DFJustin |
that's what I've been doing, at least |
20:15
🔗
|
DFJustin |
it shows them as separate links like so: https://archive.org/details/greater-key-of-solomon-rowe |
20:30
🔗
|
joepie91 |
arkiver: you just youtube-dl it |
20:30
🔗
|
arkiver |
? |
20:30
🔗
|
arkiver |
but can I also create a warc of it? |
20:30
🔗
|
joepie91 |
http://rg3.github.io/youtube-dl/ |
20:30
🔗
|
arkiver |
ah will take a look |
20:30
🔗
|
joepie91 |
arkhive: no point in creating a warc of it |
20:30
🔗
|
joepie91 |
really |
20:30
🔗
|
arkhive |
haha |
20:30
🔗
|
arkhive |
you meant arkiver |
20:31
🔗
|
arkhive |
i'm arkhive |
20:31
🔗
|
arkiver |
:D |
20:31
🔗
|
arkhive |
thousands of miles apart too. get it right joepie91 |
20:31
🔗
|
arkhive |
heh |
20:31
🔗
|
arkiver |
yes |
20:31
🔗
|
arkhive |
jk |
20:31
🔗
|
joepie91 |
baaaah D: |
20:31
🔗
|
arkiver |
heh |
20:32
🔗
|
arkiver |
:) |
20:32
🔗
|
arkiver |
arksprit |
20:32
🔗
|
arkiver |
another ark***** name :) |
20:32
🔗
|
arksprit |
! |
20:42
🔗
|
xmc |
eep |
21:45
🔗
|
dashcloud |
so, I'm not totally sure, but it appears some of the magic is knowing that semicolons are seperators, and commas aren't (for metadata fields) |
21:54
🔗
|
DFJustin |
even semicolons sometimes don't work though |