Time |
Nickname |
Message |
00:26
🔗
|
bsmith094 |
trying to run the warrior is github down? it cant find it to pull the code |
00:27
🔗
|
bsmith094 |
Cameron_D Coderjoe SketchCow i know one of you runs the warrior project but i cant remember which one |
00:43
🔗
|
ersi |
GitHub seems operational |
00:43
🔗
|
ersi |
https://status.github.com/ is a good place to check |
01:30
🔗
|
VonGuard |
http://www.archive.org/ down? |
01:32
🔗
|
SadDM |
doesn't look like it: http://downforeveryoneorjustme.com/archive.org |
01:32
🔗
|
www2 |
server problem |
01:59
🔗
|
godane |
if its down i'm not getting any server error xml |
02:02
🔗
|
VonGuard |
huh i get an nginx error 302 |
02:03
🔗
|
godane |
my problem is i have been upload pdfs i have none of those results.xml files |
02:03
🔗
|
godane |
so i think S3 is still taking stuff |
05:14
🔗
|
SketchCow |
I'm starting to think it's going to be a priority to start doing culture runs against youtube. |
05:29
🔗
|
BlueMaxim |
culture runs? |
05:30
🔗
|
DFJustin |
agreed |
05:31
🔗
|
SketchCow |
https://archive.org/details/The_Making_of_Rock_and_Rule |
05:31
🔗
|
SketchCow |
That gem was buried in there.] |
05:32
🔗
|
SketchCow |
I want to do it right, though - real metadata grabs and transfers, nice bespoke stuff. |
05:33
🔗
|
godane |
agree |
05:33
🔗
|
godane |
some of my stuff like that |
05:33
🔗
|
godane |
but its mostly rev3 and twit stuff that gets the metadata |
05:34
🔗
|
godane |
but if there is a very good xml/rss metadata still i can do it |
05:34
🔗
|
DFJustin |
a big issue is that the commonly available youtube downloading tools do not get the full resolution |
05:34
🔗
|
DFJustin |
e.g. assuming you grabbed that from https://www.youtube.com/watch?v=frCen3NVNsg there is a 480p whereas you got 360p |
05:34
🔗
|
DFJustin |
jdownloader 2 is the only prepackaged tool I've found that handles this |
05:36
🔗
|
DFJustin |
but it's a fairly obnoxious program in other ways |
05:39
🔗
|
SketchCow |
youtube-dl is doing well. |
05:39
🔗
|
DFJustin |
it used to do well until they switched to DASH |
05:39
🔗
|
DFJustin |
now the devs have their thumbs up their asses |
05:42
🔗
|
DFJustin |
in brief, anything 1080p or above is downloaded as 720p and anything 480p is downloaded as 360p |
05:42
🔗
|
godane |
SketchCow: i may get a 311mb version of that video you posted |
05:42
🔗
|
DFJustin |
I still use it to get metadata but that's not acceptable for video archival imo |
05:46
🔗
|
SketchCow |
I'm happy to check this. |
05:46
🔗
|
SketchCow |
And we should make a wiki page. |
05:48
🔗
|
DFJustin |
http://interbutt.com/temp/The%20Making%20Of%20Rock%20And%20Rule.mp4 is the 480p version of that youtube, double the file size |
05:53
🔗
|
DFJustin |
it is possible to work around with a script, this one is kind of shit but shows the approach https://github.com/rg3/youtube-dl/issues/1643#issuecomment-28317090 |
05:53
🔗
|
SketchCow |
Well, that's the bespoke part. |
05:53
🔗
|
SketchCow |
I don't want us doing wholescale grabs, I want us seeking out and doing some proper grabs, full metadata, maybe research |
05:55
🔗
|
DFJustin |
ok looks like they have gotten a little further https://github.com/rg3/youtube-dl/issues/1612 |
06:00
🔗
|
DFJustin |
it's still pretty lol that it's not the default after 5 months (youtube-dl you had one job) |
06:06
🔗
|
SketchCow |
Project channel: #youscoop |
08:28
🔗
|
midas |
i like that. |
08:28
🔗
|
midas |
im in |
08:49
🔗
|
SketchCow |
https://archive.org/movies/thumbnails.php?identifier=1984_computer_store_display_CED_videodisc |
09:41
🔗
|
SketchCow |
http://www.flickr.com/photos/textfiles/sets/72157630600565424 |
14:31
🔗
|
midas |
is it just me or is archive.org's main page a bit, broken? |
14:36
🔗
|
Nemo_bis |
WFM |
14:36
🔗
|
SadDM |
Looks fine from here... somebody was mentioning that they were having problems last night too |
14:36
🔗
|
midas |
im getting 302 Found |
14:36
🔗
|
midas |
site itself works fine, just not the index :p |
14:37
🔗
|
midas |
probably the redirect to SSL is broken |
14:38
🔗
|
midas |
yeah, if you go to the https site it works directly |
16:16
🔗
|
godane |
is there a way i can search on the IA backend even when the search index is not showing everything? |
16:16
🔗
|
godane |
i maybe have 212 items to cnnmoneyarchive but its showing only 210 in search index |
16:23
🔗
|
godane |
so it looks like its doing the same thing as before |
16:23
🔗
|
godane |
some items just don't show in search index |
16:25
🔗
|
DFJustin |
check https://catalogd.archive.org/catalog.php?history=1&justme=1 for pending tasks |
16:26
🔗
|
midas |
oh boy, im going to check that |
16:49
🔗
|
DFJustin |
actually http://archive.org/catalog.php?justme=1 is just pending |
18:06
🔗
|
SadDM |
SketchCow: at your convenience, could you please move https://archive.org/details/tome_of_treasures-20140302 to the Archive Team collection? |
19:24
🔗
|
SketchCow |
Done. |