[00:26] trying to run the warrior is github down? it cant find it to pull the code [00:27] Cameron_D Coderjoe SketchCow i know one of you runs the warrior project but i cant remember which one [00:43] GitHub seems operational [00:43] https://status.github.com/ is a good place to check [01:30] http://www.archive.org/ down? [01:32] doesn't look like it: http://downforeveryoneorjustme.com/archive.org [01:32] server problem [01:59] if its down i'm not getting any server error xml [02:02] huh i get an nginx error 302 [02:03] my problem is i have been upload pdfs i have none of those results.xml files [02:03] so i think S3 is still taking stuff [05:14] I'm starting to think it's going to be a priority to start doing culture runs against youtube. [05:29] culture runs? [05:30] agreed [05:31] https://archive.org/details/The_Making_of_Rock_and_Rule [05:31] That gem was buried in there.] [05:32] I want to do it right, though - real metadata grabs and transfers, nice bespoke stuff. [05:33] agree [05:33] some of my stuff like that [05:33] but its mostly rev3 and twit stuff that gets the metadata [05:34] but if there is a very good xml/rss metadata still i can do it [05:34] a big issue is that the commonly available youtube downloading tools do not get the full resolution [05:34] e.g. assuming you grabbed that from https://www.youtube.com/watch?v=frCen3NVNsg there is a 480p whereas you got 360p [05:34] jdownloader 2 is the only prepackaged tool I've found that handles this [05:36] but it's a fairly obnoxious program in other ways [05:39] youtube-dl is doing well. [05:39] it used to do well until they switched to DASH [05:39] now the devs have their thumbs up their asses [05:42] in brief, anything 1080p or above is downloaded as 720p and anything 480p is downloaded as 360p [05:42] SketchCow: i may get a 311mb version of that video you posted [05:42] I still use it to get metadata but that's not acceptable for video archival imo [05:46] I'm happy to check this. [05:46] And we should make a wiki page. [05:48] http://interbutt.com/temp/The%20Making%20Of%20Rock%20And%20Rule.mp4 is the 480p version of that youtube, double the file size [05:53] it is possible to work around with a script, this one is kind of shit but shows the approach https://github.com/rg3/youtube-dl/issues/1643#issuecomment-28317090 [05:53] Well, that's the bespoke part. [05:53] I don't want us doing wholescale grabs, I want us seeking out and doing some proper grabs, full metadata, maybe research [05:55] ok looks like they have gotten a little further https://github.com/rg3/youtube-dl/issues/1612 [06:00] it's still pretty lol that it's not the default after 5 months (youtube-dl you had one job) [06:06] Project channel: #youscoop [08:28] i like that. [08:28] im in [08:49] https://archive.org/movies/thumbnails.php?identifier=1984_computer_store_display_CED_videodisc [09:41] http://www.flickr.com/photos/textfiles/sets/72157630600565424 [14:31] is it just me or is archive.org's main page a bit, broken? [14:36] WFM [14:36] Looks fine from here... somebody was mentioning that they were having problems last night too [14:36] im getting 302 Found [14:36] site itself works fine, just not the index :p [14:37] probably the redirect to SSL is broken [14:38] yeah, if you go to the https site it works directly [16:16] is there a way i can search on the IA backend even when the search index is not showing everything? [16:16] i maybe have 212 items to cnnmoneyarchive but its showing only 210 in search index [16:23] so it looks like its doing the same thing as before [16:23] some items just don't show in search index [16:25] check https://catalogd.archive.org/catalog.php?history=1&justme=1 for pending tasks [16:26] oh boy, im going to check that [16:49] actually http://archive.org/catalog.php?justme=1 is just pending [18:06] SketchCow: at your convenience, could you please move https://archive.org/details/tome_of_treasures-20140302 to the Archive Team collection? [19:24] Done.