[00:46] does archivebot properly pick up urls in a pastebin document? [00:46] this is the paste in question: http://pastebin.com/raw.php?i=1zEcSqzL [00:48] !ao < http://pastebin.com/raw.php?i=1zEcSqzL would save all of those links (non-recursively) [00:49] ok. thanks. [00:58] forgive my newbieness, but when i try that mibbit gives "archivebot: No such nickname online." [00:59] you want to join the #archivebot channel [01:01] oh, ok. knew i missed something. :P [03:15] i'm having issues archiving urls from madden giferator with wget [03:15] i'm even using -H -D but it still keeps missing the images [03:17] i think it might have to do with the way image urls are referred to [03:18] the user generated images start with a double slash, and that seems to confuse wget [03:18] for example, //prod-mr-user.storage.googleapis.com/assets/user_chargers_agates85_kisssky_1410228905.129581/400x286/chargers_agates85_kisssky.gif?v=971636dc22 [03:18] any idea how to fix this? [03:18] i don't think wget supports scheme relative urls [03:21] anything else that does? [03:21] wpull does [03:22] or you can use wget+lua and scrape out the urls [03:22] ok [04:12] Hi, gang. [04:12] So, tomorrow I address a room of 1,200 dewy-eyed web designers [04:12] And I will punch them in the face for an hour [04:13] Wish me well [04:13] SketchCow: i have past 10k funny or die videos [04:14] we got all of 2007 uploaded now [04:14] Hey, godane [04:14] Did you hear about the twit thing? [04:14] i'm also grab a game mod website for red faction call factionfiles.com [04:14] You should be proud [04:15] no [04:15] One of the ex-twit hosts did a podcast with a drunken rant against Leo Laporte [04:16] Leo's response was to delete 500 hours of any shows this guy was in. [04:16] Off youtube, off cachefly, off anything he could control. [04:16] Only place that had it? archive.org [04:16] 100% your uploads. [04:17] which series? [04:18] nsfw [04:18] just figured it out [04:19] Yep [04:19] And a few others. [04:22] game on is there [04:22] still there [04:22] Yeah, Leo's being a diiiiick [04:23] https://totaldrama.org/2014/10/twit-trying-to-erase-history/ [04:26] lol what the hell [04:27] Rather than just take his ball and go home, looks like he decided to stab it. [04:27] whats said is i know i didn't upload it all [04:27] of NSFW [04:27] i think i have it on my other dirve [04:56] SketchCow: link to podcast ex-twit host rant about leo please? [05:05] http://nightattack.tv/episode/31 might be it [05:11] yes [05:15] https://www.youtube.com/watch?v=IHbuVmsz4lw is the aftershow [09:23] twit: netcasts you love from people you trust. [09:23] well well well. [09:24] https://www.reddit.com/r/DiamondClub/comments/2iqoeh/im_glad_to_see_twit_is_taking_the_mature_route/ [09:24] i'm hoping to grab the original files [09:50] Maybe it would be a decent idea to set up routines to back up selected channels, in case they ever go down. [09:51] Maybe even be an easy to use local script people can use that checks for new videos of the user's choice and downloads them. [09:53] Maybe youtube-dl the channel every day or something? [09:54] Yeah, the solution would likely involve youtube-dl. But I'm also talking about making it easy and appealing to use. [09:55] And also informing people about how YT channels and videos can go down. (This would be a project and application that's not only for seasoned archivsts.) [09:56] Yep, that's fair enough. The main issue with youtube-dl is that if you point it at a channel, it grabs EVERYTHING [09:56] If not existing already, should be an argument to say 'only grab files newer than X' [09:57] Maybe try to build up a gui tool that's fairly simple to use and hooks into youtube-dl on the backend, but it'd be a bit of a project [10:12] If nothing else it establishes that some channels like Twit are sufficiently volatile that archiving has a high importance. [10:14] Is there a project (AT lead or otherwise) to store YT metadata? [12:15] IA archives video's from YT already, it does it a bit slow tho [21:29] http://glassboard.wordpress.com/2014/10/10/glassboard-closing-down-november-1-2014/ [21:30] > Wondering if this was a split second decision? The only thing keeping Glassboard online these last few months is my credit cards and ego.