[00:21] unless they're expiring stories, a deep grab every so often is all that's needed content wise [00:33] does anyone have a quick rundown on the limitations of working with Amazon EC2 Free Micro Instances? [00:41] IA has been making an effort to crawl news sites more frequently [00:46] hmm found a good guide here: http://virtuallyhyper.com/2013/04/deploy-an-amazon-ec2-instance-in-the-free-usage-tier/ [00:46] just trying not to get raped by sudden charges [01:44] http://jalopnik.com/woman-brags-about-hitting-cyclist-discovers-police-als-509059331?utm_campaign=socialflow_jalopnik_facebook&utm_source=jalopnik_facebook&utm_medium=socialflow [01:45] http://jalopnik.com/woman-brags-about-hitting-cyclist-discovers-police-als-509059331 <- without shitty twitter tracking [01:45] Is that the dumbest use of twitter yet? [02:20] One of my proudest aspects of archive team is stuff that even I waver on the sense of trying to archive it, I come on here and people are doing it anyway. [03:55] http://www.forbes.com/sites/andygreenberg/2013/05/20/25-gun-created-with-cheap-3d-printer-fires-nine-shots-video/ [04:03] uploaded: https://archive.org/details/www.g4tv.com-episodes-20121221 [04:21] instence: btw, the free tier is only available for your first year. [04:22] dashcloud: I think the HxC was the device I was remembering. [04:23] I was thinking of making a derivative of the USB version (which, iirc, was the first version) which had a web server in it and connected to the network, allowing you to manage the contents of the floppy/ies via a web browser [05:13] Coderjoe: cool, yea I have been working on the EC2 stuff all night [05:13] I got it up and running and I am using it now [05:14] from my research, per month, these are the limitations: 30GB of Space, 2M IOPs, 15GB Network Throughput, 750 hours of CPU [05:14] also, the free tier does not cover spots [05:15] all of that is available on the amazon aws site [05:15] the CPU limit is enough to cover 24/7, iirc [05:17] how do you determine when you are breaching caps on this stuff? [05:17] the monitoring shows graphs but [05:18] you can look at the account activity [05:19] hmm I was trying that but it was empty [05:19] just checked again, still empty [05:19] "You have no activity for this period." [05:19] it might take a little bit to get started or something. I don't remember [05:19] cool [05:19] I haven't used AWS in a year or so [05:20] i am basically using the EC2 for a job where ip can get blocked quick and i might need a new one [05:20] yeah, I did that for poetry.com [05:21] gamefaqs.com does perminant block on your IP if you aren't careful. I got my home, work, and remote server banned today lol [05:21] some admin was playing wac-a-mole, I think [05:21] So I had to get an EC2 up and running and stretch out -w wait time hoping for the best [05:21] grabbing files.. verrry slowly, but eventually I will get what i need [05:41] Why gamefaqs? [06:02] Didn't someone already grab gamefaqs at one point? [06:06] i don't think so [07:56] I am interested in hearing people's bit torrent strategies. We all know having a faster connection and more seeds leads to faster downloadings [07:57] but what about # of concurrent downloads [07:57] Does overhead from too many slow items, choke off the fast items [08:09] Some clients allow prioritization but does that really help. [08:21] flickr + tumblr = fuckr [08:21] lol [08:22] more like fuibkr [08:38] I mentioned gamefaqs but I've not looked at actually grabbing it. [08:39] I have done some prelim work on it [08:39] The way I see it, if I finish mapping it out we can grab it in one huge hit [08:39] nod. [08:40] warriorize if neded. [08:40] yes, hardcore [08:40] speaking of [08:40] Smiley, lets head to ispygames [09:10] Flickr + tumblr = fumblr [09:33] * brayden fumbles [09:33] * brayden drops all user data by accident when fumbling [09:35] oh noes! [10:48] You wanna see the deviants that make up Archive Team? -> https://secure.flickr.com/photos/djsmiley2k/8235573234/ [10:48] wow, you cannot browse images on flicker without javascript anymore [10:49] GO GO YAHOOIFIY! [10:49] omf_: LOL [10:49] There is one of him climbing out of my chest [10:49] omf_: #YOLO [10:50] I fry em up good [10:50] yahoo only likes old? [10:50] https://secure.flickr.com/photos/djsmiley2k/with/8750584244/ << also members [10:50] https://secure.flickr.com/photos/djsmiley2k/8493354054/ [10:51] https://secure.flickr.com/photos/djsmiley2k/8072096941/ [10:52] https://secure.flickr.com/photos/djsmiley2k/6801016825/ [10:53] SUDDENLY, LOGIN PAGE [10:54] >Sign in to Yahoo! [10:54] >google account login [10:54] ok [10:55] yeah, private photo [10:56] private photo? [10:56] Oh, wedding shots, sry :D [10:56] currently moving all my photos over to G+ :D [10:58] I'm doing my best to use up my free 5Gb from google [10:58] And then I read they giving me 15Gb combined, and I'm like daaaaw I want'ed to BUY SOME STORAGE DAWG. [11:29] the internet would never be the same without porn and cats [11:29] but mostly cats [11:43] Smiley: google profile's face recognition and geolocating says thank you! [12:21] proboards seem easy to mirror [12:49] is there a magical way to use --page-requisites and --span-hosts with -m where wget only grabs the actual page-requisites, without starting to mirror the referenced pages? [12:49] eg for mirroring a forum and the images inside posts [14:17] is the bombergames stuff being worked on? [14:30] not by me [14:48] meh, it failed [14:48] domain=shinobiman.proboards.com; wget -m -np -w 0 -a ${domain}_$(date +%Y%m%d).log -e robots=off -nv --adjust-extension --convert-links --page-requisites --reject-regex='(&order=|action=(post|print|search|gotopost))' --span-hosts --domains=images.proboards.com,${domain} --warc-file=${domain}_$(date +%Y%m%d) --warc-cdx --keep-session-cookies http://${domain}/ [14:48] Downloaded: 1979 files, 90M in 21m 19s (72.2 KB/s) [14:48] while the site says Total Topics: 9,145 [16:52] uploaded: https://archive.org/details/GameProTV-Ep4-1996 [17:18] uploaded: https://archive.org/details/GameProTV-Ep5-1996 [17:56] uploaded: https://archive.org/details/GameProTV-Ep6-1996 [18:04] what was the failure message Schbirid ? [18:04] timed out? [18:11] Smiley: nah, it is just not complete [18:12] ah [18:14] pushing 215 warc's to our dedi for new america [18:15] sadly it OOM'eds [18:32] i figured new america download will cause problems [18:32] 215gb+ [18:32] warcs [18:41] yup [20:13] uploaded; https://archive.org/details/Equinox_Dec_1995_It_Runs_on_Water_-_Free_Energy_-_Overunity_50m18s_ConRes [20:46] Lord_Nigh, I am working on bombergames [21:47] omf_: great! [21:48] That game is on fileplanet ;) [21:49] Streets of Rage Remake I love communities like that [21:54] omf_: whose recording of the Four Seasons had you found? was going to ask in the main channel but figured it was more a -bs sort of thing [21:55] I quite like the Avison Ensemble recording [21:55] yeah I put that message in the wrong channel I mean -bs [21:57] I got this one http://www.amazon.com/VIVALDI-VIOLIN-CONCERTOS-FOUR-SEASONS/dp/B001NDR6SC/ref=sr_1_1?s=music&ie=UTF8&qid=1369259795&sr=1-1&keywords=Mariko+Sen+Ju+Vivaldi-The+Four+Seasons [21:57] I also have one I picked up off youtube but it is only Winter [21:58] The mastering is good on this recording. It is very clean [21:59] blimey. might ask a violinist friend if she has a copy I could borrow, rather than buying it cold ;) [21:59] aha, it's on YouTube for a partial audition [22:01] the Avison version is worth a listen, picked it up on 2x SACD last year - it's the full 12-concerto suite rather than just the Four Seasons by themselves [22:02] ooh I would like that [22:02] https://payments.yahoo.com/v1/refunds?intl=us¶ms=Br9Uhg== <<-- fakest looking page ever yahoo... [22:02] I collect things like the bigger readers digest collections of classical music [22:02] I also collect different versions of the 1812 overture [22:03] call for help 2002 call-a-thon: http://web.archive.org/web/20030401100258/http://www.techtv.com/callforhelp/shownotes/story/0,24330,3411091,00.html [22:03] It is always nice to find others who enjoy classical music [22:03] I am a classical neophyte, unfortunately, studied music so am vaguely acquainted with some pieces... started taking a deeper interest after meeting said violinist friend, *cough* [22:05] I recommend "The Planets" suite and prokofiev [22:05] I have played both in concert before and they are just as much a joy to listen to as perform [22:05] Mars, Bringer of War has been used by many films [22:06] I think I have a recording of the Holst somewhere - although I've only played Mars - but alas the only Prokofiev I know is the famous bit of Romeo & Juliet ;) [22:06] Opus 99 is fantastic [22:08] omf_: Do you have the Open Goldberg Variations? (which are available for free online) I have it, but haven't listened to it yet (helped back it on Kickstarter) [22:08] no but I would like them dashcloud [22:08] I would be really fucking remiss to not mention a project SketchCow helped find a home. https://musopen.org/music/composer/antonio-vivaldi/ [22:08] It has Four Seasons [22:09] http://www.opengoldbergvariations.org/ [22:11] and they are in FLAC too [22:11] fuck YEAH [22:12] ooh, are those up now? I remember they floated across my radar last year sometime and then I forgot all about them :/ [22:12] ⊂(◉‿◉)つ [22:12] (ᵔᴥᵔ) [22:16] you can also listen to it on IA: http://archive.org/details/The_Open_Goldberg_Variations-11823 [22:17] the NSA's fond of IA and the Wayback Machine: http://blog.archive.org/2013/05/18/national-security-agency-heart-internet-archive/ [22:17] I am already downloading it [22:20] also check the Musopen Collection: http://archive.org/details/musopen Especially the Lossless DVD here: http://archive.org/details/musopen-lossless-dvd [22:22] highly unlikely, but does anyone have a copy of koin.org? It had a great AOL files and docs section which I only discovered how good it was when I went to check a link, and the whole site was dead (the wayback listing has all the pages, none of the downloads) [23:33] dashcloud: when I plug in my drive I will check all of my httrack archives