[00:24] Done - ftp://ftp.fcc.gov/ & ftp://ftp.cdc.gov/ - Uploading [00:43] !ao https://www.youtube.com/watch?v=KaOC9danxNo --phantomjs [00:43] oops [01:25] underscor: cold aisle in my house is 75F rn [01:28] dc I work in runs "hot" cold aisle is 65F/19C, my hot aisle is 95F/35C, but they have options for up to 50C hot aisles with chimneys [01:29] hot [01:29] hawt [01:29] heh, current dell servers are certified to ruin at 95F inlet temp [01:29] 35C [01:30] you dont want to know how loud the fans are at that temp . . . [01:40] so I hear IA is a pretty hot place to be [01:40] It's got everything [01:41] boiling servers [01:41] an angry admin named Ralf [01:41] RÃ¤lf [01:53] BiggieJon: it's a closet in a warehouse [01:54] I think it's just outside air? There might be a cooler or two but yeah, no dc grade enviro controls at all [01:54] fuck being at work right now. [01:54] lol [01:54] what timezone? [01:54] they appently gonna unblock facebook o_O [01:54] gmt. [01:55] errr bst :/ [01:55] oh, okay [01:55] what's the offset? [01:55] hmm, can't remember if we're -4 or -5 right now [01:55] fuck dst [01:55] its 3am [01:55] oh okay, that's late! haha [01:55] night shuft. [01:55] night shaft [01:55] :B [01:56] on phone too. bored on lunch. [01:56] haha [02:55] I just found out that there are still people playing Meridian 59 (the first MMORPG), and that the game was open sourced in 2012: http://www.newyorker.com/online/blogs/elements/2014/05/the-last-survivors-of-meridian-59.html [05:25] anyone remember this? http://adhd.irule.net/~tward/tmaset/ [05:25] there was a second series, apparently, but I found out about it after many of the sites were dead and haven't been able to track them down. [07:16] I feel like an accomplished little archivist this morning. I'm nearly at the end of copying 64GB of /home and /var off on old server before we turn it off, because I said to my manager "let's keep a copy of basically everything." [07:17] I even got my manager to allow me to come in a little later today so I can finish copying everything to a portable hard disk, to bring into the office. [11:00] https://mediacru.sh/ZtlKEZqLhmhm [nsfw] [11:00] umm... [11:00] totally unrelated to anything gif... [11:01] anyways, how are we keeping track of ftpsites, who is getting what? (the big ones, etc) or is it just a case of search, if it's not there start ripping? [11:09] pretty much just search and start ripping- the only partial list of what's done is here: https://www.piratepad.ca/p/old-ftp-list there's bigger lists here: http://www.mmnt.net/ , and if you're feeling brave, here's a toolset to make a master list of every FTP that allows anonymous login: https://github.com/ArchiveTeam/ftp-nab [11:10] apparently most of that info was on http://archiveteam.org/index.php?title=FTP already, but good to put out there anyway [11:13] aye read all that, but noticed midas listed there and wondered if we was doing better tracking :3 [11:13] anyone got the output of ftp-nab? [11:18] im just grabbing and putting what im grabbing there [11:24] im grabbing one at a time, because they are kinda huge [11:34] midas, what about .snapshot directories? - ftp://ftp.axis.se/.snapshot [11:38] not sure, im just wgetting the whole thing [11:40] could be interresting if they have it ohhdemgir, seems like a nice way to see what was what [12:02] i'm uploading austrailian women's weekly from 1950 [12:08] i'm trying to bang thur that collection of austrailian women's weekly so i can get it out of the way [12:08] i was able to make a download script that worked with my rename script [12:23] midas, true but some have weekly snapshots over a year... and if the site hasn't been touched in a good while it's like making multiple copies :/ [12:23] (I suppose that's how it works, only seen a few) [13:22] hmm, lets see what SketchCow has to say about it ohhdemgir [13:32] so i made grabbing the sydeny morning herald easier [13:45] lftp --mirror --parallel works well too [13:45] if you want to do a few files at once [13:52] Hiiiii [13:52] Is this about FTP? [13:55] every one should know that trove.nla.gov.au will give you a 404 error when it takes too long [13:56] the url that 404s will have to re-tried and you get it [13:57] -------------------------------------- [13:57] OK, my take on the whole FTP thing. [13:57] I initiated the downloading of FTP sites because I was concerned there's an entire family of data and history buried on dying servers dating back from the late 1990s. [13:57] Specifically, I know mirrors of originally extant sites were being taken over by other FTP sites, and then those sites themselves were dying. [13:58] That would be really problematic - entire subsets of data and one of a kind collections are at risk. [13:58] So, the first step was to generate a list of every FTP site available from the internet. [13:58] The ftp-nab script was written, but I never saw output from it, although I could easily have been distracted from the result being known. [13:59] I also initiated downloading these sites. Just grabbing them into file directories and putting them into tar files. [13:59] It wasn't perfect, but better it get SOMEWHERE than where it's on aforemented dying server. [13:59] Now, what slowed me down was that I was trying to download multiple sites, and this worked until I hit a few 10 terabyte monster sites. [14:00] These are sites with entire runs of, say, FreeBSD, or Linux, or so on. So basically, massive mirrors of already-available material. [14:00] It blew my buffer to go in and make kill-files for these sites, so I had to switch to a couple other priorities. [14:00] But I'd like to see .tar or .zip or any other retrievable output of these items, at least grabbed off into items. [14:01] The goal is to have a place to build directories from in the future. [14:01] There. [14:01] -------------------------------------- [14:03] Boom! [14:04] Yeah, boom. [14:04] I'm back to full writing style, hence blog entries. [14:05] It's lovely [14:06] :) [14:13] i'm starting to uploaded more sydney morning herald pdfs [14:13] on a side note [14:13] Keyword: âhappinessâ [14:13] Awww <3 [14:14] i'm getting the full joy of painting with bob ross [14:14] i think that i need to get uploaded so we can have a collection of that [14:15] midas, doesn't sound like we need to grab backups of their backups backups backups... then :p [14:18] [1:35:39 AM] Jason Scott: I'm watching it work on gun manuals right now. [14:18] [1:36:11 AM] Jason Scott: manual; pin; barrel; detent; colt; sight; assembly; bolt; receiver; inspection; front sight; colt manual; receiver group; barrel nut; pivot pin; upper receiver; gas tube; firing pin; bolt catch; trigger guard [14:18] [1:36:31 AM] Jason Scott: Seriously, it's like a game of $25,000 Pyramid [14:18] [1:36:50 AM] Jason Scott: UHHHHH UHHH THINGS YOU ASSEMBLE BECAUSE YOU ARE VERY ANGRY AT YOUR TAX BILL [14:32] yahoo! funerals http://ending.yahoo.co.jp/funeral/ [14:33] Ran translate......... yep [14:33] !archive http://www.nebraskaweatherphotos.org/ [14:35] DFJustin: if they shut that down it would be really awkward. [15:19] working with proprietary video capture frameworks is such a bitch [15:20] because of the nature of the subject they're very touchy about how they're used, and if you don't use them right, all you get is an error code that may or may not be documented; you can't look inside and go "oh, I was doing it wrong" [15:20] "proprietary" meaning "Apple" [15:21] incidentally if anyone knows what the hell OSStatus -12633 from AVAssetWriterInput means, please tell me [15:24] oh, according to the voodoo masters, it can occur if samples are written "too out of order" [15:24] well ok then [15:45] SketchCow, running ftp-nab, within hours I got my first abuse claim :D - http://pastebin.com/raw.php?i=ds0kFJBF [15:46] not sure if that's something to be proud of [15:48] yipdw, means it's working, put a smile on my face at least [16:05] Nice [16:05] Keep going [17:24] ohhdemgir: did you reply: nope, just grabbing all the ftp's in the world for archiving? [17:33] midas, yes, just told them to calm their passions, linked ftp-nab, gave reason and the response was chill. [17:33] Yup, list them all, start ripping. [17:34] there's also http://www.mmnt.net/ [17:35] actually pritty good response ohhdemgir :p [18:10] TIL: http://askubuntu.com/questions/65101/what-are-these-files-like-zone-identifierdata-and-how-to-prevent-them [18:11] ftp://ftp.axis.se/pub_soft/cam_srv/cam_242SIV/4_31/242SIV_4_31_thirdpartysoftwarelicenses.txt:Zone.Identifier:$DATA [18:11] ftp://ftp.axis.se/pub_soft/cam_srv/cam_242SIV/4_31/242SIV_4_31_thirdpartysoftwarelicenses.txt [19:03] so after a bit of sorting and getting the unique urls, it's only 156 sites [19:03] easypeasy [19:09] aw, "Space Oddity" is down https://twitter.com/Cmdr_Hadfield/status/466168309441122304 [19:10] https://thepiratebay.se/torrent/10141372/Chris_Hadfield_-_Space_Oddity [19:11] http://dat.serveert.me.uk/~midas/youtube/Space%20Oddity-KaOC9danxNo.mp4 [19:11] direct link, yesterday's grab [19:12] i saw yipdw posted something on it yesterday :) [19:12] Game of Thrones just got alot better, thanks George! https://www.youtube.com/watch?v=X5REM-3nWHg [19:13] anyway hadfield was working on getting the license extended but i guess it didn't get done [19:13] sweet [19:16] wow.... wordstar 4! [19:17] hah :p [19:17] hmm "use of the high bit of each byte of its files to denote the last letter of a word" [19:17] Apple II text files (source code in particular) usually have the high bit of each byte set [19:17] which makes viewing it in a hex editor rather interesting [19:37] so i think i have up my item count from 4k to close to 5700 in 24 hours [19:37] in the godaneinbox [19:38] sweet progress :-D [19:39] http://fivethirtyeight.com/features/meet-the-man-who-preserved-decades-of-nba-history/ [20:13] underscor, those servers you linked, instant setup? [21:30] so i found something very odd with wayback machine [21:30] when i look in download.cbsnews.com/* i get 9070 urls [21:31] when i look at download.cbsnews.com/media/2013/* i get 15k [21:57] anyways 1846 of the sydney morning herald is uploaded now [21:57] starting to upload 1847 of it [22:01] http://xania.org/201405/jsbeeb-emulating-a-bbc-micro-in-javascript