#archiveteam-bs 2014-05-14,Wed

↑back Search

Time Nickname Message
00:24 πŸ”— ohhdemgir Done - ftp://ftp.fcc.gov/ & ftp://ftp.cdc.gov/ - Uploading
00:43 πŸ”— yipdw !ao https://www.youtube.com/watch?v=KaOC9danxNo --phantomjs
00:43 πŸ”— yipdw oops
01:25 πŸ”— exmic underscor: cold aisle in my house is 75F rn
01:28 πŸ”— BiggieJ dc I work in runs "hot" cold aisle is 65F/19C, my hot aisle is 95F/35C, but they have options for up to 50C hot aisles with chimneys
01:29 πŸ”— exmic hot
01:29 πŸ”— exmic hawt
01:29 πŸ”— BiggieJ heh, current dell servers are certified to ruin at 95F inlet temp
01:29 πŸ”— BiggieJ 35C
01:30 πŸ”— BiggieJ you dont want to know how loud the fans are at that temp . . .
01:40 πŸ”— yipdw so I hear IA is a pretty hot place to be
01:40 πŸ”— SketchCow It's got everything
01:41 πŸ”— SketchCow boiling servers
01:41 πŸ”— SketchCow an angry admin named Ralf
01:41 πŸ”— yipdw RÀlf
01:53 πŸ”— underscor BiggieJon: it's a closet in a warehouse
01:54 πŸ”— underscor I think it's just outside air? There might be a cooler or two but yeah, no dc grade enviro controls at all
01:54 πŸ”— Smiley fuck being at work right now.
01:54 πŸ”— underscor lol
01:54 πŸ”— underscor what timezone?
01:54 πŸ”— Smiley they appently gonna unblock facebook o_O
01:54 πŸ”— Smiley gmt.
01:55 πŸ”— Smiley errr bst :/
01:55 πŸ”— underscor oh, okay
01:55 πŸ”— underscor what's the offset?
01:55 πŸ”— underscor hmm, can't remember if we're -4 or -5 right now
01:55 πŸ”— underscor fuck dst
01:55 πŸ”— Smiley its 3am
01:55 πŸ”— underscor oh okay, that's late! haha
01:55 πŸ”— Smiley night shuft.
01:55 πŸ”— underscor night shaft
01:55 πŸ”— underscor :B
01:56 πŸ”— Smiley on phone too. bored on lunch.
01:56 πŸ”— Smiley haha
02:55 πŸ”— dashcloud I just found out that there are still people playing Meridian 59 (the first MMORPG), and that the game was open sourced in 2012: http://www.newyorker.com/online/blogs/elements/2014/05/the-last-survivors-of-meridian-59.html
05:25 πŸ”— Coderjoe anyone remember this? http://adhd.irule.net/~tward/tmaset/
05:25 πŸ”— Coderjoe there was a second series, apparently, but I found out about it after many of the sites were dead and haven't been able to track them down.
07:16 πŸ”— w0rp I feel like an accomplished little archivist this morning. I'm nearly at the end of copying 64GB of /home and /var off on old server before we turn it off, because I said to my manager "let's keep a copy of basically everything."
07:17 πŸ”— w0rp I even got my manager to allow me to come in a little later today so I can finish copying everything to a portable hard disk, to bring into the office.
11:00 πŸ”— ohhdemgir https://mediacru.sh/ZtlKEZqLhmhm [nsfw]
11:00 πŸ”— ohhdemgir umm...
11:00 πŸ”— ohhdemgir totally unrelated to anything gif...
11:01 πŸ”— ohhdemgir anyways, how are we keeping track of ftpsites, who is getting what? (the big ones, etc) or is it just a case of search, if it's not there start ripping?
11:09 πŸ”— dashcloud pretty much just search and start ripping- the only partial list of what's done is here: https://www.piratepad.ca/p/old-ftp-list there's bigger lists here: http://www.mmnt.net/ , and if you're feeling brave, here's a toolset to make a master list of every FTP that allows anonymous login: https://github.com/ArchiveTeam/ftp-nab
11:10 πŸ”— dashcloud apparently most of that info was on http://archiveteam.org/index.php?title=FTP already, but good to put out there anyway
11:13 πŸ”— ohhdemgir aye read all that, but noticed midas listed there and wondered if we was doing better tracking :3
11:13 πŸ”— ohhdemgir anyone got the output of ftp-nab?
11:18 πŸ”— midas im just grabbing and putting what im grabbing there
11:24 πŸ”— midas im grabbing one at a time, because they are kinda huge
11:34 πŸ”— ohhdemgir midas, what about .snapshot directories? - ftp://ftp.axis.se/.snapshot
11:38 πŸ”— midas not sure, im just wgetting the whole thing
11:40 πŸ”— midas could be interresting if they have it ohhdemgir, seems like a nice way to see what was what
12:02 πŸ”— godane i'm uploading austrailian women's weekly from 1950
12:08 πŸ”— godane i'm trying to bang thur that collection of austrailian women's weekly so i can get it out of the way
12:08 πŸ”— godane i was able to make a download script that worked with my rename script
12:23 πŸ”— ohhdemgir midas, true but some have weekly snapshots over a year... and if the site hasn't been touched in a good while it's like making multiple copies :/
12:23 πŸ”— ohhdemgir (I suppose that's how it works, only seen a few)
13:22 πŸ”— midas hmm, lets see what SketchCow has to say about it ohhdemgir
13:32 πŸ”— godane so i made grabbing the sydeny morning herald easier
13:45 πŸ”— underscor lftp --mirror --parallel works well too
13:45 πŸ”— underscor if you want to do a few files at once
13:52 πŸ”— SketchCow Hiiiii
13:52 πŸ”— SketchCow Is this about FTP?
13:55 πŸ”— godane every one should know that trove.nla.gov.au will give you a 404 error when it takes too long
13:56 πŸ”— godane the url that 404s will have to re-tried and you get it
13:57 πŸ”— SketchCow --------------------------------------
13:57 πŸ”— SketchCow OK, my take on the whole FTP thing.
13:57 πŸ”— SketchCow I initiated the downloading of FTP sites because I was concerned there's an entire family of data and history buried on dying servers dating back from the late 1990s.
13:57 πŸ”— SketchCow Specifically, I know mirrors of originally extant sites were being taken over by other FTP sites, and then those sites themselves were dying.
13:58 πŸ”— SketchCow That would be really problematic - entire subsets of data and one of a kind collections are at risk.
13:58 πŸ”— SketchCow So, the first step was to generate a list of every FTP site available from the internet.
13:58 πŸ”— SketchCow The ftp-nab script was written, but I never saw output from it, although I could easily have been distracted from the result being known.
13:59 πŸ”— SketchCow I also initiated downloading these sites. Just grabbing them into file directories and putting them into tar files.
13:59 πŸ”— SketchCow It wasn't perfect, but better it get SOMEWHERE than where it's on aforemented dying server.
13:59 πŸ”— SketchCow Now, what slowed me down was that I was trying to download multiple sites, and this worked until I hit a few 10 terabyte monster sites.
14:00 πŸ”— SketchCow These are sites with entire runs of, say, FreeBSD, or Linux, or so on. So basically, massive mirrors of already-available material.
14:00 πŸ”— SketchCow It blew my buffer to go in and make kill-files for these sites, so I had to switch to a couple other priorities.
14:00 πŸ”— SketchCow But I'd like to see .tar or .zip or any other retrievable output of these items, at least grabbed off into items.
14:01 πŸ”— SketchCow The goal is to have a place to build directories from in the future.
14:01 πŸ”— SketchCow There.
14:01 πŸ”— SketchCow --------------------------------------
14:03 πŸ”— ersi Boom!
14:04 πŸ”— SketchCow Yeah, boom.
14:04 πŸ”— SketchCow I'm back to full writing style, hence blog entries.
14:05 πŸ”— ersi It's lovely
14:06 πŸ”— Smiley :)
14:13 πŸ”— godane i'm starting to uploaded more sydney morning herald pdfs
14:13 πŸ”— godane on a side note
14:13 πŸ”— ersi Keyword: Γ’Β€ΒœhappinessҀ
14:13 πŸ”— ersi Awww <3
14:14 πŸ”— godane i'm getting the full joy of painting with bob ross
14:14 πŸ”— godane i think that i need to get uploaded so we can have a collection of that
14:15 πŸ”— ohhdemgir midas, doesn't sound like we need to grab backups of their backups backups backups... then :p
14:18 πŸ”— SketchCow [1:35:39 AM] Jason Scott: I'm watching it work on gun manuals right now.
14:18 πŸ”— SketchCow [1:36:11 AM] Jason Scott: manual; pin; barrel; detent; colt; sight; assembly; bolt; receiver; inspection; front sight; colt manual; receiver group; barrel nut; pivot pin; upper receiver; gas tube; firing pin; bolt catch; trigger guard
14:18 πŸ”— SketchCow [1:36:31 AM] Jason Scott: Seriously, it's like a game of $25,000 Pyramid
14:18 πŸ”— SketchCow [1:36:50 AM] Jason Scott: UHHHHH UHHH THINGS YOU ASSEMBLE BECAUSE YOU ARE VERY ANGRY AT YOUR TAX BILL
14:32 πŸ”— DFJustin yahoo! funerals http://ending.yahoo.co.jp/funeral/
14:33 πŸ”— SketchCow Ran translate......... yep
14:33 πŸ”— ArhiveBot !archive http://www.nebraskaweatherphotos.org/
14:35 πŸ”— midas DFJustin: if they shut that down it would be really awkward.
15:19 πŸ”— yipdw working with proprietary video capture frameworks is such a bitch
15:20 πŸ”— yipdw because of the nature of the subject they're very touchy about how they're used, and if you don't use them right, all you get is an error code that may or may not be documented; you can't look inside and go "oh, I was doing it wrong"
15:20 πŸ”— yipdw "proprietary" meaning "Apple"
15:21 πŸ”— yipdw incidentally if anyone knows what the hell OSStatus -12633 from AVAssetWriterInput means, please tell me
15:24 πŸ”— yipdw oh, according to the voodoo masters, it can occur if samples are written "too out of order"
15:24 πŸ”— yipdw well ok then
15:45 πŸ”— ohhdemgir SketchCow, running ftp-nab, within hours I got my first abuse claim :D - http://pastebin.com/raw.php?i=ds0kFJBF
15:46 πŸ”— yipdw not sure if that's something to be proud of
15:48 πŸ”— ohhdemgir yipdw, means it's working, put a smile on my face at least
16:05 πŸ”— SketchCow Nice
16:05 πŸ”— SketchCow Keep going
17:24 πŸ”— midas ohhdemgir: did you reply: nope, just grabbing all the ftp's in the world for archiving?
17:33 πŸ”— ohhdemgir midas, yes, just told them to calm their passions, linked ftp-nab, gave reason and the response was chill.
17:33 πŸ”— ohhdemgir Yup, list them all, start ripping.
17:34 πŸ”— DFJustin there's also http://www.mmnt.net/
17:35 πŸ”— midas actually pritty good response ohhdemgir :p
18:10 πŸ”— ohhdemgir TIL: http://askubuntu.com/questions/65101/what-are-these-files-like-zone-identifierdata-and-how-to-prevent-them
18:11 πŸ”— ohhdemgir ftp://ftp.axis.se/pub_soft/cam_srv/cam_242SIV/4_31/242SIV_4_31_thirdpartysoftwarelicenses.txt:Zone.Identifier:$DATA
18:11 πŸ”— ohhdemgir ftp://ftp.axis.se/pub_soft/cam_srv/cam_242SIV/4_31/242SIV_4_31_thirdpartysoftwarelicenses.txt
19:03 πŸ”— midas so after a bit of sorting and getting the unique urls, it's only 156 sites
19:03 πŸ”— midas easypeasy
19:09 πŸ”— sep332 aw, "Space Oddity" is down https://twitter.com/Cmdr_Hadfield/status/466168309441122304
19:10 πŸ”— DFJustin https://thepiratebay.se/torrent/10141372/Chris_Hadfield_-_Space_Oddity
19:11 πŸ”— midas http://dat.serveert.me.uk/~midas/youtube/Space%20Oddity-KaOC9danxNo.mp4
19:11 πŸ”— midas direct link, yesterday's grab
19:12 πŸ”— sep332 i saw yipdw posted something on it yesterday :)
19:12 πŸ”— midas Game of Thrones just got alot better, thanks George! https://www.youtube.com/watch?v=X5REM-3nWHg
19:13 πŸ”— sep332 anyway hadfield was working on getting the license extended but i guess it didn't get done
19:13 πŸ”— DFJustin sweet
19:16 πŸ”— balrog wow.... wordstar 4!
19:17 πŸ”— midas hah :p
19:17 πŸ”— balrog hmm "use of the high bit of each byte of its files to denote the last letter of a word"
19:17 πŸ”— balrog Apple II text files (source code in particular) usually have the high bit of each byte set
19:17 πŸ”— balrog which makes viewing it in a hex editor rather interesting
19:37 πŸ”— godane so i think i have up my item count from 4k to close to 5700 in 24 hours
19:37 πŸ”— godane in the godaneinbox
19:38 πŸ”— godane sweet progress :-D
19:39 πŸ”— schbirid http://fivethirtyeight.com/features/meet-the-man-who-preserved-decades-of-nba-history/
20:13 πŸ”— ohhdemgir underscor, those servers you linked, instant setup?
21:30 πŸ”— godane so i found something very odd with wayback machine
21:30 πŸ”— godane when i look in download.cbsnews.com/* i get 9070 urls
21:31 πŸ”— godane when i look at download.cbsnews.com/media/2013/* i get 15k
21:57 πŸ”— godane anyways 1846 of the sydney morning herald is uploaded now
21:57 πŸ”— godane starting to upload 1847 of it
22:01 πŸ”— garyrh http://xania.org/201405/jsbeeb-emulating-a-bbc-micro-in-javascript
irclogger-viewer