[00:00] I'd also like to see more essays for "regular" people. [00:00] We can touch them up and make how-tos later [00:01] Like it or not, we are now hit with general "how to save the world" interest now [00:01] help to save [00:02] I love this http://archive.org/details/software-double-r-pack collection [00:03] balrog_: Sorry, Didn't see your question. I don't know all the input commands, but 'p' pauses. [00:03] I'm slowly dumping the c64 disks and tapes I got here, so that's something [00:03] ah, ok [00:11] 20:00 <@SketchCow> I'd also like to see more essays for "regular" people. [00:11] Whatcha got in mind? [00:11] Do the metadata! [00:11] * SketchCow whipcrack [00:11] Doing it tonight! Backlogged on job apps [00:11] (You should get 2 emails from newbies soon) [00:11] Excellent [00:16] I've spent the past month explaining to old ladies why manuscripts online is a Very Good Thing; I can probably take a crack at "here's what we do" pieces [00:16] Go for it, then [00:16] Facebook hired the google wave guy [00:16] In about 5 years, someone is going to make google wave and we're all going to flip out [00:17] he's a mole [00:17] and use it [00:17] And "WHY DIDN'T WE THINK OF THIS BEFORE" [00:17] See also: Every fucking Zynga game ever [00:17] google sent him in as an undercover agent [00:18] OK, driving northward [00:18] THIS ISN'T OVER [00:18] I've pumped so much goddamned data into archive.org this week. [00:18] Terabytes. [00:18] so when will we get the complete archive.org torrent? :P [00:19] Shhh, you're still on notice [00:20] also: We have git annex [00:20] That thing is going to be the gamechanger. [00:20] If you turn git-annex into a FILESYSTEM [00:20] Why don't you get cracking on that [00:20] That... ooohhhh lordy [00:20] cat *.zip [00:21] "someone said 'cat'?" [00:21] lol! [00:21] dont quote me [00:22] Don't tase me [00:22] SketchCow: https://github.com/chmduquesne/sharebox is a FUSE filesystem built on git-annex [00:33] OK, I tried to create an account at AT and I'm receiving an error. [00:33] Here it is: [00:34] Fatal error: Call to a member function userCannot() on a non-object in /home/archivet/public_html/extensions/TitleBlacklist/TitleBlacklist.hooks.php on line 86 [00:34] And yes, I'm one of those "general" folks SketchCow mentioned earlier, so I'm sure the problem lies between my keyboard and my chair. [00:35] Sorry, I guess that was, "regular" people. :) [00:37] heh 400mb of amiga demoscene, how cute, have 9000mb of atari st :) http://archive.org/search.php?query=no%20fragments%20AND%20mediatype%3Asoftware [00:38] zgrant: I don't think that's normalâ¦ [00:38] I will admit I was a bit surprised when I saw that. [00:43] OK, I just tired again in Chrome and I received the same error message. I always knew I wasn't normal, but now I just feel like I'm becoming a bother. [00:48] That looks like a bug of some sort; more than likely not your fault at all. [00:49] OK, that's good to know. Should I just wait a few days and try again? [01:29] http://www.stephenfry.com/2011/07/28/4e3150894c7c9/ [01:38] just finished buffy season 7? now you need to check out buffy seasons 8 and 9 (comics that continue after the tv show) [01:51] Coderjoe: Oh god, I thought you were joking, until I googled it. [01:54] btw, did I link this earlier? http://www.yle.fi/tekstitv/html/P525_01.html [02:41] Back [02:42] The fiancee' has all the comics. [02:42] So no worries, that'll happen. [02:43] Archiveteam mascot [02:44] http://i.imgur.com/hnZBS.jpg [02:45] Archiveteam: No idea what you're into, saving it anyway [02:45] his cutie mark must be a ball gag [02:45] ahaha [03:36] SketchCow: latest episode of BBC's Bang Goes the Theory has a segment on archiving your data and retrieving it far into the future.. [03:37] maybe we can get some ideas from it [03:37] send it onto a space ship on a fling around the solar system? [03:38] eventually plummets back on earth to populate the deserted earth with DNA.. [03:39] SvenG: Space radiation makes things difficult. [03:39] stupid iplayer region restrictions.. just cause im in NY, im not good enough for ya ?!?!? fine then off to demonoid [03:39] that, right there, is why people pirate things [03:40] and yes space rad, is a real concern, and infortunately lead is heavy [03:40] ha! radiation! hearsay! [03:40] lead... pff [03:40] use GOLD [03:41] according to the bank there's millions of tons still [03:42] no price too high, eh?! [03:43] actually, i'm hoping for more storage in less space. right here. every grain of sand becomes storage for a few gigabytes. and ten we'll go to the beaches.. and make lots of copies... [03:43] everyone then takes a bucket of sand home... and looks for the grain that has your favourite collection of rock music. or watever. [03:44] WHAT ABOUT LICENSING [03:44] and when the police comes to check through your data then you point to the sandbox in the backyard and say: help yourself! :) [03:44] dnova: aw... come oooooooooooooooooooooooooooon [03:44] what?? sand??? did i miss something? [03:45] dnova: stop bursting my bubbles with this licensing stuff! [03:46] sorry :( [03:46] so about the sand thing.... huh? [03:47] yipdw: hows the progress on the ffnet tracker updates [03:59] bsmith093: think "nano" and "storage". stuff the data onto the orbits [04:09] neat idea [04:17] here's me, hoping that every pupil will be able to store all the wisdom and knowledge we could assemble in a few hundred grams, to be easily worn and carried around in a lifetime [04:18] couldnt this be possible? [04:18] i hope so.. [04:18] damn skippy, "here kid, have everything ever recorded, ever." [04:19] aw man i got a rock... full of knowledge [04:19] RIP charles Schultz [04:28] charles m. schultz.. peanuts.. i remember when he said he cannot go on.. just two months before he died. sad! [04:28] win 32 [04:30] "win 32"? [04:31] "/win 32" [04:31] But without the / [04:38] ah ;) [04:39] Aka alt+A for the non-lazy [04:56] bsmith093: keep asking and I'll write a bot that notice-spams you with the tracker log output [04:56] when it's done, I'll tell you [04:58] NOT GOOD ENOUGH [04:58] you're right; the bot should send two copies of each message [04:59] The bot should send 400 messages [05:06] in fact [05:06] here's some infio [05:06] I, [2012-04-02T05:06:41.727000 #29328] INFO -- : backlog: 977958 | processed: 5632 [05:07] I had to restart it, not sure why [05:07] but yeah [05:07] 977,958 category pages left to examine [05:07] 6,000 messages [05:07] this is what happens when you archive a site with 4,000 pages of fucking Pokemon [05:07] literally [05:07] fucking pokemans [05:07] ? [05:07] SQUIRTLE SQUIRTLE SQUIRTLE SQUIRTLE SQUIRTLE SQUIRTLE [05:09] ew [05:11] chronomex: could be worse [05:12] ok [05:20] Yeah, not nearly as many pages as Harry Potter and Naruto. [05:21] anyway, the crawler is getting through the backlog at about 200 items/sec [05:21] so [05:21] calculate that out for completion time [05:24] oh, huh [05:24] on an

I just noticed that HTML5 (and maybe earlier revisions) had a element [05:25] I've been looking for something like that; I often have a need for that when writing issues in our issue tracker at work [05:25] where n denotes n as a variable [05:49] is for maths, yes? [06:15] Data is flying through fortress of solitude for MobleMe [06:21] Delicious. [06:25] Also, I now have all the data from IUMA and MP3.com [06:26] Wow, mp3.com. I found some good musicians there back in...what, 2002-3 or so? [06:29] sounds about right. [06:31] Wow, I've been listening to Joe Stump for ten years? [06:34] fuck yeah there's a song I wanted from mp3.com but could never find again [06:35] one should always keep the md5sums of files... [06:39] I pinned down someone who did IT at mp3.com the other day [06:39] he said he wasn't allowed to say even what happened to the physical disks... [06:39] wasn't there a legal battle? [06:39] yeah [06:39] I'm sure SketchCow can be very...persuasive [06:40] they're under a big cement slab in the desert next to the ET cartridges [06:40] I was just thinking the very same thing about SketchCow being persuasive. [06:53] chronomex: yeah, it's for math [07:49] I have the mails [07:49] It was Vivendi. [07:50] Like, they're the ones who made this happen. [07:50] Terrible, really. [08:00] headaches suck [08:01] SketchCow: ALL data from mp3.com? how big is that? [08:02] A lot [08:02] Well, a terabyte or two [08:02] lol [08:18] Wheeeeee [08:18] Outer banks! [08:18] <3 [08:18] I'm like 30 feet from the ocean, it's fantastic [08:18] which ocean? [08:18] atlantic [08:18] barrier islands off of NC coast [08:18] ah [08:22] I'm like 30 feet from the bathtub, it's fantastic [08:22] :( [08:23] I'm like 30 feet from my pillow [08:23] I'm like 2 feet from my monitor [08:24] I'm surrounded by hard drives [08:24] ocean schmocean [08:27] I'm surrounded by hard drives in the ocean [08:27] oh wait [08:27] RedType: :D [08:28] Fuck it's late :( [08:28] but I'm past the point where I can fall asleep [08:28] it's early [08:28] ;) [08:28] partytime [08:28] lol [08:30] alard: are we done with focity? [08:31] We're nearly done. The list is down to 23 unreturned items, which all have a problem. I'm downloading those now. [08:32] SketchCow: Could you, at some point, make a list of the focity warc.gz files that have been uploaded to fos? [08:34] And, also, memac should go faster. :) Only three months left... [08:35] I'll throw some resources at it shortly [08:35] Is mobileme dead? [08:35] how are we doing eta wise? [08:35] Ah its going now Â¬_Â¬ [08:36] underscor: No idea, we've done about one third of the current list. But there are more, so we won't make it anyway. [08:37] oh :( [08:37] are you going to add in the additional ones? [08:37] I don't have them yet. [08:37] Are there any projects actively going that are missing from the "Currently Active Projects" section on the front page of the wiki? [08:38] underscor: (Have to google first. But I can google faster than we can download.) [08:39] Not that I know of. [08:39] No big projects, anyway. [08:39] alard: oh I see [08:40] I could start up the crawlers again, if you think that helps. [08:40] very good news: http://lists.wikimedia.org/pipermail/xmldatadumps-l/2012-April/000448.html [08:41] not really, we still have plenty more to go :) [08:44] Can't kennethre restart download to see how fast the total download can go? :) [08:44] for how long? :P [08:44] lol [08:44] Poor poor Heroku [08:44] until heroku calls him up [08:44] i'm trying to be a good employee [08:45] "uh, dude" [08:45] :D [08:45] Nemo_bis: Is there a plan already to get a copy of that to IA? [08:45] underscor, not yet [08:45] I'm sad we lost the optimum date for kennethre helping with his megamachines [08:46] I've been led to believe archive.org doesn't have as much of a disk space issue at the moment, by the way [08:46] maybe [08:46] I mean, it's already available there, but IA always likes having a backup of everything [08:46] I think we should just buy a botnet for a few days [08:46] oh i can still help [08:46] 200 instances is a bit much though [08:46] turns out it was one of the biggest apps running on the platform [08:46] I guess emijrp will set up some list of files to be tar'ed up and uploaded to IA. underscor, you could do the rsync + tar part. He'll contact you soon I suppose. :-p [08:46] kennethre, ah, they found out? :D [08:47] Nemo_bis: nah [08:47] eheh [08:47] just observations [08:47] i wouldn't be doing it if i didn't think they'd be okay with it :) [08:47] looking back that was probably a bit excessive though [08:47] i'm fine with running ~50 [08:47] which is still a few MB/s [08:48] http://www.archive.org/details/software now has a proper collection list. [08:48] Nemo_bis: yep, I'm here whenever he gets around to it [08:48] will talk with alexis about where/what/if they want to do with it [08:48] SketchCow: neato! [08:49] kennethre: 200 dynos is one of the biggest apps? [08:49] :P [08:49] underscor, I guess the IA wouldn't set up an rsync mirror though? [08:50] Because the first thing to do is probably to have one or two mirrors at least, where people could then download (not a single bottleneck). [08:50] underscor: that's so huge [08:50] go for 50! :D [08:51] i was at 300 actually [08:51] 36,828 software items :O [08:51] which is 1.5TB of ram [08:51] which isn't cheap in amazonland :) [08:51] ouch [08:51] true [08:51] Nemo_bis: They might, iunno [08:51] How big is it? [08:52] (if you know) [08:52] JADMaker downloded more than Harry potter, good [08:52] lets see here, i'll start some up again [08:52] underscor, about 18 TB [08:52] * underscor waits for heroku to start smouldering again [08:52] hmmmm [08:52] Nemo_bis: Hm, pretty big. I don't know if they'd want to do that. [08:52] wget --mirror... [08:52] I'll ask, of course [08:52] underscor has great ideas for other peoples' hardware [08:52] big ideas [08:52] :D [08:52] can i change seesaw to add in --progress easily? [08:53] does wget even have a progress flag? :D [08:53] SketchCow: Don't I? [08:53] ;) [08:53] SmileyG: Nope. you can do some fuckery with tee to see the log file as it's recorded [08:53] SmileyG: How could it? It wouldn't know how many links there are at a site in before hand [08:53] or get rid of q and see it download [08:53] "estimate" ;D [08:54] ok then [08:54] --vebose! [08:54] underscor/SmileyG: I think all of the wget output goes to a log file. [08:54] so I can at least see it grabbing files [08:54] oh okay [08:54] --verbose will just increase the size of the log file. [08:54] I thought it was using the --logfile thing [08:54] yeah it does... [08:54] * SmileyG wants to disable --logfile then ;D [08:54] Or does --logfile redirect all output? [08:54] underscor, http://wikitech.wikimedia.org/view/Backup_status_chart#Images_and_media [08:54] Does wget have a --logfile? [08:55] -o, --output-file=FILE log messages to FILE. [08:55] closeish [08:55] lol [08:55] That's what seesaw is using. [08:55] hehe [08:55] can I remove that easily? [08:55] \o/ [08:55] * kennethre back in action [08:55] Why don't you just run tail data/**.log ? [08:55] ^ [08:56] or multitail [08:56] Although I don't think that automatically refreshes [08:56] (when new files are created) [08:56] kennethre: yay [08:56] I figured out a way to tail this before... hmmm [08:56] running 50 [08:56] hehe, now people will have to run if they want to keep the top positions in the memach chart [08:57] lol [08:57] gamification ftw [08:57] ^ [08:57] now if only it was like a horse race or something [08:57] tail -f ./data/*/*/*/*/*/wget.log [08:57] :D [08:58] just in time to stsay at the top :) [08:58] SmileyG: Or use ** to match all of those [08:58] :P [08:58] didn't work for me :S [08:58] kennethre: pfft, we know you're gonna win [08:58] he cheats! [08:58] * underscor points to hundreds of ec2 instances [08:58] ddmorton's going really fast [08:58] *dcmorton [08:59] so is short [08:59] where are the ED guys? they told they were so interested [08:59] lol, kennethre already has half of http://memac-tamer.heroku.com/ [08:59] hehe [08:59] Nemo_bis i know! [09:00] Nemo_bis: that guy had some serious boxes too [09:00] ED? [09:01] encyclopedia dramatica [09:01] he was running scrapers on the frontend servers [09:01] that have like 8 Gb internet connections and 24 GB of ram [09:05] :o [09:05] Hurrah, e-mail inbox down to 6 [09:06] let's see if we can't get that number back up for you [09:07] You know what? [09:07] Geeks. They make the same jokes. [09:07] The same jokes I've heard for, oh, 20 years. [09:07] One of them? Someone is doing good, something good happens. [09:07] And someone goes "ha ha, let's fuck you up" [09:07] Old. [09:07] still funny [09:08] In a 'I snort a lot and haven't seen an unbought vagina' sort of way [09:08] pfff [09:09] i'll never understand how SketchCow comes up with this stuff so quickly [09:09] Not much different than anyone with that skill. [09:09] anyone for that matter [09:09] Good improv people, they're great to wach [09:10] But it's a specific skill [09:10] SketchCow should do comedy on the side [09:10] I was in comedy troupes for enough years. [09:10] Not interested in that life. [09:10] Aw :( [09:10] oh really? [09:10] that explains it [09:10] http://archive.org/details/archiveteam-sharkbait-panic [09:11] lol'd @ unbought vagina [09:12] http://archive.org/details/super-soft-magazine [09:12] Sweet stuff, japanese video game magazines [09:19] i just noticed anyhub [09:20] and therein lies the problem [09:20] looks like tars 1 thur 4 are very big [09:20] 4 is 306.8gb big [09:20] everything else is like in single mb [09:23] Wow [09:24] amazon has a TON of openings in my area [09:24] I should apply, that'd be a neat job [09:24] in a warehouse? [09:25] http://archive.org/details/2012-02-08-tpb-torrents [09:25] As soon as they discover that you'd set up a VM and eat all their resources to download memac they'll discard your application. [09:25] archive of the piratebay [09:25] YES [09:26] btw I'm constantly updating http://www.archive.org/details/publicbt.com [09:26] Nemo_bis: shhhhhhh [09:26] 8) [09:26] less digestable but somehow useful [09:26] :p [09:26] I wonder if you do get free ec2 resources [09:26] https://us-amazon.icims.com/jobs/166358/job [09:26] underscor, I suggest not to ask this at the interview for the job [09:26] This sounds so perfect [09:26] make that your first question in the interview [09:26] dnova: hahahaha [09:27] "How much bandwidth can I use without getting fired?" [09:27] Job ID: 166358 O_o [09:27] i downloaded 2 years worth of cpu magazine [09:27] 2010 and 2011 [09:28] underscor, "You act as an escalation point for junior technicians." <-- seriously? :-p [09:28] Nemo_bis: hahaha [09:28] That job is already pretty "junior" [09:28] unless you have a team of kindergarten technicians [09:28] if you look at the requirements [09:28] https://us-amazon.icims.com/jobs/165246/job Oho! [09:29] Even better! [09:29] http://archive.org/details/archiveteam-twitter-json-2011 [09:29] Night shift means they don't notice me using 140Gbps of bandwidth [09:29] some thing for archiving: http://www.mediamegamall.com/smartblu-bluray-disc-100gb-bdxl-bluray-case-sbr6b100gb-p-40078.html?gclid=CMrk9I3tla8CFUGo4AodOwy8yw [09:29] 100gb bluray [09:29] SketchCow: still deriving or buping? [09:29] No sizes on the details page [09:29] its stupid that it doesn't work with current bluray drives [09:30] Oh, you mean, a plastic disc where a laser burns an image of a groove onto light-sensitive material through the plastic? [09:30] No, underscor [09:30] hm [09:30] because your year with the archive tells you that it just stops dead and that when someone drops a link in of a brand new thing, surely that means he's leaving it 100% broken [09:30] maybe just needs a recache [09:31] heh [09:31] Oh, wow, it's actually almost been a year [09:31] I guess it actually has been, hasn't it [09:31] Is staying up until 5am the way to be social with your beach visit? [09:31] Since you were hired following PDA2011, and then got me in touch shortly after [09:31] :( [09:31] No, I should probably go to bed [09:32] I'm waiting for this CD to finish ripping [09:32] Because the drive is noisy as fuck [09:32] Yes, without you it'll never get it done [09:32] Just watch it, like a boiling pot [09:33] No, but I can't sleep with it vibrating [09:33] and this drive is broken (It won't spin down) [09:33] You'll find that out in college, too [09:33] so I need to eject it when it's done [09:33] hahahahah [09:35] i think i have over 100 episodes of GBTV [09:36] i think i may need a hard drive to ship to SketchCow [09:36] GBTV? [09:36] glenn beck internet show [09:37] archive.org has 5 months worth of glenn beck on fox [09:39] No. [09:39] It has every show he ever did. [09:40] Just because it isn't public, doesn't mean it doesn't exist [09:40] ^ [09:40] i was going by this: http://archive.org/details/GlennBeckProgram [09:51] SketchCow: Does it have the GBTV ones? [09:52] Ni. [09:52] at least i have them [09:52] there are at least some people that wanted this shows archived [09:55] http://www.youtube.com/watch?v=vAtiPcNTpOM [10:01] i think captinusa has all of glenn beck shows [10:04] if anyone needs some free storage: http://blindcode.net/ [10:37] hahaha [10:37] that's great [11:15] fleshed out the AT wiki facebook page, did a test and found that facebook's download deal is somewhat broken. [11:52] http://www.codinghorror.com/blog/2012/04/preserving-the-internet-and-everything-else.html [11:52] SketchCow ^ [12:07] Hoho, awesome [12:07] Cue the comments! [12:12] i was just reading that [12:48] Well, SketchCow's "Got my inbox cleared" surely is going to not hold on for too long with that much attention given to it [13:22] what's the deal with random shareware on a floppy from the early 1990s? what if it's shareware in the sense that some dude gave it to me saying, "i wrote this; you can have this"? probably not explicitly shareware, but my social intuition at the time told me it was intended pretty much as that? [13:23] you would have to ask the guy who wrote it [13:23] and then, a whole pile of floppies with Stuff (tm) on it, most if not all of it likely to be pirated [13:23] do we just let these things die gracefully if we can't contact the authors? [13:23] from that codinghorror link i got the impression they want it anyway [13:24] Of course they want it anyway [13:24] I doubt most shareware have ever been explicitly declared such. [13:24] YOU don't know what's worth saving. YOU don't know who's going to appreciate it [13:24] Maybe someone will appreciate it in 100 years, maybe not - but it'll be there if you (try to) save it :) [13:25] ersi, but are YOU going to pay my legal bills? [13:25] I'm a bad person to ask for that question, because I would chip in [13:25] Then again, what would someone sue YOU for? Giving away your physical plastic copy of something to someone else? [13:26] realistically i don't see it as much of a risk, but i'd like to know where on the spectrum the archiving orgs are, where they stand on having a clean paper trail [13:26] If they sue you because you put something online, making it publically available? Make it private [13:26] They'll die one day. Sooner or later [13:26] my physical plastic illegal copy :) [13:26] Your physical plastic isn't illegal [13:27] It's a plastic disc with a certain (slowly fading) magnetic properties [13:27] no, i was assuming i'd copy it off the floppy [13:27] not sure i want to give my physical artifact of the last century away :) [13:28] It's a happy fun thought exercise, and while you ponder that - software, and other content - dies [13:29] berndj, do you have proper reading devices to extract data without errors? [13:29] Nemo_bis, i have floppy drives that i'm guessing still work just fine, just as they did last time i used them maybe 10 years ago [13:30] You probably guess wrong I think. [13:30] the floppies must be about 20 years old now, they seemed fine 10 years ago [13:31] I'm not trying to piss on your parade, but I'd like to beg to differ - like Nemo_bis seems to be doing, as well [13:31] i'll give it a try when i rebuild my other computer [13:33] berndj: http://www.archiveteam.org/index.php?title=Rescuing_Floppy_Disks might interest you [13:33] It's in no way conclusive, but it has interesting info [13:51] Is there a meaningful difference between the offline life expectancy of HDD vs SSD? [13:53] Working on the wiki, and want to make sure I get this right for cheap offsite storage [13:54] that is a very complex issue [13:54] That's what I feared :( [13:55] offline storage of any type should be tested for recoverability every couple years at least [13:55] Of course [13:59] I'm just checking if "take HDD, put in safe deposit box, check yearly" is decent advice, or if I should mention SSDs at all [13:59] Since my gut says that solid state electronics tend to be longer lived, but I need something more evidential than that :P [14:00] nand flash cells have limited data retention periods [14:00] How limited is limited? [14:00] hi [14:00] Shorter than magnetic platters? [14:00] Hello [14:00] datasheets commonly specify as low as 5 years for multi-level 28nm devices. [14:01] I believe that NEDEC requires 10 year retention at 30C after the cycle life has been reached [14:01] that is very generous [14:02] but it's impossible to guarantee anything like that, no matter what kind of fake accelerated aging you do [14:02] Right [14:02] And the tech's too new to have done any real tests [14:02] Don't make any statements about long term retention in various media [14:02] Got it [14:03] Wasn't planning on it, but wanted to check in in case there was something useful [14:03] rather, make a statement that whatever media you choose, that you need to check it on a regular basis. [14:03] 'course [14:03] and 1 copy is not enough [14:04] 1 location is also not enough [14:04] dnova: My plan was to suggest one local backup and one offsite [14:05] as a minimum yes [14:05] hey ersi it's about that time where I nag you to push stuff :3 [14:05] It's not bulletproof, but it'll stave off most catastrophic losses [14:09] tef: good stuff, I'll take a look at it tonight [14:09] tef: good nod ^_^ [14:11] it's about the 1 year anniversary of googlegrape [14:13] I'll drink a beer in celebration [14:16] googlegrape? [14:17] is it a raep joke, you know, cos, raep etc? [14:17] oh help i'm coming over all equality MUST HOLD BACK [14:17] not sure where the name came from [14:17] SmileyG: the g is silent [14:17] google (video) rape project [14:17] dnova: male privilege :v :v [14:18] also, sour grapes [14:40] nice, cleaned up software page on archive.org [14:41] now if we can just get something other than starr wars as the featured item :P [14:47] Ha ha yes. [14:47] We'll get there! [14:47] I'll see if it's a forced or real staff pick. [14:52] It was forced. [14:52] Good eye. I killed it, let a thousand fucked up things bloom [14:53] when you rip those CD ISOs, do you make more than one rip and compare checksums? [14:53] i have lots of trouble getting most of my discs properly ripped [15:05] I tend to just rip once, but keep the CDs. [15:15] heh http://archive.org/post/416486/need-to-archive-the-sites-under-the-domain-homepagemaccom-and-webmecom [15:16] herp [15:22] http://www.codinghorror.com/blog/2012/04/preserving-the-internet-and-everything-else.html [15:23] This is already leading to a LOT of donations. [15:24] that's great. [15:25] "It's a great resource, but it can be disappointing. So often it only collects say 1 or 2 pages from a site (repeatedly over time) and misses the rest (also repeatedly over time), even when the content is simple HTML and image links and should pose no obstacle (that is, not Flash, etc)." â I've noticed that effectiveness isn't as good as I'd like for wayback. :( [15:27] It's hard to do [15:27] But yeah, same here [15:31] infochimps can probably be taken off the archive.org software page too considering it just has test items [15:47] I just consider it a challenge to grab that shit. [15:49] it is [15:56] Hm, AT wiki registration broken? [15:57] have heard some grumblings of such [15:59] Yes [15:59] I have to fix it [16:03] Let's do it. Someone grab all the free Infochimps shit, please [16:46] is someone doing it? if not, I'll jump in [16:46] NO YOU ARE ON VACATION [16:46] Jesus, get in some sand [16:47] I am on the beach [16:47] at this very minute [16:48] it is windy as fuck [16:48] Besides, this *is* vacation for me [16:48] :( [16:49] SAD [16:49] Outside [16:49] Outsiiiiiiidie [16:50] I am! [16:50] I am sitting on a sand dune [16:50] IRCing [16:50] it's fantastic [16:54] NO MORE INTERNET [16:54] :'( [17:01] hm, if i try to use a 3.2.13 kernel on my ovh server it boots and pongs but no ssh or httpd. booting in 2.8.something again works fine. any ideas? [17:20] SketchCow: oh god no not star wars dance party [17:22] The childhood thrashed until the Death Star disco ball. [17:22] That finished it off [17:39] http://www.codinghorror.com/.a/6a0120a85dcdae970b0167648bebff970b-800wi <-- damn [17:39] I like that [17:41] seems kind of precarious [17:42] yipdw: http://home.us.archive.org/~edward/costco_drives/ [17:42] hah [17:42] wait, those are all USB drives? [17:42] oh they're GoFlexes [17:42] hm [17:42] they just rip them out [17:43] it's to get around the rationing [17:43] oh ok [17:43] what do they do with the casings? [17:43] There's a room full of empty casings [17:43] (or there was, I think they ebay'd them or something) [17:43] iunno [17:43] they're nice cases [17:43] sell then on eBay for some extra cash [17:43] what's even better is that the logic pieces are removable [17:43] so you basically have usb3.0 docks [17:44] open a side business selling docks [17:44] no-one talk to underscor, he is supposed to be internet-less [17:44] I'm sure he will be when high tide hits [17:44] Schbirid: :( [17:44] speaking of which [17:44] yipdw: hahahah [17:44] heh [17:44] aren't you on a beach [17:44] yeah [17:44] WHY THE FUCK ARE YOU NOT DIVING OR SNORKELING OR ETC [17:44] it is very sandy :( [17:45] because it's like 50 degrees [17:45] psh [17:45] and I don't have a wetsuit [17:45] (yet?) [17:45] you don't need a wetsuit to snorkel [17:45] but it's COLD [17:45] :( [17:45] 50Â°C is HOT [17:45] he means 50 F [17:45] Schbirid: :P [17:45] we don't use modern units in the US [17:45] bastard [17:45] make a sand castle [17:45] I should make a SketchCow sand bust [17:46] ironic [17:46] the sand image of SketchCow will be washed away by the oceans [17:46] OF TIME [17:46] iconic! [17:46] but the record of you doing so will live forever at badcheese.com/atlogs [17:46] IT'S SO FITTING [17:47] true [17:47] swebb: did you customize atlogbot? [17:47] or is it stock? [17:57] yipdw: is the tracker still pulling new profiles [18:02] if I haven't said it's done, the answer is yes [18:49] hey [18:51] hi [19:52] underscor: I wrote it from scratch [19:53] The bot is pretty basic though. [19:53] oh okay [19:53] not open source? [19:53] :) [20:24] It's not closed source. :) [20:24] I just haven't made it open yet. [20:26] So, I took a new job about 4 weeks ago. For the last 3 weeks, I've been re-indenting every config file that I can find so that it displays properly. Apparently the old sysadmin didn't know that indentation made things easier to read. [20:30] I just flung a 1.3gb _images.zip at archive.org [20:30] Could be AWESOME [20:31] swebb: Can't you do that automatically? [20:32] I've done up to 1.77gb, it works but takes a long ass time [20:33] http://www.us.archive.org/log_show.php?task_id=94993998 [20:36] well, the configs could have been generated with some tool or other (for example, webmin), which could account for the lack of indentation [20:44] my derive worked at last, I got a nice djvu http://ia600808.us.archive.org/18/items/VocabolarioDellaLinguaItaliana2/Zingarelli75.djvu [20:44] had to reduce the _images.zip to only 6 GB though [20:47] Oh yeah, it is HATING LIFE [20:50] nitro2k01: It's things like puppet and nagios config files and I'm not aware of any tool that auto-indents those kinds of config files. I've seen tools to auto-indent languages like C and perl, but not puppet and nagios. [20:51] Write one. Still faster than doing it manually I would assume. [20:51] More initial work, less work per file. [20:52] is there a standalone warc file browser, so i can see inside the files and, maybe ofor offline browsing capabilities? [20:53] nitro2k01: I'm not going to write a parser. [20:54] nitro2k01: I wrote a recursive-decent parser when I was in college in 1992, but I've got more important things to do now. :) [20:54] nitro2k01: I'm almost done anyway. [20:54] nitro2k01: but it sucks. [20:56] hmpf http://www.us.archive.org/log_show.php?task_id=100000000 [21:04] Watching the deriver deal. It's going aaaaarrrggggg [21:11] Friendster may be completely uploaded (minus stragglers) [21:17] ----------------------------- [21:17] HOORAY WE UPLOADED ALL OF FRIENDSTER WE DOWNLOADED [21:18] ROUGHLY 20 MILLION ACCOUNTS, 14 TERABYTES, IN 114 PARTS [21:18] GOOD JOB TEAM [21:18] ----------------------------- [21:23] Wow crazy. Good work :) [21:24] Lot of people worked on that one. [21:24] Next: Splinder [21:25] i thought splider was fully uploaded and saved? [21:25] splinder* [21:28] yeah, actually I have some 20 gb of friendster not yet uploaded [21:32] There's going to be straggling a lot. [21:32] We'll deal. [21:32] But it's time to get 20tb of data shoved into archive.org [21:32] and get off batcave [21:32] I think we still need a second machine [21:35] that's always exciting! :D [21:35] MOAR MACHINES [21:35] MOAR POWER [21:41] SketchCow: i would offer to lend my mac powerbook 170 for dc42ing disks, but the internal hard drive is bad and the screen is on the way out too [21:41] i have one spare internal scsi drive which i could swap in but with the screen about to flake out i dunno if its such a good idea... [21:50] Awesome; wiki accounts are back up [21:50] Editing time! [21:50] Yes, try it [21:51] Once I finish this page I will [21:59] def httpparse(fp): socket = FakeSocket(fp.read()+"\r\n") response = HTTPResponse(socket) response.begin() [21:59] fuuuuu [22:12] 14 terabytes of Friendster [22:12] damn [22:12] that's bigger than my Top Gear stash [22:13] what, if any, are the known stragglers? [22:17] I have a 2TB disk to mail to SketchCow when I get back to VA [22:17] dunno if there's any duping though [22:26] argh. I have here, in my inbox, a mail from someone with Walnut Creek and Infomagic CDROM archives of usenet. [22:26] and they're trying to do some kinda for-profit with them [22:27] because everyone prefers to gain income from stuff they touch. bills don't pay themselves. :( [22:28] they're welcome to make a profit, but I have a guess what they're gonna say when I come back asking for a copy [22:28] For-profit? Is there that much interest in old Usenet postings? [22:29] Anyone who wants to help test the MeMac Warrior? (A virtual machine that downloads mobileme.) Here's an appliance you could run with VirtualBox: http://db.tt/fTnxH8PY [22:39] downloading it now, I'll give it a shot [22:51] Thanks. I'm hoping it will run on Windows, too. [22:52] works in vmware perfectly on linux [22:52] well, here at least [22:59] alard: checking it out on VirtualBox on OS X [22:59] alard: hey btw I heard your work on warc-wget mentioned in a talk by some archivists in australia :-) [22:59] I like how it's easier to validate it on platforms that already run the mobileme client well [22:59] well, at least in this channel [23:05] I can check it out on windows if you want; I just have to reboot [23:11] closure_: can you get resell rights from them? (if so, the next step writes itself pretty much) [23:16] stupid dropbox [23:16] sends it as text/plain [23:17] yeah, I had that problem too [23:17] was wondering why firefox froze for a moment [23:19] what is the size of the ovf? [23:20] 253.7mb [23:39] Hey, anyone got a couple minutes to help me with some Linux networking stuff? [23:39] what's up? [23:40] I've got a VM that's bridged through its host, so it and the host share their own 10.x.x.x network. [23:41] The VM needs to rsync to the real Linux box, which is on the same 192.168.x.x network as the host. [23:41] The VM can't figure out how to do this, so I have to rsync over the internet which is sucktastically slow. [23:41] (I get better throughput to FOS than to my own house) [23:42] Since VirtualBox is retarded I can't have the VM talk to the router directly: That stopped working a while ago. [23:42] must be embarassing [23:42] So I need to know how to make the VM able to route to the 192.168 address and hopefully be able to rsync at > 300 kB/s. [23:42] BlueMax: Horribly so. [23:57] well, it appears that vmware player on windows doesn't like it. gives some error about being unable to verify source information [23:58] try virtualbox on windows [23:58] i was going to next [23:58] I have to upgrade it first [23:59] DoubleJ: Can't even ping the other machine?