[00:04] 5 REDBULLS?!?!?!?!? [00:04] OVER 9000 [00:04] SketchCow: you're gonna kill yourself [00:04] I was buzzed after that one! [00:04] You're a lightweight [00:04] I'm a hardcore redbuller [00:04] And have been since before you were born [00:04] haha [00:05] You can handle a whole ginger beer too, so your tolerance for everything is probably higher [00:06] Ugh, Red Bull. My one and only experience with the stuff was drinking vodka & Red Bull during a night of drinking. [00:06] The third one was probably a mistake. [00:06] The fifth one definitely was. [00:07] hahah [00:08] Yeah, not the most auspicious way to turn 30. [00:08] (Wanna know how to make a hangover worse? Add a racing heart on top of it! Holy crap the next day sucked.) [00:08] Drinking red bull, going on a roller coaster, drinking a ginger beer, having the fucking spiciest burrito in existence, and then scrambling to find a gas station with nesquik to cut the heat [00:09] BEST SUMMER WITH SketchCow EVERRRRRRRRRRRRRR [00:09] srsly :D [00:10] Jeez. After putting all that through your system I hope you left a nice tip for the housekeeping staff. [00:10] haha [00:11] I babysat their daughter and played games all night with her, does that count? [00:20] underscor, you prevent their daughter from sleeping and ask recognition? [00:21] ha [00:22] This was like 5pm to 11pm :P [00:22] Not like it was all night [00:23] :p [00:37] http://news.yahoo.com/blogs/sideshow/5-hour-energy-drink-inventor-revealed-buddhist-monk-225843909.html [00:46] :D [00:46] SketchCow: http://i.imgur.com/yXUna.png [00:56] http://i.qkme.me/362i4b.jpg [00:57] game and match [00:58] hahahahahahaha [00:58] that is beautiful [00:58] <3 [00:58] SketchCow: Instead of red bulls, you should just get a few grams of http://www.dmaastore.com/ [01:00] The 5 hour meth? [01:00] http://i.qkme.me/362i7t.jpg [01:02] hahahahaha [01:02] you're really good at those, aren't you? [01:07] hahaha hermoinecam [01:13] I wish I could say it was hard [01:14] That's what she said [01:14] http://i.qkme.me/362imr.jpg [01:40] http://thejit.org/ <-- go play with that, alard/underscor [01:45] holy [01:45] fuck [01:56] http://tracker.archive.org/df.html seems to not have javascript graphs yet [01:56] chop chop [01:57] That would be cool! [01:58] I'll add them in a few [01:58] underscor: d3.js [01:58] Need to finish this essay and vocabulary [02:31] underscor: where's the graphs it's been half an hour goddamnit get moving [02:37] * SketchCow looks at watch and looks at you and looks at watch and walks away, looking at you [02:38] :| [02:41] :| |: :| [02:43] I think if I got one free punch in life, it'd be to find one of those guys who is the wiry asshole in the okay suit who walks up and down the line to keep people working [02:43] And just punch him in the face. down he goes. cheering [02:50] [02:53] I think I used up my free punch already [02:54] on a guy who sat down at my laptop when I wasn't there and then complained that my keyboard layout wasn't what he was expecting [02:54] I won't name names, but he's the sort of person who knows that you shouldn't do that [03:10] chop chop [03:34] UGH [03:34] YOU'RE MORE DEMANDING THAN MY MOTHER [03:34] GAWD [04:41] I come back and what do I find [04:42] I'M TRYING TO GET IT TO WORK [04:42] I'm tired :( [04:42] The sun was in your eyes [04:42] Lag [04:42] Crappy mag [04:42] map [04:44] random question ive looked everywhere are there any archives for the rubicon conferences [04:44] http://www.cow.net/rubicon/ [04:44] I have some. [04:45] http://audio.textfiles.com/cons/rubicon/ [04:46] SketchCow's fetish -- [XXX][PORN]Boxxy - Sweet Emo Teen in Her First Porn (Anal).wmv [04:48] SketchCow: interesting, the one thing you're missing is your own keynote [04:48] ha [04:48] I'd like to hear it as well [04:48] and come to think of it , where are the other rubicons, theyre dead now, and china bought the domain [05:07] underscor: you milf, that girl looks nothing like Boxxy and you know it [05:08] underscor: one day.. [05:09] hahaha [05:09] wait [05:09] Aranje: Did you just call me a milf [05:09] underscor: you fucking know it [05:10] ... :P [05:21] Where's that hot new interface we were promised at the last archiveteamcon [05:22] ffffff [05:22] I AM NOT PROFICIENT AT THESE JAVASCRIPTINGS BLACK MAGIC [05:23] I prefer writing in bash and playdoh™ [06:02] I've apparently been banned from efnet? [06:02] * kreitz grumbles [06:10] you seem to be h ere [06:11] web client [06:11] my IP is blocked from connection though [06:12] * kreitz misses freenode [06:12] ah [06:23] http://www.flickr.com/photos/textfiles/sets/72157628758936913/with/6867910843/ [07:17] Oh, awesome, /3 is not responding very well. [07:17] I'll bet people are gifting it tons of greatness. [07:19] There, it's back. [07:19] Not heartattacky or anything. [07:25] hmm, am I free to spin up a few instances? [07:29] No, you really aren't. [07:29] alard and I will be setting it up that you're going to a special drive shortly. [07:29] And then when you do it, it'll go there and I'll have something running there that's doing live transfers over. [07:29] That should solve the problem. [07:29] fantastic [07:30] Well, besides the fact that right now, we're likely to absorb 60% of all of archive.org's free space [07:30] Which is fascinating in itself. [07:30] damn [07:31] I assume that creates a few complications [07:31] Not overly. [07:31] 60% of 380 terabytes still leaves hundreds of terabytes [07:32] They don't like to pay for spinning drives with no data. [07:32] Bear in mind we're currently absorbing hundreds of hours of live television a day. [07:33] And we've gone from 900gb of google groups on the batcave to 275, so that's going well. [07:34] are they running any fancy big storage hardware? [07:34] (e.g. netapp heads) [07:34] http://www.archive.org/web/petabox.php [07:34] very nice [07:35] shipping container -- incredible [07:36] "so what's in this container?" "THE INTERNET" [07:38] Just going after friendster on the batcave will kill 3-4 terabytes, at least. [07:38] Then I'm stepping through others. [07:39] I wonder how those compare vs http://blog.backblaze.com/2011/07/20/petabytes-on-a-budget-v2-0revealing-more-secrets/ [07:42] http://blog.backblaze.com/wp-content/uploads/2011/07/pod20-cost-of-a-petabyte-amazon-dell.jpg [07:42] That's my favorite. [07:44] hahaha [07:44] S3 has its uses [07:44] Giving amazon millions seems to be one [07:45] that $94k needs to be tripled for 3x replication across the planet [07:45] Can't argue with nine nines :) [07:45] haha, you have no idea [07:45] how much heroku's amazon bill is every month [07:46] https://a248.e.akamai.net/assets.github.com/img/92a0e6c8cfa3aae0e70f442fc915263ee59bf5bf/687474703a2f2f6d656469612e74756d626c722e636f6d2f74756d626c725f6c74757a6a766251364c31717a677078392e676966 [07:46] gr [07:46] http://media.tumblr.com/tumblr_ltuzjvbQ6L1qzgpx9.gif [08:26] OK, so anyhub threatened to disappear, and didn't. [08:26] So we're left holding a lot of data. [08:26] OK, well, that's going up now too. [08:44] SketchCow: I'm available now, for the coming hours at least. [08:47] I'm blowing anyhub up to archive.org. [08:47] (Just so you know) [08:47] We can hopefully do the swap shortly. [09:01] Oh, as someone mentioned before. [09:01] There's a way to tell archive.org "don't even waste time deriving" [09:01] So if I do that, stuff shoots up quicker. [09:10] http://sphotos.xx.fbcdn.net/hphotos-ash4/404492_10150606146673750_507173749_9094164_595426655_n.jpg [09:10] Fairly amazing [09:11] hahahaha [09:12] 179 google results for that phone number already [09:16] kennethre: I was just thinking: does your army of mobileme workers lose users when you kill them? [09:16] alard: they do [09:16] ideally i turn them on and leave them on until the project is finished [09:16] Also between 'mark download' and 'finish upload'? [09:17] they're just running seesaw.sh [09:17] if i kill them, everything that wasn't uploaded is gone [09:19] Ah, yes. That's good to know, we'll have to check the list of uploads later to see what's missing. (Right now the system isn't designed to handle 'losing' things. If you cancel while downloading, that's ok, but losing things afterwards is not.) [09:21] yeah [09:22] for the splinder downloads we had a second go-round once the tracker reached 0 [09:22] luckily, it should be quite minimal [09:22] as long as I don't have to stop again :) [09:25] That's why I need you to wait, likely a few days, maybe a week. [09:25] Once this works, we can pump through amazing amounts of stuff. [09:26] Although my belief is we will never be able to pump through at your full rate. [09:26] So we might want to figure out how to deal with that. [09:26] yeah, that was just excessive [09:26] What was it, 400tb every 3 hours you were doing? [09:26] 400gb [09:27] sounds about right [09:27] it was 100+MB/s [09:27] It's too much [09:27] I can't possibly pull that in, yet, into their system [09:27] Not when we have 25+ people all hammering this box as we go. [09:27] Now, MAYBE... MAYBE the new box can handle it. [09:27] hehe [09:27] The new box is somewhere else than batcave. [09:27] I'll do a test when I get a shot. [09:28] We should probably add a delay option to seesaw, so the tracker can return 'please wait X seconds'. [09:28] what's the point of that? [09:28] alard, did you see that javascript library I found? [09:28] kennethre: The point of that is that we can then throttle the uploads without you having to kill everything. [09:29] ah [09:29] SketchCow: Yes, I saw and clicked the link. Not investigated further. [09:29] Looks interesting. [09:29] well everything gets recycled once every 24 hours [09:29] so it can only buy so much time :) [09:30] Well, if the tracker just says 'no, wait' instead of giving out usernames I think it might work. [09:31] I can also verify that the poor batcave machine is thrashing [09:31] Just all this disk operation at once. [09:31] I've got 20 windows doing things. [09:31] i can always setup a little webservice that my jobs check between each pull [09:31] so i can tell them to pause without turning them off [09:31] http://www.archive.org/details/scientific-american-1845-1909 is growing along. [09:32] http://www.archive.org/search.php?query=collection%3Aarchiveteam-googlegroups&sort=-publicdate growing too. [09:33] I'm moving a mobileme tar over to fortressofsolitude [09:34] It thinks it'll take 10 hours. [09:37] I may have convinced negativland to host their back catalog on archive.org [09:37] That would be nice [09:38] Now it thinks 17 hours. [09:38] I can't tell if the problem is on batcave or fortress yet. [09:39] About to find out. [09:51] Not bad, Friendster is compressed 80% in bz2 [09:55] fuckin huffman codes, how do they work [09:59] He came up with that while he was a grad student [09:59] yes, he was mr. badass. [10:09] uh, you can almost imagine Morgan Forster's characters with this http://www.archive.org/details/northernitalyi00karl [10:10] (Very few items deriving.) [10:10] > do [10:10] > echo "" >$each [10:10] for each in * [10:10] > done [10:10] You would think that wouldn't take 4 minutes [10:10] But it does [20:39] Hey, what are the instructions for downloading wget-warc again? [20:40] there's a get-wget-warc script [20:41] wget https://raw.github.com/ArchiveTeam/mobileme-grab/master/get-wget-warc.sh ; bash get-wget-warc.sh [20:51] Thanks a lot. [20:51] --------------------------------- [20:51] CONGRATULATIONS TEAM: [20:51] http://www.archive.org/details/archiveteam-googlegroups [20:51] --------------------------------- [20:52] \o/ [20:53] but 36*36=1296!=1192? [20:54] some combinations were not used apparently :) [21:06] Well, yeah. [21:07] Well done, running those google scrapers (discovery only because I had only little diskspace) was great fun [21:07] I might still find some caches, and they'll go in too. [21:09] And now I'm in the process of uploading anyhub collections. [21:09] anyhub which stopped dying [21:14] Well,who wouldn't want gigabytes of unnamed files? [21:43] SketchCow: Any developments on the moving of mobileme? (If not, I might be going offline for today.) [21:43] Let me clean things a little more, and then set up a rsync on the new server, and then we can do the rest of the install [21:43] So tomorrow [21:44] Thanks for today [21:44] alard: what's the situation with mobileme? [21:44] Okay. See you tomorrow then. [21:44] balrog: There's a new server to upload to, which probably has more space. [21:44] ahh, ok :p [21:45] But you're not above the 100GB-per-hour threshold, so it doesn't really affect you. :) [21:45] I know [21:45] and I don't have that kind of bandwidth :< [21:59] wget-warc has just become an official archive.org tool [22:00] they're using it in production [22:01] hopefully official releases with the warc support start coming out sometime soon [22:02] Uploading the sciam archive you got, Coderjoe [22:02] I noticed. cool. and you're welcome [22:07] theres a sciam archive? [22:07] Sort of. [22:08] We grabbed the public domain ones. [22:08] They may still be dicks about it, we'll see. [22:09] * DFJustin grabs popcorn just in case [22:10] I'm trying to close out that process, just like I'm flushing files out of this machine, so I am running 4 windows of uploading. New issue up every 15 seconds. [22:10] Still needs to derive, of course. [22:24] If you can squeeze in some time between clearing out the batcave, the urlte.am domain still goes to Dreamhost. [22:33] sweeeet http://batcave.textfiles.com/ocrcount/ [23:02] http://lists.wikimedia.org/pipermail/foundation-l/2012-February/072036.html [23:14] hahahaha [23:14] That OCR Count? That's me, motherfuckers. [23:15] Close your eyes, archive.org, it'll all be over soon [23:15] http://www.archive.org/catalog.php?whereami=1 is amusing too [23:18] oh and while we're on the topic can someone restart the derive for http://www.archive.org/details/desqview-x-booklet [23:19] Trying it. [23:19] It had a disk error. [23:19] Now it's working. [23:19] its on a raid array? [23:20] is it in degraded mode? [23:20] It's fine now. [23:20] I think it's because I initially uploaded in .gif, so I replaced it with .png [23:20] No. [23:20] ok [23:20] It's a system-level thing. [23:21] thx [23:21] I have finished slamming in the scientific americans. [23:21] I also uploaded the full .tar.gz, coderjoe, unindexed. [23:22] They've fixed the MIME filetypes for the file browsers, at least for .zip [23:22] excellent [23:26] http://www.archive.org/details/desqview-x-booklet looking good [23:27] I like the optimistic tagline on the cover [23:27] Same here [23:27] I notice you MESS guys are really going PC architecture mad recently [23:27] yeah for some reason half the dev team have been gangbanging it all of a sudden [23:28] It's good, just don't let the freaks mess with you [23:28] The OCR is blasting through the queue I just caused. [23:28] These newsletters are mostly 4-5 pages, some are 10. [23:29] it's showing up some of the limitations in the mame architecture though, my core 2 duo drops below fullspeed in some situations just emulating a 486 [23:31] aaron giles will probably come out of nowhere with one of his weekend rewrites of everything and fix it at some point though [23:33] kenji managed to shove a lot of stuff into the queue ahead of the sciam items [23:33] Yes. [23:33] or is it after? I'm not sure which way the whereiam queue list goes [23:33] Kenji wins, always. [23:34] same priority level, though there is some interleaving later [23:34] Yes [23:35] Yeah, just watched it slam from 400 down to 241. [23:35] It'll be through these in no time. [23:35] i find it amusing that they bother to hide the submitter on the queue, when I can just go look at the item metadata to get that info [23:36] oh. the order is right there in the box at the top. i kin reed. [23:37] Coderjoe, and you don't even need to login for that [23:41] wow [23:41] everything at prio -6 is running except one item [23:42] yes, after last time underscor put some hundreds GiB of JPG books, derivers have slacked a lot