[01:57] umich data? [07:43] Greets from Austin. [08:29] db48x`: pong (too late, probably). [08:45] http://2.bp.blogspot.com/_v8Zg3RjUumY/S8HL1L26NRI/AAAAAAAACyA/Dn5qWwyQkWk/s1600/fey-palin-side-by-side2.jpg [08:45] Still awesome [08:45] alard: I've got a little more chat with Brewster [08:46] It's late. To be clear, I am due some more chat with brewster. [09:01] SketchCow: Okay. Need more information? [09:20] No, he just needs to make an internal decision. [09:25] Good. [10:13] Here's an old photo of the book I mentioned a couple of days ago http://www.flickr.com/photos/gameboygenius/3140244360/in/photostream [10:13] Also see the next and previous photo [10:13] Spam: http://www.flickr.com/photos/gameboygenius/3140244380/in/photostream [10:13] Terrorism: http://www.flickr.com/photos/gameboygenius/3140244352/in/photostream [10:25] that last one sure is prophetic [10:26] nitro2k01: haha, awesome [10:26] Well, yes and no. There's the 1993 bombings... [10:27] "On February 26, 1993, at 12:17 p.m., a Ryder truck filled with 1,500 pounds (680 kg) of explosives, planted by Ramzi Yousef, detonated in the underground garage of the North Tower." [10:27] It's a bit funny with 'huge events' that all other events magically disappear [10:27] ah right forgot about that one [12:31] Nemo_bis, xz also lets you set most compression parameters [12:31] do you also know how to do it efficiently from tar directly? piping doesn't seem very efficient [13:44] Why doesn't Piping seem efficient? It's the unix way to do things. Afaik you can only switch xz compression on or off from tar, but not change any parameters. [15:43] any idea if i can make curl both print to stdout and save the content as file at the same time? [15:43] i want to crawl something funny and it is in json and inside the json is the url of the next page [15:43] (facebook comments9 [15:45] btw http://jumbofiles.com/ is a great free file host, you do not need cookies nor javascript to download from it [15:48] tee ? [15:53] SketchCow: I hope you're aware of the potentially onerous license terms that come with the Kryoflux firmware and software, section 3.d of the license. True, the open-source library doesn't fall under these terms, but the license, as written, applies to all dumped images [15:53] anyway, I have better things to do. [15:56] Schbirid: check out the tee command [15:58] ayeaye [15:58] thanks [16:04] as much as i like the idea of ddg, its results are way too often utterly useless [16:04] https://duckduckgo.com/html/?kp=-1&kh=1&kg=g&q=tee+curl+linux [16:15] I am not aware. [16:16] I wish I could say I paid attention to claims of ownership. [16:18] I'd have helped me to tell me what those were, than dropping thelittle bomb (out of nowhere) and then moving on. [16:20] soultcer, is piping 240 GB of stuff a good idea? (I don't know) [16:21] Nemo_bis: Piping any amount of data is fine. That's one of the fundamentals of unix. Instead of having one tool do everything, let multiple small tools each do their part [16:21] tar does not care if it writes to a file or stdout, they are both file descriptors [16:21] ok [16:21] And xz does not care if it reads from a file or stdin. The only thing it can't do is display a progress bar, as it doesn't know the size of stdin, but everything else works fine [16:22] (I love piping obviously) [16:23] balrog_ph: Next time, just lay out the issue, instead of dropping a hankerchief of knowledge for me to pick up [16:23] (And for the progress bar there's pv.) [16:23] SketchCow: There was a link posted earlier. Scrolling up, here it is: http://pastie.org/private/jvczf6qllk4roih7s8isdg [16:24] Yes, though even pv needs to know about the size of the data, otherwise it only shows throughput only. [16:24] You can make your own estimate and give that to pv, right? [16:24] Yes [16:25] hahaha, yeah, that's pretty onerous [16:25] (As they say in the IRC world.) [16:26] Btw SketchCow, thanks for making urlte.am work again. I am currently seeding the torrent to at least one leecher ;-) [16:27] Yeah, sorry it took so long. [16:28] It was just some fuckery with dealing with the whole domain thing. It's now running under my umbrella, as soon will be all my major sites. [16:28] wow, the facebook api is really terrible and unreliable [16:28] (I mean as opposed to using dreamhost.) [16:28] I am happy if that means we finally get rid of the viagra spam [16:29] hi [16:29] hm, why does wget not retry after a 500 [16:29] hi [16:30] wget has a setting for retry. [16:30] Yes, that's the plan. [16:30] speaking of wget.... [16:30] yeah, i set --tries=10 but apparently 500 does not count as worthy [16:31] What happened to your MediaWiki: I just tried to download something and was spammed with viagra [16:32] jason is not getting younger, you know! [16:32] it is a known issue :( [16:32] ohh ok :-( [16:32] LOL [16:32] ok, with smaller requests facebook seems happy to serve [16:33] sorry I didn't respond, thanks alard for the departs [16:33] repaste* [16:33] Sometimes you lose track of things when you're on 100 channels :D [16:34] Jesus, these groupies want you to go all night [16:35] I figure make some cash on the side, two birds, one stone [16:35] So making a long story short: Jason is maintaining the Wiki besides all his other projects ? (rly?!) [16:36] It's not hard! [16:36] It's just dreamhost is hacked. [16:36] I need to do the big transfer, then we're in better shape. [16:36] Oh you were affected by the 777 too? [16:36] Schbirid, is there anyone who had taken a closer look how this thing happened? [16:36] I am now seeing accounts that I have specifically set up as honeypots get spam added. [16:36] So I'm out [16:36] I think that was dreamhost [16:37] i really have no idea [16:38] They're awful [16:39] All my static sites are going to my textfiles.com machine, which is mirrored [16:39] so in disk failure, I'm down for a little but back again. [16:39] SketchCow, oh thx, did not saw it right away [17:17] OKAY HELLO [17:17] So here's the deal. [17:18] - Yes, we're going to restart the crawl, but I need to make a semi-automatic uploader [17:18] - Brewster wants to get funding to store these items. [17:18] - So I think a kickstarter might be in order [17:19] What crawl? MobileMe? [17:21] Yes. [17:27] so, would that mean abandoning the current crawl--or continue? [17:27] It means going full bore [17:43] I am happy to help with dev & infrastructure work on mobileme ][ [17:45] SketchCow: Does that mean we also continue the s3 upload? [17:47] Yes [17:48] Okay, that's good to hear. (It would help if they could improve the upload speed, by the way. I think the batcave proxy route is still faster.) [17:48] We were asked by Sam to go the other way, and then help find the problem. [17:49] And before you go NOT MY JOB, that place has almost nobody, I hope that's become clear [17:49] I'd say... 9 people run technical things of any sort [17:50] SketchCow: What do you mean by restart? >_> [17:51] Resume, buttercup [17:52] By "go the other way" you mean use the batcave proxy, is that correct? [17:52] SketchCow: I'm sure they're doing their best. It's a weird problem. But I just wanted to mention that *if* they had fixed it, the fix didn't appear to work. [17:53] SketchCow: That's better :] [17:53] I want us to keep using batcave for a number of the machines [17:53] While we're playing Where-the-fuck-is-the-probem, we shouldn't not use that channel. [17:53] But we should also start others doing it through the general direct route, to help diagnose. [17:55] A friend has checked all of Richard Stallman's tour riders into github [17:55] So people can comment and find differences [17:55] hahaha [17:56] chronomex: I'm heading to the conference center now. How about you? [17:56] SketchCow: I was stupid and left my rainjacket at home :P housemates are allegedly going to find a way to rei or something [17:58] I might just say fuckit and walk over anyway in a bit [17:58] Well, I'll be hanging about there today [17:59] k [19:01] wait... wtf? (kryoflux license) [19:03] I can see that they most likely mean tools that deal with their custom image format, but it's still a dick move to close off all alternative tools. [19:09] hmm statusboard.archive.org has been stuck on the same vibrator book for a day or more [19:10] It likes that perticular book [19:23] Coderjoe: I don't know who wrote that license. I am hoping here they change it to not restrict what can be done with formats. the annoying thing is that, well, it applies because you can only dump floppies with DTC, and even if you could use something else, you'd still need that firmware blob [19:24] but you don't have to write your images to their custom image format [19:25] DFJustin: Something got stuck. New books coming in now. (Thanks. :) [19:25] at which point, I don't think 3d.ii doesn't apply [19:25] er [19:25] s/doesn't apply/applies/ [19:25] or s/applies/is applicable/ [19:30] Coderjoe: the device reads the images into their custom STREAM format [19:30] their software can convert it to a bunch of formats, but none of them flux [19:32] 3d.ii may not apply for other reasons, but that would have to be determined by a lawyer. and this license specifically excludes commercial or institutional (this includes school or museum) use [21:09] soultcer, I suspect that my piping killed the server by filling /tmp [21:36] http://blog.wikimedia.org/2012/03/09/transfer-of-wikipedia-sites-from-godaddy-complete/ [21:37] longest domain transfer ever [21:38] Well, they have hundreds of domains. [22:09] Hurrah, I'm in thatr fucking lobby. [22:21] FUCKING LOBBY [22:22] I do agree that the thing is henious, balrog - but I really, really can't get worked up over it. [22:22] SketchCow: all right then [22:22] I just want it to be better known before people lock themselves in [22:22] Yeah. [22:38] since I already have the hardware and crap, I'll just continue using it and just fight it if they try suing me [22:39] I liken it to an optical scanner manufacturer trying to limit what you can do with their scanner [22:40] hah, yeah [22:40] idk in this case [22:40] I'll tell you, I have their hardware [22:40] it might require somre cleanroom development of additional tools, however [22:40] and sadly, I can't participate in that [22:41] that's ok [22:44] we'll figure something out [23:29] SketchCow: google things your site may be compromised [23:31] and it is [23:35] but apparently only if you click through from google, weird [23:39] Ymgve:y [23:39] Ymgve: Your site being archiveteam.org? If so, old news and it's gonna get fixed any time there is time [23:39] ascii.textfiles.com [23:43] they seem to be hosted on the same server, so probably any sites on that server