[00:03] this is pretty cool: http://addonics.com/products/raid_tower/CPR5SA.asp (small-form factor 5 drive enclosure) [00:09] Neat. Though my opinion of hardware RAID has decreased as computing power has increased. [02:26] My opinion remains [02:26] high [02:47] db48x2: alard: Is someone dedicatedly running that script? [02:47] (I only ask because I have a gigabit available that's literally 1 hop away from the datanodes) [02:51] 2011-08-24 02:50:36 (45.3 MB/s) - `/dev/null' saved [104857600/104857600] [02:51] That's hot [02:51] I remember when the idea of having T1 speeds made me hard [02:51] now I have 1.5Mbps up and am left wanting :( [02:52] hahaha [03:33] Extracting Linux Outlaws 039 - Come Back When You Can Grow a Beard.mp3 [03:33] Extracting Linux Outlaws 040 - Software Freedom, Lawsuits & Poker.mp3 [03:33] Extracting Linux Outlaws 041 - Now With File Retention Technology.mp3 [03:33] Extracting Linux Outlaws 042 - Don't Panic!.mp3 [03:33] Extracting Linux Outlaws 043 - The Unbreakable Car.mp3 [03:33] Extracting Linux Outlaws 044 - Welcome to KDE 5 (openSUSE 11 Special).mp3 [03:33] Now I'm adding piles of Linux Outlaws podcasts. [03:37] P.s. http://www.youtube.com/watch?v=wERs-s_yYVQ [03:37] Fucking brilliant [03:39] Speaking of vitriolic Linux stuff, I'm using playing Kdenlive right now; it's pretty damn usable and may even produce decent video at the end. [03:40] I'm not a filmmaker, so I don't know what features it's missing, but for an average user like myself, it seems pretty sufficient. [03:41] (And yes, I'm pretty surprised to find this out. I was expecting it to crash immediately like Cinelerra) [03:42] Yes. [03:43] Is this about my little FUK U LINUX rant? [03:44] In a sense, though I agree with you that video editing has been a weakness of my own environment of choice for all of its lifespan. [03:44] linux sucks [03:44] And it's complete nonsense to make someone change the workflow they're comfortable with for something like that. [03:44] I've had the damndest time adding proper page numbering to PDFs [03:44] there doesn't seem to be anything that does it [03:45] chronomex: Every user has different needs of their hardware and software. Linux makes my job almost sane. [03:46] I'm trolling, can't you tell? [03:46] (but it is a real problem for me) [03:46] Hey, it's a legitimate argument in some sense. [03:46] On that note, what's the issue you're having? [03:47] I can't find any software that will throw up a page image from a pdf and let you say "this is the page numbered "iv.1", it is where the numbers change to "iv.N" [03:47] and have it update the pdf metadata to reflect that [03:51] I honestly wasn't aware that the spec supported that (though I'm not surprised in the end. It _is_ PDF) [03:55] Hmm, 756 pages of spec. Surprsingly slim. [04:08] yeah, did you know that you can embed SWF in PDF files? [04:08] that makes it a trillion times more complicated [04:10] Is there anything you can't embed in a PDF? [04:10] ummmmm [04:10] silverlight? [04:13] Silverlight, like Deus Ex 2, never happened. It was all a dream. [04:18] Yeah, Silverlight sure exploded, right [04:19] I'm sure there were about 30 people who thought that would be the capstone of their careers. [04:19] Silverlight? Did that. [04:21] Yep, that was me. Spec and some of the video handling routines [04:29] I'm sorry. [04:29] I had no idea you worked on that. [04:42] underscor: yea, I ran the script over the whole archive [04:42] on my measly 50Mbps connection [04:43] well, I say 50Mbps, but it's cable [04:43] so of course it was hinky [04:44] highest was 7371kBps, lowest was 986kBps [04:48] hrm [04:48] I require more disk space [04:48] I can't install Deus Ex 3 [04:50] it will shortly turn into a calamity [05:43] my name is mud... [05:46] Is not. Tab completion isn't working for "mud" [05:47] winona had a big brown beaver [06:09] lol [06:10] -vcodec flv -f flv -r 29.97 -s 512x384 -aspect 4:3 -b 510k -g 160 -cmp dct -subcmp dct -mbd 2 -flags +aic+cbp+mv0+mv4 -trellis 1 -ac 1 -ar 44100 -ab 160k [06:10] THANKS FFMPEG [06:10] SO EASY [06:16] haha [06:17] :) [06:18] I'm annoyed, it looks like I WILL have to either type in or have people type in the table of contents for these Ham Radio magazines. [06:18] That's a bummer, there's 268. [06:18] Someone made a Ham Radio Magazine Index, but [06:18] 1. It's obviously by someone with Aspbergers [06:18] 2. It's not for human beings [06:19] 3. It obviates other people taking the time to work on it. [06:19] I checked, it's not out there. [06:21] How many magz are we talking about? [06:21] 268, but any that people add is more than there were. [06:21] Wowza [06:31] http://www.archive.org/details/1968-12-hamradiomag [06:31] There, I just did one. [06:33] Time to hook up the Metadata Warriors [06:34] No, I need them for other things. [06:34] Not a lot of people have hopped in on metadata warrioring and some are slowing down terribly. [06:34] Although it turns out one guy has been doing tons but not bringing it up, waiting to finish his entire directory. [06:34] I bet I'm in the 'pile' in yer inbox [06:37] Ahhhh fuck. [06:37] Ham Radio Magazine is still a sold product. [06:38] Well, let's just keep going, see what shakes out. [06:38] But I'm going to concentrate on other things. [06:38] Like Compute! I have all of Compute! [06:38] :] [06:39] SketchCow: I've two issues of something called "PC Disk Magazine", regrettably missing the disks. Shall I mail them your way? [06:39] I got over a really old electronics magazine in Swedish on a yard sale [06:39] Should scan it and up it (Aaany day now..) [06:51] http://spectrum.ieee.org/automaton/robotics/industrial-robots/fukushima-robot-operator-diaries [06:51] Awesome, whoever was reading that.. actually SAVED COPIES before it went away [06:51] ooh, it's still cached @ google [06:58] 537442304 bytes sent in 8.62 secs (60885.5 kB/s) [06:58] More of that [10:30] Interesting... someone is skype calling me at 6:30am my time [11:55] Bleh, it sucks ass getting data out from Amazon S3 [11:55] slowest piece of crap ever [12:05] and they charge you for the privilige too [12:06] I've been uploading so many magazines into archive.org [12:07] db48xOthe: no they don't, not me - they bill the one who uploaded it [12:09] ersi: same diff [12:09] SketchCow: their magazine box is probably full [12:09] also, be careful if you play Deus Ex [12:09] it's suddenly 5am [12:09] mmmmh, deux ex [12:10] My script that jams magazines into archive.org is working VERY well [12:10] I have to set it up before each run, but for example I'm uploading something like 140 or 160 issues of Compute [12:10] And it's adding a new one every 6 seconds. [12:10] I'll have to fine-tune afterwards, but hard to argue [12:11] mm [12:11] And of course they're all put into an appropriate collection. [12:11] that's pretty darn dandy [12:11] yep [12:11] I love automation [12:12] SketchCow: just curious, but what do you have to tweak afterwards? [12:12] Well, I am using the filenames sometimes for metadata [12:12] When 99% say May_1988 and one says Fall_1988, it comes out mangled. [12:13] ah :) [12:13] Sometimes the people who assembled, screwed up filenames [12:13] Sometimes I just need to tune the na,e. [12:13] http://www.archive.org/details/01-big-k-magazine [12:13] Meanwhile, now that I'm using WinFF to generate GDC videos, THOSE are coming up hugely fast [12:14] heh [12:15] the name was the last thing I could find on the cover [12:17] the old ads are fun to read [12:17] PURE MACHINE CODE [12:17] 4 galaxies [12:17] hall of fame [12:21] Up to issue 78! [12:22] http://www.archive.org/details/your-commodore-magazine [12:23] man, I should have slept [12:23] The archive.org machinery will take hours to get through all this [12:24] boy, that's terrible [12:25] Now up to issue 102! [12:26] ha ha, archive.org admin pinging me in skype [12:26] I WONDER WHAT ABOUT [12:26] heh [12:27] he shouldn't complain, as long as the machines don't _actually_ catch on fire [12:27] Well, let's see. [12:28] Conversation went [12:28] "could you slow down the uploads" [12:28] "no" [12:28] Essentially. [12:28] :) [12:28] I will not upload any after the compute archive. [12:30] hahaha: "Holy crap! As an area of the cracker cooks, it bubbles up in just a few seconds, leaving clear marks as to where there is microwave power and where there isn't. For this particular microwave, Saturn-shaped objects will cook evenly." [12:30] http://www.evilmadscientist.com/ [12:35] ha ha, now we're arguing [12:39] :) [12:39] do the machines feel pain? [12:39] do they get clogged? [12:40] They do [12:40] He claims it's rare. [12:40] it's not rare. [12:40] OCR takes a long time. it just does. [12:40] the queue may back up, but no plumbers are required [12:41] so it doesn't seem like there are any good reasons to slow down [12:41] well, time for me to go to work [12:51] Well, as I suspect, a PILE of Hams are coming out of the woodwork with the plan to help describe Ham Radio Magazinew [13:05] Sweet [13:53] SketchCow: I'm not surprised given how common "does anyone have [issue X] of [1960s/1970s radio magazine]?" requests are on radio-related mailing lists... [13:54] with the exception of the magazines published by the national clubs (QEX, RadCom, etc.), most magazines aren't getting digitised except by amateurs [14:27] metadata seems wrong on this http://www.archive.org/details/antic-magazine-disks [17:10] lol at the front page of archive.org, http://www.archive.org/details/70sNunsploitationClipsNunsBehavingBadlyInBizarreFetishFilms [17:26] ... [17:27] i get the feeling Spank my Booty by Lords of Acid would make a fitting soundtrack [17:47] hahaha [18:10] http://blog.greenpirate.org/stop-taxing-pixels/ [18:10] stop taxing pixels! [18:11] But it's fun! [18:12] dad-gum fiat currency [18:33] hey guys, wasnt telehack.com one your projects? its just that its offline atm [18:36] not ours, but it is 100% Archiveteam Approved (TM) [18:38] hmm i hope theres a archive of it as its gone offline and i cant seem to find any other infomation on its status. [19:05] Is there any good way to save articles / newspapers from the Google News Archives? [20:12] Interesting, a fandub parody of Inu-Yasha and LotR is in my possession and Google seems to have no clue it exists. [20:13] What to do, what to do... [20:13] score [20:14] db48x2: are you still running the ggroups script? [20:15] Looks like DV video and 16-bit PCM sound. It's a hefty 6.9G for 33:57 [20:17] ndurner: which one? [20:17] I need more *download*ers, that's why I'm asking [20:18] I don't have any disk space left, I'm afraid [20:18] if you can spare the resources, could you switch from discovering to downloading? [20:18] mh [20:18] What's this about a script needing run? [20:19] I take it we're backing up Google Groups because they're not trustworthy. Where's the script? [20:20] We're downloading files associated with individual Google Groups because we can do so rather cheaply until Aug 31 [20:20] archiveteam.org/index.php?title=Google_Groups_Files [20:21] hey guys i am having trouble getting ahold of the stanford programming methodology torrents [20:21] http://coursetorrent.stanford.edu:6969/torrents/cs106a-lecture01.mp4.torrent?FC70D4D40F781ECFBAF3D3FDE7BB75416106EB32 [20:21] anyone know if these are archived anywhere? [20:21] (caution: normal mode of operation is discovery, not download!) [20:21] youtube is really inconvenient [20:22] http://see.stanford.edu/see/courses.aspx [20:22] how can there be no seeds on free education :( [20:22] ndurner: And this is all more or less automated? No claiming ranges and such? [20:22] yes, absolutely! [20:22] fire & forget [20:22] Nice [20:22] Well I'll set some comput resources on it. Any way of setting limits? [20:23] I do that centrally (it uses Google App Engine to coordinate ;-)) [20:23] thanks! [20:23] Clever. I mean for my own connection's sake though. [20:24] My housemates don't like me eating all of our bandwidth. ;) [20:28] the ggroups script doesn't eat much bandwidth because most of its time is spent in overhead contacting the server etc [20:28] if you have a monthly cap it adds up fairly quickly though [20:28] Ahh. [20:29] Does it work to open multiple sessions? [20:29] I believe so but I haven't tried [20:30] Not using the same IP address, that'd get you banned by Google pretty quickly [20:31] Ahh, I see. [20:31] Downloading alt.startrek.vs.starwars << Fuck yeah. [20:31] :-) [20:32] do any of the usenet ones even have files [20:32] also the status on the wiki is really out of date [20:33] True usenet groups don't. But some Google Groups are just named in the same fashion. [20:33] true... [21:56] ndurner: I can run ggroups, point me in the right direction? [22:15] Wyatt: (fandub parodies) give me copies? :D [22:18] Coderjoe: Well, I only have one right now (though I can probably sore a few more from some of my con contacts). [22:18] I was thinking of transcoding to MP4 because it's WAAAAY too huge right now. [22:19] i'd kinda like the highest quality possible, within reason. [22:19] SketchCow: not to distract from something that works well for you, but if you just need h264 in a container (mp4, flv, mkv), x264 w/ffmpeg builtin may be all you need [22:19] I wonder how ffv2 would work on it [22:19] Coderjoe: I was actually just looking into that. [22:20] (unfortunately, last time i looked, ffv2 was only available as a patch) [22:20] Is it significantly better than FFV1? [22:21] And I wonder how HuffYUV compares. I haven't actually dealt with lossless video since my LD rip adventure. [22:21] in my testing, it was in most cases [22:22] I don't have any recorded numbers from my testing, other than two modes of ffv2 [22:22] (Just discovered; I still have 37GB of ffv1 Arcadia of my Youth) [22:22] basically any video encoding task ends up coming back to ffmepg sooner or later [22:22] and that was to highlight a bug in ffv2 [22:22] http://wegetsignal.org/tmp/ffv2compare.php [22:23] "bits" mode was supposed to take the i/p block that resulted in a smaller file. it frequently did not [22:23] lol [22:23] Quite. [22:24] considering there's really very few actual video encoder vendors around anymore, it happens [22:27] huffyuv will usually be larger than ffv1 or ffv2. huffyuv deals entirely with keyframes. [22:28] and as a result, does not remove temporal redundancy [22:29] Ah [22:29] ffv2 actually incorproates a number of things I was considering experimenting with [22:30] but, like I said, it was still an external patch the last time I played with it [22:30] thought ffv2 was limited to yuv420 [22:33] For now I'll probably just run ffv1/flac jsut to save myself a couple gigs or so. [22:34] I may not even bother compressing the audio, even. [22:34] Google will rate limit your IP. [22:34] oops [22:35] LET THEM TRY. [22:37] Wyatt: if you want to try something else, you could try x264's lossless mode [22:40] or just upload the whole thing to archive.org [22:40] for that to save you space, you would then have to delete your local copy [22:41] I'm not a big bsd guy. [22:41] dashcloud: AVC has a lossless profile? I somehow wasn't aware. [22:42] well in regards to the original "what to do with it" question [22:43] also it's worth noting that depending on how the colour spaces are set up, even a "lossless" codec may alter the video [22:43] DFJustin: I'm totally cool with this option. I can even metadata the shit out of it because I know a lot about the production of this one. [22:43] Well, a decent amount, at least. [22:47] What was the option to make mplayer/ffmpeg dump a nice list of info about a file? [22:49] ffmpeg -i , the midentify.sh script in the tools folder, or ffprobe if you have a new enough version of ffmpeg [22:50] ffprobe is by far the best, and is machine-readable if you need that [22:55] So looks like yuv411p. [22:55] What are PAR and DAR? [22:56] I believe pixel aspect ratio and display aspect ratio [23:01] correct [23:04] Oh, no wonder it's huge. 28771 kb/s video. [23:04] mmm [23:04] many pretty pixels [23:07] Wyatt: you did say DV, right? 28mb/s is about right for DV [23:09] I suppose it is. Too many orders of magnitude, so I usually just gloss over the math, but that number is something I understand more easily. [23:12] But right, back to this. Is that one of the colourspace conversions that will change the output? [23:13] if the color space changes from the source to the destination, then yes [23:14] basically no two colorspaces have the same gamut [23:14] and even if it's not changing the color space, it might be changing the amount of information stored about the colors [23:14] for example, going from yuv444 to yuv 422 [23:15] Ah, so I need to preserve the colour space. Interesting. [23:17] I'm sort of new to the finer aspects of video stuff, but it makes good sense. [23:18] http://en.wikipedia.org/wiki/Chroma_subsampling#Types_of_subsampling [23:20] your source DV is probably yuv411 (which I think you said above) [23:20] mpeg mostly uses yuv420 [23:25] Now that I think about it, seeing DV in an AVI container is odd, no? [23:32] What a dizzying array of video formats. The number of DV variants alone is kind of crazy. [23:35] video is more complex than it first appears [23:35] "rectangular array of pixels, changing over time" just doesn't capture the actual complexity of the problem [23:36] So I've been humbled to learn. [23:39] some less well-known video news is that some of the folks behind x264 are building x262- which aims to be the finest broadcast MPEG2 encoder available [23:40] About time. I've been wondering when someone would attempt to apply modern practice to mpeg2 for a while. [23:44] if you're actually in the industry, check out OBE- Open Broadcast Encoder [23:45] http://code.google.com/p/open-broadcast-encoder/