[00:18] * joepie91 postprocesses a dutch comic [00:19] This is an interesting video on how big things are getting information wise - http://vimeo.com/63437853 [00:46] omf_: thanks, very much enjoying that video so far [00:49] Sturgeon's Law [00:49] I think the excellent title is what got me to watch it [00:52] mm, I think my scantailor rendering is done [00:52] :) [01:04] okay, so I now have a scan of a comic magazine [01:04] in 4695 x 6487 px [01:04] TIFF [01:05] can I put these into a CBR and upload it to IA, or should I reduce the resolution (and convert to PNG?) before doing so? [01:05] note that this resolution is the actual scan/processing resolution afaik [01:05] it shouldn't be scaled up [01:06] especially cc SketchCow and DFJustin [01:06] if you don't mind the upload bandwidth then you can just leave it as-is [01:06] I have 50mbit upload so I'm fine with that :) [01:06] but can I put it in a cbz as TIFF? [01:06] at this resolution? [01:06] (I'm not sure what kind of conversion IA does) [01:06] yes [01:07] alright [01:07] will do that then! [01:07] source scans > * [01:07] I haven't tried it but I would expect it to work [01:07] * joepie91 does last visual inspection of page order and such [01:07] worst case you can edit later and reupload a different file [01:07] also, I have a stack of a few hundred of these donald duck magazines (in Dutch) laying around [01:07] I'll probably be scanning and postprocessing one per day or so [01:07] (and should I also include the original scans or only the postprocessed version?) [01:07] the nice thing about IA is that disk space from raw scans is basically nothing to them [01:09] if you look at the stuff they scan themselves they keep both before and after postprocessing in .jp2 format https://archive.org/download/constructiveanat00briduoft (_raw_jp2.zip and _jp2.zip) [01:09] okay, so I'll include the original scans as well then :P [01:09] first 26 issues of blenderart are uploaded now [01:10] should I put that in a cbz as well or would that confuse the converter? [01:10] godane, got a link handy [01:10] if there are two cbz' [01:10] yeah put it in a separate zip [01:10] not cbz [01:10] then it won't bother to convert [01:10] okay [01:10] http://archive.org/details/BlenderArt-Magazine-Issue-01 [01:10] I think IA recognizes that cbz is just a zip file [01:10] stuff named .cbz, .cbr, or _images.zip is auto-converted into pdf etc [01:10] regular zips aren't [01:11] each of these pages is like 65MB, heh [01:11] you could always just stick --no-derive on the ias3 script [01:11] :o [01:11] some are in excess of 80MB [01:11] I would expect that to zip down a lot [01:11] well, it's TIFF :P [01:11] TIFF is always large [01:11] tiff is a container, that doesn't mean anything :) [01:11] as far as I have seen [01:11] tiff can use zip compression in which case it's about the same as png [01:12] really? didn't know that [01:12] although [01:12] TIFF can do pretty much anything I think [01:12] as long as whatever is reading it, implements it [01:12] right [01:12] if I recall correctly [01:12] (read a bit about it, but most of it has left my mind by now) [01:12] 26 files remaining... [01:12] I'll start uploading ISOs as well I suppose [01:17] oh, DFJustin, I also have a few driver CDs for random obscure hardware laying around that I've made ISOs of [01:17] is this IA-suitable material, or do you have any suggestions where to host it? [01:17] throw it on ia [01:18] jason has put a couple of those in the shareware cd collection, I assume if there gets to be a lot of them then a separate collection can be created [01:18] alright :) [01:20] Can an item exist in multiple collections? [01:21] just know that issue 28 of blenderart can't be downloaded for some reason [01:21] omf_: yes [01:21] * joepie91 scans front of CD [01:21] the first one is the "primary" collection that it shows on the item page but more can be added [01:22] I really quite like this scanner - it scans pretty much everything [01:22] So Marissa Mayer has stated that all 38 years of SNL will be on yahoo soon [01:22] that answers why they left hulu, all the episodes in one place [01:22] if someone wants to help in get this issue: http://issuu.com/blenderart_magazine/docs/blenderart_mag-28_eng [01:23] godane, how were you downloading the other issues [01:24] the others have a download button [01:24] just that one doesn't [01:29] godane: got it [01:30] well [01:30] http://image.issuu.com/100714170851-c3e8c60cbf044173b710552dac855fb8/jpg/page_1.jpg etc [01:31] there are 49 pages [01:31] so just wget http://image.issuu.com/100714170851-c3e8c60cbf044173b710552dac855fb8/jpg/page_{1..49}.jpg [01:32] or I can hand you a zip [01:32] omf_:) joepie91 That vimeo is awesome [01:32] godane: these also seem available from http://blenderart.org/issues/ [01:35] https://ia601703.us.archive.org/3/items/ComputerEasyMagazineDiscFebruary2003/CE_2003_Cover.png < whee! [01:35] first upload :D [01:35] uh [01:35] fail [01:35] https://archive.org/details/ComputerEasyMagazineDiscFebruary2003 [01:35] that [01:38] does it have to be derived to browse the iso or is that just not a feature [01:38] I also may just be blind [01:41] next upload: https://archive.org/details/CompuKidsCDRom2001 [01:44] and more: https://archive.org/details/BuyInCoinsVL807GamepadDriver [01:47] https://archive.org/details/CrestaXWA1300NightviewWebcamDrivers [01:52] aaand much much more :P [02:04] post-processed magazine is 2.8GB, heh [02:07] all 40 issues of blenderart is uploaded to IA now [02:07] another collection in the bag [02:14] starting to upload my bbc click collection [02:15] i'm hoping it doesn't need to get block since its made by bbc [02:15] and bbc is sort of govement owned if i remember [02:16] the crazy thing is i'm uploading 3 items at once [02:17] anyone got a script that gets the links to all the videos in a youtube channel [02:17] I already got something for playlists [02:17] can't you use youtube-dl ? [02:18] never used it before, can it do full channels [02:19] the documentation has no information about channel downloads only playlists and single files [02:21] omf_: yes [02:21] it can do pretty much anything [02:21] just insert the URL [02:22] of any playlist, user, video, etc [02:22] yeah youtube-dl is godlike [02:26] I never bothered with youtube-dl because of how few video sites it supports [02:28] I find slight irony in how I am using a Magic Eraser to effectively un-erase data from scratched discs [02:28] lol [02:32] hah [02:33] right [02:33] my 3.4 GB comic magazine is uploading [02:33] and my ddrescue for some shovelware disk is running [02:33] time for sleep! [02:39] uploaded: https://archive.org/details/BBC.Click.2007.11.29 [02:43] I am glad youtube-dl allows me to export the url list [02:43] having it try and do it in one go is just dumb. I will spread the urls over a few servers and get all the downloads done much faster [02:44] I think there is like 2k videos [03:12] wow youtube-dl sucks a fucking cock. I am doing ./youtube-dl https://www.youtube.com/user/The1UPNetwork --simulate --get-url > 1up_videoes.txt [03:12] which is fairly straight forward [03:13] If a video in the last is blocked then youtube-dl just fails out [03:14] no recovery, no continue, nothing [03:14] and consider this isn't even downloading the videos just grabbing their links [03:19] Gotta go find a tool now that actually works. [04:17] error code 4 [04:17] did i do something wrong [04:18] wget* error code 4 [04:50] HI [04:51] hey SketchCow [04:51] Been watching movie [04:51] The director greeted me by name [04:51] That was.... something [04:54] SketchCow flaunting his wares again [04:58] i'm backing up wilkow episodes of this week [04:58] SketchCow: i got the 3 hour coverage of theblaze this past friday [04:59] Excellent [04:59] Isn't G4 dead now? [04:59] also wilkow was 2 hours this friday [04:59] g4 is not dead yet [04:59] i'm still getting old techtv video [05:18] I'm trying to dump everything off FOS into archive.org [05:18] so much stuff [05:21] i'm going to be doing the same soon [05:21] uploading 10 episodes of gbtv/theblaze [05:21] from aug 2012 [08:01] Mornin GLaDOS long time no chat [08:02] Morning [08:02] I've been preoccupied with some real life things. [08:02] nod [10:14] well fuck [10:14] I guess it IS serious [10:14] doctor signed me off for a week [12:14] hm [12:14] perhaps I didn't do the smartest thing tonight. [12:14] looks like my OS OOM-killed some system styff [12:15] wow, formspring is fast enough to screw up mah interenets [12:15] stuff * [12:15] crap, now I don't know if my upload got through.. [12:16] Also I really need to setup my QoS stuff on my router :O [12:19] let's retry that upload [12:19] Ugfh [12:19] Amazon can't charge my card for last month [12:19] Whyyyyy [12:22] duggan: remember that AWS contact you had? [12:23] i can't do a damn thing for posterous [12:23] i'm just going to run formspring at hyperspeed [12:23] sorry formspring [12:23] Heh [12:24] --concurrent 300 [12:24] the tracker is going to scream first [12:24] Reminds me of that time I ran 8000 threads spread out across 20 instances [12:25] heh [12:25] i should spin up 20 vms and do that [12:26] also, what happened to formspring shutting down [12:27] apparently they got bought or something. [12:27] SO WE'LL BE ARCHIVING THEM AGAIN WITHIN A YEAR [12:27] yay [12:27] i'll be here with even more internet next time [12:27] finally got a day job [12:28] Congrats! [12:28] i got tired of hosting [12:28] too much drama [12:29] for some reason posterous was giving me this weird wget error code 4 thing [12:29] now it's not downloading at all [12:30] In other words, you're banned! [12:30] They've gotten aggressive with banning [12:31] ok [12:31] what's with the error code 4 bit though [12:32] SO WE'LL BE ARCHIVING THEM AGAIN WITHIN A YEAR [12:32] perhaps the existence of archiving scripts for their platform will make them change their minds ;) [12:32] (the new owners planning to shut it down eventually, I mean) [12:34] joepie91: they'll just change a bit of code to make it incompatible. [12:34] Sue: no idea [12:34] http://tracker.archiveteam.org/formspring/ [12:34] heh [12:34] GLaDOS : easily fixed :D [12:34] ooo [12:34] my 3.2GB upload is almost done! [12:34] I'd do some more, but for some reason amazon fails to charge my prepaid [12:36] It's not currency exchange rates either (147USD is 142AUD) [12:36] nononononoNONONONO [12:36] chrome is hanging D: [12:37] good, it receovered [12:37] recovered * [12:38] https://archive.org/details/DonaldDuckNL-2008-19 [12:38] :D [12:44] go sue, go sue go sue. [12:45] hehe [12:45] i turned it up to 11 [12:45] :) [12:45] GO TO FUCKIN 12! [12:46] btw what are you runnin sue, infra wise? [12:46] just a single machine [12:46] D: [12:46] got lots of IP's tho? [12:46] yeah [12:46] here let me turn it up to 12 [12:46] yey I found my QoS scripts. [12:47] * Smiley watches as sue takes down formspring. [12:47] EdgarSaysFuck ? [12:47] XD [12:48] it's not 12 enough [12:48] i need another machine [12:48] xD [12:58] * joepie91 uploads moar [12:58] I also have quite a few issues of the Dutch Donald Duck magazine around 1985-1992 [12:58] that I will be scanning [12:58] three boxes online [12:58] i think it's 12 now [12:58] not sure [13:01] Sue: IT DOESN'T MATTER UNLESS YOU'RE GOING 742 MPH [13:01] ol [13:01] l [13:16] :D [14:04] http://owely.com/7NGJ6Z [14:04] would you look at that classic... [14:35] Gah, my HE IPv6 tunnel screws with the data that goes through it. [14:35] I grab a .c file over it, parts of it are missing. [14:35] I grab the same file over IPv4, it's fine. [14:38] http://wiki.batcom-it.net/index.php?title=VNC_OSD_interface [14:38] my setup: http://i.imgur.com/q6EPTOY.jpg [14:38] DVD-R drive in desktop under desk, extra external DVD-R drive on desk [14:39] flatbed scanner with a broken lid (glue is currently drying) [14:39] and lots and lots of work! [14:39] archiving station, ghetto edition :) [14:40] me, ssh'ed into my work box [14:40] wgetting all of IGN [14:40] while signed off from work by the doctor :/ [14:40] yes [14:40] Archive team has a week of smiley power coming up [14:40] I want IGN and gamespy finished now [14:40] they pissing me off [14:41] why is that/ [14:41] ?* [14:45] Actually, no, HE wasn't corrupting it. [14:45] joepie91: who? [14:45] :P [14:45] Smiley: it was re: "pissing me off" [14:47] because it's taking so damn long :D [14:47] ah [14:47] I thought they did something nasty in particular :) [14:48] Oh no [14:48] they don't care about the fact I'm grabbing so much [14:48] no bans or anything, lots of broken links tho [14:51] we just don't have any info other than "It's shutting down". [14:51] I think that is going to turn into a case of "we haven't paid the server providers anymore". [14:52] as random bits and peices already don't work [14:53] heh jason is ranting on twitter, prepare for influx! [15:12] jason is ranting on twitter? Must be a day ending in 'y' [15:15] ;) [15:15] true dat [15:19] I try to focus on vowel days, thank you very much [15:43] https://www.youtube.com/watch?v=DkaUsBwe0fo [15:43] :) [15:43] old school computer music [15:43] quite awesome [15:44] starring a HP Scanjet for the vocals [16:00] aaawwww yeah, the automated instruments [18:01] hmm [18:01] how can I force scantailor to mark a region as color image when the output mode is set to Mixed? [18:01] Picture Zones only lets me add to the auto layer [18:02] and for whatever reasion, it decides that the region I marked is text [18:02] even though it has a colored background :| [18:09] i found a lost interview of Roger Ebert from techtv [18:48] who is k [18:49] and how are they vacuuming posterous [18:49] kennethre, he works at heroku [18:50] damn [18:50] or just really generous [18:53] kennethre: i'm just in utter amazement, you're awesome [18:54] Sue: <3 [18:57] fight the good fight kennethre [18:57] hope it stays amicable [19:00] DFJustin: i'd appreciate it if you stop identifying me :) [19:01] kennethre: hiya from my irc channel :) [19:01] Sue: i double click too quickily [19:02] heh, i was tabbing through windows and i was like oh hey wat [19:02] i kinda want to fire up a few more machines to finish formspring [19:06] sry [19:06] no worries :) [19:12] Sue: a few more? XD [19:12] it's gonna take quite a bit i think? [19:12] i just want it over and done [19:13] the major issue is the tracker is super limited [19:13] Sue: it is? [19:13] yes [19:13] very [19:13] as in a manual limit [19:13] yes [19:13] or you litterlally break it? [19:13] "in order to prevent" blah blah [19:13] granted: â max:250 [19:13] Max 50 [19:13] too slow for me [19:13] wtf [19:14] hmmm [19:14] tracker is not internet scale? [19:14] Sue: how many can you do a minute? [19:15] i'm on 1gige [19:15] xD [19:15] i can download at ~900mbps from the other side of the country [19:16] yow [19:16] limited mostly by bandwidth-delay-product :P [19:17] heh [19:18] i'm wondering how far we can push it without breaking [19:18] If you can stick around sue I can keep raising it [19:19] i'm having a problem right now but yeah [19:19] for some reason it cached too hard and swapped hard [19:19] well let me know when we can do some testing D: [19:19] vm.swappyness= 0! [19:20] this is gonna hurt [19:29] ok so [19:29] first, can you please clear any requests i've made [19:29] from the tracker [19:30] Sue: That's not necessary, we regularly requeue anything that's not returned. [19:30] ok [19:30] well i did just ctrl-c a huge chunk [19:31] because i swapped so hard it almost killed the server [19:31] no idea why that happened [19:31] Smiley: what number of concurrent would you like me to start at [19:31] i was running 300 just fine [19:31] i can pull harder than that [19:32] what do you have atm? [19:32] what do you mean [19:32] atm the limit on the tracker is 100/min [19:33] I want you to keep increasing until you start seeing issues [19:33] i'm just going to do 600 [19:33] oh [19:33] i was running 500 [19:33] how about 1000 [19:33] i like that number [19:33] sure :D [19:34] sorry formspring [19:34] it's for your own good [19:35] i'm not even on the tracker [19:35] did i run posterous on accident? [19:35] did i kill the tracker...? [19:38] i touched STOP [19:38] that's weird [19:39] i'm getting errors from the tracker now [19:40] sec [19:40] 599 timeout [19:40] not getting many requests here :/ [19:40] * Smiley checks sue's claims [19:40] maxed your allowance :< [19:41] lol [19:41] at 1345 [19:41] it's still downloading [19:41] how many you running o_O? [19:41] 1000 [19:41] i touched stop a while ago [19:41] weird :/ [19:41] for some reason i'm not showing up on the leaderboard [19:41] i can see it rsyncing [19:42] yeah the tracker just isn't responding any more [19:43] loads of 599 timeout errors [19:45] :< [19:45] what did i break this time .-. [19:45] alard: .... [19:45] I'm not sure if it's related, but I'm having problem viewing the Posterous claims list at the moment. [19:46] i blame kennethre [19:46] Sue: Â¬_Â¬ [19:46] totally not my fault [19:47] ;) [19:48] Sue: You're getting error 599? [19:48] 599 timeout [19:48] and after that i started getting async popen [19:48] no tracker connection whatsoever [19:49] might have been something else [19:49] but it was spamming my screen [19:49] 599 Network connect timeout error (Unknown) [19:49] This status code is not specified in any RFCs, but is used by Microsoft HTTP proxies to signal a network connect timeout behind the proxy to a client in front of the proxy [19:49] i don't have any proxies [19:49] The tracker is still giving out items and doesn't look particularly busy. [19:50]