#archiveteam 2012-01-11,Wed

↑back Search

Time Nickname Message
01:11 🔗 underscor I love oneliners like this
01:11 🔗 underscor id=387;for i in $(wget -q -U "Testing/1.0" -O - "http://xxxx:xxxx@www.rusc.com/members/series.aspx?ID=$id"|grep -oP "show.aspx\?ID=[0-9]*"|grep -o "[0-9]*");do wget $(wget -q -U "Testing/1.0" -O - "http://xxxx:xxxx@www.rusc.com/members/show.aspx?ID=$i"|grep -oP "http://data.rusc.com.*?mp3");wget -O $id.html "http://xxxx:xxxx@www.rusc.com/members/series.aspx?ID=$id";done
01:47 🔗 yipdw Coderjoe: that's one scenario I hope is true
01:48 🔗 yipdw Coderjoe: it's not so much about "hurting GoDaddy", because nothing short of a metaphorical meteor strike is going to do that -- it's more just about followthrough
01:48 🔗 yipdw on a happier note, I think I have a significant percentage of public Proust data on batcave now
02:25 🔗 yipdw oh
02:25 🔗 yipdw something good to know: the open-source Wayback Machine code doesn't seem to handle WARC revisits
02:25 🔗 yipdw er
02:25 🔗 yipdw maybe it does and my server just sucks
02:25 🔗 yipdw hard to tell.
02:43 🔗 Coderjoe http://girlwalkallday.com/watch-the-film
03:47 🔗 Paradoks Does anyone know about fast/relatively cheap ways to digitize photos?
03:47 🔗 Paradoks My family has gone over this question, and my brother even got a scanner. But a flat-bed scanner, so it's really, really slow.
03:47 🔗 Paradoks I have a ScanSnap, so I could get a lot of them done in a minimal amount of time, but I doubt the quality would be terribly great.
03:48 🔗 Paradoks But I get the feeling that no other option would result in the photos being digitized, as the other options are too slow or too expensive.
03:49 🔗 no2pencil Don't confuse the scanner with the shredder
03:50 🔗 Paradoks True. I'm intending to use the ScanSnap, regardless. I just keep hoping for a higher-quality option that doesn't take 50x as long or cost $5+ per 24 photos.
03:51 🔗 Paradoks And perhaps there's no good option, now, and thus ScanSnap now, but different scanner in five years.
03:51 🔗 Coderjoe this takes too long, let's go shopping
03:52 🔗 underscor I have an canon mx870 with a document feeder
03:52 🔗 underscor I just take 1200dpi scans with that to tiffs
03:52 🔗 underscor It takes forever, but I can start it and check on it */10
03:56 🔗 Paradoks Taking forever is much more reasonable when it's unattended.
03:57 🔗 Paradoks But if it's a reasonable option, I can probably convince my brother to buy it, and we do bunches of scans during Family Christmas.
03:57 🔗 Paradoks That 1200dpi end up being pretty close to what you'd get from using a flatbed scanner?
04:04 🔗 yipdw whoa
04:04 🔗 underscor Paradoks: Yeah
04:05 🔗 underscor I mean, it's a flatbed with a document feeder
04:05 🔗 underscor So
04:05 🔗 yipdw I dug a three-year-old ARM7 board out of my closet and wired up a power supply to it
04:05 🔗 yipdw hooked it up via serial
04:05 🔗 yipdw Technologic Systems TS-LINUX/arm 7.0
04:05 🔗 yipdw ts7200 login:
04:05 🔗 yipdw :D
04:05 🔗 yipdw now I just need to remember the fucking credentials
04:06 🔗 underscor Paradoks: Apparently it's been replaced by the MX882
04:06 🔗 Paradoks underscor: Theoretically using the document feeder could mean it acts differently. *shrug*. But cool. I'll mention it to my brother. (Though, please, anyone else with experience, do still chime in.)
04:06 🔗 underscor Cannot vouch for it's quality
04:06 🔗 underscor its*
04:08 🔗 Coderjoe i don't know if I would trust one-of-a-kind items of unusual thickness or material to an ADF, though
04:09 🔗 underscor I like to live on the edge
04:09 🔗 underscor Haven't gotten out of that "FUCK YES I'M INVINCIBLE" stage yet
04:09 🔗 underscor But it's seriously the best document feeder I've ever used
04:10 🔗 underscor Autoduplex too, f'yeah
04:10 🔗 Coderjoe eek
04:38 🔗 Paradoks Coderjoe: I figure the "valuable" photos (e.g., the ones to actually make it into an album) would get flat-bed scanner treatment, but with the rest of the photos, the danger of a fire/flood/etc. seems greater than the risk of losing a photo or two.
04:45 🔗 bsmith093 i have a CC dvd that i want to edit, specifically fix the menus, because i pulled out 4 gb of junk, is there ANYTHING besides qdvdauthor that does dvd with menus from an iso, because qdvdauthor will let me make them from scratch, but i would muh rather just have something to load the iso into and tweak it slightly, and before you ask ive been googling for hours, ive got nothing, using ubuntu, lucid 1004 if it helps
04:48 🔗 Coderjoe ifoedit (windows program) might be able to let you remove menu items (though just the menu links, not the on screen listing. that's burned into the mpeg2 video)
09:56 🔗 SketchCow http://img90.imageshack.us/img90/5859/airbaga.jpg
10:02 🔗 rixard "Use what you got at hand"
15:12 🔗 SketchCow Well, I have to say.... WHOIS modification at dotAM is pretty damned unimpressive.
15:12 🔗 SketchCow They say 72 hours
15:12 🔗 SketchCow I thought, oh, they're just being super-safe
15:12 🔗 SketchCow But now, it may in fact be 72 hours
15:24 🔗 asiekierk hey
15:24 🔗 asiekierk adding my VPS to the MobileMe project
15:28 🔗 SketchCow Excellent.
15:28 🔗 asiekierk not like me.com is any fast
15:28 🔗 SketchCow I think it's time for us to kick that into high gear.
15:28 🔗 asiekierk i will try to run two processes on my VPS
15:28 🔗 asiekierk to the coders, could any of them impose a filesize limit?
15:28 🔗 asiekierk i can only spare 15GB on the VPS
15:29 🔗 asiekierk the perfect solution would be "download ~10-15GB, upload via rsync, repeat"
15:29 🔗 asiekierk also SketchCow rsync slot please
15:30 🔗 asiekierk also, - Running wget --mirror (at least 1367 files)... <- that's not very informative of the progress
15:33 🔗 asiekierk oh hey wait
15:33 🔗 asiekierk it's fast
15:33 🔗 asiekierk and it DOES write te result
15:35 🔗 asiekierk SketchCow so 2 requests: rsync slot and a maximum download size
15:38 🔗 asiekierk if there is a maximum download size i can set up an automatic download script on my VPS
15:38 🔗 asiekierk 1. download 10GB
15:38 🔗 asiekierk 2. upload 10GB
15:38 🔗 asiekierk 3. delete data folder
15:38 🔗 asiekierk 4. repeat
15:41 🔗 asiekierk @SketchCow how's the rsync slot coming?
15:41 🔗 asiekierk oh hey i'm on the status board downloading stuff
15:49 🔗 SketchCow Jesus.
15:49 🔗 SketchCow Calm down.
15:49 🔗 asiekierk sorry :<
15:49 🔗 asiekierk it's just my first time i got to help the archiveteam
15:49 🔗 SketchCow Here is what you don't do.
15:49 🔗 SketchCow You do not go "thing please" at 10:51 and then go "How is thing going" 12 minutes lter.
15:50 🔗 SketchCow I'm not a fucking tech support call
15:50 🔗 asiekierk okay
15:50 🔗 SketchCow I'm trying to decipher 4 names from an audio
15:51 🔗 SketchCow I would play that audio so you can help but you won't be able to help.
15:51 🔗 SketchCow When I'm done with that, you'll be sent a slot.
15:51 🔗 asiekierk okay
15:51 🔗 asiekierk right
17:02 🔗 yipdw asiekierk: if you want more information, tail the wget logs
17:02 🔗 yipdw dumping that information to stderr or stdout would ordinarily just spam a console
17:02 🔗 asiekierk yes
17:02 🔗 asiekierk and i accidentally wasted 3GB of work by accidentally killing the whole process... oh well, newbie errors
17:23 🔗 yipdw asiekierk: https://gist.github.com/6483375b0fcab1c5ae74
17:24 🔗 yipdw asiekierk: let me know if that works for you. if it does, I'll add it to mobileme-grab
17:24 🔗 asiekierk ok, when i finish this batch
17:27 🔗 asiekierk yipdw so from what i presume i give it the amount of free space, in gigabytes
17:27 🔗 asiekierk and if the free space is smaller than that it stops
17:28 🔗 asiekierk [Wed Jan 11 12:26:11 UTC 2012] data filesystem: using 11 GiB, free space threshold: 10 GiB, remaining: 1 GiB
17:28 🔗 asiekierk /dev/xvda1 61927420 11535784 47245908 20% /
17:28 🔗 asiekierk Filesystem 1K-blocks Used Available Use% Mounted on
17:28 🔗 asiekierk is this what should happen?
17:28 🔗 yipdw actually, that needshttps://gist.github.com/6483375b0fcab1c5ae74/d944dd7df9482b9a58afd3464425412bce202a02
17:28 🔗 yipdw er
17:28 🔗 yipdw https://gist.github.com/6483375b0fcab1c5ae74/d944dd7df9482b9a58afd3464425412bce202a02
17:28 🔗 yipdw and no, that isn't what should happen
17:28 🔗 yipdw what version of coreutils is that
17:29 🔗 asiekierk actually no
17:29 🔗 yipdw I'm using this
17:29 🔗 yipdw gdf --version
17:29 🔗 yipdw Copyright (C) 2011 Free Software Foundation, Inc.
17:29 🔗 yipdw df (GNU coreutils) 8.12
17:29 🔗 asiekierk i didn't use -BG on df
17:29 🔗 asiekierk Copyright (C) 2010 Free Software Foundation, Inc.
17:29 🔗 asiekierk License GPLv3+: GNU GPL version 3 or later <http: gnu.org licenses gpl.html>.
17:29 🔗 asiekierk df (GNU coreutils) 8.5
17:29 🔗 yipdw use the version I linked
17:29 🔗 yipdw it's less stupid
17:30 🔗 yipdw the previous version of that script did some bogus calculations
17:30 🔗 asiekierk it's also grabbing the wrong parameter for me, Used rather than Available
17:30 🔗 yipdw the revision I linked is more straightforward
17:30 🔗 asiekierk i'll just use print $4 and it should work
17:31 🔗 yipdw oh
17:31 🔗 yipdw oops
17:31 🔗 asiekierk yup
17:32 🔗 asiekierk Illegal option -s
17:32 🔗 asiekierk Usage: /usr/bin/which [-a] args
17:32 🔗 asiekierk also
17:32 🔗 yipdw jesus christ
17:32 🔗 yipdw I hate shell scripting
17:32 🔗 asiekierk We all do
17:32 🔗 asiekierk Don't worry
17:33 🔗 yipdw nothing is ever cross-compatible
17:33 🔗 asiekierk still, big thanks
17:33 🔗 asiekierk nothing is ever cross-compatible beyond the basic features shell scripts never need*
17:33 🔗 yipdw hmm
17:33 🔗 yipdw how about this: I set DF to df and the people on *BSD/OS X can fix it themselves
17:34 🔗 asiekierk yeah
17:36 🔗 yipdw ok!
17:36 🔗 yipdw asiekierk: try this -> https://gist.github.com/6483375b0fcab1c5ae74/6429a6e3b34f89e15418dc9e867501b334b1c903
17:36 🔗 yipdw er wait, no
17:36 🔗 asiekierk i already fixed it for myself
17:36 🔗 asiekierk don't worry
17:36 🔗 asiekierk thanks
17:38 🔗 yipdw ok, I'll push it to the mobileme-grab git repo
18:30 🔗 asiekierk okay, after a few dumb things i set up the VPS
18:30 🔗 asiekierk 3 dld-client processes at once and a free space monitor
18:31 🔗 asiekierk as well as 2 dld-single processes, finishing 2 incomplete downloads including keith.garner which is quite large
18:32 🔗 asiekierk the speeds are 200KB/s-1.5MB/s
18:32 🔗 asiekierk total
18:33 🔗 asiekierk with spikes of 3MB/s
21:15 🔗 savetz is Splinder all done?
21:19 🔗 Coderjoe istr needing someone (SketchCow or underscor most likely, given batcave) to run a verification script over everything and identify problem profiles to add back to the pool. or something.
21:19 🔗 SketchCow Eeryday I'm shufflin'
21:20 🔗 savetz I finally have an internet connection that's not limited in bandwidth use per month ,I want to archive something.
21:20 🔗 yipdw you're in luck
21:20 🔗 yipdw http://archiveteam.org/index.php?title=MobileMe
21:20 🔗 yipdw there's a good number of terabytes
21:26 🔗 savetz cool. I'll fire up the linux box.
21:38 🔗 savetz building wget-warc: configure: error: --wish-ssl was given, but GNUTLS is not available. Suggestions?
21:39 🔗 dnova apt-get install gnutls-dev
21:40 🔗 savetz yay
21:42 🔗 bsmith093 is warc in the mainline repos yet? i have it but it qould be more convenient to just apt get update it like everything else
21:50 🔗 yipdw is it in wget's canonical repo, yes: http://bzr.savannah.gnu.org/lh/wget/trunk/revision/2571
21:50 🔗 yipdw is it in a wget release: doesn't look like it
21:50 🔗 yipdw is it in any package repository: who knows
23:43 🔗 dashcloud SketchCow: what happened with the people queueing up in that one interview? they just showed up and stood there?
23:44 🔗 dashcloud in your test shot from magfest you posted earlier

irclogger-viewer