#archiveteam-bs 2013-01-26,Sat

โ†‘back Search

Time Nickname Message
02:47 ๐Ÿ”— godane1 Famicoman: ping
06:03 ๐Ÿ”— turnkit In America, government hacks you... http://www.whitehouse.gov/blog/2013/01/22/roll-your-sleeves-get-involved-and-get-civic-hacking
06:04 ๐Ÿ”— turnkit or as Andrew Auernheimer @rabite says, "If your app is deemed unamerican you go to prison!"
06:05 ๐Ÿ”— Zebranky Good ol' weev
06:39 ๐Ÿ”— illunatic fuck
06:40 ๐Ÿ”— illunatic media is pushing a story of john kerry saying hackers are nukes
06:41 ๐Ÿ”— illunatic http://activepolitic.com:82/external/1785.html
06:41 ๐Ÿ”— illunatic 00:12 <+u4t> imagine if a hacker had been dropped on hiroshima or nagasaki
06:41 ๐Ÿ”— illunatic 00:12 <+u4t> there would be NO SURVIVORS
06:47 ๐Ÿ”— kennethr- hahaha
06:47 ๐Ÿ”— kennethr- well, admittedly, our shit is so fucking vulnerable
06:50 ๐Ÿ”— kennethr- can't we all just get along?
07:16 ๐Ÿ”— illunatic <!-- __ _ _ _ __| |_ (_)__ _____ / _` | '_/ _| ' \| |\ V / -_) \__,_|_| \__|_||_|_| \_/\___| -->
07:16 ๐Ÿ”— illunatic oops
07:17 ๐Ÿ”— illunatic <!-- __ _ _ _ __| |_ (_)__ _____ -->
07:17 ๐Ÿ”— illunatic <!--/ _` | '_/ _| ' \| |\ V / -_) -->
07:17 ๐Ÿ”— illunatic <!--\__,_|_| \__|_||_|_| \_/\___| -->
07:31 ๐Ÿ”— turnkit thinking a lot about the "bubble" window-period of lots of semi-freely available information due to the CD-ROM/DVD-ROM era of distribution... we get this big explosion of INFORMATION availability and then in a couple decades it seems like that access is less available. Is all the info still there like it was 15 years ago?
07:31 ๐Ÿ”— turnkit What the heck is this publication? http://www.worldcat.org/title/canadian-cd-rom-newsletter/oclc/18111186
07:34 ๐Ÿ”— turnkit If every CD-ROM is now a web site... where is the site, "The rock cycle in Michigan" lol -- http://www.worldcat.org/title/rock-cycle-in-michigan-cd-rom/oclc/49221323
07:35 ๐Ÿ”— turnkit oh, I guess this is it... https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&cad=rja&ved=0CD0QFjAB&url=http%3A%2F%2Fwww.oakland.k12.mi.us%2Fscope%2Fseventh_lessons%2Fscience%2Funit5%2FSC070504TB.ppt&ei=G4cDUaHoEMSQqgHejoCQDg&usg=AFQjCNEsym5C44QZ3CC9eyKiLWcxmiXZTg&sig2=32aCcKoVhvrMHq_CCDrBCA&bvm=bv.41524429,d.aWM
07:35 ๐Ÿ”— godane1 just for you guys to know i download g4tv.com videos
07:36 ๐Ÿ”— turnkit should have linked: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&cad=rja&ved=0CEEQxQEwAQ&url=https%3A%2F%2Fdocs.google.com%2Fviewer%3Fa%3Dv%26q%3Dcache%3A_OwfKzETh84J%3Awww.oakland.k12.mi.us%2Fscope%2Fseventh_lessons%2Fscience%2Funit5%2FSC070504TB.ppt%2B%26hl%3Den%26gl%3Dus%26pid%3Dbl%26srcid%3DADGEESglvcHQH5V5tU6eFA2ZTt2-Ddh9wo-lL-DrtMVCnDKHMa4ELCoNRUdpLh0Sh-EQGoNT1RTJ-LYACtXu9
07:36 ๐Ÿ”— turnkit Geeze godane1-- made me think I was posting in the non -bs page. something meaningful? :)
07:37 ๐Ÿ”— illunatic balrog_: http://archive.org/details/AaronSwartzMemorial0
07:39 ๐Ÿ”— illunatic i left the original video titles because i wanted to keep it as close to the original format as possible
07:39 ๐Ÿ”— illunatic all that has changed is the container from flv to mp4
07:40 ๐Ÿ”— DFJustin hmm that newsletter is in the vancouver public library, not so far
07:41 ๐Ÿ”— DFJustin doesn't sound like it necessarily has an enclosed disc though
07:47 ๐Ÿ”— illunatic http://archive.org/details/AaronSwartzMemorialAtTheInternetArchive
07:59 ๐Ÿ”— illunatic authoritarians!
08:26 ๐Ÿ”— turnkit DFJustin-- these days I'm thinking I should take a cd-reader into any large local library to do archiving sessions. I doubt they will keep those discs for ten+, or twenty+ years.
08:27 ๐Ÿ”— DFJustin yeah go for it
08:27 ๐Ÿ”— DFJustin cds rot eventually too
08:47 ๐Ÿ”— turnkit thanks for uploading the memorial... am watching... good thoughts.
08:49 ๐Ÿ”— turnkit 29m05s+ "if you are a programmer or technologist like many of you in the audience today, you have special powers and special responsibilities..."
08:50 ๐Ÿ”— turnkit "... you can do magic"
08:51 ๐Ÿ”— turnkit abt 29m15s+ "Aaron really could do magic. And I'm dedicated to making sure his magic doesn't end with his death. I hope you'll join me" -- missed her name, Aaron's girlfriend.
08:52 ๐Ÿ”— turnkit Sobering stuff.
08:52 ๐Ÿ”— illunatic turnkit: very inspiring
08:58 ๐Ÿ”— SketchCow Taren\
08:59 ๐Ÿ”— godane1 SketchCow: I'm mirroring the g4 videos on g4tv.com
08:59 ๐Ÿ”— godane1 i have the list
08:59 ๐Ÿ”— godane1 getting tons of old techtv videos
09:01 ๐Ÿ”— godane1 in other news i have a mcdonalds employee training video from 1972
09:01 ๐Ÿ”— turnkit training video is neat
09:01 ๐Ÿ”— turnkit b/c of the age and the format
09:01 ๐Ÿ”— turnkit and iconic source
09:01 ๐Ÿ”— godane1 and i'm getting a blockbuster employee training from 2002
09:02 ๐Ÿ”— turnkit I've got some Tandy training LASERDISC but it's from like 1992 -- not nearly as cool. haha. :)
09:02 ๐Ÿ”— turnkit category: CorporateTraining -?
09:03 ๐Ÿ”— turnkit what are you using to digitize?
09:06 ๐Ÿ”— turnkit Whoever was involved in shooting the Internet Archive memorial did a very nice job. Multi-cam shoot with good establishing shots. Nothing overdone, simple, but live-edited well.
09:07 ๐Ÿ”— godane1 turnkit: i just find stuff on the web
09:07 ๐Ÿ”— turnkit you mean, not on youtube?
09:07 ๐Ÿ”— turnkit :)
09:08 ๐Ÿ”— turnkit have you heard the 1800-sos-apple phone tech support calls collection?
09:08 ๐Ÿ”— turnkit it's like only 10 calls
09:08 ๐Ÿ”— turnkit some apple IIe and Mac+ type era calls
09:09 ๐Ÿ”— turnkit I think I found them on DSLreports.com again... someone uploaded them to their forum (that's a good forum/site to archive btw)
09:09 ๐Ÿ”— turnkit http://www.dslreports.com/forum/r12697522-humor-Apple-Support-Calls
09:09 ๐Ÿ”— turnkit weird old stuff...
09:12 ๐Ÿ”— illunatic http://blog.greenpirate.org/aaronz-swartz-memorials-archived/
09:19 ๐Ÿ”— DFJustin #1 weird old trick for fixing your IIe
09:25 ๐Ÿ”— turnkit just realized there is not much chat going on b/c it's friday night at 3:30 AM. someone has a life?
09:28 ๐Ÿ”— turnkit http://archive.org/details/AaronSwartzMemorialAtTheInternetArchive
09:29 ๐Ÿ”— turnkit 56m -- Tim O'Reilly makes sobering statements about being formed by the things that "defeat" us. Enjoying these talks. Feels like a good church service.
09:30 ๐Ÿ”— illunatic i'm in the same time zone turnkit
09:30 ๐Ÿ”— illunatic yeah that was a great one
09:31 ๐Ÿ”— turnkit East Texas here.
09:31 ๐Ÿ”— illunatic Ausint
09:31 ๐Ÿ”— illunatic -t
09:31 ๐Ÿ”— illunatic or put it somewhere more appropriate anyway :D
09:31 ๐Ÿ”— turnkit you guys have a DC meet or 2600 down there?
09:32 ๐Ÿ”— illunatic t is playing leapfrog
09:32 ๐Ÿ”— illunatic hm i don't know if they have 2600
09:32 ๐Ÿ”— illunatic yes of course
09:32 ๐Ÿ”— illunatic http://www.meetup.com/ATX-2600/
09:32 ๐Ÿ”— illunatic would have been surprised if not
09:32 ๐Ÿ”— turnkit Dallas has an interesting DC group , but I hate driving an hour+ each way
09:32 ๐Ÿ”— turnkit ah
09:33 ๐Ÿ”— turnkit I'm near Tyler
09:33 ๐Ÿ”— turnkit podunk out here but I like it
09:34 ๐Ÿ”— illunatic :)
09:34 ๐Ÿ”— illunatic as long as you have internets i guess
09:34 ๐Ÿ”— illunatic priorities
09:34 ๐Ÿ”— turnkit Tyler has Suddenlink's nationwide VOIP control/termination I think. They have a good network but I'm out in the countryside with AT&T DSL
09:34 ๐Ÿ”— turnkit 3mb/s and am trying to game the system to get 6 which is technically possible but for some reason has been a big battle.
09:35 ๐Ÿ”— illunatic there's a dungeons and dragons meetup too
09:35 ๐Ÿ”— illunatic no time for that unfortunately
09:35 ๐Ÿ”— turnkit lulzies. we have a "Game Board Geek" store in town
09:35 ๐Ÿ”— turnkit I play Settlers but not most of the games they have there.
09:36 ๐Ÿ”— illunatic i literally just upgraded from 3mbps
09:36 ๐Ÿ”— turnkit congrats. I know your pain. lol
09:36 ๐Ÿ”— illunatic :)
09:36 ๐Ÿ”— illunatic at&t was charging about $50 per month for that
09:36 ๐Ÿ”— turnkit yep
09:36 ๐Ÿ”— illunatic because we had signed a year deal or whatever
09:37 ๐Ÿ”— turnkit what service providers do you havei n Austin?
09:37 ๐Ÿ”— illunatic at least we were able to get a new year deal for slightly better speeds
09:37 ๐Ÿ”— illunatic at&t and time warner
09:37 ๐Ÿ”— illunatic who i would never use
09:37 ๐Ÿ”— turnkit so what/who do you have now?
09:37 ๐Ÿ”— illunatic in this area anyway
09:37 ๐Ÿ”— illunatic at&t still
09:38 ๐Ÿ”— illunatic i dunno
09:38 ๐Ÿ”— illunatic i might like to move to sweden for some time
09:38 ๐Ÿ”— turnkit did you ever get notices on datacaps?
09:38 ๐Ÿ”— illunatic not that i know of
09:38 ๐Ÿ”— turnkit I think ATT has them, but are not implimented in our area - thank goodness
09:39 ๐Ÿ”— turnkit it's like 150GB or 250GB per month, I can't remember
09:39 ๐Ÿ”— illunatic I've been meaning to update since this http://blog.greenpirate.org/comcast-data-caps-how-long-to-reach-your-cap/
09:39 ๐Ÿ”— illunatic i think they upped it to 350GB, not sure
09:39 ๐Ÿ”— turnkit I'll switch to business class as soon as they impliment here if I get close to it. Business doesn't have a cap
09:39 ๐Ÿ”— turnkit but it's more expensive
09:40 ๐Ÿ”— illunatic http://muninetworks.org/content/bandwidth-caps-are-unnecessary-and-counterproductive
09:40 ๐Ÿ”— turnkit there's a good twit.tv special on datacaps -- guys from ISP Hurricane Electric (I think that's their name)
09:41 ๐Ÿ”— illunatic nice
09:41 ๐Ÿ”— turnkit yeah - peak congestion is the real problem - not overall capping
09:41 ๐Ÿ”— turnkit at least in our market
09:44 ๐Ÿ”— turnkit I am somewhat suspicious AT&T is purposely selling lower speeds than they can in order to push purchasing of data plans over mobile.
09:45 ๐Ÿ”— turnkit it's crazy but Verizon is about 15 miles from me too and they have purposefully not deployed DSL. Their rep came out to our counry town to tell a group interested in DSL that it would never come but 4G data would "in the future" -- guess which make more money for Verizon?
09:45 ๐Ÿ”— turnkit So I wonder if ATT isn't motivated the same way
09:47 ๐Ÿ”— illunatic actually they are tho
09:47 ๐Ÿ”— illunatic and they are cutting unlimited plans for mobile
09:48 ๐Ÿ”— illunatic oh man i left them because of that
09:48 ๐Ÿ”— illunatic they give some small amount of bandwidth
09:48 ๐Ÿ”— illunatic and if you hit it, another $20 fee each time
09:48 ๐Ÿ”— illunatic i wasn't even using it and somehow hitting it from crappy apps or something
09:48 ๐Ÿ”— illunatic no idea why tbh
09:56 ๐Ÿ”— turnkit anyone know how to play an archive.org video starting right at a time code (like youtubes &t=0m0s)?
09:57 ๐Ÿ”— turnkit I want to post to FB Malamud's 82m40s+ Aaron Schwartz portion
09:57 ๐Ÿ”— illunatic what kind of video player do they use?
09:58 ๐Ÿ”— illunatic maybe you should suggest that feature
09:59 ๐Ÿ”— turnkit Don't know what they are using. But would be nice too if the timeline could be expanded to fill the screen for accurate scrubbing. A ninety minute video is hard to scrub on when it's shown in 4" of screen real estate.
09:59 ๐Ÿ”— turnkit well right now, in full screen the scrub is only 1/3 of the screen
10:01 ๐Ÿ”— turnkit the Malamud's talk should be re-up'd on it's own
10:02 ๐Ÿ”— turnkit it's so good
10:02 ๐Ÿ”— turnkit with energy
10:02 ๐Ÿ”— turnkit clear passion
10:02 ๐Ÿ”— turnkit but I like this guy already
10:02 ๐Ÿ”— turnkit so I'm biased
10:05 ๐Ÿ”— turnkit // Lossless flv/mp4 cutters?
10:09 ๐Ÿ”— DFJustin turnkit: if you click on the animated gif thumbnail you get a bunch of thumbnail images with links to time codes
10:09 ๐Ÿ”— turnkit Thanks for the "feedback" suggestion
10:09 ๐Ÿ”— DFJustin tweak as needed
10:09 ๐Ÿ”— turnkit I see where to do that
10:09 ๐Ÿ”— turnkit "We use the jwplayer from longtail video."
10:09 ๐Ÿ”— turnkit DFJustin - I'll check it. thx
10:11 ๐Ÿ”— turnkit well it added code, such as ?start=5009.5 at the end of the URL
10:12 ๐Ÿ”— turnkit ah -- the time code shows starting at "0" but when you hit play it pops forward.
10:12 ๐Ÿ”— turnkit THANKS
10:12 ๐Ÿ”— turnkit that works
10:19 ๐Ÿ”— omf__ I think the best hackers will never work for the gov for a number of reasons
10:20 ๐Ÿ”— omf__ resistance to authority figures
10:20 ๐Ÿ”— ersi Mainly because the gov is a bunch of assholes
10:20 ๐Ÿ”— omf__ not being squeaky clean enough to work for them
10:20 ๐Ÿ”— omf__ etc ...
10:20 ๐Ÿ”— ersi decitivive assholes
10:20 ๐Ÿ”— omf__ this bs to try to get us to help them will not work
10:20 ๐Ÿ”— turnkit If you don't feel you have time to watch the whole memorial watch the last part first... it might motivate you :) http://archive.org/details/AaronSwartzMemorialAtTheInternetArchive?start=4955
10:21 ๐Ÿ”— turnkit haha -- yeah -- kids with life long authority issues / authorities with life long exploition and power trip issues -- the world is kinda f'd up
10:21 ๐Ÿ”— turnkit good luck getting them to enjoy eachother in a functional way
10:22 ๐Ÿ”— omf__ Also and I think the biggest reason is you have to play by their rules
10:23 ๐Ÿ”— omf__ and that is a fucking non-starter for me
10:23 ๐Ÿ”— omf__ When I do a security audit at a company they want me to bash everything in
10:23 ๐Ÿ”— omf__ The gov freaks out if you find something too unexpected because there were *rules*
10:23 ๐Ÿ”— turnkit haha -- yeah makes sense
10:24 ๐Ÿ”— godane1 uploaded: http://archive.org/details/McDonalds.Employee.Training.VHS.1972
10:24 ๐Ÿ”— turnkit "control" is why they hire audits. when they discover less of it, they aren't feeling warm fuzzies
10:24 ๐Ÿ”— omf__ thanks godane, I really want to watch that video
10:25 ๐Ÿ”— omf__ Most of the hackers who I know are on the level are fucking kernel programmers for Linux and FreeBSD
10:25 ๐Ÿ”— turnkit hmm... McDonalds video -vs.- Malamud's talk @ Aaron Schwartz memorial?
10:25 ๐Ÿ”— turnkit Correct answer: both
10:25 ๐Ÿ”— omf__ the gov wouldn't pay them enough to come over
10:25 ๐Ÿ”— omf__ yeah I am a big fan of Malamud
10:26 ๐Ÿ”— turnkit he's awesome. I got his book on "the internet" from the 90's a couple years ago... I still need to finish... same issues different decade and different data
10:27 ๐Ÿ”— turnkit MickeyD is making me happy and gaayyyy... oh wait.
10:27 ๐Ÿ”— turnkit not really but if you listen to the song you'll know how I feel
10:27 ๐Ÿ”— turnkit :)
10:28 ๐Ÿ”— omf__ I need to dig up my copy of waiting and see how there fake training compares
10:28 ๐Ÿ”— DFJustin man why does everyone have to rip vhs to mpeg-1, like it wasn't crap enough already
10:29 ๐Ÿ”— omf__ because the vhs conversion units usually spit out mpeg 1 or 2
10:29 ๐Ÿ”— godane1 DFJustin: the g4tv.com videos may piss you off
10:29 ๐Ÿ”— omf__ my vhs reader dumps straight to dvd
10:29 ๐Ÿ”— turnkit I have an old Avid system... digitizes to Avid Meridien codec that nothing can use. So I'd have to transcode to something... and something thats compressed....
10:29 ๐Ÿ”— godane1 a lot of full episodes 56k
10:30 ๐Ÿ”— turnkit Oh man, I got to the sad part in the McD video :(
10:30 ๐Ÿ”— turnkit I was so happy till "if I wanted frys I WOULD HAVE ASKED FOR T H E M ! !!!!@"
10:30 ๐Ÿ”— omf__ turnkit, you sure ffmpeg does not have support for that avid codec? They have support for the others like dnxhd
10:31 ๐Ÿ”— turnkit hmm... but the bandwidth is huge
10:31 ๐Ÿ”— turnkit I worked on a Fox SportsNet show in the early 2000's -- BluetorchTV (extreme sports) -- we MASTERED at 3:1 compression
10:32 ๐Ÿ”— turnkit Avid Meridien from that era could do what they called 1:1, 2:1, 3:1, 10:1 and 20:1 (and some single field codecs)
10:32 ๐Ÿ”— turnkit But it's a tought decision -- what compression should be used.
10:33 ๐Ÿ”— turnkit I'm glad that McD vid starts so happy... people are mean.
10:33 ๐Ÿ”— turnkit I'm hoping it will come full circle and the hero will win at the end. lol
10:34 ๐Ÿ”— omf__ Someone just started testing a robot that can make 350 burgers an hour
10:34 ๐Ÿ”— turnkit 1:1 avid footage for one hour: 185.3 GB. http://www.digitalrebellion.com/webapps/video_calc.html
10:34 ๐Ÿ”— omf__ the fast food jobs death clock has started
10:35 ๐Ÿ”— turnkit about 3GB/minute
10:35 ๐Ÿ”— omf__ that isn't so much "avid" footage as raw
10:35 ๐Ÿ”— turnkit Well that's what broadcast quality footage is... "uncompressed" -- aka "raw"
10:35 ๐Ÿ”— turnkit at 3:1 one minute is down to 260MB/minute... a lot more reasonable
10:36 ๐Ÿ”— omf__ were you guys doing 4:3 ratio or 16:9?
10:36 ๐Ÿ”— turnkit this was 2001 I think - all 4:3
10:36 ๐Ÿ”— turnkit SD - NTSC
10:36 ๐Ÿ”— turnkit but if I want to archive something well... it's a tough call for me
10:37 ๐Ÿ”— omf__ I am so glad there are other video peeps in this group.
10:37 ๐Ÿ”— turnkit I'll probably compromise and do 3:1 or digitize 1:1 and then transcode to MP4 or AVC at a high bitrate
10:37 ๐Ÿ”— turnkit deinterlacing issues can make a mess
10:37 ๐Ÿ”— turnkit people don't understand it and then end up wanting to deinterlace everything which is a no-no
10:38 ๐Ÿ”— omf__ yep
10:39 ๐Ÿ”— turnkit but if you don't have a way to deinterlace on playback, then the footage looks bad
10:39 ๐Ÿ”— turnkit so what's the answer?
10:39 ๐Ÿ”— turnkit I think the footage has to be archived in it's native format
10:39 ๐Ÿ”— godane1 i have figured out the video names dates for the g4tv.com videos
10:39 ๐Ÿ”— turnkit and we have to work on output engines that render based on the device being used -- these days mostly in a progressive format
10:40 ๐Ÿ”— godane1 its YYMMDD
10:40 ๐Ÿ”— turnkit typical american dating style... so weird. :)
10:41 ๐Ÿ”— turnkit Man - I want a happy meal now
10:41 ๐Ÿ”— godane1 also for everyone at home keeping count i have 13.1Gb of g4tv.com videos
10:41 ๐Ÿ”— turnkit that's pretty good
10:42 ๐Ÿ”— godane1 bad news any file with vc# is going to end in a 404
10:43 ๐Ÿ”— turnkit why is that?
10:44 ๐Ÿ”— godane1 dont know
10:44 ๐Ÿ”— turnkit bug in the scraper?
10:44 ๐Ÿ”— godane1 no
10:44 ๐Ÿ”— turnkit not on the server?
10:44 ๐Ÿ”— godane1 maybe
10:47 ๐Ÿ”— turnkit if you strip off the #vc can you manually dl?
10:47 ๐Ÿ”— turnkit oh, nevermind
10:47 ๐Ÿ”— turnkit doh
10:48 ๐Ÿ”— turnkit I read that wrong
10:48 ๐Ÿ”— godane1 its 404 on website page
10:48 ๐Ÿ”— godane1 http://www.g4tv.com/videos/1675//moby-interview/
10:49 ๐Ÿ”— godane1 plus side is some of the vc videos i think are there but with normal names and different path
10:54 ๐Ÿ”— turnkit why don't all magazine publishers do this?:http://www.ebay.com/itm/National-Geographic-112-Years-32-CD-Rom-Set-Complete-Magazine-All-Issues-PC-Mac-/271101566054
10:54 ๐Ÿ”— turnkit Even looks like the licensed the deal out to whatever company name is on the box... but at least they didn't sit on their assets.
10:56 ๐Ÿ”— turnkit that moby link just hangs for me... but I think all the g4tv video links are doing that... not sure why
10:57 ๐Ÿ”— omf__ I agree turnkit. I got fucking stacks of mags I keep for interesting bits but I wish they were digital. Time & Newsweek are two of the worst
10:58 ๐Ÿ”— omf__ well newsweek is dead in print now
10:59 ๐Ÿ”— turnkit is that new news?
10:59 ๐Ÿ”— turnkit Daily Beast ate them, no?
11:00 ๐Ÿ”— turnkit great quote from a 1994 CD-ROM review in the Seattle Times: "Angus' Law states that in any category, 85 percent is mediocre or less, 10 percent is just fine and 5 percent is excellent. The rash of CD-ROM titles conforms."
11:01 ๐Ÿ”— turnkit Some of that mediocrity is actually mineable though.
11:01 ๐Ÿ”— omf__ I still claim Sturgeon's Law
11:02 ๐Ÿ”— omf__ mainly because once you get exposed to really good content for a while a bunch of things you liked are now crap
11:13 ๐Ÿ”— turnkit omf__ - sorry I'm not reading well -- I skipped the highlighted line your replied to me in and just read the next as if it was the only thing your wrote
11:13 ๐Ÿ”— turnkit agreed.
11:13 ๐Ÿ”— turnkit Somebody has to digitize and license affordably.
11:14 ๐Ÿ”— turnkit Or just back off and let enthusiasts help the community of knowledge
11:19 ๐Ÿ”— omf__ I know this is obvious, but it is worth stating. The search capabilities enabled by having things digital is far more useful than most can imagine.
11:20 ๐Ÿ”— omf__ There are so many forever projects I had that are now possible because of data becoming free and things like internet archive and freebase
11:21 ๐Ÿ”— omf__ that is why JSTOR is such a cock tease. All online and searchable... just too fucking expensive for the 99%
12:00 ๐Ÿ”— Schbirid google play downloading dashboard graph porn http://news.ycombinator.com/item?id=5117983
13:23 ๐Ÿ”— joepie91 omf__, turnkit, I'd argue for a modified version of Sturgeons Law: 90% of everything starts out as being crap, and this percentage increases over time
13:29 ๐Ÿ”— joepie91 http://www.youtube.com/watch?v=DvrPsBiZYaY
13:34 ๐Ÿ”— ersi http://i.imgur.com/oPOidhn.gif
14:31 ๐Ÿ”— joepie91 how would one mirror an entire site plus 1 level deep of external links?
14:31 ๐Ÿ”— joepie91 using wget-warc
14:44 ๐Ÿ”— alard joepie91: Try wget-lua.
14:47 ๐Ÿ”— joepie91 aside from me not speaking lua, does that do WARCs?
14:48 ๐Ÿ”— alard Yes, the warc thing is included in Wget 1.14, and wget-lua is based on the current wget git version. I'm making a little example script.
14:52 ๐Ÿ”— joepie91 alright, thanks\
14:53 ๐Ÿ”— alard https://gist.github.com/2c5bbbeec96979c84768
14:53 ๐Ÿ”— alard wget-lua --recursive --page-requisites, but no --span-hosts
14:55 ๐Ÿ”— alard (Didn't try it.)
14:58 ๐Ÿ”— ersi Yeah, keep a watch on the process by following the output (or output to a log and tail that)
15:02 ๐Ÿ”— alard The most recent Wget+Lua tar is here: http://warriorhq.archiveteam.org/downloads/wget-lua/
15:03 ๐Ÿ”— alard or here: https://raw.github.com/ArchiveTeam/xanga-grab/master/get-wget-lua.sh
15:11 ๐Ÿ”— joepie91 alard: doesn't that just do page assets though?
15:11 ๐Ÿ”— alard No, line 14-16 should accept any URL that is referred to from the original host.
15:12 ๐Ÿ”— alard start_url_parsed is the URL that you give to Wget on the command line.
15:12 ๐Ÿ”— alard parent is the URL where Wget found the current URL.
15:12 ๐Ÿ”— alard urlpos is the URL that Wget is considering.
15:13 ๐Ÿ”— alard So I think it should work, but do check it.
15:32 ๐Ÿ”— joepie91 it seems to just be doing infinite recursion now
15:32 ๐Ÿ”— joepie91 downloading half the internet
15:33 ๐Ÿ”— joepie91 cc alard
15:33 ๐Ÿ”— alard Oh.
15:34 ๐Ÿ”— alard What are your Wget options?
15:34 ๐Ÿ”— joepie91 ./wget-lua -t 2 --lua-script=../luascripts/externaldl.lua -e robots=off --wait 0.25 http://home.hccnet.nl/t.amerongen/ --mirror --warc-file=at-amerongen
15:35 ๐Ÿ”— joepie91 actually I'm not sure
15:35 ๐Ÿ”— joepie91 this guy may just haev a lot of outbound links
15:35 ๐Ÿ”— joepie91 let me watch it for a bit longer
15:36 ๐Ÿ”— alard In the meantime, could you send an update of the seesaw-kit to pypi?
15:36 ๐Ÿ”— joepie91 hm, have you updated the setup.py with the new version?
15:37 ๐Ÿ”— joepie91 git doesn't indicate any changes to setup.py
15:37 ๐Ÿ”— joepie91 oh right
15:37 ๐Ÿ”— joepie91 that's defined elsewhere
15:38 ๐Ÿ”— joepie91 never mind
15:38 ๐Ÿ”— alard Ah yes, I had to look it up, but the version isn't in setup.py.
15:39 ๐Ÿ”— ersi ooh, it's tagged and all ^_^
15:40 ๐Ÿ”— joepie91 there we go, updated
15:40 ๐Ÿ”— joepie91 pip install --upgrade seesaw-kit
15:40 ๐Ÿ”— joepie91 to update
15:40 ๐Ÿ”— joepie91 Connecting to www.imageshack.us|208.94.0.38|:80... failed: No route to host.
15:40 ๐Ÿ”— joepie91 derp?
15:40 ๐Ÿ”— ersi derp indeed
15:41 ๐Ÿ”— alard Thanks. The Xanga script needs the latest version.
15:41 ๐Ÿ”— joepie91 oh god, they're probably on cogent
15:41 ๐Ÿ”— joepie91 cogent has basically nulled all routing with voxility afaik
15:41 ๐Ÿ”— joepie91 it's a bit annoying
15:41 ๐Ÿ”— ersi cogent for the lose
15:41 ๐Ÿ”— joepie91 they were complaining about "too much abuse"
15:41 ๐Ÿ”— joepie91 but ironic given how much crap comes off cogent itself
15:41 ๐Ÿ”— joepie91 bit *
15:42 ๐Ÿ”— joepie91 but okay
16:51 ๐Ÿ”— alard I wrote a little bit of documentation for the Wget+Lua callbacks: https://github.com/alard/wget-lua/wiki/Wget-with-Lua-hooks
17:01 ๐Ÿ”— ersi nice
17:24 ๐Ÿ”— kennethr- this video is pretty epic http://www.youtube.com/watch?feature=player_embedded&v=WaPni5O2YyI
17:33 ๐Ÿ”— ersi Indeed
17:50 ๐Ÿ”— omf__ What do people use for backups now days? I used cdr, then dvdr, and now bluray but even that is still a pain
17:50 ๐Ÿ”— omf__ I found out in my company's backups that some disks are bad due to a shitty drive that reported burns as good
17:51 ๐Ÿ”— omf__ I thought about going raid hard drives on a large scale but after the thailand floods and the cluster fuck around hard drives that does not seem as feasible
17:51 ๐Ÿ”— omf__ unless I waste the money on "enterprise" drives
17:52 ๐Ÿ”— omf__ any archivers got suggestions?
17:53 ๐Ÿ”— ersi Most important is to have off-site copies
17:53 ๐Ÿ”— ersi I currently don't have any backups >_>
17:53 ๐Ÿ”— omf__ I know that, I am asking about formats
17:54 ๐Ÿ”— omf__ I had a terrible crash in 96 in which I spent a month with norton disk editor recovering everything. I keep backups but I found some backups failed
17:54 ๐Ÿ”— omf__ I do social media data mining
17:54 ๐Ÿ”— omf__ 129 of the 400 backup disks have appeared to fail
17:56 ๐Ÿ”— illunatic https://www.techdirt.com/articles/20130125/07585121787/german-court-recognizes-that-internet-connection-is-now-indispensable-modern-life.shtml heh
17:56 ๐Ÿ”— omf__ some of that data is proving unrecoverable and since I measure collection time in years this is a shit bag problem.
17:56 ๐Ÿ”— omf__ illunatic, one country down, everyone else left to go
17:57 ๐Ÿ”— Schbirid omf__: harddisks are cheap ;)
17:57 ๐Ÿ”— Schbirid 3tb for 100รขย‚ยฌ, cant beat that with discs
18:00 ๐Ÿ”— omf__ current backup size 9.8 terabytes
18:01 ๐Ÿ”— omf__ and bluray disks are way cheaper, even the quality ones
18:01 ๐Ÿ”— omf__ hard drives it might be
18:01 ๐Ÿ”— omf__ I considered tape as well
18:01 ๐Ÿ”— Smiley blu ray isnt old enough to trust for archiving
18:02 ๐Ÿ”— omf__ They said the same about dvd and 10 years later my first burned dvds are still rock solid
18:02 ๐Ÿ”— omf__ shit it is more than 10
18:02 ๐Ÿ”— omf__ more like 15 now
18:02 ๐Ÿ”— omf__ I am not afraid of media
18:03 ๐Ÿ”— omf__ Schbirid, any specific drives you recommend
18:03 ๐Ÿ”— Smiley lucky you
18:03 ๐Ÿ”— omf__ I tested a ton of shit before I commited
18:03 ๐Ÿ”— Schbirid omf__: any, but 3 redundant or so
18:03 ๐Ÿ”— omf__ I tested every bluray media on the market but was stupid to trust the drive
18:03 ๐Ÿ”— omf__ I normally get seagates with no problems.
18:04 ๐Ÿ”— omf__ Does anyone else test their drives?
18:04 ๐Ÿ”— Smiley optical drives or real drives?
18:04 ๐Ÿ”— omf__ I do a 35 pass dban to flex the drive out and then a multipass badblocks to test every single sector
18:05 ๐Ÿ”— omf__ hard disk drives
18:05 ๐Ÿ”— Schbirid nope, they might fail just because the day felt like an opportunity, so that is worthless imo
18:06 ๐Ÿ”— Smiley its a good start...
18:06 ๐Ÿ”— Smiley but what Schbirid said
18:06 ๐Ÿ”— Smiley redundancy is key.
18:07 ๐Ÿ”— omf__ that and have proper hard drive cooling. I have found that extends drive life quite a bit
18:07 ๐Ÿ”— db48x hmm
18:07 ๐Ÿ”— db48x that report google put out says otherwise
18:07 ๐Ÿ”— omf__ but this backup would only be on to receive updates and then be turned off
18:07 ๐Ÿ”— db48x drive lifetime is weakly anticorrelated with temperature
18:08 ๐Ÿ”— db48x also, most drives that die will do so quickly, so an stress-test is a very good idea
18:08 ๐Ÿ”— db48x make sure you know about the bad ones as soon as possible, then rma them
18:08 ๐Ÿ”— Schbirid interesting!
18:08 ๐Ÿ”— db48x buy a few more than you need to set up your raid, rma the ones that fail the test, then use their replacements as spares for the raid array
18:08 ๐Ÿ”— db48x yea, the temperature thing was surprising
18:09 ๐Ÿ”— db48x there wasn't enough information for them to determine a cause, but the speculation is that the increased vibration from the fans offsets the benefit of improved ventilation
18:10 ๐Ÿ”— Smiley fans..... in a DC?
18:11 ๐Ÿ”— Smiley guess it depends what kind of chassis
18:12 ๐Ÿ”— Smiley now i think about it dell have a lot of fans near the hdd bays
18:12 ๐Ÿ”— omf__ you mean the 2007 report?
18:12 ๐Ÿ”— db48x yea
18:12 ๐Ÿ”— db48x yes, 2007
18:12 ๐Ÿ”— Smiley though google dont have cases?
18:13 ๐Ÿ”— omf__ That shit is already out of date. Remember it was on older drives they ran and they held back all the really good bits
18:13 ๐Ÿ”— omf__ like which brands, models, lifetime ages matched up
18:13 ๐Ÿ”— omf__ I do not even have a drive that old
18:13 ๐Ÿ”— omf__ plus is it repeatable
18:14 ๐Ÿ”— omf__ no one else is really opening the door for us to take a peek and see
18:14 ๐Ÿ”— Smiley samsung drives have failed lots for us....
18:15 ๐Ÿ”— omf__ you would think with an industry this old there would be more information
18:15 ๐Ÿ”— db48x omf__: agreed
18:15 ๐Ÿ”— Smiley such as?
18:15 ๐Ÿ”— omf__ Dell, HP, Apple, google, facebook, etc.. all keep their yaps shut because it helps their bottom line
18:16 ๐Ÿ”— Smiley if you prove the unreliability of one company its a death sentence
18:16 ๐Ÿ”— omf__ like Packard Bell
18:16 ๐Ÿ”— Smiley dell rebrand drives
18:17 ๐Ÿ”— omf__ the upside to the whole hard disk industry is things get bigger in size and faster.
18:18 ๐Ÿ”— db48x BER stays the same though
18:18 ๐Ÿ”— omf__ just imagine showing a SSD drive to people in the 80s
18:18 ๐Ÿ”— db48x heh
18:18 ๐Ÿ”— omf__ yeah the error rate on the drives is not going down
18:18 ๐Ÿ”— omf__ there is a good recent report on that
18:19 ๐Ÿ”— db48x I think we just have to live with that, and move to more reliable software
18:19 ๐Ÿ”— omf__ which is why I agree redundancy is so freaking important
18:19 ๐Ÿ”— db48x ZFS is the way to go, I think
18:19 ๐Ÿ”— omf__ zfs is already old, there is some interesting new stuff coming out of netapp
18:19 ๐Ÿ”— db48x even the linux support is shaping up, thanks to LLNL
18:20 ๐Ÿ”— omf__ if only Oracle was not Oracle
18:20 ๐Ÿ”— db48x indeed
18:22 ๐Ÿ”— omf__ I just want to stop losing my freaking data
18:22 ๐Ÿ”— db48x :)
18:22 ๐Ÿ”— illunatic omf__: yep :D
18:22 ๐Ÿ”— omf__ if it wasn't for the twitter tos I would upload all the twitter data I collected to IA
18:23 ๐Ÿ”— omf__ which is funny since the IA doesn't really have a backup either
18:23 ๐Ÿ”— db48x you could upload a very large file containing random numbers, and then a very small file containing a random number...
18:23 ๐Ÿ”— db48x IA has mirrors
18:24 ๐Ÿ”— omf__ full mirrors? I heard most were partial at best
18:24 ๐Ÿ”— db48x I know the one in Alexandria is partial
18:39 ๐Ÿ”— joepie91 omf__: upload a giant file with random data, search for occurrences of every single tweet in it, and store the positions
18:40 ๐Ÿ”— joepie91 *technically* you're not reproducing the tweets
18:40 ๐Ÿ”— joepie91 just indicating where coincidental copies can be found :)
18:40 ๐Ÿ”— joepie91 (oh man, a judge would probably have a field day with this, haha)
18:40 ๐Ÿ”— Smiley random data? why? just a ascii-16 list of charas ;)
18:41 ๐Ÿ”— joepie91 Smiley: I never specified the source alphabet :P
18:42 ๐Ÿ”— Smiley joepie91: inlcude ALL THE ALPHABETS
18:42 ๐Ÿ”— joepie91 on a different note
18:42 ๐Ÿ”— joepie91 my insertion of the khan academy datasets into a database is going okay
18:42 ๐Ÿ”— joepie91 now that I have a sane mysql lib to work with
18:47 ๐Ÿ”— balrog_ mistym: that thing arrived
18:53 ๐Ÿ”— mistym balrog_: Awesome!
19:20 ๐Ÿ”— SketchCow Whew
21:00 ๐Ÿ”— illunatic nice discussion going on here if anyone is interested https://kat.ph/blog/GreenPirate/
21:04 ๐Ÿ”— illunatic spiderwort
22:19 ๐Ÿ”— godane1 SketchCow: you may have to mirror the g4tv.com videos too
22:20 ๐Ÿ”— godane1 my internet wifi sucks
22:57 ๐Ÿ”— omf__ My memory is slipping. Anyone remember the page for SketchCow's universal file format collection thing. I want to read all the material over before emailing him a question
23:01 ๐Ÿ”— DFJustin http://fileformats.archiveteam.org/
23:02 ๐Ÿ”— SketchCow Boy, I love the idea someone has to do research before asking me something.
23:02 ๐Ÿ”— SketchCow That ensures a quick, speedy reply.
23:10 ๐Ÿ”— godane1 i have a list of the video files
23:11 ๐Ÿ”— godane1 https://archive.org/details/g4tv.com-video-url-list-1
23:12 ๐Ÿ”— godane1 wait thats a old list
23:20 ๐Ÿ”— godane1 i updated that item

irclogger-viewer