#archiveteam 2012-04-07,Sat

↑back Search

Time Nickname Message
00:02 🔗 oli 100mbpt
00:02 🔗 oli but had 2 or 3 systems going at various times
00:02 🔗 oli right now 3 at a time
00:02 🔗 oli so about 300mbit :P
00:05 🔗 Wyatt|Wor Aah, I see. Still that's some really good throughput. I've been getting...looks like about 500GB/week with my 100Mbit connection.
00:07 🔗 oli not running 24/7 ?
00:47 🔗 Wyatt|Wor No, running pretty much 24/7 with three clients.
01:02 🔗 Coderjoe spending a lot of time waiting for wget to figure out what it wants to do
01:03 🔗 AdamCaudi I really should invest in a faster vps for memac...
01:11 🔗 oli yes overtook Coderjoe :D
01:11 🔗 oli and hi underscor
01:11 🔗 oli underscor: check status board,
01:11 🔗 oli 810GB here in 48 hours or something :p
01:11 🔗 Coderjoe bastard. :P
01:11 🔗 oli ahah
01:11 🔗 Coderjoe woo
01:12 🔗 oli i ordered another dedicated box but that prob wont be deployed till monday
01:12 🔗 oli or tuesday if people are on holidays then i guess :(
01:12 🔗 Coderjoe just a little too much capsaicin in that sub
01:12 🔗 oli haha
01:12 🔗 underscor hahaha
01:13 🔗 oli btw for those running their own servers: EasterBunny2012
01:13 🔗 oli use that promocode with pingdom
01:13 🔗 oli free business account for a year
01:14 🔗 oli oh wait, appears it might be over :(
01:14 🔗 Coderjoe bah
01:14 🔗 Coderjoe freeze warning from the NWS
01:14 🔗 oli NWS?
01:15 🔗 Coderjoe national weather service
02:03 🔗 DoubleJ Jeez. At this rate I'll be lucky to stay in the top ten.
02:35 🔗 yipdw FYI, we're up and running in #fanfriction
04:42 🔗 underscor I'M EIGHTEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEN
04:42 🔗 underscor :D
04:42 🔗 zgrant Many Happy Returns! Now get out there and vote.
04:43 🔗 zgrant Also, Alice Coppers, "I"m 18", just sprang into my head. I'm much too old.
04:44 🔗 underscor hahah
04:44 🔗 underscor :D
05:25 🔗 Wyatt|Wor If I kill one of these curl processes that's stuck in the giant retry loop, what happens?
05:49 🔗 shaqfu underscor: 'grats; now go enlist :D
05:49 🔗 shaqfu (kidding!)
05:50 🔗 underscor haha
05:50 🔗 underscor thanks
05:51 🔗 chronomex shaqfu: no, it's a federal law that you have to ...
05:51 🔗 shaqfu chronomex: For the draft, yeah
05:51 🔗 chronomex yus
05:51 🔗 shaqfu (don't get me started on the draft...)
05:51 🔗 chronomex <3
05:52 🔗 shaqfu I think I'm the one person on the planet in favor of it
05:54 🔗 shaqfu Oh, you can also own guns now! Depending on jurisdiction
06:49 🔗 Coderjoe Wyatt|Wor: i think that the file(s) it is trying to upload never get uploaded and potentially marked as complete anyway
06:51 🔗 Wyatt|Wor Ah. Because I've had it happen once before that it went through a hundred failures and then, as far as I could tell, after that it started a new curl process that worked fine on the first try.
06:51 🔗 Wyatt|Wor Was it just a coincidence?
06:51 🔗 Coderjoe alard would be able to tell you for certain
07:18 🔗 Wyatt|Wor Are you still getting 503? Are we just hitting IA too hard?
07:18 🔗 Coderjoe i'm not using s3
07:18 🔗 Wyatt|Wor Ah
07:19 🔗 Coderjoe http://archive.org/catalog.php?history=1&identifier=archiveteam-mobileme-hero-444x
07:19 🔗 Coderjoe the queue on that has dissipated, though
07:19 🔗 Coderjoe still lists the "server readonly" item, though
07:23 🔗 Wyatt|Wor Ah, I see, looks like I've got a job over here: http://archive.org/catalog.php?history=1&identifier=archiveteam-mobileme-hero-480x
07:24 🔗 Wyatt|Wor I suppose it just got backed up.
09:41 🔗 nitro2k01 In case anyone wants to help the world by reporting spam... http://www.youtube.com/watch?v=7NdGGU19M1M
11:05 🔗 oli yes
11:05 🔗 oli made it into top 10
11:05 🔗 oli lol
11:40 🔗 oli wolkommen Woet
11:41 🔗 Woet hello
11:41 🔗 oli :D
11:56 🔗 oli nice to have woet on board
11:57 🔗 oli he is smasshing it
12:02 🔗 Woet http://memac.heroku.com/
12:02 🔗 Woet am I doing it right?
12:03 🔗 emijrp is there any documentation for doing trackers?
12:09 🔗 oli woet yes you are :D
12:16 🔗 alard emijrp: Doing trackers?
12:16 🔗 emijrp that app Woet linked
12:17 🔗 Woet emijrp: http://www.archiveteam.org/index.php?title=MobileMe
12:19 🔗 alard emijrp: This one? https://github.com/ArchiveTeam/universal-tracker
12:20 🔗 emijrp maybe
12:21 🔗 alard Well, that's what memac, focity, splinder are running on. And the new fanfiction tracker.
12:23 🔗 emijrp can it run in any server?
12:23 🔗 alard Yes, if you can run a Ruby rack application.
12:24 🔗 alard The live updates use node.js. The whole thing needs Redis.
12:24 🔗 emijrp we need that thing in #wikiteam who can help?
12:25 🔗 alard I could help you with the configuration.
13:18 🔗 SketchCow I didn't run anything on Fortress for a day.
13:18 🔗 SketchCow Within that say, 51% of the drive with mobileme sets filled.
13:18 🔗 SketchCow So that... that's a party.
13:20 🔗 SketchCow Actually, I forgot Fortunecity is on there.
13:20 🔗 SketchCow That's the next question - curating Fortunecity.
13:22 🔗 oli how're you SketchCow ?
13:23 🔗 SketchCow They gotta put a valve on my sexy so it doesn't explode
13:26 🔗 oli neat
13:42 🔗 godane i found some good things when mirror pdfs from cpu magazine
13:43 🔗 godane 1. 2012 and 2011 pdf torrents maybe from cpu magazine
13:43 🔗 godane same md5sum on may 2012
13:43 🔗 godane and one from 2011
13:45 🔗 godane 2. cpu magazine website hosts 5 magazines
13:46 🔗 godane comsumer electronics tips, first glimpse, pc today, smart computing, and refernce series
13:46 🔗 godane *reference series
13:57 🔗 SketchCow Boy, I wish instead of discussing ways to improve access to at-risk digital works and coming up with ways to spread the message on the need to back things up, this was a 24-hour anaemic version of #bookwarez
14:05 🔗 SketchCow Also fun: I think we're breaking archive.org's s3
14:05 🔗 SketchCow I ALMOST, but did not delete 2tb of uploaded files that were not actually uploaded
14:06 🔗 SketchCow Which means I get to add a brand new step in uploading, where I later run a script that checks to see if a file exists on the server, the final one, and THEN deletes.
14:06 🔗 godane shouldn't use some sort of snapshot file system
14:07 🔗 SketchCow Try that again using sparkling, clear english.
14:07 🔗 godane something like zfs
14:07 🔗 godane it has snapshot support i think
14:08 🔗 SketchCow Were you trying to say "Shouldn't you use some sort of snapshot file system?"
14:08 🔗 SketchCow Or were you saying "You shouldn't use some sort of snapshot file system?"
14:08 🔗 SketchCow Or "You shouldn't use a snapshot file system!"
14:08 🔗 godane i mean should have
14:10 🔗 alard Isn't it enough to check the result of the curl upload?
14:10 🔗 SketchCow No.
14:10 🔗 SketchCow No, no it's not.
14:11 🔗 alard It can still go wrong if it says 200 - thanks for your upload?
14:11 🔗 SketchCow YEs.
14:11 🔗 alard That's awkward.
14:11 🔗 SketchCow Rarely, but yes.
14:12 🔗 SketchCow Like, enough for me to want to add that extra step, that last verification.
14:16 🔗 SketchCow And on top of that, a number of failures on the hardware side.
14:16 🔗 SketchCow Just where I want to get on top of that, we have so much data coming in now.
14:36 🔗 oli blame Woet if he breaks it
14:36 🔗 oli he has a few gbits going to it now i think, lol
14:37 🔗 oli overtook db48x :D
14:46 🔗 emijrp #WikiTeam needs more volunteers to download 10,000 wikis. TaskForce http://code.google.com/p/wikiteam/wiki/TaskForce
14:48 🔗 balrog_ph How is URLTeam coming along?
15:16 🔗 underscor We didn't really break s3, IA is having network issues
15:16 🔗 underscor and large packet loss between the s3 headends and the datanodes
15:16 🔗 frame_at ok, thanks for the update
15:16 🔗 underscor so s3 backed up and caused "issues"
15:17 🔗 underscor (they're working on it)
15:36 🔗 oli almost 100TB of memac done :D
17:08 🔗 shaqfu Where can I find the Wikileaks cables set? TPB doesn't seem to have it
17:09 🔗 shaqfu (probably putting myself on all sorts of watchlists asking...)
17:58 🔗 godane hey everyone
17:59 🔗 godane how do you guys get past a robot?
18:03 🔗 Schbirid i usually turn on RADAR ransparency
18:03 🔗 Schbirid *T
18:06 🔗 chronomex pull the circuit breakers
19:20 🔗 DFJustin shaqfu: http://archive.org/details/wikileaks-cables-csv
19:58 🔗 Schbirid http://www.facebook.com/photo.php?pid=11709588&l=e63df9b592&id=517581288&_fb_noscript=1
19:58 🔗 Schbirid godane: if you want a real answer, ask a better question ;)
20:03 🔗 kennethre mmm, the smell of pipes being flooded with data
20:08 🔗 shaqfu DFJustin: Thanks
20:08 🔗 shaqfu Need to research work
20:45 🔗 DFJustin http://arstechnica.com/gaming/news/2012/04/what-ever-happened-to-the-american-arcade.ars
20:53 🔗 shaqfu Demographics, cost, taste
20:53 🔗 Soojin it died already back in 1985 or so
21:07 🔗 godane Schbirid: i'm trying to get a lot at files on computerpoweruser.com
21:08 🔗 godane but articles/pdfmagazine path is blocked
21:08 🔗 godane in robots.txt
21:08 🔗 godane i can download files once i know the name of it
21:09 🔗 godane but i don't know if i'm missing anything in there
21:11 🔗 kennethre you know i've never understood the point of robots.txt outside of seo
21:13 🔗 emijrp godane: what are you using, wget?
21:14 🔗 godane i tryed wget
21:14 🔗 godane the -e robots=off doesn't work
21:14 🔗 godane i'm also getting 403 error
21:15 🔗 godane *403 forbidden error
21:16 🔗 chronomex try changing your user agent
21:16 🔗 chronomex "eat delicious poop" is a popular one
21:16 🔗 chronomex or for greater transparency
21:16 🔗 chronomex "archiveteam/from_the_future"
21:17 🔗 godane still 403 error
21:17 🔗 chronomex hrm
21:17 🔗 chronomex do you need to send a referer?
21:18 🔗 godane yes
21:19 🔗 godane i use --referer and it did nothing
21:23 🔗 godane wget: unable to resolve host address 'www.computerpowermagazine.com'
21:33 🔗 oli 23:33:37 up 1 day, 10:44, 28 users, load average: 20.67, 17.40, 13.79
21:33 🔗 oli :(
21:42 🔗 oli lol one of my wget threads
21:42 🔗 oli went nuts
21:42 🔗 oli and ate 22GB of RAM :(
21:43 🔗 emijrp wget sucks sometimes
21:49 🔗 chronomex wget sucks ram :)
22:08 🔗 Schbirid godane: example url?
22:09 🔗 godane www.computerpoweruser.com/articles/pdfmagazine/
22:11 🔗 Schbirid what would be a referrer?
22:11 🔗 Schbirid and what are the filenames?
22:12 🔗 godane add good/cpu_0406.pdf
22:13 🔗 godane you will get june 2004 pdf of cpu magazine
22:13 🔗 Schbirid ok, i am downloading it just fine
22:13 🔗 godane its fine all the names thats the problem
22:13 🔗 godane cause some have weird names
22:15 🔗 Schbirid do you know those names?
22:15 🔗 godane not really
22:16 🔗 godane i have seen some with R___0803.pdf on smart computing site
22:16 🔗 Schbirid some https://encrypted.google.com/search?q=site%3Awww.computerpoweruser.com+inurl%3Apdfmagazine+inurl%3Agood&btnG=Search&hl=en&gbv=1&prmd=imvns&filter=0
22:16 🔗 godane oh
22:17 🔗 godane never did that before
22:17 🔗 Schbirid :)
22:17 🔗 godane its still not every url
22:19 🔗 godane smart computing is worser then cpu magazine
22:20 🔗 godane it disables everything in the url root
22:20 🔗 godane good news is i got all pdfs that i could get
22:23 🔗 Schbirid :)
22:23 🔗 Schbirid good night

irclogger-viewer