#archiveteam 2012-10-13,Sat

↑back Search

Time Nickname Message
00:44 🔗 SketchCow Back.
00:45 🔗 SketchCow underscor: What date did Hank give?
00:51 🔗 SketchCow By the way, I have yet to find a webshots with a CDX.
00:53 🔗 SketchCow And I'm starting to think we should make these items two 25gb files instead of one 50gb, and put them in one item.
01:25 🔗 underscor SketchCow: He said sometime in the next 2 weeks
01:25 🔗 underscor SketchCow: http://archive.org/details/webshots-freeze-frame-20121012103518
01:28 🔗 SketchCow OK, good (2 weeks)
01:29 🔗 SketchCow Brewster was thinking today.
01:30 🔗 SketchCow Well, hooray on that.
01:35 🔗 SketchCow So, help me here.
01:35 🔗 SketchCow Is there a new, improved megawarc program?
01:39 🔗 a35u is there a way to do more than 6 items at once?
01:42 🔗 SketchCow Because I can do another proust rip from the directory.
02:43 🔗 underscor SketchCow: Yes
02:43 🔗 underscor Pull from the repo
02:48 🔗 SketchCow Did
02:48 🔗 SketchCow And I'm uploading a new item
02:48 🔗 SketchCow After generating a new warc
02:48 🔗 SketchCow We'll see!
02:55 🔗 underscor SketchCow: Schweet!
02:55 🔗 underscor :D
03:42 🔗 SketchCow Converting the remainder of the webshots uploads people sent to fos.
03:42 🔗 SketchCow Might as well get in on that, right
03:43 🔗 SketchCow I see it's notably more anal about the warcs.
08:50 🔗 godane http://jpfau.github.com/gbajs/
08:50 🔗 godane a java emulator of game boy advance
09:16 🔗 alard What's this: http://www.us.archive.org/log_show.php?task_id=127850584 ?
13:54 🔗 SketchCow Damn, we have a timeout issue.
14:08 🔗 SketchCow Oh, I see they know of it, and will work on it.
14:08 🔗 SketchCow Great. Here's hoping.
14:27 🔗 underscor Yup!
14:27 🔗 underscor SketchCow: Validity seems good consistently now though
14:27 🔗 underscor which is good news :D
14:31 🔗 godane i wish linux format had full pdfs of all the old magazines
14:31 🔗 godane the russian version does
14:31 🔗 godane the russian only from 70 to 141
16:30 🔗 alard SketchCow: Would it be possible to reopen the webshotz rsync for a while? Or would that cause you a lot of trouble?
16:30 🔗 alard There are a few warriors that are stuck trying to upload their current items to FOS. They'll upgrade once they've done that, but for now they're stuck.
16:31 🔗 alard It's a bit hard to see, but I think there are about five warriors (set to "auto" or "webshots") that we could win back.
18:33 🔗 no2pencil Happy weekend, archivers!
18:46 🔗 chronomex \o/
18:48 🔗 SmileyG \o/
18:48 🔗 S[h]O[r]T \o/
21:46 🔗 nertzy hey, new warrior user here, and i noticed that before it was using RsyncUpload to do web shots and was working, but now it's using CurlUpload and always seems to stall out, pause for 30 seconds, and then resume itself, over and over
21:46 🔗 alard nertzy: Hi, welcome. Does it still do that now?
21:46 🔗 underscor ls
21:46 🔗 underscor oops
21:46 🔗 alard We had some problems with the upload servers (the disk was full...).
21:47 🔗 nertzy ah
21:47 🔗 nertzy yes it still is doing it
21:47 🔗 alard But that is being fixed now, so as long as it's retrying it should soon work.
21:47 🔗 alard Does it give you an upload server?
21:47 🔗 nertzy I rebooted around noon because I saw the conversation in here and my rsync upload was stalled
21:48 🔗 nertzy i can copy/paste the log for one of the items if that's useful
21:48 🔗 alard Well, rsync is another problem. That was our previous upload system, we filled that. We're now using the curl upload to different servers.
21:48 🔗 nertzy or is there a better way? it's a bit tough to copy/paste it through the web interface
21:50 🔗 alard Well, I think that as long as it's retrying the curl upload it's worth waiting a bit.
21:50 🔗 alard The full log isn't that useful. When curl fails, there should be a line "Upload server: btdownload..." somewhere.
21:51 🔗 nertzy how long should it be between retries? I haven't seen one for quite a while
21:51 🔗 alard 30 seconds.
21:51 🔗 nertzy well, i mean, how long does curl go with 0 bytes/second before it fails and then decides to retry...
21:52 🔗 alard Ah, well, that depends a little bit on your version, which you can't see. If you have an early version (you probably do) it won't fail.
21:52 🔗 alard You can kill them, but there are a few steps:
21:53 🔗 alard Are you familiar with virtualbox and linux?
21:53 🔗 nertzy yes
21:53 🔗 underscor alard: it (should) fail over, hopefully now
21:53 🔗 underscor I sigkilled the nginxs on the affected hosts
21:53 🔗 underscor and it seemed to do behave correctly
21:53 🔗 alard Ah, well, let's see. nertzy: they should fail now.
21:54 🔗 nertzy ok so it was probably holding open a connection for a long time then?
21:54 🔗 nertzy it hasn't failed yet, i'm watching
21:54 🔗 alard Yes. curl doesn't give up easily.
21:54 🔗 nertzy ok i'll keep an eye on it and check back later
21:55 🔗 underscor ls
21:55 🔗 underscor dammit, I keep doing that
21:55 🔗 nertzy ha
21:56 🔗 nertzy btw, i have always loved Archive Team, and I was inspired to join because Gowalla went down and offered me no way to get my data, but their CTO gave me false hope around the time they shut down
21:56 🔗 underscor nertzy: Glad to have you aboard! <3
21:57 🔗 alard nertzy: If it doesn't work (but I really hope it does, so let's wait for a while) there's a way to kill the curls. Click in your warrior. Press Alt+F3 to get a login prompt. Log in as root. killall curl
21:57 🔗 nertzy https://twitter.com/nertzy/status/255009776004657153
21:57 🔗 nertzy alard: ok i'll give it a few mins first
21:58 🔗 underscor hm, is gowalla basically like 4sq?
21:58 🔗 underscor s/is/was/
21:58 🔗 nertzy vs this statement several months ago https://twitter.com/nertzy/statuses/178896851364356096
21:58 🔗 SmileyG tell him to foad
21:58 🔗 nertzy yeah, it came out around the same time, then was snatched up by Facebook a year ago
21:58 🔗 SmileyG iaf
22:02 🔗 underscor I can already think of so many uses for that
22:02 🔗 underscor http://bigtextbox.com/ :o
22:02 🔗 underscor note*
22:02 🔗 underscor where I would fire up word and leave a big not onscreen
22:02 🔗 underscor :D
22:02 🔗 underscor _awesome_
22:02 🔗 nertzy haha cool thanks
22:02 🔗 nertzy we use it a ton at my job
22:02 🔗 nertzy we do remote pair programming sometimes, so it's useful to throw up on the screen if you want to tell the other guy something and he's off to lunch and you have to run
22:02 🔗 underscor definitely!
22:03 🔗 nertzy then my coworker made http://smalltextbox.com for pasting large things, and by complete coincidence released it exactly a year to the day later than mine
22:03 🔗 underscor hahaha
22:07 🔗 SmileyG I don't get it o_O
22:18 🔗 closure http://sm.nomeata.de/
22:19 🔗 closure I prefer the standalone version of sm to the website, but I see he got the changing font to work in javascript too
22:19 🔗 closure my 4 year old grand-neice loves this
22:40 🔗 chronomex I can imagine ;)
22:43 🔗 closure http://git-annex.branchable.com/bugs/gix-annex_help_is_homicidal/
22:43 🔗 closure my program is channeling sketchcow
22:46 🔗 chronomex hahaha

irclogger-viewer