#archiveteam-bs 2012-07-13,Fri

↑back Search

Time Nickname Message
00:05 🔗 underscor http://imgur.com/gallery/qleuW
00:05 🔗 arkhive Schbirid: How did you set up your server to help AT? And how much are you paying a month?
00:06 🔗 arkhive Schbirid: the server you mentioned earlier with 100Mb connection. I'm interested in getting one...if the price is right.
04:59 🔗 Coderjoe arkhive: btw, Schbirid had been gone for 2.30 hours prior to you attempting to ask the question
05:00 🔗 Coderjoe er, 3.30 hours
07:10 🔗 arkhive oh
07:10 🔗 arkhive do you know about using servers for AT andthe costs
07:11 🔗 arkhive and i'm going to bed. it's 1:11am here
07:11 🔗 arkhive but let me know.. i'm leaving irc on. night
07:24 🔗 ersi arkhive: afaik schbirid has a free server from a OVH campaign
07:34 🔗 GLaDOS Multiple free servers, I think.
13:57 🔗 Schbirid i think ovh has servers available again right now ovh.com/bhs
14:02 🔗 Schbirid oops, i had one laying around for 3 weeks unused
14:03 🔗 Coderjoe check the sofa cushions!
14:05 🔗 Schbirid time to slap tor on it just to make it useful
14:14 🔗 Coderjoe Schbirid: by the way, what format are those archives you wanted to serve from a compressed/deduped setup?
14:15 🔗 Schbirid html files in many directories
14:15 🔗 Schbirid oh
14:15 🔗 Schbirid i would use anything
14:15 🔗 Schbirid tar.gz seems alright
14:15 🔗 Coderjoe what are they currently?
14:15 🔗 Schbirid dunno if i put them into 7z yet
14:15 🔗 Schbirid i have them as many seperated 7z files though
14:15 🔗 Coderjoe 7z would be terrible for CPU usage when serving them out
14:16 🔗 Schbirid yeah
14:16 🔗 Coderjoe you have to decide on the tradeoff between compression ratio and CPU usage to access a file from within
14:17 🔗 Coderjoe I suppose 7z wouldn't be too bad if it weren't solid, but then you aren't much better off than a zip file for compression ratio
14:18 🔗 Schbirid the targz is 15G which is alright with me
14:18 🔗 Schbirid havent tried zip iirc
14:18 🔗 Coderjoe care to see what tar.bz2 does?
14:19 🔗 Schbirid well, serving the tar.gz with avfs and google bot accessing pages every few minutes already used all cpu (load of ~5)
14:19 🔗 Schbirid or would bz2 be better to uncompress?
14:19 🔗 Coderjoe loadavg is not indicitive of cpu usage
14:20 🔗 Coderjoe bz2 is split into discrete blocks, which would make random access easier (if you had the code in place to do random access)
14:21 🔗 Coderjoe whereas, while gz can have multiple blocks, it isn't required, and backreferences can be made across a block boundary
14:24 🔗 Coderjoe (so you would have to index the location of the start of each block in the compressed file, the location in the uncompressed stream, and the state of the window, or as much as is needed based on scanning the data)
14:24 🔗 Coderjoe (bz2 could do random access with a minimum of compressed block start offset and uncompressed stream offset)
14:30 🔗 Schbirid nice, i will try it
14:32 🔗 Coderjoe unfortunately, I am not aware of any existing software that really allows such random access
15:11 🔗 SmileyG hmmm winr4r :O
15:15 🔗 Schbirid oh
15:21 🔗 Schbirid oh nice, my robots.txt files 7z finished. 300MB :)
15:36 🔗 Schbirid avfs says it does
15:36 🔗 Schbirid access to the uncompressed files without caching to whole file.
15:36 🔗 Schbirid o Indexing of gzip and bzip2 files. This achieves fast random
15:38 🔗 godane uploading episode 30 of GBTV
15:38 🔗 godane :-D
15:38 🔗 godane i almost have you guys up to november 2011 with this
15:39 🔗 godane just know the earlyer copys was re-encoded to be at 800mb
15:54 🔗 winr4r SmileyG: hmm?
15:56 🔗 winr4r oh, the £414 battery pack? that is hilarious
15:57 🔗 SmileyG yah
15:57 🔗 SmileyG is that serious price?
15:59 🔗 winr4r SmileyG: well, the same seller has lots of nikon batteries, listed at not-totally-insane prices
16:00 🔗 winr4r but then they have D1 batteries listed at *fucking insane* prices
16:00 🔗 winr4r i just ordered one from another seller, for £14
16:01 🔗 SmileyG D:
16:01 🔗 SmileyG Weird.
16:02 🔗 winr4r maybe they're cashing in on the ebaying-so-drunk-they-read-£414-as-£14 market
16:09 🔗 SmileyG AAAAArugh
16:09 🔗 * SmileyG just crashed vbox twice in a row freezing his system
16:09 🔗 winr4r p.s. don't drink and ebay, there's people willing to take advantage of you
16:09 🔗 winr4r SmileyG: :<
16:09 🔗 winr4r what happens if you crash it twice in a row, rather than once?
16:10 🔗 SmileyG world ends.;
16:12 🔗 winr4r oh, you meant you crashed your system twice
16:12 🔗 winr4r never mind
16:39 🔗 Coderjoe more on the passwords that were leaked the other day: http://boingboing.net/2012/07/12/crummy-passwords-from-yahoo-us.html
16:40 🔗 Schbirid direct link http://pastebin.com/2D6bHGTa
16:41 🔗 Schbirid loweralpha: 146486 (33.08%)
16:41 🔗 Schbirid damn
16:42 🔗 Schbirid ncie tool http://www.digininja.org/projects/pipal.php
16:59 🔗 Schbirid ~200 of the alexa top 10000 domains disallow / for ia_archiver
17:04 🔗 Schbirid how do i make an easy bash for loop over a-z?
17:06 🔗 Schbirid bash rules so much
17:06 🔗 Schbirid {a..z}
17:07 🔗 winr4r yes it does
17:07 🔗 yipdw except where its syntax is shit
17:07 🔗 winr4r i thought it was [a-z] though
17:09 🔗 yipdw [ evaluates tests, so it can't be [
17:09 🔗 yipdw (case in point, heh)
17:10 🔗 yipdw that said, if you write e.g. for i in [a-z]; do echo $i; done
17:10 🔗 yipdw depending on your version and environment you WILL get something that starts out like a loop
17:10 🔗 yipdw but it will not behave the way you expect:
17:10 🔗 yipdw well, just try it if you're on bash 3.2.48
17:10 🔗 yipdw I don't know what the fuck it does on 3.2.minorrevisionup
17:10 🔗 yipdw much less 4
17:11 🔗 winr4r [ with a space after it evaluates tests
17:11 🔗 yipdw then I don't know what [a-z] is actually doing
17:11 🔗 Coderjoe [ is an alias/link to the "test" command
17:12 🔗 winr4r go to your home directory, do "ls [a-c]*"
17:12 🔗 yipdw oh, it's a range
17:12 🔗 winr4r then go tell me how wrong i am about it
17:12 🔗 yipdw in pathname expansion
17:12 🔗 yipdw but not in for loops
17:12 🔗 yipdw ok
17:12 🔗 yipdw so it's a range in a different context
17:12 🔗 yipdw QED :P
17:12 🔗 yipdw bash sucks so much
17:13 🔗 winr4r yipdw: yes it does
17:13 🔗 winr4r yipdw: it made us argue about stupid shit
17:13 🔗 winr4r it's like that asshole who goes to a party and starts fights between people who would otherwise be friends, "hey did you hear what he just said?"
17:14 🔗 winr4r i mean that guy SUCKS
17:14 🔗 Schbirid bash is fantastic for quick hacky
17:15 🔗 yipdw I guess
17:39 🔗 underscor bash is fantastic as a command interpreter
17:46 🔗 yipdw I'd say it's about as good as Marcus Brutus
17:46 🔗 yipdw it's pretty good until it stabs you in the back
17:47 🔗 yipdw and it has a bunch of hidden state
17:47 🔗 yipdw (if someone can clarify /etc/bashrc vs. ~/.bashrc vs. /etc/profile.d vs. ~/.bash_profile for me that'd be pretty cool -- I keep forgetting what does which and when)
17:48 🔗 yipdw also, I don't hate bash
17:48 🔗 Schbirid well, the ~ ones are user specific
17:49 🔗 yipdw I keep forgetting which apply to interactive vs. non-interactive shells
17:49 🔗 yipdw and it doesn't seem to be consistent across systems anyway
17:49 🔗 yipdw Ubuntu uses bash_profile for interactive shells, I think
17:49 🔗 yipdw I'm not sure if CentOS does
17:50 🔗 yipdw maybe it does
17:50 🔗 yipdw I know one recommendation is that you just source one from the other
17:50 🔗 yipdw which seems to be an admittance of "hey guys we may have done fucked this up a bit"
17:51 🔗 * yipdw shrugs
17:51 🔗 yipdw I've been fixing bash-related crap for a couple weeks, so I'm probably just venting
17:51 🔗 Schbirid i did that minutes ago :P
18:49 🔗 winr4r yipdw: if you find yourself doing that, it's probably best to write in python or perl
19:00 🔗 winr4r by "python or perl" i mean "something that isn't bash"
19:05 🔗 Schbirid i wish the software world would move to python3 alltogether already
19:06 🔗 mistym yipdw: http://www.joshstaiger.org/archives/2005/07/bash_profile_vs.html - best short explanation I've seen
19:07 🔗 winr4r Schbirid: meh
19:07 🔗 winr4r not really all that much reason to do so
19:09 🔗 Schbirid i love this story so much http://www.untoldentertainment.com/blog/2011/03/05/holding-the-bag-how-i-gamed-gdcs-top-social-game-developers/
19:42 🔗 godane hey everyone
19:42 🔗 godane uploading more GBTV
19:43 🔗 godane this is guy is BIG data
19:43 🔗 godane with 4 to 5gb of week of shows it takes alot of time to upload
19:48 🔗 winr4r awesome
23:08 🔗 Coderjoe and the vuln is supposedly fixed: http://www.theregister.co.uk/2012/07/13/yahoo_fixes_password_hole/

irclogger-viewer