#archiveteam 2012-11-01,Thu

↑back Search

Time Nickname Message
02:46 🔗 instence_ I'm setting up slack in vmware, obviously for archiving. Would reiser be a better option than ext4?
02:47 🔗 instence_ due to smaller files, and number of files
02:50 🔗 chronomex for large files it usually doesn't matter
02:50 🔗 chronomex reiser tends to win at many teeny files
02:54 🔗 instence_ yea this is going to be for website archiving specifically, so I guess I will go with reiser
02:54 🔗 instence_ I wasn't aware ext3 had a files/folder limitation of 5,000 without htrees
02:55 🔗 instence_ Have been reading this overview guide, which is great:
02:55 🔗 instence_ http://www.serverfocus.org/reiserfs-vs-ext4-vs-xfs-vs-zfs-vs-btrfs
02:55 🔗 chronomex I usually build my boxes with jfs
02:55 🔗 chronomex solid as a rock, not fancy performance but it's consistent
02:56 🔗 instence_ ah, cool, yea slack supports it
02:58 🔗 instence_ I used to do website archiving in windows, and for the past year or more a lot of the tasks on my plate have been non-recurssive in nature. Static targetted grabs.
02:58 🔗 instence_ However with windows wget being stuck on 1.11.4, without css parsing, I have to get something setup in linux to take advantage of newer wget builds
02:59 🔗 instence_ There have been "experimental" wget builds of newer versions but I don't trust them
03:00 🔗 instence_ I think I will test out reiser for now, and keep IBM's jfs in mind for a future test run
03:01 🔗 chronomex jfs has never let me down
03:01 🔗 chronomex reiser has weirded on me once, but I was not treating it nicely
03:01 🔗 chronomex zfs totally fucked me over
03:02 🔗 chronomex ext4 hasn't weirded on me but its performance isn't great
03:02 🔗 instence_ if I run into any issues with reiser, i will switch to jfs
03:03 🔗 instence_ what are some things to watch out for with reiser shitting the bed?
03:04 🔗 instence_ I'm basically going to be doing a process of archive a single site, tar it, pulling it down from FTP over local network to another box for link checking and post processing.
03:04 🔗 SketchCow ....kills your wife
03:04 🔗 instence_ lol
03:04 🔗 chronomex I never had actual reportable shit with reiser
03:04 🔗 chronomex it was just a bit tricky to manage
03:04 🔗 chronomex iirc
03:04 🔗 chronomex this was years ago and I was in high school
03:04 🔗 instence_ ah
03:22 🔗 Aranje If you figure smaller files and large numbers of files, probably. Does it matter? not really.
03:22 🔗 Aranje cause the latest 3.x's have data loss issues. issue boiled up in ext4 that hasn't been fixed yet
03:22 🔗 Aranje literally. the issue is triggered when the ext4 journal isn't written out on reboot or something.
03:22 🔗 Aranje not an issue if you don't reboot every 10 seconds
03:22 🔗 Aranje though... what kernel?
03:22 🔗 Aranje seems legit
03:22 🔗 Aranje chronomex:) what issues did you have with zfs?
03:23 🔗 chronomex zfs-fuse transmuted a large number of symlinks, but not all of them, into regular files with size 0 and permissions 0000
03:31 🔗 Aranje I uh what
03:31 🔗 Aranje yeah that sucks
03:31 🔗 Aranje we use zfs on our fbsd servers
03:31 🔗 Aranje cause it does something Sue likes
06:30 🔗 ersi haha, website archiving from windows
06:43 🔗 Sue use the native zfs module instead
06:43 🔗 Sue it's much more stable
06:44 🔗 Sue haven't checked it in a while, dedup w/ large pages and snapshots hopefully have been added
08:59 🔗 SmileyG zfs on linux chronomex ?
08:59 🔗 SmileyG Oh, zfs-fuse
09:48 🔗 Frigolit SmileyG: there's a kernel patch for ZFS as well
09:48 🔗 SmileyG Frigolit: I know.
09:48 🔗 SmileyG I know the guy whos doing it :D
09:48 🔗 Frigolit ah :3
09:48 🔗 SmileyG Thats why I was asking, hes doing quite well tbh (I do love to rib him over it as he proper evangalises over ZFS)
09:48 🔗 Frigolit hehe
09:49 🔗 SmileyG He's in NY tho, he lost power on his ipad after the storm and hasn't yet reappeared. I'm pretty sure he's fine though
09:49 🔗 Frigolit :|
09:49 🔗 Frigolit yea let's hope so
09:49 🔗 SmileyG I do wonder about americas infrastructure tho
09:50 🔗 SmileyG Does seem so very fragile.
09:50 🔗 Frigolit indeed
09:50 🔗 Frigolit speaking of zfs though, i'm not sure i'd use in-kernel zfs either at this point, seems about as stable as america's infrastructure
09:51 🔗 Frigolit for now i'd rather go for fbsd
09:51 🔗 Frigolit could go for solaris but... no... NO!
09:59 🔗 SketchCow Is this -bs?
09:59 🔗 Frigolit it is not!
09:59 🔗 * Frigolit walks over there
10:00 🔗 SketchCow I'll answer this one thing, though.
10:00 🔗 SketchCow America's infrastructure: Not Fragile
10:00 🔗 SketchCow The issue is:
10:00 🔗 SketchCow America's Infrastructure - We're a huge-ass fucking country
10:00 🔗 SmileyG Well yeah that too
10:00 🔗 Frigolit true
10:01 🔗 SmileyG I think I suddenly realised what happens
10:01 🔗 SmileyG due to being a realtively young country.
10:02 🔗 SmileyG Do you ever demolish stuff over there? Like "en mass" ?
10:02 🔗 Frigolit less OT, anyone knows how well btrfs works? i'm trying to figure out the best setup for a future fileserver
10:02 🔗 * SmileyG goes to -bs
20:05 🔗 SketchCow ---------------------------------------------
20:05 🔗 SketchCow So, we're looking at doing an Archive Team Kickstarter
20:06 🔗 SketchCow Would love suggestions for rewards
20:06 🔗 SketchCow ---------------------------------------------
20:06 🔗 mistym Ooh. I need to try to think of smth
20:15 🔗 deathy what's the goal of the kickstarter?
20:15 🔗 deathy also..
20:15 🔗 deathy Jason's hat
20:15 🔗 deathy hat that looks like Jason's hat
20:16 🔗 deathy old HDDs used for important projects (like WOW server auction :) )
20:18 🔗 mistym That's a good idea.
20:18 🔗 mistym Some high reward tier should be the obligatory "archive team dinner" with SketchCow, etc.
20:29 🔗 DFJustin http://archiveteam.org/index.php?title=Kickstarter_Prizes
20:54 🔗 SketchCow Thanks for reminding me of that, DF
21:05 🔗 flaushy SketchCow: pins :)
21:06 🔗 soultcer Will this be a real kickstarter at kickstarter.com?
21:06 🔗 flaushy is the logo from the wiki the "official" archiveteam logo?
21:08 🔗 alard Expert archiving by the Archive Team of a website of your choice?
21:11 🔗 mistym flaushy: It ought to be.
21:11 🔗 mistym I'd stick a high-res poster of that on my office wall.
21:13 🔗 mistym Though I'd probably be forced to cover up the right-hand corner with another poster or smth
22:03 🔗 Dark_Star I don't get it. Kickstarter? what for?
22:21 🔗 Coderjoe Dark_Star: we put a lot of stuff up on archive.org, and they don't run on happy thoughts and fairy dust.
22:44 🔗 SketchCow This willbe a real kickstarter.
22:53 🔗 soultcer Nice
22:57 🔗 bsmith094 SketchCow: what is that pic on twitter?
22:57 🔗 bsmith094 http://t.co/z0c62yMF
23:19 🔗 SketchCow My editing box.
23:19 🔗 SketchCow The one I'm on now (although all my IRC is through a different server)

irclogger-viewer