Time |
Nickname |
Message |
02:46
🔗
|
instence_ |
I'm setting up slack in vmware, obviously for archiving. Would reiser be a better option than ext4? |
02:47
🔗
|
instence_ |
due to smaller files, and number of files |
02:50
🔗
|
chronomex |
for large files it usually doesn't matter |
02:50
🔗
|
chronomex |
reiser tends to win at many teeny files |
02:54
🔗
|
instence_ |
yea this is going to be for website archiving specifically, so I guess I will go with reiser |
02:54
🔗
|
instence_ |
I wasn't aware ext3 had a files/folder limitation of 5,000 without htrees |
02:55
🔗
|
instence_ |
Have been reading this overview guide, which is great: |
02:55
🔗
|
instence_ |
http://www.serverfocus.org/reiserfs-vs-ext4-vs-xfs-vs-zfs-vs-btrfs |
02:55
🔗
|
chronomex |
I usually build my boxes with jfs |
02:55
🔗
|
chronomex |
solid as a rock, not fancy performance but it's consistent |
02:56
🔗
|
instence_ |
ah, cool, yea slack supports it |
02:58
🔗
|
instence_ |
I used to do website archiving in windows, and for the past year or more a lot of the tasks on my plate have been non-recurssive in nature. Static targetted grabs. |
02:58
🔗
|
instence_ |
However with windows wget being stuck on 1.11.4, without css parsing, I have to get something setup in linux to take advantage of newer wget builds |
02:59
🔗
|
instence_ |
There have been "experimental" wget builds of newer versions but I don't trust them |
03:00
🔗
|
instence_ |
I think I will test out reiser for now, and keep IBM's jfs in mind for a future test run |
03:01
🔗
|
chronomex |
jfs has never let me down |
03:01
🔗
|
chronomex |
reiser has weirded on me once, but I was not treating it nicely |
03:01
🔗
|
chronomex |
zfs totally fucked me over |
03:02
🔗
|
chronomex |
ext4 hasn't weirded on me but its performance isn't great |
03:02
🔗
|
instence_ |
if I run into any issues with reiser, i will switch to jfs |
03:03
🔗
|
instence_ |
what are some things to watch out for with reiser shitting the bed? |
03:04
🔗
|
instence_ |
I'm basically going to be doing a process of archive a single site, tar it, pulling it down from FTP over local network to another box for link checking and post processing. |
03:04
🔗
|
SketchCow |
....kills your wife |
03:04
🔗
|
instence_ |
lol |
03:04
🔗
|
chronomex |
I never had actual reportable shit with reiser |
03:04
🔗
|
chronomex |
it was just a bit tricky to manage |
03:04
🔗
|
chronomex |
iirc |
03:04
🔗
|
chronomex |
this was years ago and I was in high school |
03:04
🔗
|
instence_ |
ah |
03:22
🔗
|
Aranje |
If you figure smaller files and large numbers of files, probably. Does it matter? not really. |
03:22
🔗
|
Aranje |
cause the latest 3.x's have data loss issues. issue boiled up in ext4 that hasn't been fixed yet |
03:22
🔗
|
Aranje |
literally. the issue is triggered when the ext4 journal isn't written out on reboot or something. |
03:22
🔗
|
Aranje |
not an issue if you don't reboot every 10 seconds |
03:22
🔗
|
Aranje |
though... what kernel? |
03:22
🔗
|
Aranje |
seems legit |
03:22
🔗
|
Aranje |
chronomex:) what issues did you have with zfs? |
03:23
🔗
|
chronomex |
zfs-fuse transmuted a large number of symlinks, but not all of them, into regular files with size 0 and permissions 0000 |
03:31
🔗
|
Aranje |
I uh what |
03:31
🔗
|
Aranje |
yeah that sucks |
03:31
🔗
|
Aranje |
we use zfs on our fbsd servers |
03:31
🔗
|
Aranje |
cause it does something Sue likes |
06:30
🔗
|
ersi |
haha, website archiving from windows |
06:43
🔗
|
Sue |
use the native zfs module instead |
06:43
🔗
|
Sue |
it's much more stable |
06:44
🔗
|
Sue |
haven't checked it in a while, dedup w/ large pages and snapshots hopefully have been added |
08:59
🔗
|
SmileyG |
zfs on linux chronomex ? |
08:59
🔗
|
SmileyG |
Oh, zfs-fuse |
09:48
🔗
|
Frigolit |
SmileyG: there's a kernel patch for ZFS as well |
09:48
🔗
|
SmileyG |
Frigolit: I know. |
09:48
🔗
|
SmileyG |
I know the guy whos doing it :D |
09:48
🔗
|
Frigolit |
ah :3 |
09:48
🔗
|
SmileyG |
Thats why I was asking, hes doing quite well tbh (I do love to rib him over it as he proper evangalises over ZFS) |
09:48
🔗
|
Frigolit |
hehe |
09:49
🔗
|
SmileyG |
He's in NY tho, he lost power on his ipad after the storm and hasn't yet reappeared. I'm pretty sure he's fine though |
09:49
🔗
|
Frigolit |
:| |
09:49
🔗
|
Frigolit |
yea let's hope so |
09:49
🔗
|
SmileyG |
I do wonder about americas infrastructure tho |
09:50
🔗
|
SmileyG |
Does seem so very fragile. |
09:50
🔗
|
Frigolit |
indeed |
09:50
🔗
|
Frigolit |
speaking of zfs though, i'm not sure i'd use in-kernel zfs either at this point, seems about as stable as america's infrastructure |
09:51
🔗
|
Frigolit |
for now i'd rather go for fbsd |
09:51
🔗
|
Frigolit |
could go for solaris but... no... NO! |
09:59
🔗
|
SketchCow |
Is this -bs? |
09:59
🔗
|
Frigolit |
it is not! |
09:59
🔗
|
* |
Frigolit walks over there |
10:00
🔗
|
SketchCow |
I'll answer this one thing, though. |
10:00
🔗
|
SketchCow |
America's infrastructure: Not Fragile |
10:00
🔗
|
SketchCow |
The issue is: |
10:00
🔗
|
SketchCow |
America's Infrastructure - We're a huge-ass fucking country |
10:00
🔗
|
SmileyG |
Well yeah that too |
10:00
🔗
|
Frigolit |
true |
10:01
🔗
|
SmileyG |
I think I suddenly realised what happens |
10:01
🔗
|
SmileyG |
due to being a realtively young country. |
10:02
🔗
|
SmileyG |
Do you ever demolish stuff over there? Like "en mass" ? |
10:02
🔗
|
Frigolit |
less OT, anyone knows how well btrfs works? i'm trying to figure out the best setup for a future fileserver |
10:02
🔗
|
* |
SmileyG goes to -bs |
20:05
🔗
|
SketchCow |
--------------------------------------------- |
20:05
🔗
|
SketchCow |
So, we're looking at doing an Archive Team Kickstarter |
20:06
🔗
|
SketchCow |
Would love suggestions for rewards |
20:06
🔗
|
SketchCow |
--------------------------------------------- |
20:06
🔗
|
mistym |
Ooh. I need to try to think of smth |
20:15
🔗
|
deathy |
what's the goal of the kickstarter? |
20:15
🔗
|
deathy |
also.. |
20:15
🔗
|
deathy |
Jason's hat |
20:15
🔗
|
deathy |
hat that looks like Jason's hat |
20:16
🔗
|
deathy |
old HDDs used for important projects (like WOW server auction :) ) |
20:18
🔗
|
mistym |
That's a good idea. |
20:18
🔗
|
mistym |
Some high reward tier should be the obligatory "archive team dinner" with SketchCow, etc. |
20:29
🔗
|
DFJustin |
http://archiveteam.org/index.php?title=Kickstarter_Prizes |
20:54
🔗
|
SketchCow |
Thanks for reminding me of that, DF |
21:05
🔗
|
flaushy |
SketchCow: pins :) |
21:06
🔗
|
soultcer |
Will this be a real kickstarter at kickstarter.com? |
21:06
🔗
|
flaushy |
is the logo from the wiki the "official" archiveteam logo? |
21:08
🔗
|
alard |
Expert archiving by the Archive Team of a website of your choice? |
21:11
🔗
|
mistym |
flaushy: It ought to be. |
21:11
🔗
|
mistym |
I'd stick a high-res poster of that on my office wall. |
21:13
🔗
|
mistym |
Though I'd probably be forced to cover up the right-hand corner with another poster or smth |
22:03
🔗
|
Dark_Star |
I don't get it. Kickstarter? what for? |
22:21
🔗
|
Coderjoe |
Dark_Star: we put a lot of stuff up on archive.org, and they don't run on happy thoughts and fairy dust. |
22:44
🔗
|
SketchCow |
This willbe a real kickstarter. |
22:53
🔗
|
soultcer |
Nice |
22:57
🔗
|
bsmith094 |
SketchCow: what is that pic on twitter? |
22:57
🔗
|
bsmith094 |
http://t.co/z0c62yMF |
23:19
🔗
|
SketchCow |
My editing box. |
23:19
🔗
|
SketchCow |
The one I'm on now (although all my IRC is through a different server) |