Linux Repository | which filesystem

Availability for the Always-On Enterprise

Linux Repository | which filesystem

Veeam Logoby thomas23 » Wed May 24, 2017 2:45 pm

Hello veeam-users,

we plan a new place for hold our backup repository and And we want to use linux. There are differences
which filsystem should we use for the direct attached storage (performance vs stability?
I prefer a CentOS or Debian System, but the main-question is ext4,btrfs,ZFS ....
Today we use version 9.5.

Thanks in advance
Thomas
thomas23
Novice
 
Posts: 4
Liked: never
Joined: Thu Jan 15, 2015 10:12 am

Re: Linux Repository | which filesystem

Veeam Logoby mkretzer » Wed May 24, 2017 4:13 pm

I have the same question - I hope that at some point something like refs block clone works with btrfs or so. What is the most future prove fs?
mkretzer
Expert
 
Posts: 302
Liked: 66 times
Joined: Thu Dec 17, 2015 7:17 am

Re: Linux Repository | which filesystem

Veeam Logoby nitramd » Wed May 24, 2017 5:48 pm 1 person likes this post

I had the good fortune and pleasure to attend VeeamON 2017. I attended one of Anton Gostev's breakout sessions, which was on the topic of Backup Repository Best Practices. His personal recommendation for a Linux file system is XFS; developed by SGI. It's been around for ~25 years and has never had a crash in over 20 years.

You can check out the XFS website @ xfs.org; be sure to look at the FAQ. You can also check Red Hat's article on file system limitations here: https://access.redhat.com/solutions/1532 - good read.

As you may be aware, the current release of CentOS 7 defaults to the XFS filesystem.

Hope this helps.

-MD
nitramd
Enthusiast
 
Posts: 26
Liked: 2 times
Joined: Thu Feb 16, 2017 8:05 pm

Re: Linux Repository | which filesystem

Veeam Logoby mlott@gie.com » Wed May 24, 2017 7:25 pm 1 person likes this post

We use XFS for our file server and generally for anything that would require more than 16TB of storage. We also use it for smaller than 16TB. The failures I have seen with this file system were only when there was a problem with the underlying array, etc. In those extreme cases, you can end up with some zero-length files and other weirdness. I recommend it but I wouldn't say it's indestructible.
mlott@gie.com
Enthusiast
 
Posts: 38
Liked: 2 times
Joined: Fri Nov 07, 2014 3:51 pm
Full Name: Miles Lott

Re: Linux Repository | which filesystem

Veeam Logoby nitramd » Wed May 24, 2017 9:17 pm

Sorry, should have been more clear. The comments with regards to the XFS filesystem, i.e. how long its been around, etc, were made by Anton at the breakout session; this is my recollection of what he said about XFS.

I believe that he was trying to show that XFS is a proven technology due to its longevity and robustness.

I also know of no bulletproof computer hardware or software but certainly recommend XFS.
nitramd
Enthusiast
 
Posts: 26
Liked: 2 times
Joined: Thu Feb 16, 2017 8:05 pm

Re: Linux Repository | which filesystem

Veeam Logoby Gostev » Wed May 24, 2017 10:43 pm

Yes, I can confirm I did say that :D of course, while it was more of a joke to get the point across - the reason for one was that I've never heard anything but praise on XFS stability and reliability.
Gostev
Veeam Software
 
Posts: 21354
Liked: 2333 times
Joined: Sun Jan 01, 2006 1:01 am
Full Name: Anton Gostev

Re: Linux Repository | which filesystem

Veeam Logoby thomas23 » Fri May 26, 2017 7:52 am

Hello together,

i wonder, that nobady talk about btrfs. Behind the question, it stands the hope that we see some integration in filesystem-functionality (in the future).
Anyway, I'll test first with xfs.

thanks
Thomas
thomas23
Novice
 
Posts: 4
Liked: never
Joined: Thu Jan 15, 2015 10:12 am

Re: Linux Repository | which filesystem

Veeam Logoby Gostev » Fri May 26, 2017 7:58 pm

Because simply put, btrfs is a terrible choice these days (way too unreliable, needs to mature first). Definitely the last place you want to be using for storing your backups.
Gostev
Veeam Software
 
Posts: 21354
Liked: 2333 times
Joined: Sun Jan 01, 2006 1:01 am
Full Name: Anton Gostev

Re: Linux Repository | which filesystem

Veeam Logoby dellock6 » Mon May 29, 2017 6:19 pm

To better answer, BTRFS instability should be split into two different parts:
- file structure is totally stable, has not been changed for a long time, and it's proven in multiple places (its lead developers work at Facebook and they use it in many places, and Suse is using now btrfs as their default filesystem)
- userland tools is were development is still rapidly changing, and some tools and options are not stable yet. You can have a better view on the current status here: https://btrfs.wiki.kernel.org/index.php/Status

Do you need specifically some of the feature that BTRFS has? If no, then you are ok with XFS. I'd go for XFS myself probably "today", but who knows in one year.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 4989
Liked: 1308 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Linux Repository | which filesystem

Veeam Logoby Robvil » Mon May 29, 2017 6:52 pm 1 person likes this post

IĀ“m running on btrfs without issues.
Robvil
Enthusiast
 
Posts: 44
Liked: 2 times
Joined: Mon Oct 03, 2016 12:41 pm
Full Name: Robert

Re: Linux Repository | which filesystem

Veeam Logoby davecla » Mon May 29, 2017 10:25 pm

Anyone using ZFS??
I've migrated my repositories to ReFS which seems to work really well, but was thinking seriously about moving to ZFS on Linux to give OS separation. I've just had 600TB of Dell JBOD delivered - waiting for the linux guys to do their bit, then it's all go, so very keen to hear about others experiences in this space.
davecla
Influencer
 
Posts: 19
Liked: 1 time
Joined: Wed Feb 03, 2016 9:40 pm
Full Name: Dave Clarke

Re: Linux Repository | which filesystem

Veeam Logoby Gostev » Tue May 30, 2017 1:58 am

ZFS is fine. It is quite popular file system for backup repositories, especially among our service providers. I recommend both XFS and ZFS without hesitation, but prefer XFS for maturity and reliability.
Gostev
Veeam Software
 
Posts: 21354
Liked: 2333 times
Joined: Sun Jan 01, 2006 1:01 am
Full Name: Anton Gostev

Re: Linux Repository | which filesystem

Veeam Logoby nitramd » Thu Jun 01, 2017 5:03 pm

@davecla,

If you're interested, check out the following ZFS links on the FreeNAS website; these documents may help to illuminate ZFS:

FreeNASĀ® User Guide 9.10.2-U2: http://doc.freenas.org/9.10/

FreeNAS: A Worst Practices Guide: http://www.freenas.org/blog/freenas-worst-practices/

Although I don't use ZFS, I find it quite intriguing and may have to setup a test environment sometime down the road.

-MD
nitramd
Enthusiast
 
Posts: 26
Liked: 2 times
Joined: Thu Feb 16, 2017 8:05 pm


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: No registered users and 26 guests