Veeam backup repository and distributed file system

Availability for the Always-On Enterprise

Veeam backup repository and distributed file system

Veeam Logoby DaFresh » Thu Nov 24, 2016 11:07 am

Hello,

I am in the process of evaluating distributed storage solution for storing Veeam backup files, as the time pass backup are growing fast, managing single name spaces become painful, a wast of time and space (actually got 3 linux servers totalising 200To). I am aware of the recent veeam feature scale out repository, but I need this solution to act as a NFS server as well.

Any idea ? does anybody had successfully use in production something like Ceph or Gluster as Veeam repository ?
DaFresh
Enthusiast
 
Posts: 64
Liked: 1 time
Joined: Tue Aug 30, 2011 9:31 pm
Full Name: Cedric Lemarchand

Re: Veeam backup repository and distributed file system

Veeam Logoby PTide » Thu Nov 24, 2016 4:01 pm

Hi,

A datamover that is deployed on a repository interacts with its filesystem not directly but via OS. In other words, you can use any filesystem you want until the operating system on the repository knows how to handle it.

P.S. Hadoop as a Veeam repository

Thanks
PTide
Veeam Software
 
Posts: 3019
Liked: 246 times
Joined: Tue May 19, 2015 1:46 pm

Re: Veeam backup repository and distributed file system

Veeam Logoby dellock6 » Fri Nov 25, 2016 12:17 am

Hi Cedric,
I have personally seen several service providers using Ceph as their Veeam repository, usually mounting RBD as a block device into a Linux machine, that is then used as a linux repository in Veeam. I talked with one provider using Gluster, but had no additional information about their satisfaction with this solution.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5047
Liked: 1330 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Veeam backup repository and distributed file system

Veeam Logoby DaFresh » Fri Nov 25, 2016 1:23 pm

Thanks for inputs guys. The things that really bother me is not really if it will works or not, in the way every POSIX compliant FS will be supported by the Veeam Linux Agent, but more how those kind of storage solutions handles the Veeam files transformation phases, which require a lot of IOPS. Distributed files system has different pro and cons, and sometime are not designed the handle such type of workloads (eg random IOPS), this is why I ask if some people already has successful experiences with such configurations ;-)
DaFresh
Enthusiast
 
Posts: 64
Liked: 1 time
Joined: Tue Aug 30, 2011 9:31 pm
Full Name: Cedric Lemarchand

Re: Veeam backup repository and distributed file system

Veeam Logoby DaFresh » Mon Dec 12, 2016 9:30 am

So, I actually have a POC running with GlusterFS, it works well and seems to be promising even if I have no visibility on how a real backup workload (ie multiple To) would be handle, as the test job does only few hundred Go.
It runs on 3 nodes (virtual), the GlusterFS volume is in erasure coding 2+1, and a gateway serveur that mount the storage cluster as a local file system, used as a Linux repository.

I am surprised that nobody use such configuration which seems great, which make me a bit not confident.

Luca did you have some more informations ? any input will be greatly appreciated.
DaFresh
Enthusiast
 
Posts: 64
Liked: 1 time
Joined: Tue Aug 30, 2011 9:31 pm
Full Name: Cedric Lemarchand

Re: Veeam backup repository and distributed file system

Veeam Logoby dellock6 » Thu Dec 15, 2016 5:14 am

Hi Cedric, sorry but no, I've seen some test deployment of GlusterFS used a repository but never arrived to producion. Can't tell however to be honest if the project was dropped because of performance or issues, or because of other reasons. In one case it was a side-by-side comparison with Ceph and ceph was selected at the end.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5047
Liked: 1330 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Veeam backup repository and distributed file system

Veeam Logoby Kellen.Flood » Mon Jul 31, 2017 11:58 pm

@dellock6 Has Veeam seen any more installs leveraging GlusterFS?
Kellen.Flood
Enthusiast
 
Posts: 41
Liked: 3 times
Joined: Fri Apr 19, 2013 8:30 pm
Full Name: Kellen Flood

Re: Veeam backup repository and distributed file system

Veeam Logoby dellock6 » Wed Aug 02, 2017 4:20 pm

Not a single one since I wrote the previous post, sorry.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5047
Liked: 1330 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], iwik and 49 guests