Comprehensive data protection for all workloads
Post Reply
DaFresh
Enthusiast
Posts: 64
Liked: 1 time
Joined: Aug 30, 2011 9:31 pm
Full Name: Cedric Lemarchand
Contact:

Veeam backup repository and distributed file system

Post by DaFresh » Nov 24, 2016 11:07 am

Hello,

I am in the process of evaluating distributed storage solution for storing Veeam backup files, as the time pass backup are growing fast, managing single name spaces become painful, a wast of time and space (actually got 3 linux servers totalising 200To). I am aware of the recent veeam feature scale out repository, but I need this solution to act as a NFS server as well.

Any idea ? does anybody had successfully use in production something like Ceph or Gluster as Veeam repository ?

P.Tide
Product Manager
Posts: 5184
Liked: 448 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Veeam backup repository and distributed file system

Post by P.Tide » Nov 24, 2016 4:01 pm

Hi,

A datamover that is deployed on a repository interacts with its filesystem not directly but via OS. In other words, you can use any filesystem you want until the operating system on the repository knows how to handle it.

P.S. Hadoop as a Veeam repository

Thanks

dellock6
Veeam Software
Posts: 5688
Liked: 1604 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Veeam backup repository and distributed file system

Post by dellock6 » Nov 25, 2016 12:17 am

Hi Cedric,
I have personally seen several service providers using Ceph as their Veeam repository, usually mounting RBD as a block device into a Linux machine, that is then used as a linux repository in Veeam. I talked with one provider using Gluster, but had no additional information about their satisfaction with this solution.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2019
Veeam VMCE #1

DaFresh
Enthusiast
Posts: 64
Liked: 1 time
Joined: Aug 30, 2011 9:31 pm
Full Name: Cedric Lemarchand
Contact:

Re: Veeam backup repository and distributed file system

Post by DaFresh » Nov 25, 2016 1:23 pm

Thanks for inputs guys. The things that really bother me is not really if it will works or not, in the way every POSIX compliant FS will be supported by the Veeam Linux Agent, but more how those kind of storage solutions handles the Veeam files transformation phases, which require a lot of IOPS. Distributed files system has different pro and cons, and sometime are not designed the handle such type of workloads (eg random IOPS), this is why I ask if some people already has successful experiences with such configurations ;-)

DaFresh
Enthusiast
Posts: 64
Liked: 1 time
Joined: Aug 30, 2011 9:31 pm
Full Name: Cedric Lemarchand
Contact:

Re: Veeam backup repository and distributed file system

Post by DaFresh » Dec 12, 2016 9:30 am

So, I actually have a POC running with GlusterFS, it works well and seems to be promising even if I have no visibility on how a real backup workload (ie multiple To) would be handle, as the test job does only few hundred Go.
It runs on 3 nodes (virtual), the GlusterFS volume is in erasure coding 2+1, and a gateway serveur that mount the storage cluster as a local file system, used as a Linux repository.

I am surprised that nobody use such configuration which seems great, which make me a bit not confident.

Luca did you have some more informations ? any input will be greatly appreciated.

dellock6
Veeam Software
Posts: 5688
Liked: 1604 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Veeam backup repository and distributed file system

Post by dellock6 » Dec 15, 2016 5:14 am

Hi Cedric, sorry but no, I've seen some test deployment of GlusterFS used a repository but never arrived to producion. Can't tell however to be honest if the project was dropped because of performance or issues, or because of other reasons. In one case it was a side-by-side comparison with Ceph and ceph was selected at the end.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2019
Veeam VMCE #1

Kellen.Flood
Enthusiast
Posts: 49
Liked: 3 times
Joined: Apr 19, 2013 8:30 pm
Full Name: Kellen Flood
Contact:

Re: Veeam backup repository and distributed file system

Post by Kellen.Flood » Jul 31, 2017 11:58 pm

@dellock6 Has Veeam seen any more installs leveraging GlusterFS?

dellock6
Veeam Software
Posts: 5688
Liked: 1604 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Veeam backup repository and distributed file system

Post by dellock6 » Aug 02, 2017 4:20 pm

Not a single one since I wrote the previous post, sorry.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2019
Veeam VMCE #1

Post Reply

Who is online

Users browsing this forum: No registered users and 62 guests