Comprehensive data protection for all workloads
Post Reply
mdestrez
Service Provider
Posts: 4
Liked: never
Joined: Feb 01, 2013 10:26 am
Full Name: matthieu destrez
Contact:

Use a swift storage as backend

Post by mdestrez » Feb 01, 2013 11:46 am

Hi there,

I'm trying to use a swift storage as BackEnd. I use Cloudfuse to mount the storage on the repository. My issue is that swift limits uploaded files size to 5Gb.
Have you ever tried to store Veeam backups on OpenStack? Is there a way to segment backup in many files < 5Gb?

Thanks a lot.

dellock6
Veeam Software
Posts: 5628
Liked: 1575 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Use a swift storage as backend

Post by dellock6 » Feb 01, 2013 1:20 pm

Hi, Veeam cannot natively split backup files into chunks, so you need to eventually find another way. Reading for example here:

http://www.mirantis.com/blog/large-obje ... -storages/

Seems you can work around this limit by doing multi-part uploads. If you are using a software instead of native API, it all comes down to the availability of this feature inside the software.

Anyway, object storage is not the best solution to store large files, whatever it is. Metadata calculations made by the object storage are heavier and heavier with the growth in size of the files; they are optimized for millions of small files.
We did some tests with Ceph, and on a local LAN it "could" be used, if you use servers with a good amount of CPU and RAM on every node. But I'm still not so sure is a good solution to archive Veeam backups.

Luca.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2019
Veeam VMCE #1

Post Reply

Who is online

Users browsing this forum: aperkins, Karinne and 25 guests