Use a swift storage as backend

[mdestrez]

Hi there,

I'm trying to use a swift storage as BackEnd. I use Cloudfuse to mount the storage on the repository. My issue is that swift limits uploaded files size to 5Gb.
Have you ever tried to store Veeam backups on OpenStack? Is there a way to segment backup in many files < 5Gb?

Thanks a lot.

[dellock6]

Hi, Veeam cannot natively split backup files into chunks, so you need to eventually find another way. Reading for example here:

http://www.mirantis.com/blog/large-obje ... -storages/

Seems you can work around this limit by doing multi-part uploads. If you are using a software instead of native API, it all comes down to the availability of this feature inside the software.

Anyway, object storage is not the best solution to store large files, whatever it is. Metadata calculations made by the object storage are heavier and heavier with the growth in size of the files; they are optimized for millions of small files.
We did some tests with Ceph, and on a local LAN it "could" be used, if you use servers with a good amount of CPU and RAM on every node. But I'm still not so sure is a good solution to archive Veeam backups.

Luca.