Discussions related to using object storage as a backup target.
Post Reply
azureblob
Lurker
Posts: 2
Liked: never
Joined: Nov 10, 2022 10:27 pm
Full Name: AzureBlob
Contact:

veeam backup to azure blob BAD performance

Post by azureblob »

We are using Veeam Backup and Replication and the azure appliance to backup directly to azure blob storage. Backups have horrible performance of about 60 MB/s. Read the MS documentation and they clearly state that throughput limits on Block Blocks adhere to max ingress on the storage account:

Target throughput for a single block blob Up to storage account ingress/egress limits1

https://learn.microsoft.com/en-us/azure ... ty-targets

This ingress limit is 60 Gbps for our azure region:

https://learn.microsoft.com/en-us/azure ... 2Ftoc.json

Any ideas why we are only getting throughput via Veeam of 60 MB/s? I used azcopy from the Veeam backup server and got 350 MB/s writing a single blob to the same storage container that Veaam is only realizing 60 MB/s.

Any assistance - greatly appreciated.
Thanks!!
jorgedlcruz
Veeam Software
Posts: 1355
Liked: 613 times
Joined: Jul 17, 2015 6:54 pm
Full Name: Jorge de la Cruz
Contact:

Re: veeam backup to azure blob BAD performance

Post by jorgedlcruz »

Hello, there are a few other topics regarding this very same topic.
I remember reading on a few guides that the 60MB/s is a limit Azure has.
https://github.com/uglide/azure-content ... ecklist.md

I remeber seeing the same performance on Customers as well. It was painful for full copy, but incrementals was quite okay, as it just uploads new blocks.

I am not certain if anythinf has changed. I can give it a try later, as I have 1gbps upload to Internet.
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software

@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
azureblob
Lurker
Posts: 2
Liked: never
Joined: Nov 10, 2022 10:27 pm
Full Name: AzureBlob
Contact:

Re: veeam backup to azure blob BAD performance

Post by azureblob »

hi Jorge
I saw those posts too, but I think they aren't accurate.

The MS documentation is very clear that while there is a 60 MB/s throughput limit on writing of single page blob, the block blob adheres to the storage account ingress limits. This is why I am able to use azcop to write a single block blob to the same storage account container that Veeam is configured to use and I achieve throughput rates of 350 MB/s.

I don't believe this is an Azure limit. Otherwise, I'd not be able to exceed 60 MB/s using tools other than Veeam Backup.

Any idea or advice will be greatly appreciated!
Gostev
Chief Product Officer
Posts: 31455
Liked: 6646 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: veeam backup to azure blob BAD performance

Post by Gostev » 2 people like this post

For large blobs, Azure automatically leverages a different transfer mechanism called High-Throughput Block Blob (HTTB), so your test with a single large blob is not an apple-to-apple comparison. Please try other tools on the same workload as Veeam uses (many 0.5-1MB objects) and let us know the results.
Regnor
Veeam Software
Posts: 934
Liked: 287 times
Joined: Jan 31, 2011 11:17 am
Full Name: Max
Contact:

Re: veeam backup to azure blob BAD performance

Post by Regnor »

I can't remember my performance results when using Azure Blob, but here someone achieved more then 100MB/s: object-storage-f52/wasabi-vs-backblaze- ... 81522.html

Will try to do some tests next week and give you a feedback. Which region are you in?
Post Reply

Who is online

Users browsing this forum: Stupots and 18 guests