Feature Request: Azure Blob Storage

Availability for the Always-On Enterprise

Feature Request: Azure Blob Storage

Veeam Logoby nichola.vandevoorde » Wed Nov 02, 2016 12:40 pm

Dear Sir,
Dear Madam,

I would like to file a feature request (couldn't find a previous request on the forum) regarding Veeam Cloud Connect backup to Azure Blob Storage (cool storage).

Now the amount of storage we can present to a Veeam Cloud Connect infrastructure is dependent of the Azure VM size (max 64 disks -> high cost for this VM). It would be nice to offload backup data from on-prem to Azure via the Veeam Cloud Connect infrastructure OR directly to Azure Storage blob account (like in Veeam Cloud Edition).

Thanks in advance!

Nichola
nichola.vandevoorde
Novice
 
Posts: 4
Liked: 1 time
Joined: Fri Jun 13, 2014 11:47 am
Full Name: Nichola Van de Voorde

Re: Feature Request: Azure Blob Storage

Veeam Logoby Mike Resseler » Wed Nov 02, 2016 12:45 pm

Hi Nichola,

One of the biggest issues I see with that request is that it can take ages to download the backup again and recover... When there is no compute attached to the storage, you can't do item level recovery, and downloading a full backup to restore one file will be costly + if there is a real disaster, downloading all backups will significantly slow down the recovery process. It could take days or longer before you can even start recovering something.

So if you talk about placing backups onto Blob storage, can you live with the above? Or are you seeing it differently (then just putting the backups on that storage)

Let me know

Mike
Mike Resseler
Veeam Software
 
Posts: 3150
Liked: 362 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: Feature Request: Azure Blob Storage

Veeam Logoby v.Eremin » Wed Nov 02, 2016 12:59 pm

Now the amount of storage we can present to a Veeam Cloud Connect infrastructure is dependent of the Azure VM size (max 64 disks -> high cost for this VM).

It's dependent only if you stick to appliance that is shipped in form of Azure VM (available in Azure Marketplace).

It would be nice to offload backup data from on-prem to Azure via the Veeam Cloud Connect infrastructure OR directly to Azure Storage blob account (like in Veeam Cloud Edition).

Are you a SP yourself? Will you be keen to sacrifice restore time, miss SLA, etc. at the cost of increased disk space?

Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Feature Request: Azure Blob Storage

Veeam Logoby csinetops » Wed Nov 02, 2016 1:05 pm

I'd agree with Mike, we use Azure blob storage but it is only for long term retention or if our main site completely burned to the ground. In that case, a week to recover while we download backups wouldn't really matter because we'd have to rebuild from scratch.

We front end our Azure with a Netapp AltaVault appliance. That takes care of dedupe/compression and moving the data into Azure. There is also a AltaVault cloud appliance that you can spin up, inventory your backups and restore right to Azure if you want.

We also use Cloud Connect with a Veeam partner for one of our branches, that works well if you don't have a ton of data and just need some backups off site.

I guess what are your goals?
csinetops
Expert
 
Posts: 105
Liked: 15 times
Joined: Fri Jun 06, 2014 2:45 pm
Full Name: csinetops

Re: Feature Request: Azure Blob Storage

Veeam Logoby Gostev » Thu Nov 03, 2016 12:53 am

Will the upcoming 32TB virtual disks for Azure VMs solve your concern?
Gostev
Veeam Software
 
Posts: 21390
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Feature Request: Azure Blob Storage

Veeam Logoby fredpelaez » Mon Nov 07, 2016 1:59 am

Hi,

I would agree with Nichola that this feature is a must. Backup data in Azure Blob Storage would be for long term retention (i.e tape replacement). I do agree that MS StorSimple and an NTAP Altavault can push data directly to Blob Storage quite efficiently but there is a cost element to it. Azure VM's don't really do the job because of the capacity limit. I would prefer to have a storage with "unlimited bucket" that I can use. CommVault Simpana can do this natively. I did hear that Microsoft DPM can do this as well (can't verify this at this point though)
fredpelaez
Novice
 
Posts: 8
Liked: never
Joined: Mon Oct 10, 2016 2:18 am
Location: The most isolated city in the world....Perth, Australia
Full Name: Fred Pelaez

Re: Feature Request: Azure Blob Storage

Veeam Logoby v.Eremin » Mon Nov 07, 2016 8:50 am

Azure VM's don't really do the job because of the capacity limit.

But what do you think about forthcoming disk capacity increase mentioned by Anton? Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Feature Request: Azure Blob Storage

Veeam Logoby fredpelaez » Tue Nov 08, 2016 6:11 am

In my opinion, 32 TB is too small.
fredpelaez
Novice
 
Posts: 8
Liked: never
Joined: Mon Oct 10, 2016 2:18 am
Location: The most isolated city in the world....Perth, Australia
Full Name: Fred Pelaez

Re: Feature Request: Azure Blob Storage

Veeam Logoby v.Eremin » Tue Nov 08, 2016 9:51 am

It's 32 TB per virtual disk. In other words, 32x increase of currently existing disk limit (1024 GB per one virtual disk) won't answer your requirements? May I ask you how much data do you plan to store in public cloud? Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Feature Request: Azure Blob Storage

Veeam Logoby nichola.vandevoorde » Tue Nov 08, 2016 10:23 am

Gostev wrote:Will the upcoming 32TB virtual disks for Azure VMs solve your concern?


That will cover our issue with the capacity limit in combination with Veeam CC on Azure.

Mike Resseler wrote:Hi Nichola,

One of the biggest issues I see with that request is that it can take ages to download the backup again and recover... When there is no compute attached to the storage, you can't do item level recovery, and downloading a full backup to restore one file will be costly + if there is a real disaster, downloading all backups will significantly slow down the recovery process. It could take days or longer before you can even start recovering something.

So if you talk about placing backups onto Blob storage, can you live with the above? Or are you seeing it differently (then just putting the backups on that storage)

Let me know

Mike


You are absolutely right with the missing restore capabilities in case it's a simple offload to a blob storage account. However, the majority of our customers do not have large amounts of data and want to get rid of their tape handling in a "the most economical way" (which I do not always agree with). So the most economical way in their eyes is to have a simple long term retention backup copy job to cool Azure blob storage (being aware of the limited RTO and restore capabilities).

fredpelaez wrote:Hi,

I would agree with Nichola that this feature is a must. Backup data in Azure Blob Storage would be for long term retention (i.e tape replacement). I do agree that MS StorSimple and an NTAP Altavault can push data directly to Blob Storage quite efficiently but there is a cost element to it. Azure VM's don't really do the job because of the capacity limit. I would prefer to have a storage with "unlimited bucket" that I can use. CommVault Simpana can do this natively. I did hear that Microsoft DPM can do this as well (can't verify this at this point though)


I can verify that SCDPM has this capability (so does Azure Backup Server). I agree with the cost element, which can be a showstopper in some cases.

Sorry for the late response and thanks for the rapid feedback!
nichola.vandevoorde
Novice
 
Posts: 4
Liked: 1 time
Joined: Fri Jun 13, 2014 11:47 am
Full Name: Nichola Van de Voorde

Re: Feature Request: Azure Blob Storage

Veeam Logoby Mike Resseler » Tue Nov 08, 2016 11:51 am

Thanks all for the information

Really appreciated, I won't make any promises of course but these insights give us valuable information at various discussion tables :-)

Cheers
Mike
Mike Resseler
Veeam Software
 
Posts: 3150
Liked: 362 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: Feature Request: Azure Blob Storage

Veeam Logoby mtunc » Fri Nov 11, 2016 3:38 pm

May I ask - approximately when will the 32TB per disk feature be released? Are we talking in a few weeks or few months? I tried to find some documentation on this but couldn't find any.

This week I have been playing around with Azure and the 1TB per disk limitation (and 32 disks per VM which costs upwards of £800 per month!) is putting me off.

Also may I ask about the "Veeam Cloud Connect for the Enterprise" route in Azure? Is that essentially running your own Service Provider instance in Azure without paying a 3rd party to run it all for you?

Thanks!
Mikail
mtunc
Lurker
 
Posts: 2
Liked: never
Joined: Fri Nov 11, 2016 3:32 pm
Full Name: Mikail Tunç

Re: Feature Request: Azure Blob Storage

Veeam Logoby Mike Resseler » Sat Nov 12, 2016 2:33 am

Mikail,

Unfortunately I can't give you a timeline for the 32TB disk feature. Microsoft has promised that they are working on it (as we speak) but when they go live is not known. There is no documentation on it but Mark Russinovich has stated it in public at Ignite during a session.

We aware of the costly VM that comes with 32 disks and this is one of the discussion points which we have with Microsoft Azure teams on regular basis. So they are also aware of it and understand it very well.

For the Veeam Cloud Connect for the Enterprise route. In essence this is indeed "playing" your own (internal) Service Provider for your enterprise. We see this as a solution that can solve many issues in large enterprises but the biggest problem that it potentially could solve is RoBo offices that have their own local backup for the few servers they run and then get a copy offsite to a central environment, managed by the global IT team. In that aspect, we are also building the Veeam Availability Console that can be used as an addition to VCC-E but also give "managed" service provider capabilities to remotely manage and monitor those local Veeam Backup instances without the need of complex networking.

PS: This does not apply to Azure alone... VAC will also be able to be installed on-premises if you don't want to go the Azure route but want to keep it in your central datacenter

Hope it helps
Mike
Mike Resseler
Veeam Software
 
Posts: 3150
Liked: 362 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: Feature Request: Azure Blob Storage

Veeam Logoby bJako » Mon Nov 14, 2016 7:38 am

You can create file share in Azure and use it on Veeam server - create new repository, type= Shared Folder, \\yourstoragename.file.core.windows.net\yoursharename and you put credentials to it.
Size is max 5 TB and fileshare type storage is most expensive in Azure.
Full 5TB will cost ~350 €/month.

But you can use it as normal repository, file and app level resore works, even Instant Recovery seems to work (very slow of course).

Backup/restore speed depends on your internet connection and connection between your ISP and Azure DC.

First full Copy Job backup runs ~50Mbit/s (5 MB/s). Bottleneck - Target (99%) (my backup testsite have Internet connection 100 Mbit/s)

What Veeam experts think about this method?
bJako
Novice
 
Posts: 3
Liked: 1 time
Joined: Tue Oct 18, 2016 7:24 am
Full Name: Jako BErgson

Re: Feature Request: Azure Blob Storage

Veeam Logoby Mike Resseler » Mon Nov 14, 2016 7:44 am

Jako,

We have investigated this and we see a few issues.

First, if MSFT can improve this technology (or method :-)) then it certainly becomes a good and valid one. But...

* Yes, 5TB is the max fileshare and the biggest file you can use is 1 TB (so even with per-VM backup chains, this could get many customers into trouble...)
* The price is indeed pretty high.

The way I see it, this can become better when MSFT increases the max size per share and the max size per file (these numbers are not random... So every time MSFT makes a change somewhere (for example the 32TB disks soon...) I expect these numbers to change also. What's more, I start to notice a trend that higher capacity and better performance and so on does not always result in a more expensive price. So we probably have some nice things coming up (This is not a FACT by the way, I am guessing here and looking at the patterns of the last few years...)

Now, final thoughts is indeed performance. As you said yourself, the biggest bottleneck is the target but if this is for your backup copy job or secondary backup, and you can live with the lower performance, I see no reasons to say NO against it.

Just my thoughts

Mike
Mike Resseler
Veeam Software
 
Posts: 3150
Liked: 362 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], Google [Bot] and 20 guests