-
- Influencer
- Posts: 11
- Liked: never
- Joined: Mar 19, 2019 1:44 am
- Full Name: Ian Jackson
- Contact:
Recovering from a disaster a Azure Blob storage
Hi All,
We are using Azure blob storage for retention of GFS archive backups.
Playing through some scenarios we realised we need a procedure on what to do if you lose your Veeam servers and hence your database and vbm files.
With a backup that is still on a disk you can just import it, however for a backup store in Azure this doesn't appear to be an option.
I have tested this with some dummy backup data and it looks like your backups stored in Azure blob storage are "lost" (they are still in Azure, but there doesn't appear to be a way to get Veeam to recognise them) in this scenario.
I haven't been able to find any information on this scenario so I am wondering if there is a process to get these backups back.
We are using Azure blob storage for retention of GFS archive backups.
Playing through some scenarios we realised we need a procedure on what to do if you lose your Veeam servers and hence your database and vbm files.
With a backup that is still on a disk you can just import it, however for a backup store in Azure this doesn't appear to be an option.
I have tested this with some dummy backup data and it looks like your backups stored in Azure blob storage are "lost" (they are still in Azure, but there doesn't appear to be a way to get Veeam to recognise them) in this scenario.
I haven't been able to find any information on this scenario so I am wondering if there is a process to get these backups back.
-
- Product Manager
- Posts: 8191
- Liked: 1322 times
- Joined: Feb 08, 2013 3:08 pm
- Full Name: Mike Resseler
- Location: Belgium
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Hi Ian,
All of the data is stored on Azure also. So even with a total loss of the on-premises datacenter, you still would be able to restore the data from Azure.
A few things come to mind this morning with my coffee
* Create a new VBR installation and add a new SOBR repository and connect the existing capacity tier again. That should get all the necessary information
* Simply deploy a free version of VBR and use direct restore to Azure
What things did you already tested and how?
Thanks
Mike
All of the data is stored on Azure also. So even with a total loss of the on-premises datacenter, you still would be able to restore the data from Azure.
A few things come to mind this morning with my coffee
* Create a new VBR installation and add a new SOBR repository and connect the existing capacity tier again. That should get all the necessary information
* Simply deploy a free version of VBR and use direct restore to Azure
What things did you already tested and how?
Thanks
Mike
-
- Product Manager
- Posts: 14840
- Liked: 3086 times
- Joined: Sep 01, 2014 11:46 am
- Full Name: Hannes Kasparick
- Location: Austria
- Contact:
Re: Recovering from a disaster a Azure Blob storage
just to add: with community (former free) edition you need to add the scale out repository & capacity tier with powershell as it is not available in the UI (community is "standard edition" which does not support scale out repository per default)
-
- Influencer
- Posts: 11
- Liked: never
- Joined: Mar 19, 2019 1:44 am
- Full Name: Ian Jackson
- Contact:
Re: Recovering from a disaster a Azure Blob storage
I have tried this: * Create a new VBR installation and add a new SOBR repository and connect the existing capacity tier again
However no backups have appeared and the SOBR says that 0 space is being used. First rescan of the Azure Blob storage took about an hour and I can see on the Azure end there were transactions against it.
Will give it another crack, might have missed a step when trying it out.
However no backups have appeared and the SOBR says that 0 space is being used. First rescan of the Azure Blob storage took about an hour and I can see on the Azure end there were transactions against it.
Will give it another crack, might have missed a step when trying it out.
-
- Product Manager
- Posts: 20413
- Liked: 2302 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Recovering from a disaster a Azure Blob storage
If you have
- added the exact same object storage repository to a backup console
- added it as capacity extent to Scale-Out Backup repository
- re-scanned SOBR
and still can see no backups previously offloaded to capacity tier, then, reach our support team for further investigation, as the described behaviour doesn't look expected.
Thanks!
- added the exact same object storage repository to a backup console
- added it as capacity extent to Scale-Out Backup repository
- re-scanned SOBR
and still can see no backups previously offloaded to capacity tier, then, reach our support team for further investigation, as the described behaviour doesn't look expected.
Thanks!
-
- Veeam Software
- Posts: 742
- Liked: 209 times
- Joined: Jan 14, 2016 6:48 am
- Full Name: Anthony Spiteri
- Location: Perth, Australia
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Hey there ...just to add to Vladimir's comment, I recently demoed this last week live at Cloud Field Day (though used Amazon S3) and I have done this process a number of times... works a charm.
Here is a little more info on the process and a video link of the demo: https://anthonyspiteri.net/disaster-rec ... loud-tier/
Here is a little more info on the process and a video link of the demo: https://anthonyspiteri.net/disaster-rec ... loud-tier/
Anthony Spiteri
Regional CTO APJ & Lead Cloud and Service Provider Technologist
Email: anthony.spiteri@veeam.com
Twitter: @anthonyspiteri
Regional CTO APJ & Lead Cloud and Service Provider Technologist
Email: anthony.spiteri@veeam.com
Twitter: @anthonyspiteri
-
- Enthusiast
- Posts: 57
- Liked: 4 times
- Joined: Jan 21, 2019 1:38 pm
- Full Name: Dariusz Tyka
- Contact:
Re: Recovering from a disaster a Azure Blob storage
I have similar situation here but with Amazon S3 storage. Support case number: 03487891.
I was testing capacity tier functionality and after some data was offloaded to object storage I simply deleted all content from performance tier (only one test job was targeted to it). Later on I made a rescan of SOBR but unfortunately those offloaded backups did not appear in Veeam console.
From support I got below info:
"I have discussed the issue with RnD team and the behavior is considered as a bug and will be resolved in a future release of the product."
So it looks like it is sitll not working as expected in some situations.
I was testing capacity tier functionality and after some data was offloaded to object storage I simply deleted all content from performance tier (only one test job was targeted to it). Later on I made a rescan of SOBR but unfortunately those offloaded backups did not appear in Veeam console.
From support I got below info:
"I have discussed the issue with RnD team and the behavior is considered as a bug and will be resolved in a future release of the product."
So it looks like it is sitll not working as expected in some situations.
-
- Product Manager
- Posts: 14840
- Liked: 3086 times
- Joined: Sep 01, 2014 11:46 am
- Full Name: Hannes Kasparick
- Location: Austria
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Hello,
@dariusz.tyka: I was aware that there is an issue for your situation (I had the same in my lab ) . The workaround was to also remove the backups from configuration. After removing backups from configuration, the rescan worked.
But this should not be the case here, because he mentioned that he has a new setup.
Best regards,
Hannes
@dariusz.tyka: I was aware that there is an issue for your situation (I had the same in my lab ) . The workaround was to also remove the backups from configuration. After removing backups from configuration, the rescan worked.
But this should not be the case here, because he mentioned that he has a new setup.
Best regards,
Hannes
-
- Enthusiast
- Posts: 57
- Liked: 4 times
- Joined: Jan 21, 2019 1:38 pm
- Full Name: Dariusz Tyka
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Hi @HannesK,
I was instructed to remove backups from configuration but unfortunately it didn't change anything in my case. Still nothing in 'Disk-imported' on Veeam console.
I was instructed to remove backups from configuration but unfortunately it didn't change anything in my case. Still nothing in 'Disk-imported' on Veeam console.
-
- Product Manager
- Posts: 20413
- Liked: 2302 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Have you re-scanned SOBR, once backups were removed from configuration? Thanks!
-
- Enthusiast
- Posts: 57
- Liked: 4 times
- Joined: Jan 21, 2019 1:38 pm
- Full Name: Dariusz Tyka
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Yes, sure. Several times.
-
- Product Manager
- Posts: 20413
- Liked: 2302 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Hmm, looks unexpected. We will investigate your case internally and see what's the root cause of the behaviour experienced. Thanks!
-
- Influencer
- Posts: 13
- Liked: 7 times
- Joined: Jul 30, 2019 5:58 pm
- Full Name: Andres Martinez
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Hi, we're working on similar scenario to execute a direct restore to Azure from MS Blob Storage. We're trying to estiamte how much space we need to provision for the "capacity tier" in the new SOBR repository to be part of the MV in Azure where we're going to install Veeam B&R. The size of the capacity tier should be the sum of all full backups of the VMs that we want to restore?
thanks in advance
Arty
thanks in advance
Arty
-
- Chief Product Officer
- Posts: 31814
- Liked: 7302 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Hello, I'm not sure I understand the question. Capacity Tier uses object storage, which in case of public cloud has effectively no space limit. So, capacity tier size is not something you need to "provision"?
-
- Influencer
- Posts: 13
- Liked: 7 times
- Joined: Jul 30, 2019 5:58 pm
- Full Name: Andres Martinez
- Contact:
Re: Recovering from a disaster a Azure Blob storage
HI Gostev, sorry for the misunderstanding.. I mean "performance tier". In other words when you perform a SOBR Download Jobs the amount of space required in the performance tier to perform a direct restore to azure must be the sum of all full backups in the capacity tier?, I'm guessing the data is first moved from capacity to performance and that's the source when you execute a direct restore to AZ
-
- Chief Product Officer
- Posts: 31814
- Liked: 7302 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Ah, got it.
When importing backups from object storage, we only download metadata to the Performance Tier, and re-create backup file stubs using this metadata. I don't remember the exact figures on the amount of metadata, but it should be less than 1% of your backups size for sure.
And once the backups are imported, you can start restoring directly from the object storage. Unlike with other vendors, there's no requirement to download entire backups to the Performance Tier first. Besides, doing so would not make any sense in your particular restore scenario anyway (direct restore from blob storage to IaaS), as both source and target are located in the same physical Microsoft Azure data center.
When importing backups from object storage, we only download metadata to the Performance Tier, and re-create backup file stubs using this metadata. I don't remember the exact figures on the amount of metadata, but it should be less than 1% of your backups size for sure.
And once the backups are imported, you can start restoring directly from the object storage. Unlike with other vendors, there's no requirement to download entire backups to the Performance Tier first. Besides, doing so would not make any sense in your particular restore scenario anyway (direct restore from blob storage to IaaS), as both source and target are located in the same physical Microsoft Azure data center.
-
- Influencer
- Posts: 13
- Liked: 7 times
- Joined: Jul 30, 2019 5:58 pm
- Full Name: Andres Martinez
- Contact:
Re: Recovering from a disaster a Azure Blob storage
You guys really put a lot of thought on this, it rocks how it works ! Thanks for continuous effort to support the commnuity
-
- Chief Product Officer
- Posts: 31814
- Liked: 7302 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Wow, I think you just came up with our new motto
-
- Influencer
- Posts: 13
- Liked: 7 times
- Joined: Jul 30, 2019 5:58 pm
- Full Name: Andres Martinez
- Contact:
Re: Recovering from a disaster a Azure Blob storage
Looking forward to get a Veeam t-shirt with the new motto
Who is online
Users browsing this forum: No registered users and 14 guests