-
- Veeam Vanguard
- Posts: 103
- Liked: 17 times
- Joined: Aug 05, 2014 1:13 pm
- Full Name: Dean lewis
- Contact:
SRM replication and Veeam Backups causing issues
I have a customer whom is using SRM to replicate critical VM's throughout the day (every 1 and 2 hours).
Each night Veeam (version 7, updating to version 8 today) backs the VM's up to a NAS device.
The production VMware environment is using NetApp SAN over FC, a synology NAS is used as the backup repo. A virtual machine is selected to be veeam proxy.
The DR environment is geographically near, here there is another set of hosts with NetApp SAN over FC, the physical Veeam server is also located here.
When backup jobs run, it uses the veeam proxy in the production environment, jobs show as HOT ADD.
it's become apparent that there is an issue that SRM is replicating machines whilst VMs are being backed up by Veeam, meaning there can be two open snapshots per machine, sometimes the snapshots are not removed properly, which leads to performance issues.
During the actual backups, servers such as exchange may "go offline" for a period of up to 30 minutes.
I've looked into the latest version of SRM, but it seems you are not able to set a replication job window, so that replication only happens during business hours. Due to the setup of the company, they want to remain using SRM and minimise any downtime for remediation work done, so I thought I would ask on here for any suggestions on ways to alleviate the issue.
Each night Veeam (version 7, updating to version 8 today) backs the VM's up to a NAS device.
The production VMware environment is using NetApp SAN over FC, a synology NAS is used as the backup repo. A virtual machine is selected to be veeam proxy.
The DR environment is geographically near, here there is another set of hosts with NetApp SAN over FC, the physical Veeam server is also located here.
When backup jobs run, it uses the veeam proxy in the production environment, jobs show as HOT ADD.
it's become apparent that there is an issue that SRM is replicating machines whilst VMs are being backed up by Veeam, meaning there can be two open snapshots per machine, sometimes the snapshots are not removed properly, which leads to performance issues.
During the actual backups, servers such as exchange may "go offline" for a period of up to 30 minutes.
I've looked into the latest version of SRM, but it seems you are not able to set a replication job window, so that replication only happens during business hours. Due to the setup of the company, they want to remain using SRM and minimise any downtime for remediation work done, so I thought I would ask on here for any suggestions on ways to alleviate the issue.
Technical Architect
Veeam Certified Architect
Veeam Vanguard
Veeam Certified Architect
Veeam Vanguard
- Personal Technical Blog - www.veducate.co.uk
- Twitter - @saintdle
-
- Influencer
- Posts: 10
- Liked: 3 times
- Joined: Aug 16, 2013 8:19 am
- Full Name: Geoff Grice
- Contact:
Re: SRM replication and Veeam Backups causing issues
I have a similar mixed environment with SRM and Veeam operating at the same time. I don't get the issue that you note although my SRM replication is not done via an SRA but rather via VMware replication so it does not use conventional VMware snapshots (but rather an under the hood SRM snapshot - apparently).
Another plus is that I'm using Tintri storage with the VAAI plug in so my Veeam snapshots create and delete with zero stun.
Another plus is that I'm using Tintri storage with the VAAI plug in so my Veeam snapshots create and delete with zero stun.
-
- Veeam Vanguard
- Posts: 103
- Liked: 17 times
- Joined: Aug 05, 2014 1:13 pm
- Full Name: Dean lewis
- Contact:
Re: SRM replication and Veeam Backups causing issues
Hi,
they are not using the SRA with the NetApp, just using vsphere replication. And I am sure this uses normal snapshots, nothing under the hood, as I've had to cleanup the stuck snapshots
I've upgraded to v8 today, so hopefully the snapshot hunter will help,
just wondering the best way to get around all this you see. Bit of a pain, as its not my company, I just turn up as a consultant for the customer.
they are not using the SRA with the NetApp, just using vsphere replication. And I am sure this uses normal snapshots, nothing under the hood, as I've had to cleanup the stuck snapshots
I've upgraded to v8 today, so hopefully the snapshot hunter will help,
just wondering the best way to get around all this you see. Bit of a pain, as its not my company, I just turn up as a consultant for the customer.
Technical Architect
Veeam Certified Architect
Veeam Vanguard
Veeam Certified Architect
Veeam Vanguard
- Personal Technical Blog - www.veducate.co.uk
- Twitter - @saintdle
-
- Veteran
- Posts: 1531
- Liked: 226 times
- Joined: Jul 21, 2010 9:47 am
- Full Name: Chris Dearden
- Contact:
Re: SRM replication and Veeam Backups causing issues
Vsphere replication uses a special type of snapshot - there is a little more info on it here http://forums.veeam.com/post64493.html
are they using VSS with their replication snapshots ?
you can't usually see the replication snapshots unless there is a prexisting snap on the machine.
what about using pre / post job scripts to pause and restart the replication ?
is the customer running Enterprise plus ? you might be able to get round a lot of the issue by using backup form storage snapshots which will minimise the impact of the vmware snap commits.
are they using VSS with their replication snapshots ?
you can't usually see the replication snapshots unless there is a prexisting snap on the machine.
what about using pre / post job scripts to pause and restart the replication ?
is the customer running Enterprise plus ? you might be able to get round a lot of the issue by using backup form storage snapshots which will minimise the impact of the vmware snap commits.
-
- Novice
- Posts: 4
- Liked: never
- Joined: Jun 15, 2015 3:55 pm
- Full Name: Stan Wilkins
- Contact:
Re: SRM replication and Veeam Backups causing issues
Have you managed to figure out what's causing the issue between SRM and Veeam ?
-
- Product Manager
- Posts: 20415
- Liked: 2302 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: SRM replication and Veeam Backups causing issues
Hi, Stan,
Do you mind answering several questions? What particular you get while working with combination of SRM and VB&R? Do you replicate or backup exact VMs via two solutions? Is one or two products taking care about VSS freez inside VMs?
More information regarding your situation would be helpful.
Thanks.
Do you mind answering several questions? What particular you get while working with combination of SRM and VB&R? Do you replicate or backup exact VMs via two solutions? Is one or two products taking care about VSS freez inside VMs?
More information regarding your situation would be helpful.
Thanks.
-
- Novice
- Posts: 4
- Liked: never
- Joined: Jun 15, 2015 3:55 pm
- Full Name: Stan Wilkins
- Contact:
Re: SRM replication and Veeam Backups causing issues
Hello, thanks for the questions,
If VSS is enabled for SRM - even on just two of the 8 vms beings replicated - it appears to clash with the VSS that is enabled on VB&R jobs for all vms. Example, one vm not being replicated with SRM was constantly creating and removing snapshots of itself whilst replications - using vss - continued. As soon as they were paused the snapshot issue stopped.
We replicate 8 of the 25 vms we backup.
VSS was used on 2 of the replicated machines and VSS is used is used for the majority of vms in veeam.
If VSS is enabled for SRM - even on just two of the 8 vms beings replicated - it appears to clash with the VSS that is enabled on VB&R jobs for all vms. Example, one vm not being replicated with SRM was constantly creating and removing snapshots of itself whilst replications - using vss - continued. As soon as they were paused the snapshot issue stopped.
We replicate 8 of the 25 vms we backup.
VSS was used on 2 of the replicated machines and VSS is used is used for the majority of vms in veeam.
-
- Product Manager
- Posts: 20415
- Liked: 2302 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: SRM replication and Veeam Backups causing issues
I'd say if both solutions are trying to manage VSS freeze inside particular VM, conflicts are expected. If those VMs aren't running special VM applications, you might want to disable VSS processing in one solution or in the other one to avoid overlaps. Thanks.
-
- Novice
- Posts: 4
- Liked: never
- Joined: Jun 15, 2015 3:55 pm
- Full Name: Stan Wilkins
- Contact:
Re: SRM replication and Veeam Backups causing issues
OK, thanks for the update, would you also say that we'd expect the same conflict within Hyper-V?
-
- Product Manager
- Posts: 20415
- Liked: 2302 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: SRM replication and Veeam Backups causing issues
It is not related to underlying platform, but rather to the fact that if two independent solutions try to take care about VSS aware application present inside VM, some conflicts are expected.
-
- Novice
- Posts: 4
- Liked: never
- Joined: Jun 15, 2015 3:55 pm
- Full Name: Stan Wilkins
- Contact:
Re: SRM replication and Veeam Backups causing issues
OK, thanks for your reply and support
-
- Product Manager
- Posts: 20415
- Liked: 2302 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: SRM replication and Veeam Backups causing issues
You're welcome. Should other questions arise, don't hesitate to ask.
-
- Veeam Vanguard
- Posts: 103
- Liked: 17 times
- Joined: Aug 05, 2014 1:13 pm
- Full Name: Dean lewis
- Contact:
Re: SRM replication and Veeam Backups causing issues
Hi, im the OP here, no we havent managed to resolve the issue, or do further testing,
I was researching SRM, and it looks like you cannot set a blackout window for the SRM Replication jobs.
It may be that we re-architect the environment to allow for direct FC SAN backups, which should bring down the backup time
I was researching SRM, and it looks like you cannot set a blackout window for the SRM Replication jobs.
It may be that we re-architect the environment to allow for direct FC SAN backups, which should bring down the backup time
Technical Architect
Veeam Certified Architect
Veeam Vanguard
Veeam Certified Architect
Veeam Vanguard
- Personal Technical Blog - www.veducate.co.uk
- Twitter - @saintdle
Who is online
Users browsing this forum: No registered users and 22 guests