Host-based backup of Microsoft Hyper-V VMs.
Post Reply
mhugradar
Novice
Posts: 5
Liked: never
Joined: Jul 26, 2021 3:47 pm
Full Name: Hussain Ugradar
Contact:

Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by mhugradar »

Hi
so here is my scenario:


2 Hyper-V hosts in a cluster – W-SRV-HYPERV3 & W-SRV-HYPERV4. Both running Windows Server 2012 R2.

Both attached via 100GB iSCSI to the SC5020.

Mixture of VMs ranging from 2008 to 2019.

Veeam installed on W-SRV-HYPERV4.

The following applications installed on both Hyper-V hosts
• Dell Storage Replay Manager
• Dell Storage Replay Manager Management Tools
• Dell Storage Replay Manager Verification Services

If a VM is running on W-SRV-HYPERV3, Veeam is able to backup the VM using the Compellent Replay Manager VSS Provider 100% of the time.

If a VM is running on W-SRV-HYPERV4, Veeam will always give the following message:

Failed to create snapshot (Compellent Replay Manager VSS Provider) (mode: Veeam application-aware processing) Details: Unknown status of async operation.
The shadow copy provider had an error. Check the System and Application event logs for more information.
--tr:Failed to create VSS snapshot.
--tr:Failed to perform pre-backup tasks.

If I move a VM that failed on W-SRV-HYPERV4 to W-SRV-HYPERV3, the backup then works fine.

I have a ticket open with Veeam and they suggested contacting Dell because of the VSS provider that is being used. Its also worth mentioning, the reason we are using the Compellent Replay VSS provider is because the volume which hosts the VMs is larger than 64TB which I believe is the limit for Windows VSS provider.
Both DELL and VEEAM are sending me to each other and we are not getting any closer to a resolution.

following on from this, I was advised to upgrade both hosts to Server 2019, this has now been completed yet the same issue still remains.

Does anyone have any ideas?

I could install VEEAM on a VM instead and attempt this, but i assumed this would be the fastest way to get backups.
Andreas Neufert
VP, Product Management
Posts: 6699
Liked: 1400 times
Joined: May 04, 2011 8:36 am
Full Name: Andreas Neufert
Location: Germany
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by Andreas Neufert »

Regarding the VM usage for the Off-Host Proxy.
It is documented here:
https://helpcenter.veeam.com/docs/backu ... ml?ver=110


On the same page, you will find this sentence:
"If you plan to perform off-host backup for a Microsoft Hyper-V cluster with CSV, you must deploy an off-host backup proxy on a host that is not a part of the cluster. If the off-host backup proxy is deployed on a node of the cluster, the cluster will fail during VM data processing."
This is not a Veeam limitation, but it is by design of the VSS Framework from Microsoft.

Can you please share for the reference your support ticket number?
Andreas Neufert
VP, Product Management
Posts: 6699
Liked: 1400 times
Joined: May 04, 2011 8:36 am
Full Name: Andreas Neufert
Location: Germany
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by Andreas Neufert »

Just an idea, you could make the other Hyper-V server an offhost proxy as well and select the opposit host as proxy for the VMs.
It would have some management overhead but would maybe work.
mhugradar
Novice
Posts: 5
Liked: never
Joined: Jul 26, 2021 3:47 pm
Full Name: Hussain Ugradar
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by mhugradar »

The VEEAM Reference is: 04930509



Whilst VEEAM is installed on the HV Host, if i select Off Host i still get the error, but also i noticed it wont display the backup proxy servers in the list. (Within the backup job)

I only have 2 hosts though, and both are part of the cluster, so does that rule out Of Host Backup whilst Veeam is on a VM?
Andreas Neufert
VP, Product Management
Posts: 6699
Liked: 1400 times
Joined: May 04, 2011 8:36 am
Full Name: Andreas Neufert
Location: Germany
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by Andreas Neufert »

Off-host backup of CSV volumes need a third hardware server for off-host prox processing.
In the link you find a statement related to the VM usage as off-host proxy.
mhugradar
Novice
Posts: 5
Liked: never
Joined: Jul 26, 2021 3:47 pm
Full Name: Hussain Ugradar
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by mhugradar »

ok, i dont have a 3rd host to be able to use that method then unfortunately.
mhugradar
Novice
Posts: 5
Liked: never
Joined: Jul 26, 2021 3:47 pm
Full Name: Hussain Ugradar
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by mhugradar »

Update: the names were changed on the Hyperv Hosts

W-HV01
W-HV02 - VEEAM Installed

some weird combinations going on now

it seems any new Virtual Machine running Windows Server 2019 on Configuration Version 9.0 - backs up fine.

If the server is a prev OS version with Config 5.0 then it fails with that error

I found this out because, i was able to back new servers initially that were not in the CLUSTER yet, and i was wondering why non cluster machines are working but not VMs in the Cluster.

The problem i have now is, i can upgrade the Config on Servers running 2019, but what do i do about servers running 2012 R2 on 5.0!!
Andreas Neufert
VP, Product Management
Posts: 6699
Liked: 1400 times
Joined: May 04, 2011 8:36 am
Full Name: Andreas Neufert
Location: Germany
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by Andreas Neufert »

We are not performing anything special for the VMs. It is all about the VSS framework and how the hardware vendor has implemented their own hardware VSS provider.
We know that it is not working in any case and as I shared above, it is not officially supported.
mhugradar
Novice
Posts: 5
Liked: never
Joined: Jul 26, 2021 3:47 pm
Full Name: Hussain Ugradar
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by mhugradar »

i tested a Windows Server 2012 running config file 5.0 and the backup failed

I upgraded the config file to 9.0 and backup succeeded ..
Andreas Neufert
VP, Product Management
Posts: 6699
Liked: 1400 times
Joined: May 04, 2011 8:36 am
Full Name: Andreas Neufert
Location: Germany
Contact:

Re: Veeam Backups failing - Dell Compellent VSS Hardware Providers

Post by Andreas Neufert »

Thanks for sharing this. Please remember that in the end this configuration is unsupported by definition within our documentation (see above link).
Post Reply

Who is online

Users browsing this forum: Bing [Bot] and 11 guests