Backup VMs with Passthrough PCIe devices (GPU)

VMware specific discussions

Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby DJSnels » Thu Mar 06, 2014 8:01 am

I was wondering if there is a method to backup VMWare guests that have a PCIe device passthrough (such as in our case a GPU).
Backing up such VM failes because VMs with passthrough devices cannot be snapshotted. Is there any way to skip the snapshot and backup the VM using VSS only?
I prefere NOT to shut down the guest.

ESX: 5.5
Veeam: 7
Guests: Server 2012R2
DJSnels
Lurker
 
Posts: 2
Liked: never
Joined: Thu Mar 06, 2014 7:56 am

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby v.Eremin » Thu Mar 06, 2014 9:28 am

Passthrough disks are automatically skipped from processing, since they can't be snapshotted. Do you mean you want to backup VMs on a file level? Thanks.
v.Eremin
Veeam Software
 
Posts: 13558
Liked: 1006 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby dellock6 » Thu Mar 06, 2014 10:13 am

To clarify Vladimir, a passthrough device is different from a passthrough disk, VMware calls this DirectPath I/O. In this case it's the graphic processor passed to the VM directly.
Since this process completely by-passed th VMM (virtual machine manager) and let's the guest os use directly the hardware device, I suspect it's a limit that cannot be avoided when calling VADP libraries. Probably some lab tests are needed, but my feeling the problem cannot be avoided (just like for example vmotion is not supported for obvious reasons)

Luca.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5118
Liked: 1361 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby dellock6 » Thu Mar 06, 2014 8:19 pm

I finally found the answer, sadly for the opener, a VM with DirectPath I/O enabled cannot be saved with VADP libraries:

http://pubs.vmware.com/vsphere-50/index ... 88613.html

Look at the 3rd bullet point. I'm not even sure it's enough to power off the VM.

Luca.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5118
Liked: 1361 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby lp@albersdruck.de » Thu Mar 06, 2014 8:36 pm

dellock6 wrote:I finally found the answer, sadly for the opener, a VM with DirectPath I/O enabled cannot be saved with VADP libraries:

http://pubs.vmware.com/vsphere-50/index ... 88613.html

Look at the 3rd bullet point. I'm not even sure it's enough to power off the VM.

Luca.


I have a VM with a DirectPath I/O PCIe passthrough (LSI SAS Controller). I can backup the VM without problems as long as it is powered off. Even CBT works.
lp@albersdruck.de
Enthusiast
 
Posts: 81
Liked: 31 times
Joined: Mon Mar 25, 2013 7:37 pm
Full Name: Lars Pisanec

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby dellock6 » Thu Mar 06, 2014 8:45 pm

Hi Lars, thanks for the additional information, really appreciated.

Luca.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5118
Liked: 1361 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby DJSnels » Mon Mar 10, 2014 10:44 am

Thanks for the replies.
Is there any way to create Veeam backups without the use of snapshots? e.g. Microsoft VSS only?
I don't like using any other software (such as Windows Backup) to backup VM's with passthrough PCI devices.
DJSnels
Lurker
 
Posts: 2
Liked: never
Joined: Thu Mar 06, 2014 7:56 am

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby dellock6 » Mon Mar 10, 2014 11:10 am

Veeam does not supports backups at the guest level, they are always done at the hypervisor level using VADP libraries, and thus VMware snapshots.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5118
Liked: 1361 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby Vitaliy S. » Mon Mar 10, 2014 11:18 am

DJSnels wrote:Is there any way to create Veeam backups without the use of snapshots? e.g. Microsoft VSS only?

No, VM snapshot is still required.
Vitaliy S.
Veeam Software
 
Posts: 19773
Liked: 1120 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

[MERGED] Veeam Backup VM with Passthrough Device

Veeam Logoby leedudmish » Wed Nov 02, 2016 7:58 am

Hi All,

We are looking at gpu passthrough for VM's for high end users and have the lab working ok, during setup it did state snapshots are not supported with machines that have a passthrough device.

Can this be confirmed or is this something which veeam can overcome, is there any pre/post scripts whcih could be run to alleviate the issue at all such as shut down the vm, take snapshot, then switch vm back on again after the backup.

The vm's will be running windows 10 and are end user based so we can switch off if necessary?

thanks

Lee
leedudmish
Influencer
 
Posts: 11
Liked: 2 times
Joined: Mon May 09, 2016 6:13 pm
Full Name: Lee

Re: Backup VMs with Passthrough PCIe devices (GPU)

Veeam Logoby v.Eremin » Wed Nov 02, 2016 11:28 am

Your post has been merged into existing discussion. Kindly, check the answers provided above.

Additionally, you can try to backup such VMs from the inside, using Veeam Endpoint Backup.

Thanks.
v.Eremin
Veeam Software
 
Posts: 13558
Liked: 1006 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin


Return to VMware vSphere



Who is online

Users browsing this forum: No registered users and 14 guests