Veeam B&B v8 update 3 vSphere 6 update 1b

[pidthepiper]

Hi guys,

I am considering upgrading to update 1b and I was wondering of B&B v8 update 3 would support it OK?

I literally just thought of this now, and thought I should also since update 1b only just came out.
Cheers,

[Gostev]

Hi, yes. But be aware that there are already some bug reports on Update 1b. Thanks!

[justind]

One issue that I am investigating is that after upgrading the vmtools Veeam fails trying to quiesce using VM tools.

Out-of date Tools v9.4.10.38250

Code: Select all

vcpu-0| I120: ToolsBackup: changing quiesce state: IDLE -> STARTED
vcpu-0| I120: ToolsBackup: changing quiesce state: STARTED -> COMMITTED

Current Tools v10.0.0.50046
vcpu-0| I120: Tools: Tools heartbeat timeout.

Code: Select all

[msg.snapshot.quiesce.rpc_timeout] A timeout occurred while communicating with VMware Tools in the virtual machine.
vmx| I120: SnapshotVMXTakeSnapshotComplete: Snapshot 0 failed: Failed to quiesce the virtual machine (31).

Reverting back to the previous tools resolves this error.

Taking a snapshot using the VI Client does not product an error quiescing.

Case ID: 01449970

[lando_uk]

Hi, yes. But be aware that there are already some bug reports on Update 1b. Thanks!

Care to enlighten us?

I'm waiting for Dell to make a nice clean Update 1b ISO before I go ahead and install our shiny new servers.

[svenh]

Current Tools v10.0.0.50046

vcpu-0| I120: Tools: Tools heartbeat timeout.
[msg.snapshot.quiesce.rpc_timeout] A timeout occurred while communicating with VMware Tools in the virtual machine.
vmx| I120: SnapshotVMXTakeSnapshotComplete: Snapshot 0 failed: Failed to quiesce the virtual machine (31).

I cannot provide much insight but I can add to your data points:

Tools v10.0.5-3227872 on ESX 5.5-u2:

Code: Select all

2016-01-19T20:41:21.600Z| vmx| I120: SnapshotVMX_TakeSnapshot start: 'VEEAM BACKUP TEMPORARY SNAPSHOT', deviceState=0, lazy=0, logging=0, quiesced=1, forceNative=0, tryNative=1, sibling=0 saveAllocMaps=0 cb=4467E30, cbData=323C1930
2016-01-19T20:41:39.248Z| vmx| I120: GuestRpcSendTimedOut: message to toolbox timed out.
2016-01-19T20:41:44.188Z| vmx| I120: Tools: Tools heartbeat timeout.
2016-01-19T20:41:51.643Z| vmx| I120: GuestRpcSendTimedOut: message to toolbox timed out.
2016-01-19T20:41:51.643Z| vmx| I120: Msg_Post: Warning
2016-01-19T20:41:51.643Z| vmx| I120: [msg.snapshot.quiesce.rpc_timeout] A timeout occurred while communicating with VMware Tools in the virtual machine.
2016-01-19T20:41:51.643Z| vmx| I120: ----------------------------------------
2016-01-19T20:41:51.646Z| vmx| I120: ToolsBackup: changing quiesce state: IDLE -> DONE
2016-01-19T20:41:51.646Z| vmx| I120: SnapshotVMXTakeSnapshotComplete: Done with  'VEEAM BACKUP TEMPORARY SNAPSHOT': 0
2016-01-19T20:41:51.646Z| vmx| I120: SnapshotVMXTakeSnapshotComplete: Snapshot 0 failed: Failed to quiesce the virtual machine (40).
2016-01-19T20:41:54.249Z| vmx| I120: GuestRpcSendTimedOut: message to toolbox timed out.
2016-01-19T20:42:09.252Z| vmx| I120: GuestRpcSendTimedOut: message to toolbox timed out.
2016-01-19T20:42:24.254Z| vmx| I120: GuestRpcSendTimedOut: message to toolbox timed out.
[...]

After that the VMtools inside the VM are stopped and the next try to snapshot and backup the VM works, but with a warning about the VMTools not running and thus not being able to quiesce the VM.

Not all with this tools version show this behavior but VMs that are affected are always affected.

[svenh]

I cannot provide much insight but I can add to your data points:

Tools v10.0.5-3227872 on ESX 5.5-u2:

Adding to that:

I can also confirm that downgrading to 9.10.5-2981885 (the version from ESX 6.0u1) gets the backup working again.

I find it very interesting that not all VMs with 10.0.5 show this problem. But affected VMs are affected in every backup cycle and not just sporadic.

So far I have yet to find anything those affected VMs have in common and what is different to other unaffected VMs with 10.0.5.

[Pat490]

any news on that issue with vmtools? I updated my hosts to update 1b but still waiting with updating tools on guest vm's

[justind]

The only work around I have been given so far is to use Application aware processing. The only issue I have with this is now getting it to work with DMZ computers as previously I had just used the VMware quiescence.

[svenh]

That was my solution as well.

[pantoufle]

Same error for me.

vCenter 6.0 u1b
ESXi 5.5u3

VMTools 9 + Virtual HW 9 = OK
VMTools 9 + Virtual HW 10 = OK
VMTools 10 + Virtual HW 9 = OK

VMTools 10 + Virtual HW 10 = K.O.


i'm using last version of Veeam Backup 8

do you think a need to open a ticket to Veeam or Vmware support ?

best regards.

[Vitaliy S.]

I would recommend to open a case with VMware support team and let them investigate error messages in the VMware Tools debug log files. If they are able to tell you the reason for these issues, it would be appreciated if you could share the solution (results of investigation) with the community members.

[pantoufle]

done, thanks

support case number is 01720894

[pantoufle]

my problem of tools during snapshot is also present with a manual hand-made snapshot, so i contact VMware support

keep you in touch

[s.leukhin]

pantoufle, It would be great if you post the solution)

ESXi 5.5 3568722

Windows 2012 R2 vmtools 10240
Backup with VMtools Quiesce - Fail: A timeout occurred while communicating with VMware Tools in the virtual machine.
Backup with Veeam Application-Aware Processing: Success

Windows 2012 R2 vmtools 9359
Backup with VMtools Quiesce - Fail: The guest OS has reported an error during quiescing. The error code was: 3 The error message was: Quiesce operation aborted
Backup with Veeam Application-Aware Processing: Success

[mkretzer]

Hello,

i talked to VMware this week they finally know that there is an issue and they told me to downgrade tools to 9.10.5 or even better ESX 5.5 pre-Version 10 tools.

Markus

[vEngineer]

Has anyone seen that a reboot of the VM temporarily resolves the issue, and then it returns? Have seen this issue with 10.0.0 and 10.0.8 tools, though we're using a different VADP-based backup solution. Does anyone have a VMware KB, VMware case # or VMware PR # that can be referenced. Besides this forum discussion, having trouble finding other info about it.

[justind]

According to the release notes VM Tools v10.0.9 should have resolved the tools not running issue after quiesce. I haven't verified it myself.