Disaster recovery orchestration for the Enterprise
Post Reply
Markus.K1985
Veeam Vanguard
Posts: 60
Liked: 18 times
Joined: Dec 08, 2014 2:30 pm
Full Name: Markus Kraus
Contact:

Lab Test is stuck at waiting for VM

Post by Markus.K1985 » Jun 06, 2018 9:18 am

Hello,

I have created a simple Lab with one VM on a Singe ESXi Host. The Lab is tarting, but the Lab Test is stuck at waiting for VM Heartbeat. VMware Tools are running and ESXi Hosts receives VM Heartbeat. Veeam B&R Job "Vm Start Job" is in Status -
Working.

Code: Select all

The File Log of the Job repeats:
[i][06.06.2018 11:13:25] <01> Info     [StableIp] Searching for real IP-address
[06.06.2018 11:13:25] <01> Info     [StableIp] Network adapter: Index=0, DeviceConfigId=4000, IpAddress='fe80::250:56ff:feb1:dce1'
[/i]

And exits with:
[i][06.06.2018 11:14:37] <01> Info     [StableIp] IP-address hasn't been detected
[06.06.2018 11:14:37] <01> Info     [StableIp] ===============================================================================================================================================
[06.06.2018 11:14:37] <01> Info     [StableIp] ====
[06.06.2018 11:14:37] <01> Info     [StableIp] |  |
[06.06.2018 11:14:37] <01> Info     [StableIp] ====
[06.06.2018 11:14:37] <01> Info     [StableIp] |  |
[06.06.2018 11:14:37] <01> Info     [StableIp] ====
[06.06.2018 11:14:37] <01> Error    Results: OS did not boot in the allotted time (System.TimeoutException)
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.Core.CViVmStartStableIpAction.<>c__DisplayClass3.<Execute>b__0()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CIpDetectionWaitTask.CheckDeadline(DateTime deadline)
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CIpDetectionWaitTask.RunImpl()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CStableIpWaitTask.Run()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CAnalyzeAlgorithm.Execute()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CAnalyzeAlgorithm.Analyze(CStableIpAddress address, DateTime deadLine, Int32 timeOut, TimeOutDelegate timeOutDelegate, CheckStoppedDelegate checkStoppedDelegate, CLogDelegate logDelegate, CAlgorithmStateChangedDelegate stateChangedDelegate, CStableIpAlgorithmParams parameters)
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CRebootTolerantAnalyzeAlgorithm.Execute()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CStableIpAlgorithm.AnalyzeMode()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.Core.CViVmStartStableIpAction.Execute()
[06.06.2018 11:14:37] <01> Info         [Soap] Connection 'esxi-10.lab.local:443:root:False::0:1' is disposing.
[06.06.2018 11:14:37] <01> Error    Results: OS did not boot in the allotted time (System.TimeoutException)
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.Core.CViVmStartStableIpAction.<>c__DisplayClass3.<Execute>b__0()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CIpDetectionWaitTask.CheckDeadline(DateTime deadline)
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CIpDetectionWaitTask.RunImpl()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CStableIpWaitTask.Run()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CAnalyzeAlgorithm.Execute()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CAnalyzeAlgorithm.Analyze(CStableIpAddress address, DateTime deadLine, Int32 timeOut, TimeOutDelegate timeOutDelegate, CheckStoppedDelegate checkStoppedDelegate, CLogDelegate logDelegate, CAlgorithmStateChangedDelegate stateChangedDelegate, CStableIpAlgorithmParams parameters)
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CRebootTolerantAnalyzeAlgorithm.Execute()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.SureBackup.Common.CStableIpAlgorithm.AnalyzeMode()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.Core.CViVmStartStableIpAction.Execute()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.Core.CViVmStartEngine.Run()
[06.06.2018 11:14:37] <01> Error       at Veeam.Backup.Core.CVmStartJobExecuter.Execute()
[06.06.2018 11:14:37] <01> Info     Session completed with error. Job: [Vm Start Job]
[/i]
Is a real IP in the VM necessary für the VAO LAB (VMware Heartbeat does not have this requirement)?
Any hints where I can start troubleshooting this situation?

Best regards,
Markus

Alec King
VP, Product Management
Posts: 934
Liked: 174 times
Joined: Jan 01, 2006 1:01 am
Contact:

Re: Lab Test is stuck at waiting for VM

Post by Alec King » Jun 06, 2018 9:43 am

Hi Markus,

Is the VM configured to get IP v4 address?

Markus.K1985
Veeam Vanguard
Posts: 60
Liked: 18 times
Joined: Dec 08, 2014 2:30 pm
Full Name: Markus Kraus
Contact:

Re: Lab Test is stuck at waiting for VM

Post by Markus.K1985 » Jun 06, 2018 12:18 pm

I have configured a IPv4 to my Replication VM (test) and now, as expected, the VM Heartbeat was detected. But I am wondering about this behavior, because a configured IP is not VM Heartbeat. I would expect a separate Test for that.

After "Fixing" this issue my Lab Test is still exiting with warning:
Recovery Step Details
Check VM license and availability (Warning)
Timestamp Details
12:53:06 License has not expired
12:53:06 License is not exceeded
12:53:06 Waiting VM for availability...
12:53:06 VM is already testing
Process Replica VM (Skipped)
Timestamp Details
12:53:06 Skipped: VM is already testing
Check VM Heartbeat (Skipped)
Timestamp Details
12:53:06 Skipped: VM is already testing

The File log only throws one warning:
[06.06.2018 14:10:27] <01> Warning Unknown guest id vmwarePhoton64Guest

Any hint why "VM is already testing" ?

Alec King
VP, Product Management
Posts: 934
Liked: 174 times
Joined: Jan 01, 2006 1:01 am
Contact:

Re: Lab Test is stuck at waiting for VM

Post by Alec King » Jun 06, 2018 12:25 pm

Our initial check called 'Heartbeat' has been present in SureBackup / SureReplica for years, and is actually a check of -
* VM Powered on successfully
* Network initialised
* VMTools heartbeat
This algorithm is built into B&R and not easily changed!

Regarding 'VM already testing' - try Power OFF the lab in VAO UI, and make sure that Lab Appliance in B&R and vCenter also shows powered off, and all VM replicas powered off and reverted to Ready state.

Markus.K1985
Veeam Vanguard
Posts: 60
Liked: 18 times
Joined: Dec 08, 2014 2:30 pm
Full Name: Markus Kraus
Contact:

Re: Lab Test is stuck at waiting for VM

Post by Markus.K1985 » Jun 06, 2018 2:19 pm

I have Reset the State of the whole Lab -> same Issue

In my config I have not enabled the Network Appliance in Lab Settings, is that a possible problem?

Alec King
VP, Product Management
Posts: 934
Liked: 174 times
Joined: Jan 01, 2006 1:01 am
Contact:

Re: Lab Test is stuck at waiting for VM

Post by Alec King » Jun 06, 2018 4:04 pm

You definitely need to Enable the lab (for your desired Site, if more than one Site)
In Configuration - Plan Components, on Virtual Labs tab, check the box for the lab.
After it's checked, you should see this lab in the Home area of UI, in Virtual Labs node.

Select the lab and Edit to configure it with a 'test environment' (it looks very similar to editing a Plan). I believe at a minimum you will need to add a Domain Controller to the test environment so that your plan VMs can boot in the isolated network. (note -the DC must be replicated by B&R)

With above complete, you can select your plan in Failover Plans page and choose Verify - Run Lab Test.
You will see everything start in order -
1. Lab Appliance
2. Lab Groups (e.g. domain controller)
3. Your chosen Plan

Hope that helps!
Alec King
Vice President, Product Management
Veeam Software

Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest