Host-based backup of Microsoft Hyper-V VMs.
Post Reply
Captnspdr
Veeam Vanguard
Posts: 27
Liked: 3 times
Joined: Apr 16, 2019 4:50 pm
Full Name: Jonah May
Contact:

Replication Failover Logging

Post by Captnspdr »

We've found that some of the logging for replication failovers can be misleading, leading to us going down the wrong troubleshooting paths with Veeam support. It seems that in some cases, whether it be environment changes or otherwise, the HvNicMappings for a replica VM become broken. This of course causes the failover to fail, but the way in which the errors are written to the failover logs makes it sound like it is an issue with the NEA. In most cases, support has had us troubleshoot various NEA connectivity and configuration issues because of the error, when in reality the problem lies with the saved configuration of the replica VM in SQL.

Here's the snippet of the Session.log file where the error occurs. The QuotaNetwork warning is actually the cause of the error, and as stated above is due to missing oib data for the replica being failed over, not the NEA configuration. In looking at these entries with support, it seems the switch-friendly name and UUID are blank (hence the double space after "switch", and the vlan default value, in this case, is 0.

Code: Select all

[05.01.2021 08:24:17] <1820> Warning  QuotaNetwork was not found for switch  vlan 0
[05.01.2021 08:24:17] <1820> Info     [ReplicaAlgLocker] Unlocking replica (SessionId='98b8184a-ec4a-4af5-bde7-9c94fff52005', LockId='df78c2c2-f85a-4fcf-9e65-1e954a3916d8')
[05.01.2021 08:24:17] <1820> Info         [API] DestroyLease.Started, leaseId: [7f0330a4-cbe8-4ee9-a879-8c499aeac5d5]
[05.01.2021 08:24:17] <1820> Info         [API] DestroyLease.Success, leaseId: [7f0330a4-cbe8-4ee9-a879-8c499aeac5d5]
[05.01.2021 08:24:17] <1820> Error    Failed to prepare network extension appliance for failover (System.Exception)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.Core.HyperV.CHvCloudApplianceFailoverAlg.Failover(CHvSnapReplicaVm snapReplicaVm, COib oib, CBaseSession session)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.Core.CLocalFailoverJobAlg.Failover(COib oib)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.CloudService.CCloudFailoverManager.FailoverOib(Guid oibId, CCloudSessionManager sessionManager)
[05.01.2021 08:24:17] <1820> Error    Failed to get replica networks info from infrastructure (System.Exception)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.Core.CCloudFailoverApplianceAlgImpl.Failover(Guid objectId, Guid replicaId, IXmlLogger logger, ICloudApplianceOperator applianceOperator, CCloudFailoveredVmNetworking[] vmNetworkings, Boolean sourceVmHasNics)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.Core.HyperV.CHvCloudApplianceFailoverAlg.Failover(CHvSnapReplicaVm snapReplicaVm, COib oib, CBaseSession session)
[05.01.2021 08:24:17] <1820> Error    Failed to prepare network extension appliance for failover (System.Exception)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.Core.HyperV.CHvCloudApplianceFailoverAlg.Failover(CHvSnapReplicaVm snapReplicaVm, COib oib, CBaseSession session)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.Core.CLocalFailoverJobAlg.Failover(COib oib)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.CloudService.CCloudFailoverManager.FailoverOib(Guid oibId, CCloudSessionManager sessionManager)
[05.01.2021 08:24:17] <1820> Error    Failed to get replica networks info from infrastructure (System.Exception)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.Core.CCloudFailoverApplianceAlgImpl.Failover(Guid objectId, Guid replicaId, IXmlLogger logger, ICloudApplianceOperator applianceOperator, CCloudFailoveredVmNetworking[] vmNetworkings, Boolean sourceVmHasNics)
[05.01.2021 08:24:17] <1820> Error       at Veeam.Backup.Core.HyperV.CHvCloudApplianceFailoverAlg.Failover(CHvSnapReplicaVm snapReplicaVm, COib oib, CBaseSession session)
[05.01.2021 08:24:18] <213> Error    Cloud Connect failed to perform VM failover (System.Exception)
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CCloudFailoverManager.FailoverOib(Guid oibId, CCloudSessionManager sessionManager)
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CCloudServerFailoverInvoker.FailoverOib()
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CCloudServerFailoverInvoker.Invoke()
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CAsyncOperation.DoInternal()
[05.01.2021 08:24:18] <213> Error    --- End of stack trace from previous location where exception was thrown ---
[05.01.2021 08:24:18] <213> Error       at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CAsyncOperation.GetInvokerState()
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CAsyncInvokeExecutor.GetInvokerState(CAsyncOperation operation, Exception& exception)
[05.01.2021 08:24:18] <213> Error    --- End of stack trace from previous location where exception was thrown ---
[05.01.2021 08:24:18] <213> Error       at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CAsyncInvokeExecutor.GetState(Guid asyncId)
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CCloudServerSpecInvoker.RequestTaskResult(CCloudSessionAccessor accessor, COutputXmlData request, CInputXmlData response, CCloudServiceTaskResult& taskResult)
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CCloudServerSpecInvoker.InvokeInternal(CCloudSessionAccessor accessor, COutputXmlData request, CInputXmlData response)
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CCloudServerSpecInvoker.Invoke(CCloudSessionAccessor accessor, COutputXmlData request, CInputXmlData response)
[05.01.2021 08:24:18] <213> Error       at Veeam.Backup.CloudService.CSocketInvokerServerProtocol.InvokeCommand()
Mildur
Product Manager
Posts: 8481
Liked: 2203 times
Joined: May 13, 2017 4:51 pm
Full Name: Fabian K.
Location: Switzerland
Contact:

Re: Replication Failover Logging

Post by Mildur »

Please do not post log files in the R&D Forums.
It‘s not allowed. Technical issues need a support case :)

veeam-backup-replication-f2/rules-of-po ... -t755.html
Product Management Analyst @ Veeam Software
Captnspdr
Veeam Vanguard
Posts: 27
Liked: 3 times
Joined: Apr 16, 2019 4:50 pm
Full Name: Jonah May
Contact:

Re: Replication Failover Logging

Post by Captnspdr »

Case # 04542160
PetrM
Veeam Software
Posts: 3224
Liked: 518 times
Joined: Aug 28, 2013 8:23 am
Full Name: Petr Makarov
Location: Prague, Czech Republic
Contact:

Re: Replication Failover Logging

Post by PetrM »

By the way, the message "Failed to get replica networks info from infrastructure" from the stack trace gives a hint about the reason whereas "Failed to prepare network extension appliance for failover" seems to be a consequence.

Thanks!
Post Reply

Who is online

Users browsing this forum: No registered users and 12 guests