Error when replicating VM's on VSphere

[techteam]

Hi,
Veeam B&R 11.0.1.1261, VCenter 7.0.3, Esxi 7.02

I'm getting an error when replicating certain VM's. The error is:

Code: Select all

Processing vmxxxxx Error: The object has been deleted. VDS error code: 0x8004240b Failed to retrieve an enumeration of the disk objects. Failed to open disk for write. Failed to download disk '>'. Shared memory connection was closed. Failed to upload disk. Skipped arguments: [>]; Agent failed to process method {DataTransfer.SyncDisk}.

The job completes successfully on Retry 1 so not sure what's going on. Any help would be appreciated. Thanks.

[Natalia Lupacheva]

Hello,

Please provide a support case ID for this issue, as requested when you click New Topic.
It's a technical issue so the logs analysis is required here, Support could help.

Thanks!

[techteam]

I've now created a support case. The ID is #02316618.
Thanks.

[Zondit]

Hello,

Did you find out the cause to this?
We are having the same issue.

Thanks.

[PetrM]

Hi Anton,

The case is still under research, I suggest you to contact our support team as well because the mentioned error might be just a symptom of different problems. However, you may try to decrease the number of concurrent tasks running in parallel, I encountered a case in which this workaround helped to get rid of failures but no guarantees that the same thing will be helpful in your situation. Please share a support case ID so that we can keep all related cases on our radar.

Thanks!

[techteam]

Status Update:
The replication job has not thrown any errors since we reduced the concurrent tasks to 4 ( it was 8 previously) on the backup proxy.
I would suggest trying this.

[FrancWest]

Same issue here, case #04956030. We only get the error when using hot-add, with NBD the issue does not occur, but then we have the known issue with vSphere 7 that it’s very slow.

[PetrM]

Hello,

@techteam Many thanks for sharing this information with the Community!

The research of the issue is still in progress, our senior support engineers work together with RnD in order to reveal the root cause.

Thanks!

[AVavav]

Hi,

Since a few months and versions ago, our Veeam daily replication job of 6 VMs fails on random nights and on random VMs and leave unusable replicas that need to be deleted so that ithe next replcation job can start afresh.
For example:
Processing XYZ Error: The object has been deleted. VDS error code: 0x8004240b Failed to retrieve an enumeration of the disk objects. Failed to open disk for write. Failed to download disk '>'. Reconnectable protocol device was closed. Failed to upload disk. Skipped arguments: [XYZ-flat.vmdk]; Agent failed to process method {DataTransfer.SyncDisk}.

Veeam Support - Case # 05315821 which is tasking ages to progress and last I was asked to check if:
mounted disks stuck on Proxies, auto-mount enabled or VMs needing consolidation, neither are.

Anyone came across it or as any idea?

[HannesK]

Hello,
to answer the first part of the question... yes (see above)

Checking the cases, the reasons seem to be different (system requirements not met, backup server = source and target proxy)... so I suggest to figure out with support.

Best regards,
Hannes

[AVavav]

Hello,

@techteam Many thanks for sharing this information with the Community!

The research of the issue is still in progress, our senior support engineers work together with RnD in order to reveal the root cause.

Thanks!

Did you ever get to the bottom of this? I've a case open but am chasing updates from support for a good few days

[PetrM]

Hello,

Our support engineers found that the issue can occur when proxy processes many tasks in parallel in HotAdd and disk detach and enumeration tasks overlap. Looks like there is a private fix for this issue and I've just asked our team to check whether this fix is applicable in your case or not.

Thanks!