Backup Copy to Cloud error:same key already been added

[mingji]

case number: 03017125

Hi there,
This issue has been bugging me for a while, I had to create a new job completely but it still happens somehow.
Basically, a Backup Copy to Cloud job was all right when first created, it will replicate backups without issue. However, when I started a new interval, it says:

Code: Select all

:: Failed to preprocess target Error: An item with the same key has already been added.  
:: Unable to create target storage, processing will be retried (retry 1 out of 6)  
Job will fail after 6 tries.

I renamed vbm, rescanned repository, named vbm back and remapped job, issue was fixed last week, but this week the same thing happened again, and renaming vbm will not fix it this time.
more logs:

Code: Select all

[21.05.2018 10:54:18] <01> Info     [CloudGateSvc 203.167.148.98:6180]Request: [Db.WriteSessionLog] 
[21.05.2018 10:54:18] <01> Info     [CloudGateSvc 203.167.148.98:6180]Response: 
[21.05.2018 10:54:18] <01> Error    An key [91a2bd01-62ce-4309-902f-95d48cb7904f] with the same value [84caa0e6-ea73-49e8-b849-89755953496e] has already been added. New key: [716480ab-cb2e-4b92-b751-61475986e2a8] (System.Exception)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Common.TwoWayDictionary`2.Add(TKey key, TValue value)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CCloudDbBackupInterceptor.ToRemoteObjectId(Guid localObjectId, Guid backupId)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CCloudDbAccessor.FindOibByBackupIdPointIdAndObjectId(Guid backupId, Guid pointId, Guid objectId)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CPoint.FindOib(Guid objId)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.FindLastStorageInPointGroup(Guid objectId)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.GetLastStorage(Guid objectId, Boolean checkAvailability)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.CreateStorageAlg(Guid objId, CHost host)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.<>c__DisplayClass13.<CreateInContainer>b__12(Guid objId)
[21.05.2018 10:54:18] <01> Error       at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CStorageGroupSplitter`1.GetOrAdd(Guid objectId, Func`2 func)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.CreateInContainer(Guid objectId, CHost host)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.CreateStorageAlgs(IEnumerable`1 objectIds)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.CreateStorageAlgs(IEnumerable`1 taskObjects, Boolean createStoragesForPreviousTasks)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.PreProcess(ITasksScheduler tasksScheduler, IEnumerable`1 taskObjects, Boolean createStoragesForPreviousTasks)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupCopyJobTargetCreator.PreprocessBackupTarget(CBackupJobTarget jobTarget, ITaskBuilderEntry[] entries)
[21.05.2018 10:54:18] <01> Error    An item with the same key has already been added. (System.ArgumentException)
[21.05.2018 10:54:18] <01> Error       at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
[21.05.2018 10:54:18] <01> Error       at System.Collections.Generic.Dictionary`2.Add(TKey key, TValue value)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Common.TwoWayDictionary`2.Add(TKey key, TValue value)
[21.05.2018 10:54:18] <01> Error    An key [91a2bd01-62ce-4309-902f-95d48cb7904f] with the same value [84caa0e6-ea73-49e8-b849-89755953496e] has already been added. New key: [716480ab-cb2e-4b92-b751-61475986e2a8] (System.Exception)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Common.TwoWayDictionary`2.Add(TKey key, TValue value)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CCloudDbBackupInterceptor.ToRemoteObjectId(Guid localObjectId, Guid backupId)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CCloudDbAccessor.FindOibByBackupIdPointIdAndObjectId(Guid backupId, Guid pointId, Guid objectId)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CPoint.FindOib(Guid objId)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.FindLastStorageInPointGroup(Guid objectId)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.GetLastStorage(Guid objectId, Boolean checkAvailability)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.CreateStorageAlg(Guid objId, CHost host)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.<>c__DisplayClass13.<CreateInContainer>b__12(Guid objId)
[21.05.2018 10:54:18] <01> Error       at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CStorageGroupSplitter`1.GetOrAdd(Guid objectId, Func`2 func)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.CreateInContainer(Guid objectId, CHost host)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.CreateStorageAlgs(IEnumerable`1 objectIds)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.CreateStorageAlgs(IEnumerable`1 taskObjects, Boolean createStoragesForPreviousTasks)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupJobTarget.PreProcess(ITasksScheduler tasksScheduler, IEnumerable`1 taskObjects, Boolean createStoragesForPreviousTasks)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Core.CBackupCopyJobTargetCreator.PreprocessBackupTarget(CBackupJobTarget jobTarget, ITaskBuilderEntry[] entries)
[21.05.2018 10:54:18] <01> Error    An item with the same key has already been added. (System.ArgumentException)
[21.05.2018 10:54:18] <01> Error       at System.Collections.Generic.Dictionary`2.Insert(TKey key, TValue value, Boolean add)
[21.05.2018 10:54:18] <01> Error       at System.Collections.Generic.Dictionary`2.Add(TKey key, TValue value)
[21.05.2018 10:54:18] <01> Error       at Veeam.Backup.Common.TwoWayDictionary`2.Add(TKey key, TValue value)
[21.05.2018 10:54:18] <01> Info     [RemoteBackupJobPerformer] Failed to preprocess target. Sleeping for 5 minutes

[jayscarff]

Did you get this resolved? Just started having this issue with a cloud copy job today,

Thanks

[veremin]

In original case the issue seems to have been caused by duplicated entities (same VMs were managed by two SCVMM servers and both were added to backup server).

Anyway, I recommend you opening your own ticket and letting our support team investigate it directly.

Thanks.

[Shaveen]

Hello all,

I have a replication job and a backup job configured in my infra. I am acting as a tenant side and backup and replication is being done to cloud hosts and repositories. I wanted to test a replication for a virtual machine which was initially backup to the cloud repo using seeding in the job.
Note that a normal replication was already done before that successfully. I just deleted the replica from the cloud host and from my veeam backup server under replica in Ready section. I then created a new job using seeding from the repo and run it

I got error : ''The key already existed in the dictionary''

Any help would be appreciated

Thank you

[PetrM]

Hello,

The error is quite generic and can appear due to various reasons, for example because of duplicated entries at the level of configuration database.
Feel free to contact our support team for further investigation, debug logs and database analysis is required to identify the root cause.

Thanks!