Application Eventlog is filling up with error

[wuffzack]

Hello,
I just installed Veeam Backup & Replication Community edition 10a to automate back up of a couple of PCs.
All is working well, but the eventlog on the server (2019) shows, that Veeam.Backup.ExternalInfrastructure.DbProvider.exe is crashing once every minute:

Code: Select all

Anwendung: Veeam.Backup.ExternalInfrastructure.DbProvider.exe
Frameworkversion: v4.0.30319
Beschreibung: Der Prozess wurde aufgrund einer unbehandelten Ausnahme beendet.
Ausnahmeinformationen: System.ArgumentException
   bei System.Collections.Hashtable.Insert(System.Object, System.Object, Boolean)
   bei Veeam.Backup.ExternalInfrastructure.DbProvider.CSslConfigItem.QueryConfig()
   bei Veeam.Backup.ExternalInfrastructure.DbProvider.CSslCertificateRegistrator.GetBindingItem(System.String, Int32)
   bei Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService.RegisterCertificate(System.Security.Cryptography.X509Certificates.X509Certificate2, Int32)
   bei Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService..ctor()
   bei Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService.get_Instance()
   bei Veeam.Backup.ExternalInfrastructure.DbProvider.Program.Main(System.String[])

The Svc.PlatformDbProvider.log reveals a hint, what might go wrong:

Code: Select all

[24.08.2020 21:48:55] <01> Info     Server starting...
[24.08.2020 21:48:55] <01> Error    Das Element wurde bereits hinzugefügt. Schlüssel im Wörterbuch: "0.0.0.0:443". Hinzuzufügender Schlüssel: "0.0.0.0:443". (System.ArgumentException)
[24.08.2020 21:48:55] <01> Error       bei System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
[24.08.2020 21:48:55] <01> Error       bei Veeam.Backup.ExternalInfrastructure.DbProvider.CSslConfigItem.QueryConfig()
[24.08.2020 21:48:55] <01> Error       bei Veeam.Backup.ExternalInfrastructure.DbProvider.CSslCertificateRegistrator.GetBindingItem(String ipAddress, Int32 port)
[24.08.2020 21:48:55] <01> Error       bei Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService.RegisterCertificate(X509Certificate2 certificate, Int32 port)
[24.08.2020 21:48:55] <01> Error       bei Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService..ctor()
[24.08.2020 21:48:55] <01> Error    Unhandled exception occured. Runtime is terminating: [True]

What is "Veeam.Backup.ExternalInfrastructure.DbProvider.exe" and do I even need it? I just do local backups and don't need any "external infrastructure".
The funny thing is, everything seems to work fine. I have tried to rename "Veeam.Backup.ExternalInfrastructure.DbProvider.exe" and everything continues to work (as far, as I can tell) and the crashes stop obviously, but this can't be a good solution.

Any idea, what I can do to resolve the issue? What does "Das Element wurde bereits hinzugefügt. Schlüssel im Wörterbuch: "0.0.0.0:443". Hinzuzufügender Schlüssel: "0.0.0.0:443". (System.ArgumentException)" mean?

Thank you!

Case ID 04352622

[wuffzack]

I believe I have found the solution myself. The problem was an existing binding to 0.0.0.0:443

Deleting the existing key

Code: Select all

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\HTTP\Parameters\SslBindingInfo\0.0.0.0:443

from the registry seems to have solved the problem.

However, Veeam.Backup.ExternalInfrastructure.DbProvider.exe really shouldn't crash again and again, and the interface / port 443 binding requirement should be adjustable / documented...?

[Vitaliy S.]

Let me ask our support team to escalate it to the RnD team, as this process should not be failing like that, and a closer look is required.

[jeddytier4]

I receive the following in my log and the accompanying event viewer entry recording the crash, ~ every 30 seconds. Removing the registry key for the offending port binding immediately stops the errors being logged. This may be an issue with IPV6 and IPV4 being considered duplicates. As I had the 2 entries below. I have a backup of the registry settings for 9524 if needed for further testing.

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\HTTP\Parameters\SslBindingInfo\[::]:9524
HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\HTTP\Parameters\SslBindingInfo\0.0.0.0:9524

Svc.PlatformDbProvider.log:

Code: Select all

[27.08.2020 09:40:54] <01> Error    Item has already been added. Key in dictionary: '0.0.0.0:9524'  Key being added: '0.0.0.0:9524' (System.ArgumentException)
[27.08.2020 09:40:54] <01> Error       at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CSslConfigItem.QueryConfig()
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CSslCertificateRegistrator.GetBindingItem(String ipAddress, Int32 port)
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService.RegisterCertificate(X509Certificate2 certificate, Int32 port)
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService..ctor()
[27.08.2020 09:40:54] <01> Error    Unhandled exception occured. Runtime is terminating: [True]
[27.08.2020 09:40:54] <01> Error    Item has already been added. Key in dictionary: '0.0.0.0:9524'  Key being added: '0.0.0.0:9524' (System.ArgumentException)
[27.08.2020 09:40:54] <01> Error       at System.Collections.Hashtable.Insert(Object key, Object nvalue, Boolean add)
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CSslConfigItem.QueryConfig()
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CSslCertificateRegistrator.GetBindingItem(String ipAddress, Int32 port)
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService.RegisterCertificate(X509Certificate2 certificate, Int32 port)
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService..ctor()
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService.get_Instance()
[27.08.2020 09:40:54] <01> Error       at Veeam.Backup.ExternalInfrastructure.DbProvider.Program.Main(String[] args)

[Audio-Tuning]

Hi,

I have the same Issue on Windows Server 2016 with Veeam Backup & Replication 10.0.0.4461 P2.
Deleted the Registry Key 0.0.0.0:443 like jeddytier4 described and suddenly the Errors stopped showing up in Windows Eventlog.

So probably this is a bigger case here.

[nielsengelen]

@Audio-Tuning did you contact support around it as well by any chance? If so, do you have a support case for us?

[Audio-Tuning]

Hi Niels,

no sorry. I've just searched with the errormessage in the forum and found this thread.
Should I open a support case?

[nielsengelen]

Yes, please open a case and refer to this thread so it can get investigated. Thanks!

[haarloser]

Hi,

unbelivable. Is a support case number for that given anywhere?
In my case it started since a reboot on october 27th and deleting the reg key fixed it.

Instantly after deleting it eventlog shows following entry:

Warnung 28.10.2020 09:38:39 HttpEvent 15301 Keine

Veeam created a new key:

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\HTTP\Parameters\SslBindingInfo\0.0.0.0:6172

So how could it work for long time without that entry ?

[Vitaliy S.]

Jan, the only support case opened for that is in the post above. To make sure it is properly fixed (in vNext)/resolved it is highly recommended to contact our technical team.

[popeyesails]

I am running Windows Server 2019 and Veeam Backup and Replication the community Edition locally. I keep getting bombarded with .Net Runtime and Application Errors in my Event Viewer. The application is working however these errors are non stop.

Code: Select all

Event 1000, Application Error
Faulting application name: Veeam.Backup.ExternalInfrastructure.DbProvider.exe, version: 10.0.1.4854, time stamp: 0x5f171ee1
Faulting module name: KERNELBASE.dll, version: 10.0.17763.1518, time stamp: 0xff301d3c
Exception code: 0xe0434352
Fault offset: 0x00000000000396c9
Faulting process id: 0x1f9c
Faulting application start time: 0x01d6c8d2f10bdbbd
Faulting application path: C:\Program Files\Veeam\Backup and Replication\Backup\Veeam.Backup.ExternalInfrastructure.DbProvider.exe
Faulting module path: C:\Windows\System32\KERNELBASE.dll
Report Id: c0726a4a-f42a-4094-b458-6c62c76dc9be
Faulting package full name: 
Faulting package-relative application ID: 

and 

Event 1026, .Net Runtime
Application: Veeam.Backup.ExternalInfrastructure.DbProvider.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.ArgumentException
   at System.Collections.Hashtable.Insert(System.Object, System.Object, Boolean)
   at Veeam.Backup.ExternalInfrastructure.DbProvider.CSslConfigItem.QueryConfig()
   at Veeam.Backup.ExternalInfrastructure.DbProvider.CSslCertificateRegistrator.GetBindingItem(System.String, Int32)
   at Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService.RegisterCertificate(System.Security.Cryptography.X509Certificates.X509Certificate2, Int32)
   at Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService..ctor()
   at Veeam.Backup.ExternalInfrastructure.DbProvider.CDbProviderApiService.get_Instance()
   at Veeam.Backup.ExternalInfrastructure.DbProvider.Program.Main(System.String[])

I have a support case open with VEEAM currently (CASE NUMBER 04524033).

The only thing I have seen in the log is referencing a binding to a reg key that already exists on port 443. I can bind to another port but I am not sure how. ANy help would be awesome

[Dima P.]

Hello Matt,

Based on the event log snippet it sounds like a .Net conflict issue: looks like the event is created by Framework Version: v4.0.30319 (which is not used by Veeam B&R or agents, currently we reply on v4.7.2 which is installed together with all the products. Please keep working with our support team and let us know how the investigation goes. Cheers!

[KOPFteam]

the only support case opened for that is in the post above. To make sure it is properly fixed (in vNext)/resolved it is highly recommended to contact our technical team.

Exact same situation here: Same error in the eventlog and same entries in Svc.PlatformDbProvider.log
I've already opened a support case yesterday: 04553667 and sent a link to this thread a moment ago.

Veeam 10.0.1.4854 is running on Server 2008R2 (yes, I know...). Maybe a hint?

[Vitaliy S.]

Windows Server version should not affect this, so please keep working with our support team to resolve this issue.

[KOPFteam]

The answer from support was "I assume that the issue with eventlog can be resolved by editing the registry, as it described in the article on forum, that you provided earlier.", so no futher investigation of the problem from support

I checked HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\HTTP\Parameters\SslBindingInfo and found three keys:
* 0.0.0.0:443
* [::]:443
* 0.0.0.0:9401
I removed the two 443 keys and immediately the key
* 0.0.0.0:6172
was automatically added and the repeating errors in the event log stopped

[Maladaptive]

I am having the exact same issue. Did you ever figure out a solution?

[Dima P.]

Hello Ryan,

Please raise a support case as these issues are very infrastructure specific. Once you have a case id do not forget to share it with us. Cheers!

[pdm@korjkx.ru]

Get same problem, and find a solution: https://www.relentlessrevolutions.com/v ... uis-9-5-4/
delete key in registry: HKEY_LOCAL_MACHINE\SYSTEM\ControlSet001\Services\HTTP\Parameters\SslBindingInfo\0.0.0.0:443 then restart "Veeam Backup Service"

[Dima P.]

Hello Denis,

Thank you for sharing the solution with the community. I've asked QA team to review the mentioned issue. Cheers!

[c2l1a7]

same here ; server 2012 R2

[Dima P.]

Hello Christoph,

Can you please check if the solution posted above works for you? Any chance you have a case ID to share? Thanks!

[Sofyan]

Goodday everybody, hope you are all safe and sound,

I have the same problem (same error code and program) as my fellow colleague's above:
After deleting the following keys in the register, the error stops being logged.
* 0.0.0.0:443
* [::]:443

However I am not sure if this means it stopped to log the error (for administrative purposely) or that the application is not crashing anymore. Any idea's? Furthermore after I have rebooted the system, the error appears again(also are the above keys found in the register).

Hope somebody has any idea's. Thank for the Reply
Regards
Sofyan

[Vitaliy S.]

It would be best to contact our technical team and verify that the proposed solution works and there are no other alternatives. Thanks!