I've opened support call #01723575 but we don't seem to be getting anywhere.
The Veeam backup server is a VM running Windows 2012 R2 and Veeam 9.0.0.1491. All proxies and repositories are also running Windows 2012 R2. I have 40 WAN sites with a repository and proxy sitting locally. I have approximately 52 backup jobs. Of those, 40 jobs backup remote sites to remote repositories once an hour that I retain for 14 days. I also have 2 backup copy jobs per job, one to copy to my tape server and one to copy to my datacenter for 180 day storage that run once a day.
I'm having jobs either failing or run with warnings. The warnings are sending an email but the failed jobs don't. The jobs are not failing or giving warning consistently, one hour is runs fine and then the next time I get the warning. The warning I'm getting is a commit catalog transaction issue. The Veeam server and the Enterprise Manager server both have over 500 GB of free disk space where the VBRCatalog folder is. I had guest indexing enabled on the jobs but I've since disabled it but I still get the warnings. I created a new backup job that has never had guest indexing enabled and I got a warning email for that job.
On the Backup server I'm also seeing Application errors in the event logs. The application error seems to coincide with the backup failures and warning emails. If I restart the backup server, the jobs seem to run fine for 15-24 hours before I start seeing the application errors and warning emails. I've tried building a new VM for the backup server and then reconnecting it to the existing database. It ran fine for 24 hours and then started pitching the same errors and warnings.
This weekend I created a scale out repository that included my tape out repository. In order to do that I had to disable all the backup copy jobs that were using that repository. While the tape out copy jobs were disabled, I got no application errors or warnings. This lasted the whole day, but as soon as the backup evacuation was complete and I re-enabled the copy jobs, I instantly started getting warning emails and application errors.
This is the warning message:
Failed to commit catalog transaction "D:\VBRCatalog\Publications\Upload\c3354745-99b1-4f65-9fd5-65fdb81a342f". Meta-file "D:\VBRCatalog\Publications\Upload\c3354745-99b1-4f65-9fd5-65fdb81a342f\PubCommands.txt" is unavailable. Retrieving the COM class factory for component with CLSID {4EF18917-F9D6-4A72-AEBF-8A4A88E99496} failed due to the following error: 80070583 Class does not exist. (Exception from HRESULT: 0x80070583).
This is the event log entry:
Code: Select all
Faulting application name: Veeam.Backup.Manager.exe, version: 9.0.0.1491, time stamp: 0x56df70e3
Faulting module name: KERNELBASE.dll, version: 6.3.9600.18233, time stamp: 0x56bb4ebb
Exception code: 0xc0000142
Fault offset: 0x00000000000ecdd0
Faulting process id: 0x4698
Faulting application start time: 0x01d19284c750a047
Faulting application path: D:\Program Files\Veeam\Backup and Replication\Backup\Veeam.Backup.Manager.exe
Faulting module path: KERNELBASE.dll
Report Id: 04fd2c91-fe78-11e5-80e0-005056961478
Faulting package full name:
Faulting package-relative application ID: Thanks,
John