Veeam One server - 300% CPU load increase

[mcwill]

[Case ID - 00437470]

https://www.dropbox.com/s/l15y2xde0ixht ... Server.jpg

Just posting to check if anyone else had seen similar and been able to resolve this...

Upgrade of a 6.5 installation to V7 has seen the average CPU load on the Veeam One server jump from 700 MHz to 1800MHz on day of upgrade slowing rising to 2600MHz after 3 weeks. Stopping the "Veeam One Monitor Server" service causes the excess CPU load to disappear, which appears to indicate it is the source of the load.

Looking at windows task manager, the processes consuming the CPU appear to the embedded SQL Server and the Veeam Data Collector Service.

This means that the Veeam One Monitor is now consuming 25% of the CPU of the current host and is easily the most CPU intensive VM in the cluster. As you can understand I am keen to return to a more sensible CPU usage pattern so am open to any suggestions.

Thanks,
Iain

[Vitaliy S.]

Hello Iain,

Have you possibly changed anything in your Veeam ONE configuration? Do you monitor both VI and the backup infrastructure?

Thank you!

[mcwill]

Hi Vitaliy,

The configuration of Veeam One is unchanged. We just performed an update install over version 6.5

It only monitors a VI of 3 single CPU vsphere hosts plus Veeam Backup.

[Vitaliy S.]

Iain, can you please tell me what our support team has found out after investigating your case? Cannot find any note in your support ticket regarding that.

[mcwill]

Vitaliy,

Unfortunately not, it was a very short WebEx.

I received the impression when talking with support that they knew what was causing the issue and would get back to me shortly but that was over 3 weeks ago.

[Vitaliy S.]

Iain, I have asked our R&D team to take a closer look at your case, thanks for bringing this to our attention.

[felyjos]

Hello,
Sorry to jump in but I have the same issue with the two VMs used for Veeam Reporter 6.5 and Veeam Reporter 7 they are identical.
BUT Veeam 7 VM is completely hammered on CPU... practically 24/7... versus Veeam 6.5 which is running properly..

Thanks,
DOm

[mcwill]

Hi Dom,

Not great news I'm afraid, Veeam set up a second webex and identified the cause to be Veeam One monitoring of the Veeam Backup & Replication infrastructure. I've taken the harsh step of removing Backup monitoring from Veeam One and CPU levels are back to normal.

[Vitaliy S.]

Dom,

Can you please open a support case on high CPU usage issue, so we could investigate it further?

Thanks!

[felyjos]

I will
Thanks,
Dom

[heino_moeller]

I have Veeam One and Backup Server on different servers.

When I add the Backup server to Veeam One, the CPU on backup server will instantly rise to approx. 50% and stay there.

CPU fall to normal when removing it from Veeam ONE.

Any suggestions??

/Heino

[Vitaliy S.]

Hello Heino,

Do you add Veeam B&R server or Backup Enterprise Manager to the Veeam ONE console? What is the configuration of your backup server? How many CPUs do you have there?

Thank you!

[heino_moeller]

I've tried to add both Enterprise Manager and B&R server with same outcome - 50% CPU usage.

The B&R server is virtual and has 2vCPU's.

[Vitaliy S.]

Try increasing the vCPU amount (as per our Veeam B&R system requirements), should help!

[heino_moeller]

Doesn't that violate with the licensing of Veeam??

I could increase the number of cores... it's only configured with 2 virtual sockets with 1 core pr. socket.

I've looked in the system requirements and it doesn't say anything about the amount of vCPU's??

[Vitaliy S.]

Licensing? Not really, as we license only physical sockets of ESXi/Hyper-V servers you're backing up VMs from, and not the amount of CPUs on the backup server.

[asigurds]

I'm experiencing the same issue. After upgrading Veeam ONE to V7.0, CPU load increases considerably. Both on the ONE server and the B&R server (V7.0 R2).
Both servers are configured with two vCPUs. If I stop monitoring the B&R server, CPU usage is normal.

[Vitaliy S.]

Hello Asgeir,

Are you monitoring your backup infrastructure via EM or direct connection to the backup server? If you could open a support case on this and let our engineers take a look at the setup, it would be highly appreciated.

Thank you!

[asigurds]

Hi Vitaliy.

This is a direct connection to the backup server. I'll open a support case.

[Vitaliy S.]

Once you do this, please PM me your case ID, so I could also track it. Thanks!

[joergr]

Please keep the forum updated on this one. Best regards, Joerg

[asigurds]

According to support, this is a known behaviour and R&D are working on a solution. Currently they do not have information as of when a fix will be released.

[Vitaliy S.]

This optimization is scheduled for the next major update, but I will discuss this problem with our dev team once again. Thanks!

[joergr]

OK thanks guys. Please keep us updated. Best regards, Joerg

[asigurds]

Just to let know that this is issue hasn't been fixed with patch #3 of B&R.

[Vitaliy S.]

Yes, as this has to be addressed from both products. As far as I know the reason for this is the number of WMI queries, so we have decided further enhance our data collection engine in the next updates of Veeam ONE.