Monitoring and reporting for Veeam Data Platform
Post Reply
mcwill
Enthusiast
Posts: 64
Liked: 10 times
Joined: Jan 16, 2010 9:47 am
Full Name: Iain McWilliams
Contact:

Veeam One server - 300% CPU load increase

Post by mcwill » 1 person likes this post

[Case ID - 00437470]

https://www.dropbox.com/s/l15y2xde0ixht ... Server.jpg

Just posting to check if anyone else had seen similar and been able to resolve this...

Upgrade of a 6.5 installation to V7 has seen the average CPU load on the Veeam One server jump from 700 MHz to 1800MHz on day of upgrade slowing rising to 2600MHz after 3 weeks. Stopping the "Veeam One Monitor Server" service causes the excess CPU load to disappear, which appears to indicate it is the source of the load.

Looking at windows task manager, the processes consuming the CPU appear to the embedded SQL Server and the Veeam Data Collector Service.

This means that the Veeam One Monitor is now consuming 25% of the CPU of the current host and is easily the most CPU intensive VM in the cluster. As you can understand I am keen to return to a more sensible CPU usage pattern so am open to any suggestions.

Thanks,
Iain
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. » 1 person likes this post

Hello Iain,

Have you possibly changed anything in your Veeam ONE configuration? Do you monitor both VI and the backup infrastructure?

Thank you!
mcwill
Enthusiast
Posts: 64
Liked: 10 times
Joined: Jan 16, 2010 9:47 am
Full Name: Iain McWilliams
Contact:

Re: Veeam One server - 300% CPU load increase

Post by mcwill » 1 person likes this post

Hi Vitaliy,

The configuration of Veeam One is unchanged. We just performed an update install over version 6.5

It only monitors a VI of 3 single CPU vsphere hosts plus Veeam Backup.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. » 1 person likes this post

Iain, can you please tell me what our support team has found out after investigating your case? Cannot find any note in your support ticket regarding that.
mcwill
Enthusiast
Posts: 64
Liked: 10 times
Joined: Jan 16, 2010 9:47 am
Full Name: Iain McWilliams
Contact:

Re: Veeam One server - 300% CPU load increase

Post by mcwill » 1 person likes this post

Vitaliy,

Unfortunately not, it was a very short WebEx.

I received the impression when talking with support that they knew what was causing the issue and would get back to me shortly but that was over 3 weeks ago.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. » 1 person likes this post

Iain, I have asked our R&D team to take a closer look at your case, thanks for bringing this to our attention.
felyjos
Veteran
Posts: 285
Liked: 3 times
Joined: Jun 08, 2011 5:46 pm
Full Name: Dominique DUCHEMIN
Contact:

Re: Veeam One server - 300% CPU load increase

Post by felyjos »

Hello,
Sorry to jump in but I have the same issue with the two VMs used for Veeam Reporter 6.5 and Veeam Reporter 7 they are identical.
BUT Veeam 7 VM is completely hammered on CPU... practically 24/7... versus Veeam 6.5 which is running properly..

Thanks,
DOm
mcwill
Enthusiast
Posts: 64
Liked: 10 times
Joined: Jan 16, 2010 9:47 am
Full Name: Iain McWilliams
Contact:

Re: Veeam One server - 300% CPU load increase

Post by mcwill » 1 person likes this post

Hi Dom,

Not great news I'm afraid, Veeam set up a second webex and identified the cause to be Veeam One monitoring of the Veeam Backup & Replication infrastructure. I've taken the harsh step of removing Backup monitoring from Veeam One and CPU levels are back to normal.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. » 1 person likes this post

Dom,

Can you please open a support case on high CPU usage issue, so we could investigate it further?

Thanks!
felyjos
Veteran
Posts: 285
Liked: 3 times
Joined: Jun 08, 2011 5:46 pm
Full Name: Dominique DUCHEMIN
Contact:

Re: Veeam One server - 300% CPU load increase

Post by felyjos »

I will
Thanks,
Dom
heino_moeller
Novice
Posts: 3
Liked: never
Joined: May 14, 2013 9:01 am
Full Name: Heino Tandrup Eilsø
Contact:

Re: Veeam One server - 300% CPU load increase

Post by heino_moeller »

I have Veeam One and Backup Server on different servers.

When I add the Backup server to Veeam One, the CPU on backup server will instantly rise to approx. 50% and stay there.

CPU fall to normal when removing it from Veeam ONE.

Any suggestions??

/Heino
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. »

Hello Heino,

Do you add Veeam B&R server or Backup Enterprise Manager to the Veeam ONE console? What is the configuration of your backup server? How many CPUs do you have there?

Thank you!
heino_moeller
Novice
Posts: 3
Liked: never
Joined: May 14, 2013 9:01 am
Full Name: Heino Tandrup Eilsø
Contact:

Re: Veeam One server - 300% CPU load increase

Post by heino_moeller »

I've tried to add both Enterprise Manager and B&R server with same outcome - 50% CPU usage.

The B&R server is virtual and has 2vCPU's.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. »

Try increasing the vCPU amount (as per our Veeam B&R system requirements), should help!
heino_moeller
Novice
Posts: 3
Liked: never
Joined: May 14, 2013 9:01 am
Full Name: Heino Tandrup Eilsø
Contact:

Re: Veeam One server - 300% CPU load increase

Post by heino_moeller »

Doesn't that violate with the licensing of Veeam??

I could increase the number of cores... it's only configured with 2 virtual sockets with 1 core pr. socket.

I've looked in the system requirements and it doesn't say anything about the amount of vCPU's??
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. »

Licensing? Not really, as we license only physical sockets of ESXi/Hyper-V servers you're backing up VMs from, and not the amount of CPUs on the backup server.
asigurds
Novice
Posts: 9
Liked: never
Joined: May 09, 2012 3:52 pm
Full Name: Asgeir Sigurdsson
Contact:

Re: Veeam One server - 300% CPU load increase

Post by asigurds »

I'm experiencing the same issue. After upgrading Veeam ONE to V7.0, CPU load increases considerably. Both on the ONE server and the B&R server (V7.0 R2).
Both servers are configured with two vCPUs. If I stop monitoring the B&R server, CPU usage is normal.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. »

Hello Asgeir,

Are you monitoring your backup infrastructure via EM or direct connection to the backup server? If you could open a support case on this and let our engineers take a look at the setup, it would be highly appreciated.

Thank you!
asigurds
Novice
Posts: 9
Liked: never
Joined: May 09, 2012 3:52 pm
Full Name: Asgeir Sigurdsson
Contact:

Re: Veeam One server - 300% CPU load increase

Post by asigurds »

Hi Vitaliy.

This is a direct connection to the backup server. I'll open a support case.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. »

Once you do this, please PM me your case ID, so I could also track it. Thanks!
joergr
Veteran
Posts: 391
Liked: 39 times
Joined: Jun 08, 2010 2:01 pm
Full Name: Joerg Riether
Contact:

Re: Veeam One server - 300% CPU load increase

Post by joergr »

Please keep the forum updated on this one. Best regards, Joerg
asigurds
Novice
Posts: 9
Liked: never
Joined: May 09, 2012 3:52 pm
Full Name: Asgeir Sigurdsson
Contact:

Re: Veeam One server - 300% CPU load increase

Post by asigurds »

According to support, this is a known behaviour and R&D are working on a solution. Currently they do not have information as of when a fix will be released.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. »

This optimization is scheduled for the next major update, but I will discuss this problem with our dev team once again. Thanks!
joergr
Veteran
Posts: 391
Liked: 39 times
Joined: Jun 08, 2010 2:01 pm
Full Name: Joerg Riether
Contact:

Re: Veeam One server - 300% CPU load increase

Post by joergr »

OK thanks guys. Please keep us updated. Best regards, Joerg
asigurds
Novice
Posts: 9
Liked: never
Joined: May 09, 2012 3:52 pm
Full Name: Asgeir Sigurdsson
Contact:

Re: Veeam One server - 300% CPU load increase

Post by asigurds »

Just to let know that this is issue hasn't been fixed with patch #3 of B&R.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam One server - 300% CPU load increase

Post by Vitaliy S. »

Yes, as this has to be addressed from both products. As far as I know the reason for this is the number of WMI queries, so we have decided further enhance our data collection engine in the next updates of Veeam ONE.
Post Reply

Who is online

Users browsing this forum: JayMeath and 11 guests