Maintain control of your Microsoft Office 365 data
Post Reply
HenrikS.
Influencer
Posts: 17
Liked: 6 times
Joined: Jul 04, 2017 12:59 pm
Full Name: Henrik Schewe
Contact:

v4.0c - Resource consumption?

Post by HenrikS. »

Hello,

We thought we had scaled our new deployment server pretty well, with 24C EPYC ROME, 256GB ram and local disks.
However, watching the resource consumption during the initial full backup, I see that we could probably have added more juice.
What are you seeing as normal resource consumption? It is only the Veeam.Archiver.Proxy.exe that is running wild it seems, consuming alone 100% CPU and 157GB of RAM.


Image

-BR

Mike Resseler
Product Manager
Posts: 6122
Liked: 712 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: v4.0c - Resource consumption?

Post by Mike Resseler »

Hey Henrik,
During backup our proxies have a lot of work, so CPU and Memory are pretty much needed. I believe you are running everything on one server? Are all jobs running at the same time? And how large is this job?

HenrikS.
Influencer
Posts: 17
Liked: 6 times
Joined: Jul 04, 2017 12:59 pm
Full Name: Henrik Schewe
Contact:

Re: v4.0c - Resource consumption?

Post by HenrikS. »

I am running two jobs atm, first run ever, towards two different repos:

Both durations so far: 22h30m
Exchange online - 354 out of 2813 objects, fetched 2,6TB
OneDrive - 83 out of 1840 objects, fetched 1,4TB

Mike Resseler
Product Manager
Posts: 6122
Liked: 712 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: v4.0c - Resource consumption?

Post by Mike Resseler »

It is actually not that bad to be honest. We can only catch what MSFT endpoints want to give us, and most others will tell you they have a max. of 1 TB per day

HenrikS.
Influencer
Posts: 17
Liked: 6 times
Joined: Jul 04, 2017 12:59 pm
Full Name: Henrik Schewe
Contact:

Re: v4.0c - Resource consumption?

Post by HenrikS. »

Hello Mike,

The Exchange online job has finished and further incremental runs are running quickly without any issues.
For OneDrive there is a completely different story.

The resource consumption on the proxy server is still very high while this job runs, 100% on CPU.
I see very few item/s, 2-4, even though we have now added 40 auxiliary backup accounts. - so no visible increase or decrease.
The download speed seems to be a reflection on the site of those items, since I can see rates of up to 40MB/s (350Mbps), but as long as there are very many small files to fetch the overall completion time is still not reached.
We are now at 236 out of 1840 Objects after about 200 hours of running and only 6,5TB fetched.

How can we debug and increase the items/s ?

Edit: We see in Cloud App Security console that the proxy server uses all 40 auxiliary accounts to download onedrive items.

-Henrik

Mike Resseler
Product Manager
Posts: 6122
Liked: 712 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: v4.0c - Resource consumption?

Post by Mike Resseler »

Henrik,

There might be something blocking. We know that many small files can be a challenge (although we already have improvements for that...).
Maybe you can best create a support call at the moment so our engineers can see if there is not something blocking.

As per forum rules, please post the case ID and follow-up after investigation here.

moh@dhigroup.com
Novice
Posts: 8
Liked: 3 times
Joined: Jun 04, 2020 6:55 pm
Full Name: Morten Hemmingsen
Contact:

Re: v4.0c - Resource consumption?

Post by moh@dhigroup.com »

Hi.
I have the same Veeam VBO version with exactly the same problem. OneDrive backup is really slow!!! and CPU is 100%.
Regards
Morten

moh@dhigroup.com
Novice
Posts: 8
Liked: 3 times
Joined: Jun 04, 2020 6:55 pm
Full Name: Morten Hemmingsen
Contact:

Re: v4.0c - Resource consumption?

Post by moh@dhigroup.com »

Hi Henrik.
Have you found a solution to the problem?
Regards
Morten

nielsengelen
Veeam Software
Posts: 3418
Liked: 686 times
Joined: Jul 15, 2013 11:09 am
Full Name: Niels Engelen
Contact:

Re: v4.0c - Resource consumption?

Post by nielsengelen »

Morten, please open a support case and post the ID here so we can investigate what is going on.
https://foonet.be

Steve-nIP
Service Provider
Posts: 63
Liked: 16 times
Joined: Feb 06, 2018 10:08 am
Full Name: Steve
Contact:

Re: v4.0c - Resource consumption?

Post by Steve-nIP »

You're not the only one that sees high resource consumption. Just hoping it will be optimised further.

moh@dhigroup.com
Novice
Posts: 8
Liked: 3 times
Joined: Jun 04, 2020 6:55 pm
Full Name: Morten Hemmingsen
Contact:

Re: v4.0c - Resource consumption?

Post by moh@dhigroup.com »

Thanks for your information Steve.

Polina
Veeam Software
Posts: 1280
Liked: 214 times
Joined: Oct 21, 2011 11:22 am
Full Name: Polina Vasileva
Contact:

Re: v4.0c - Resource consumption?

Post by Polina »

High CPU consumption during backup is normal for VBO. Working threads will consume as many resources as they can and as available to ensure faster operations.

moh@dhigroup.com
Novice
Posts: 8
Liked: 3 times
Joined: Jun 04, 2020 6:55 pm
Full Name: Morten Hemmingsen
Contact:

Re: v4.0c - Resource consumption?

Post by moh@dhigroup.com »

Okay.
Thanks Polina.
I dont think Veeam support team know about that. They havent told me about this.
Regards
Morten

Polina
Veeam Software
Posts: 1280
Liked: 214 times
Joined: Oct 21, 2011 11:22 am
Full Name: Polina Vasileva
Contact:

Re: v4.0c - Resource consumption?

Post by Polina »

Morten,

I'm sure support engineers provided you the most accurate response according to the specific details of your case (which I'm obviously not aware of).
Will you please share your case ID so that we all could be on the same page?

Thanks!

moh@dhigroup.com
Novice
Posts: 8
Liked: 3 times
Joined: Jun 04, 2020 6:55 pm
Full Name: Morten Hemmingsen
Contact:

Re: v4.0c - Resource consumption?

Post by moh@dhigroup.com » 1 person likes this post

The case number is 04232326.

Post Reply

Who is online

Users browsing this forum: Baidu [Spider] and 2 guests