Comprehensive data protection for all workloads
Post Reply
Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

How to speed up a Proxy server?

Post by Wabun » Jan 29, 2016 7:56 am

Hi,

I am using a virtualized Windows 7 pro as a proxy server, and wonder what will provide more speed, the amount of vCPU or Memory.
Just wonder because my memory is a little bit limited on the ESxii server.

Thank you.

foggy
Veeam Software
Posts: 18158
Liked: 1542 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: How to speed up a Proxy server?

Post by foggy » Jan 29, 2016 8:32 am

Nick, provided the amount of memory meets the proxy server system requirements, the amount of CPU cores is what defines the proxy server performance.

veremin
Product Manager
Posts: 16789
Liked: 1411 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: How to speed up a Proxy server?

Post by veremin » Jan 29, 2016 9:47 am

Also, it might be interesting to know whether the proxy is the slowest component in backup chain indeed? Is that what full bottleneck statistics suggest? Thanks.

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Jan 29, 2016 10:22 am

Hiya,

Current configuration is 4GB and 2vCPU and the NIC is a E1000.

Yes it is showing as: Bottleneck: Target.

I will change it to 3GB and 4vCPU that should be giving more power reading the link provided?

Thank you

foggy
Veeam Software
Posts: 18158
Liked: 1542 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: How to speed up a Proxy server?

Post by foggy » Jan 29, 2016 10:25 am

Depends on the backup load you're assigning to this proxy.

NightBird
Service Provider
Posts: 175
Liked: 32 times
Joined: Apr 28, 2009 8:33 am
Location: Strasbourg, FRANCE
Contact:

Re: How to speed up a Proxy server?

Post by NightBird » Jan 29, 2016 10:31 am 1 person likes this post

Bottleneck: Target ==> the Backup Repository is the bottleneck, isn't it ??? (or ESXi datastore performance if on replication job)

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Jan 29, 2016 10:41 am

Hiya

I am migrating a few VMs, will do a new move tomorrow, will let know the outcome.

Thank you

foggy
Veeam Software
Posts: 18158
Liked: 1542 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: How to speed up a Proxy server?

Post by foggy » Jan 29, 2016 10:50 am

Are you running backup or replication jobs (or both)? If backup, what kind of repository do you have?

Vitaliy S.
Product Manager
Posts: 22876
Liked: 1541 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: How to speed up a Proxy server?

Post by Vitaliy S. » Jan 29, 2016 1:50 pm

Wabun wrote:I will change it to 3GB and 4vCPU that should be giving more power reading the link provided?
NightBird wrote:Bottleneck: Target ==> the Backup Repository is the bottleneck, isn't it ??? (or ESXi datastore performance if on replication job)
NightBird is correct, adjusting proxy server configuration will not improve your job performance, you should be looking at target storage hardware here.

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Jan 29, 2016 2:35 pm

Hi,

I am not backing up, I am migrating, so this means the datastore is the issue?

Kind regards,

veremin
Product Manager
Posts: 16789
Liked: 1411 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: How to speed up a Proxy server?

Post by veremin » Jan 29, 2016 3:02 pm

Migrating? Using what particular functionality? Quick Migration or Replication?

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Jan 29, 2016 3:05 pm

Veeam 9, using the Quick Migration Job.

veremin
Product Manager
Posts: 16789
Liked: 1411 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: How to speed up a Proxy server?

Post by veremin » Jan 29, 2016 3:18 pm

Yep, the destination datastore seems to be the slowest component in this case. Thanks.

NightBird
Service Provider
Posts: 175
Liked: 32 times
Joined: Apr 28, 2009 8:33 am
Location: Strasbourg, FRANCE
Contact:

Re: How to speed up a Proxy server?

Post by NightBird » Jan 29, 2016 4:14 pm

Check if you have write back cache on the destination esx raid controller

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Jan 29, 2016 5:50 pm

Hiya,

Yes it's an LSI 8708eEM2 with BBU and write back cache enabled.

dellock6
Veeam Software
Posts: 5718
Liked: 1611 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: How to speed up a Proxy server?

Post by dellock6 » Jan 30, 2016 3:26 pm

also, remember that bottleneck stats are not meant to warn you of any error or problem, it's more an analysis of the time consumed by each component of the process. If the target is the bottleneck, it may simply be that the destination datastore is not able to go any faster when receiving data of Quick Migration.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2019
Veeam VMCE #1

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Jan 30, 2016 8:36 pm

Thank you :-)

foggy
Veeam Software
Posts: 18158
Liked: 1542 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: How to speed up a Proxy server?

Post by foggy » Feb 01, 2016 11:42 am

Check the transport mode used to populate the target datastore.

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Feb 01, 2016 12:45 pm

foggy wrote:Check the transport mode used to populate the target datastore.
Network mode.

It seems that I don't understand the information regards the Bottleneck.
After testing this weekend I discovered that the bottleneck might be the 100Mb nic port, I moved a 120GB VM across the Internet and the limits where the ones my bandwidth graph in DC showed. I am not sure if any proxy server can speed that up... I am worried now when to move a 300GB VM. I also noticed that the amount of data read and transferred was different, Processed: 120GB, Read: 120GB, Transferred: 71.8GB. Does that mean that only actual data is transferred and not deleted files on the disk, I read somewhere that zero filled sectors where not transferred but a bit puzzled about the difference as I can't imagine that there is any zero filled sector left on that disk :-)

Would a proxy server on the Target definitely speed this up?

Kind regards

foggy
Veeam Software
Posts: 18158
Liked: 1542 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: How to speed up a Proxy server?

Post by foggy » Feb 01, 2016 2:31 pm

Having proxy server close to the target datastore will definitely speed things up as traffic will be transferred between proxies in a compressed format (compression is, btw, the reason of why you see Transferred less than Read). Also, it will allow to use hotadd to populate the target datastore, instead of network mode.

What is your current Quick Migration topology?

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Feb 03, 2016 5:08 pm

foggy wrote:What is your current Quick Migration topology?
Veeam Backup and replication 9

Esxi v5.x with a Win7 Backup proxy server, 4vCPU, 3GB, 32GB, E1000
Esxi v5.x with a Win 10 Backup proxy server, 4vCPU, 3GB, 40GB, E1000

When using the proxy the speed is increased from 8MB to 30MB, but now Bottleneck is Proxy.
Source 0% > Proxy 16% > Network 0% > Target 12%
In vSphere Client I can see that each Backup proxy is now having attached the disk from the VM which is being migrated, so it works like you said :-)

Is it possible to get more speed, if so how?
Is there any relation with the size of the Backup Proxy server HD, or is it simple just adding more vCPU?

Thank you.

foggy
Veeam Software
Posts: 18158
Liked: 1542 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: How to speed up a Proxy server?

Post by foggy » Feb 05, 2016 12:06 pm 1 person likes this post

Just adding more vCPU.

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Feb 05, 2016 12:13 pm

Thank you.

O, one question if I change vCPU from 4 to 8 do I need to rescan or update this in the Veeam Master?
Or will it automatic detect the new amount of vCPU?

veremin
Product Manager
Posts: 16789
Liked: 1411 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: How to speed up a Proxy server?

Post by veremin » Feb 05, 2016 1:42 pm

Increase max concurrent tasks from 4 to 8 in settings of given proxy server. Thanks.

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Feb 05, 2016 2:05 pm

Thanks again, I did some testing with the 8vCPU, but it's back to 8MB speed 'weirdo', I just wonder if it is very important where the Master is located?

- Would you use the Master on the receiving side or on the sending side?

foggy
Veeam Software
Posts: 18158
Liked: 1542 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: How to speed up a Proxy server?

Post by foggy » Feb 05, 2016 3:35 pm 1 person likes this post

Provided everything else stayed similar to the previous test, just adding vCPU shouldn't result in performance decrease. Though, it doesn't guarantee faster processing as well unless proxy CPU was maxed out previously.

Wabun
Influencer
Posts: 12
Liked: never
Joined: Apr 04, 2014 12:06 pm
Full Name: Nick

Re: How to speed up a Proxy server?

Post by Wabun » Feb 05, 2016 4:02 pm

My fault, I just discovered I had to go in the Master, then to the proxies and then change the cpu to 8 and fo rthe master as well...

Sadly, once the job is running you need to let it run out completely, so I need to wait patiently till this job is done and try again.
Well, it's all about learning :-)

Thanks everyone so far for all feedback, it is much appreciated.

Post Reply

Who is online

Users browsing this forum: Bing [Bot], Google [Bot], helly.wu, TheRealTy and 35 guests