Discussions specific to the VMware vSphere hypervisor
mcrdr85
Influencer
Posts: 17
Liked: never
Joined: Aug 15, 2013 6:51 pm
Full Name: Chris Powell
Contact:

Number of VM's per job

Post by mcrdr85 » Oct 08, 2013 7:24 pm

Hi everyone,

Currently, I have 3 jobs. 1 exchange job, one file server job and then everything else. The everything else job has 67 with 2.5 TB of raw data and it taking a backup window of about 10-12 hours. Its just taking way too long. The only positive is the incremental size. Oh and I should mention I do the jobs in order so only one job runs at a time. And we only have one proxy.

How many VM's\data per job is optimal? Is splitting the one job into 4 about right? Is one proxy good enough? VM's per proxy?

I'm just trying to make the backup more efficient and close the backup window. Any suggestions on how to make my environment better would greatly be appreciated.

Thanks Chris!

Gostev
SVP, Product Management
Posts: 24022
Liked: 3256 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Number of VM's per job

Post by Gostev » Oct 08, 2013 7:29 pm

Hi Chris, what product version are you using?

mcrdr85
Influencer
Posts: 17
Liked: never
Joined: Aug 15, 2013 6:51 pm
Full Name: Chris Powell
Contact:

Re: Number of VM's per job

Post by mcrdr85 » Oct 08, 2013 7:45 pm

7.0 enterprise

Gostev
SVP, Product Management
Posts: 24022
Liked: 3256 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Number of VM's per job

Post by Gostev » Oct 08, 2013 7:51 pm 1 person likes this post

Assuming it all goes into the same backup repository, with this amount of data I would just put everything into the single job, and enabled parallel processing.

If you are still going to be missing your backup window after that, then may be its time to add another proxy server (unless it is backup repository that cannot keep up, which it will be clear from the bottleneck analysis stats).

mcrdr85
Influencer
Posts: 17
Liked: never
Joined: Aug 15, 2013 6:51 pm
Full Name: Chris Powell
Contact:

Re: Number of VM's per job

Post by mcrdr85 » Oct 08, 2013 8:32 pm

Yes, this is all going to the same repository, a DataDomain DD630 via CIFS.

I just enabled parallel processing. so i will see how that goes!

The bottleneck statistics look like this (took from one job but im sure its the avg):

Source 95%
Proxy 29%
Network 5%
Target 22%

Gostev
SVP, Product Management
Posts: 24022
Liked: 3256 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Number of VM's per job

Post by Gostev » Oct 08, 2013 8:36 pm

Judging on this statistics, parallel processing should make a huge difference.

foggy
Veeam Software
Posts: 17718
Liked: 1482 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Number of VM's per job

Post by foggy » Oct 08, 2013 8:40 pm

What transport mode is being used during processing (look at the [tag] next to the proxy name in the job statistics window, after selecting the particular VM to the left)?

mcrdr85
Influencer
Posts: 17
Liked: never
Joined: Aug 15, 2013 6:51 pm
Full Name: Chris Powell
Contact:

Re: Number of VM's per job

Post by mcrdr85 » Oct 08, 2013 8:55 pm

Are you talking about [hotadd]? That's the only thing i see besides that I'm using CBT

foggy
Veeam Software
Posts: 17718
Liked: 1482 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Number of VM's per job

Post by foggy » Oct 08, 2013 9:01 pm

Yes, I was referring to that. So let's see whether parallel processing does the job.

mcrdr85
Influencer
Posts: 17
Liked: never
Joined: Aug 15, 2013 6:51 pm
Full Name: Chris Powell
Contact:

Re: Number of VM's per job

Post by mcrdr85 » Oct 09, 2013 2:25 pm

The job just finished at it still took 11 hrs and 15 minutes. Still better than the night before at 13 hrs and 49 minutes. I only have max concurrent tasks set to 2 though. So ill bump it up to 4 and see if thats any better.

The bottleneck statistic did change though:

Source 78%
Proxy 31%
Network 24%
Target 19%

foggy
Veeam Software
Posts: 17718
Liked: 1482 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Number of VM's per job

Post by foggy » Oct 09, 2013 2:47 pm

Make sure you check the max concurrent tasks setting for both proxy and repository.

mcrdr85
Influencer
Posts: 17
Liked: never
Joined: Aug 15, 2013 6:51 pm
Full Name: Chris Powell
Contact:

Re: Number of VM's per job

Post by mcrdr85 » Oct 09, 2013 3:08 pm

okay.... I set them both to 4!

mcrdr85
Influencer
Posts: 17
Liked: never
Joined: Aug 15, 2013 6:51 pm
Full Name: Chris Powell
Contact:

Re: Number of VM's per job

Post by mcrdr85 » Oct 10, 2013 3:33 pm

still took 13 hrs to complete after making those changes!

Source 78%
Proxy 17%
Network 39%
Target 34%

dellock6
Veeam Software
Posts: 5628
Liked: 1575 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Number of VM's per job

Post by dellock6 » Oct 10, 2013 4:47 pm

In all your tests the bottleneck is always source. Can you give us more details about the storage you are using in production, its connections to ESXi servers, the sizing of the proxies, etc?

Luca.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2019
Veeam VMCE #1

mcrdr85
Influencer
Posts: 17
Liked: never
Joined: Aug 15, 2013 6:51 pm
Full Name: Chris Powell
Contact:

Re: Number of VM's per job

Post by mcrdr85 » Oct 10, 2013 5:10 pm

I'm using a DataDomain DD630 for storage and it has 2 gig nics that are bonded that is hooked up to the same core of switches as the esx's. Connected to the proxy via cifs. The proxy has 8gb of ram and 2 quad core cpu's. the datastores for the esx's are hp lefthand sans connected via iSCSI to the esx's (again on the same switches).

Post Reply

Who is online

Users browsing this forum: No registered users and 16 guests