Parallel VM Processing on a Per Job basis?

VMware specific discussions

Parallel VM Processing on a Per Job basis?

Veeam Logoby jbarrow.viracoribt » Fri Oct 24, 2014 6:07 pm

So, I want my backup jobs to utilize parallel processing but I want my replication jobs to only do 1 at a time. Looks to be something I cant control. Is this on the feature request list already?
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby tsightler » Fri Oct 24, 2014 8:31 pm

You can control it indirectly, just set the proxy on the target side of the replication to be limited to 1 task, that should do it.
tsightler
Veeam Software
 
Posts: 4768
Liked: 1737 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby jbarrow.viracoribt » Fri Oct 24, 2014 8:57 pm

That seems to only sort of work.

I have 6 replication jobs that fire off every 2 hours.

Those 6 jobs are configured to use two different virtual proxies on the production side, and two virtual proxies on the destination side, each proxy can handle 8 tasks at a time

I notice that one of my 6 replication jobs seems to take off first (even though they all start on the hour), that first job seems to gobble up all the available slots on the two proxies (processing 16 different disks) while the other 5 jobs wait for an available proxy.

With parallel processing off, each job would start at the same time but each job would only process one system/disk at a time.

If I did as you suggested i would still have one job gobbling up all the threads while the other jobs wait.

Does that make sense?

Image
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby tsightler » Fri Oct 24, 2014 10:53 pm

I think I wasn't clear to your exact goal in the initial question. I'm still not sure I totally understand, it sounds like you want to use parallel processing, but you want the tasks to be evenly spread across all 6 jobs instead of having one job using all the resources and the others pending. Is that correct?
tsightler
Veeam Software
 
Posts: 4768
Liked: 1737 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby jbarrow.viracoribt » Sat Oct 25, 2014 12:03 am

tsightler wrote:I think I wasn't clear to your exact goal in the initial question. I'm still not sure I totally understand, it sounds like you want to use parallel processing, but you want the tasks to be evenly spread across all 6 jobs instead of having one job using all the resources and the others pending. Is that correct?


For my backup job, which is just one large job, I'm fine with parallel processing working like it does. I have 140 VM's in that job and it just mows through them.

My replication jobs though, those are defined per LUN so I have many replication jobs that are supposed to fire off at the same time. The org wants replication to run every 2 hours. Right now parallel processing messes that all up because job 1 gets done first, then job 2, etc. I just wish the parallel processing setting was defined at the job level vs. server wide.
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby Gostev » Sat Oct 25, 2014 1:54 pm

We recommend managing replication jobs with a separate backup server located in the DR site (to ensure you can perform failover when the production site is down). You can simply disable parallel processing on that server?
Gostev
Veeam Software
 
Posts: 21390
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby jbarrow.viracoribt » Sun Oct 26, 2014 2:11 pm

Gostev wrote:We recommend managing replication jobs with a separate backup server located in the DR site (to ensure you can perform failover when the production site is down). You can simply disable parallel processing on that server?


Won't that mess me up on Veeam licenses though since it will look as if i'm managing double the hosts?
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby Vitaliy S. » Sun Oct 26, 2014 7:17 pm

It doesn't matter how many Veeam B&R servers you deploy, given that you're using your license key against the same source hosts all the time.
Vitaliy S.
Veeam Software
 
Posts: 19558
Liked: 1102 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby jbarrow.viracoribt » Mon Oct 27, 2014 7:00 pm

Okay, I just spent most of the day today splitting out the backup and replication environments to two, as you suggested.

Now the replication server has parallel processing turned off and the backup server has parallel processing turned on.

A new error, it seems the are now tripping over each other. The Backup job throws an error because a VM is in the middle of a replication initiated by the other server. I understand that I can set a retry counter but our policy has the system email a ticket on every failure, which is going to start spamming our helpdesk.

Thoughts?

Image
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby Vitaliy S. » Mon Oct 27, 2014 9:18 pm

If you're using application aware image processing (aka VSS), then your jobs should not overlap, since Guest OS cannot freeze and unfreeze the OS at the same time. Setting different schedules for your job should resolve this issue.
Vitaliy S.
Veeam Software
 
Posts: 19558
Liked: 1102 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby jbarrow.viracoribt » Mon Oct 27, 2014 10:17 pm

Vitaliy S. wrote:If you're using application aware image processing (aka VSS), then your jobs should not overlap, since Guest OS cannot freeze and unfreeze the OS at the same time. Setting different schedules for your job should resolve this issue.


Application aware image processing is on.

Both the replication server and the backup server seem to on occasion try and process the same VM, when that happens, this error comes up. Before, when both replication and backup tasks were in the same server instance the job would give a message that it was in use by another task (or something similar), it would then wait for that task to finish and then continue with the job. Now that the jobs are split out across two different servers they are throwing this new error when they run into each other. Different schedules seems like a poor workaround as sometimes need to have my backup jobs running while replication jobs are running. Could this be fallout from using two different instances of Veeam on the same vCenter cluster?
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby Vitaliy S. » Tue Oct 28, 2014 10:14 am

jbarrow.viracoribt wrote:Both the replication server and the backup server seem to on occasion try and process the same VM, when that happens, this error comes up.

That's expected behavior, since both jobs interact with a VSS writer on the Guest OS, which cannot do freeze and unfreeze operations at the same time.
Different schedules seems like a poor workaround as sometimes need to have my backup jobs running while replication jobs are running. Could this be fallout from using two different instances of Veeam on the same vCenter cluster?

Yes, secondary Veeam server is not aware about jobs running on the first server, that is why the error above can show up sometimes. The workaround for that would be to use different VM schedule or disabling VSS in one of the jobs (need to confirm that).
Vitaliy S.
Veeam Software
 
Posts: 19558
Liked: 1102 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby Delo123 » Thu Nov 13, 2014 11:30 pm

Maybe a bit off-topic, but it's been on my wish-list for some time...
We use parallel processing (and love it:)) but for some jobs we would like to control VM Processing per Job basis too...
Example:
We backup our Exchange nodes in one backup job, mainly because they belong together and for dedupe etc...
However, we had the case where a backup failed because of some bad disks on the repository etc during exchange backup.
Since both nodes are backuped at the same time (we only use our physical veeamserver as proxy due to direct SAN access we cannot controll parallel processing with number of jobs) both jobs were stuck and we had to consolidate files etc which caused a bit of downtime...
Same case for DC's, i like to backup them together, but IF something happens, the risks of something happening to all of them is quite big...

Comments? :)
Delo123
Expert
 
Posts: 348
Liked: 94 times
Joined: Fri Dec 28, 2012 5:20 pm
Full Name: Guido Meijers

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby haslund » Sat Jan 03, 2015 11:15 pm

Gostev: We recommend managing replication jobs with a separate backup server located in the DR site (to ensure you can perform failover when the production site is down). You can simply disable parallel processing on that server?

Is this really the recommended way of handling this situation?

Setting up one VBR server in Production site to handle backups and a seperate VBR server in DR site to handle replication?
I thought there would be some advantages to only having one consolidated VBR server and then place it in DR site.
Rasmus Haslund
Principal Technologist, Global Education Services @ Veeam Software
Veeam Certified Architect #1 | Veeam Certified Trainer #4 [v7,v8,v9] | Veeam Certified Trainer Mentor #1
Twitter: @haslund
Blog: www.perfectcloud.org
haslund
Veeam Software
 
Posts: 270
Liked: 50 times
Joined: Thu Feb 16, 2012 7:35 am
Location: Denmark
Full Name: Rasmus Haslund

Re: Parallel VM Processing on a Per Job basis?

Veeam Logoby Gostev » Sun Jan 04, 2015 12:59 am

Yes, especially when there is a stable, low latency connectivity to DR site.
In other cases, placing backup server close to vCenter is preferred.
Gostev
Veeam Software
 
Posts: 21390
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Next

Return to VMware vSphere



Who is online

Users browsing this forum: Google [Bot] and 8 guests