Understanding Parallel Processing and Concurent Tasks

VMware specific discussions

Understanding Parallel Processing and Concurent Tasks

Veeam Logoby rurouni » Sat Jul 04, 2015 11:36 am

Hi, i need to get a good understanding to // processing and concurrent tasks interactions and available levers to speed up backups.
We have 65 Jobs for about 700 vms to backup per night.

I observed that this high amount of jobs increase the collision probability in time scheduling. So i often sometime observe jobs waiting for hours for available resources to perform backups.
I have two huge proxies that remains lower than 25% CPU/RAM usage during backups. Concurrent tasks are set to 10 per proxy. (So i guess i could raise the max concurrent tasks supported).
On the other hand i have a bunch of repositories set up to 5 concurrent tasks each.

Is there a way to monitor the simultaneous sessions during backup windows to determine what are the resources busy enough to make my jobs wait for hours?
Are there others settings that can impact // processing and concurrent tasks?
I don't understand how resources are allocated since i started a job manually yesterday during backup window and this job waited more than 4 hours before really starting backups. On the other hand i found other jobs scheduled to start later that have been starting and finishing earlier than the job i started manually.
Could there be a way to especially prioritize a job against others or are we totally relying on resources allocation?
On last question, i found that inside a single job i can move up/down vms in the processing list. I guess it has a relation with the order the vms are processed inside a job. How about if i'm using vm folders as backup objects. Can i still define a proper vm processing order inside my job? I didn't get it.

Thanks for the answers then, and hope it will help others, i may not be the only one to ask these questions.
rurouni
Enthusiast
 
Posts: 44
Liked: 6 times
Joined: Wed Jul 24, 2013 7:21 pm

Re: Understanding Parallel Processing and Concurent Tasks

Veeam Logoby Gostev » Sat Jul 04, 2015 10:09 pm

Hi, for monitoring how your backup infrastructure component perform, look no further than Data Protection view of Veeam ONE Monitor. This will let you identify the most and least busy components.

Our task scheduler totally relies on resource allocation, and every new released resource will first be offered to higher priority VMs - those at the top of the list of pending VMs (which is populated according to the job start time).

To define VM processing order within the job when using containers, add the VMs you care to be processed first to the job explicitly (in addition to adding them via a container), and move them up to ensure they end up higher in the list than the remaining VMs included in a container.

Thanks!
Gostev
Veeam Software
 
Posts: 21390
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Understanding Parallel Processing and Concurent Tasks

Veeam Logoby Vitaliy S. » Sun Jul 05, 2015 8:31 pm

rurouni wrote:Is there a way to monitor the simultaneous sessions during backup windows to determine what are the resources busy enough to make my jobs wait for hours?

Just to elaborate on Anton's reply - check out our root summary tab for proxy servers as well as individual tab for the detailed information about each proxy. And the same tabs for repository > repositories overview and summary for individual repository.

This should give you overview of how backup components are used in your infrastructure.
Vitaliy S.
Veeam Software
 
Posts: 19558
Liked: 1102 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Understanding Parallel Processing and Concurent Tasks

Veeam Logoby rurouni » Fri Aug 21, 2015 5:05 pm

Sorry but i don't own veeam One.
rurouni
Enthusiast
 
Posts: 44
Liked: 6 times
Joined: Wed Jul 24, 2013 7:21 pm


Return to VMware vSphere



Who is online

Users browsing this forum: Google [Bot] and 8 guests