Understanding Parallel Processing and Concurent Tasks

[rurouni]

Hi, i need to get a good understanding to // processing and concurrent tasks interactions and available levers to speed up backups.
We have 65 Jobs for about 700 vms to backup per night.

I observed that this high amount of jobs increase the collision probability in time scheduling. So i often sometime observe jobs waiting for hours for available resources to perform backups.
I have two huge proxies that remains lower than 25% CPU/RAM usage during backups. Concurrent tasks are set to 10 per proxy. (So i guess i could raise the max concurrent tasks supported).
On the other hand i have a bunch of repositories set up to 5 concurrent tasks each.

Is there a way to monitor the simultaneous sessions during backup windows to determine what are the resources busy enough to make my jobs wait for hours?
Are there others settings that can impact // processing and concurrent tasks?
I don't understand how resources are allocated since i started a job manually yesterday during backup window and this job waited more than 4 hours before really starting backups. On the other hand i found other jobs scheduled to start later that have been starting and finishing earlier than the job i started manually.
Could there be a way to especially prioritize a job against others or are we totally relying on resources allocation?
On last question, i found that inside a single job i can move up/down vms in the processing list. I guess it has a relation with the order the vms are processed inside a job. How about if i'm using vm folders as backup objects. Can i still define a proper vm processing order inside my job? I didn't get it.

Thanks for the answers then, and hope it will help others, i may not be the only one to ask these questions.

[Gostev]

Hi, for monitoring how your backup infrastructure component perform, look no further than Data Protection view of Veeam ONE Monitor. This will let you identify the most and least busy components.

Our task scheduler totally relies on resource allocation, and every new released resource will first be offered to higher priority VMs - those at the top of the list of pending VMs (which is populated according to the job start time).

To define VM processing order within the job when using containers, add the VMs you care to be processed first to the job explicitly (in addition to adding them via a container), and move them up to ensure they end up higher in the list than the remaining VMs included in a container.

Thanks!

[Vitaliy S.]

Is there a way to monitor the simultaneous sessions during backup windows to determine what are the resources busy enough to make my jobs wait for hours?

Just to elaborate on Anton's reply - check out our root summary tab for proxy servers as well as individual tab for the detailed information about each proxy. And the same tabs for repository > repositories overview and summary for individual repository.

This should give you overview of how backup components are used in your infrastructure.

[rurouni]

Sorry but i don't own veeam One.