Enhancement request -- job priority

Availability for the Always-On Enterprise

Re: Enhancement request -- job priority

Veeam Logoby ChuckS42 » Wed Feb 03, 2016 9:53 pm

The application running on these servers doesn't like the stun a snapshot creates, so they set aside a backup window during specific hours to allow a backup to run when the stun can be tolerated. Outside this window a stun will interrupt critical processes on the servers.

I see what you're saying with regards to backup windows, but that seems to be an awful complicated way to work around a simple problem. I could stand up dedicated proxy and repository servers just for this job, but that's an overly complicated solution as well.

A simple high-priority flag (for an individual VM in a job, or for the entire job) would make this much easier.
ChuckS42
Enthusiast
 
Posts: 70
Liked: 5 times
Joined: Wed Apr 24, 2013 8:53 pm
Full Name: Chuck Stevens

Re: Enhancement request -- job priority

Veeam Logoby foggy » Thu Feb 04, 2016 10:28 am

I see the point, you need to make sure the job gets resources once it starts.
foggy
Veeam Software
 
Posts: 15295
Liked: 1133 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Enhancement request -- job priority

Veeam Logoby Tarqy » Thu May 04, 2017 9:19 am

Apologies for bumping an old thread but are there any plans to implement this in a future version?

I have the same issue as Chuck above, I have a some servers that runs various maintenance and batch task overnight and there is only a short period of time where we can do the stun for backup but we are finding that starting the job at this time is not sufficient to guarantee access to resources.

Thanks
VMCE
Tarqy
Service Provider
 
Posts: 25
Liked: 3 times
Joined: Fri Aug 08, 2014 1:51 pm
Full Name: Barry Knox

Re: Enhancement request -- job priority

Veeam Logoby foggy » Thu May 04, 2017 11:52 am

Hi Barry, cannot say anything regarding the plans, but in addition to the workaround mentioned above, you can set up a dedicated proxy server assigned exclusively for this job.
foggy
Veeam Software
 
Posts: 15295
Liked: 1133 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Enhancement request -- job priority

Veeam Logoby Tarqy » Thu May 04, 2017 3:36 pm

This is a Hyper-V host using on-host processing, the resource contention is on the repository and having moved to a SOBR having to add in a dedicated repository for this particular jobs seems like going backwards!
VMCE
Tarqy
Service Provider
 
Posts: 25
Liked: 3 times
Joined: Fri Aug 08, 2014 1:51 pm
Full Name: Barry Knox

Re: Enhancement request -- job priority

Veeam Logoby foggy » Thu May 04, 2017 4:15 pm

Ok, fair enough. Thanks for your feedback.
foggy
Veeam Software
 
Posts: 15295
Liked: 1133 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Enhancement request -- job priority

Veeam Logoby meeyou » Wed Sep 27, 2017 9:46 pm

Just piling on to add another request for this feature.

We have a select few jobs that are very time sensitive (the server has to be powered off for the job to complete due to DirectPath I/O device passed through) so we need this one job to cut in line and take the very next available resource slots when it starts, otherwise it is doomed for failure after its window.
meeyou
Influencer
 
Posts: 20
Liked: never
Joined: Tue Oct 16, 2012 5:47 pm
Full Name: John White

Re: Enhancement request -- job priority

Veeam Logoby Gostev » Thu Sep 28, 2017 2:45 pm

Thanks for sharing your use case, John.
Gostev
Veeam Software
 
Posts: 21621
Liked: 2411 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

[MERGED] [Feature Request] Concurrent Backup Copy Job Tasks

Veeam Logoby ddubois » Wed Oct 11, 2017 7:13 pm

Back Story: I have quite a number of chained backup jobs and three backup copy jobs. When the backup copy jobs are transferring data, they grab many concurrent tasks from the repository. If the repository is set too low, these jobs will hold up the normal backup jobs. The problem is that two of the backup copy jobs go to an offsite location and some of the larger VMs can hold up the backups for hours. I have the concurrent tasks on the Proxy set to 1 as I just want sequential writing to the repository for deduplication purposes. There is no current way to limit the backup copy jobs to x number of concurrent tasks. They do not use a proxy and only have the shared resource of the repository to limit the tasks! The backup copy jobs NEED an in-job control of the number of concurrent tasks. This is my main issue. I do have one other issue I am dealing with though that I will mention in case someone has a good suggestion for it. My two jobs that copy backups offsite run on different schedules. One job has a daily cycle for the more critical business applications. The second remote copy job has an interval set to one week to pick up the weeklies of the less changing VMs. I would like to limit each of these jobs to one concurrent task so that they might get equal bandwidth but I would also love to be able to group these two jobs and set a priority on them so that one runs before the other. A weighting system maybe. I would like the ones on the daily schedule to complete before it tries to copy the weekly job if that makes sense...

Any suggestions would be appreciated but definitely would love to see a concurrent task limit on backup copy jobs!
Case# 02338963
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: [Feature Request] Concurrent Backup Copy Job Tasks

Veeam Logoby tsightler » Wed Oct 11, 2017 9:16 pm

Perhaps I'm not fully grasping the issue, but if you just want to limit the concurrency of the backup copy job you can set the task limit of the target repository.
tsightler
Veeam Software
 
Posts: 4874
Liked: 1821 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: [Feature Request] Concurrent Backup Copy Job Tasks

Veeam Logoby ddubois » Wed Oct 11, 2017 9:49 pm

I have two jobs going to the remote repository, a daily copy job and a weekly interval job. If I set the destination repository to say 2, then one of the jobs will grab both unfortunately and make the other wait and there is no way to guarantee which job will grab them. Unfortunately, right now, I am looking at the two jobs running, and the weekly job is using about 95% of the bandwidth and the daily job is using the remaining 5%. I wish I could A) control the concurrent tasks on each job individually, and B) set a priority so that the daily job will take precedence and complete instead of it being a crap shoot as to which gets the most bandwidth and number of tasks. I mean the daily has only 24 hours to complete, but the weekly job can take up to 7 days. At this rate, my daily will not complete within its interval and the weekly will finish in less than 2 days. Hopefully that illustrates the issue better. One remote job has 3 tasks running and the other has 1 (luckily).
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: [Feature Request] Concurrent Backup Copy Job Tasks

Veeam Logoby ddubois » Thu Oct 12, 2017 1:45 pm

I thought about placing all of the VMs into one remote copy job and tried it. Because I keep daily backups on the VMs that I want to copy on a weekly schedule, it wants to sync those VMs daily as well as the priority ones that I backup every 2 hours. With it trying to keep up with the changes, it will not complete in the allotted time and errors out. So it became two jobs with different intervals. However, now I cannot control them as I need to be able to.
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Enhancement request -- job priority

Veeam Logoby foggy » Thu Oct 12, 2017 5:23 pm

Hi Derek, I'm merging the thread since your request comes down to the job priority feature mostly. Thanks for the feedback.
foggy
Veeam Software
 
Posts: 15295
Liked: 1133 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Enhancement request -- job priority

Veeam Logoby ddubois » Thu Oct 12, 2017 7:34 pm

And a way to limit tasks on backup copy jobs going to the same repository... This is very frustrating as I cannot figure out a way to get my daily offsite jobs to complete without the weekly job getting in the way. We are great as far as local jobs and retention policies but if anything ever happens to this place, we are in trouble. I was hoping that there would be a workaround. Wow, this has been open for a long time. There have to be many others in my same situation. What is everyone else doing to get around it?
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Enhancement request -- job priority

Veeam Logoby ddubois » Sat Oct 14, 2017 7:17 pm

Instead of two separate backup copy jobs, I tried one, but then the systems that I want to copy offsite do not complete in time. I would like some of the systems to copy daily and the rest copy weekly however since all of those backup locally at least once a day, the ones that I want weekly of at the remote site, copy every day with the others causing too much traffic to complete. With the two copy jobs, one on a daily cycle and the other on a weekly cycle, it seems the weekly occupies most of the bandwidth causing the daily job to not complete for the first half of the week. If only I could get veeam to put a preference on the daily job over the weekly one, my problems would be over. I am desperately seeking a work around until the software can do that.
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Previous

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot] and 1 guest