Backup Copy Jobs Question

Availability for the Always-On Enterprise

Backup Copy Jobs Question

Veeam Logoby ddubois » Thu Oct 19, 2017 4:25 pm

If I have a ton of VMs that backup at least daily and have a copy job setup to copy those backups to another repository. I am trying to find a way to grab some of those backups nightly for high priority VMs and weekly for low priority VMs. If the cycle is set to daily for the important VMs then it grabs the daily of all the others as well that I only want weekly copies of. Is there a way to control this?
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Backup Copy Jobs Question

Veeam Logoby DGrinev » Thu Oct 19, 2017 4:34 pm

Hi Derek,

If I get you right, you can create two backup copy jobs where the first one will contain only important VMs for nightly cycle and the second one for the rest with the interval of 7 days.
Please keep in mind the backup copy job isn't copying backup files, but moves VM data blocks from the backups. Thanks!
DGrinev
Veeam Software
 
Posts: 678
Liked: 73 times
Joined: Thu Dec 01, 2016 3:49 pm
Full Name: Dmitry Grinev

Re: Backup Copy Jobs Question

Veeam Logoby ddubois » Thu Oct 19, 2017 4:37 pm

Right, it not touching the live VMs but is getting changed data and synthetically staging it to the other repository, correct?
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Backup Copy Jobs Question

Veeam Logoby nitramd » Thu Oct 19, 2017 4:44 pm

@ddubois, a backup copy job does not "touch" the live VMs; it works with the VM files found on the repository, which, of course, was generated by a backup job.

Hope this helps.
nitramd
Enthusiast
 
Posts: 55
Liked: 9 times
Joined: Thu Feb 16, 2017 8:05 pm

Re: Backup Copy Jobs Question

Veeam Logoby ddubois » Thu Oct 19, 2017 5:21 pm

Great. The problem this brings me to that I have posted on here and got merged into another feature request post on job priority, is that if I split it into two jobs, then there is no way to tell Veeam to run the daily jobs first and either the weekly job (that has a huge amount of VMs in it) either take up all the available concurrent tasks, or if I up the tasks, the weekly one then seems to take 95% of the bandwidth causing the small number of VMs in the job to fail... Was hoping that maybe if I worded my problem different that someone might have a good workaround instead of it getting lumped into a 5 year old feature request... :(
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Backup Copy Jobs Question

Veeam Logoby nitramd » Thu Oct 19, 2017 6:44 pm

@ddubois , I'm not sure I understand what you're saying. However, I'll give it a go:

- Split your large backup copy job (yes?) into two backup copy jobs; one for critical/high priority VMs (runs daily) and the other backup copy job will be run weekly.
- Schedule your daily backup copy job to copy every one day with whatever start time you want, e.g., 11:00 PM.
- Schedule your weekly backup job to copy every 7 days with whatever start time you'd like, e.g., 3:30 AM.

If you decide to go this route, I would highly recommend that you have a firm grasp on how much data is being copied on every backup copy job run and how long it takes to complete. This information will help you determine when run the weekly backup copy job. The hope here is that you avoid resource contention on your repository as much as possible.

You may find that you may have to experiment, if possible, to find out what works best for you.

Good luck.
nitramd
Enthusiast
 
Posts: 55
Liked: 9 times
Joined: Thu Feb 16, 2017 8:05 pm

Re: Backup Copy Jobs Question

Veeam Logoby ddubois » Thu Oct 19, 2017 8:12 pm

Yes, I now have it broken into two jobs like you are referring to. However, there is no way in Veeam to prioritize a job over another so, it always seems like the "weekly" job that is currently running, grabs almost all of the available bandwidth and is preventing the "daily" job from completing until later in the week when the weekly job finishes. From my previous posts about it, I got merged into this post but was hopefully seeking a workaround... veeam-backup-replication-f2/enhancement-request-job-priority-t18019.html
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Backup Copy Jobs Question

Veeam Logoby nitramd » Thu Oct 19, 2017 8:42 pm

Ok, I have a little bit better idea, thanks.

It sounds like your running into hardware limitations, i.e. network, CPU, memory (possible).

My first question is how much total data are you backing up with the weekly job?

Next, what type of repository do you have (make, model)?
nitramd
Enthusiast
 
Posts: 55
Liked: 9 times
Joined: Thu Feb 16, 2017 8:05 pm

Re: Backup Copy Jobs Question

Veeam Logoby ddubois » Thu Oct 19, 2017 8:50 pm

local Dell server with two 64TB repositories, remote dell server connected by a 10Mbps fiber link with a 64TB repository. Both servers have 24 cores and 64GB RAM. I have a blackout period set from 6AM to 6PM Monday through Friday. It is a large amount of data for the weekly job and pegs the max on the fiber at all times. I would say that the weekly job is getting about 1MBs of the bandwidth leaving about .1-.2 for the daily job. There is no way to say, "Hey, put the weekly job on hold until this daily job finishes". Which would take about 4 hours. The weekly job completes in about 4 days and we are still adding servers to it. The daily job just includes two SQL servers that are backends for our applications and in a disaster, do not want to loose more than a day. We are backing up about 14TB of data total. For the backup copy jobs, we are adding servers one by one until we hit our limit. The only gotcha is that the weekly job smothers the one we need to run daily.
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Backup Copy Jobs Question

Veeam Logoby nitramd » Thu Oct 19, 2017 9:33 pm

10Mbps fiber link?

Is it possible to route your critical daily job to a different repository?
nitramd
Enthusiast
 
Posts: 55
Liked: 9 times
Joined: Thu Feb 16, 2017 8:05 pm

Re: Backup Copy Jobs Question

Veeam Logoby ddubois » Thu Oct 19, 2017 9:38 pm

Unfortunately, our remote server across that line is our only remote repository. I hate the idea of having to setup another server to act as a repository in another one of our sites. In typing this, I just realized a workaround that had escaped me until now. I can block out more time on the weekly job to let the daily one have a few hours to run before the other starts back up. Can't believe that I didn't think of that sooner. I just wish there was a way to tell Veeam, let this job take precedence when it starts.
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Backup Copy Jobs Question

Veeam Logoby nitramd » Thu Oct 19, 2017 9:50 pm

Great! That's advantage of "talking" about a problem. You eventually realize something that you had not before.

Good luck.
nitramd
Enthusiast
 
Posts: 55
Liked: 9 times
Joined: Thu Feb 16, 2017 8:05 pm

Re: Backup Copy Jobs Question

Veeam Logoby ddubois » Thu Oct 19, 2017 9:52 pm

Thanks for your help... I do wish there was a way to let them both run and throttle them or prioritize them... Maybe in release 10...
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Re: Backup Copy Jobs Question

Veeam Logoby mountainSE » Mon Oct 23, 2017 5:00 pm

If you have the Enterprise Plus version, this is a perfect situation for use of the WAN Accelerator feature.
mountainSE
Veeam Software
 
Posts: 17
Liked: never
Joined: Mon Jan 26, 2015 4:08 pm
Location: Colorado
Full Name: Brock Bruner

Re: Backup Copy Jobs Question

Veeam Logoby ddubois » Mon Oct 23, 2017 5:16 pm

I was told that the direct would be best for 10Mbps or faster connection by support... But I might just give it a shot and see how it does!
ddubois
Influencer
 
Posts: 13
Liked: never
Joined: Wed Oct 11, 2017 5:57 pm
Full Name: Derek DuBois

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: No registered users and 1 guest