v9 GFS Job Schedule Questions

Everything about backing up to tape

Re: v9 GFS Job Schedule Questions

Veeam Logoby Shestakov » Thu Feb 11, 2016 4:40 pm

Hello Werner,
We do receive the similar requests from time to time and thinking to implement backup window in one of the next releases.
Thanks!
Shestakov
Veeam Software
 
Posts: 4861
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: v9 GFS Job Schedule Questions

Veeam Logoby PenguinSSH » Fri Feb 12, 2016 5:22 pm

Can we get a retry option when the job fails. Seriously, if a job fails in the middle of the night because it was stopped by backup jobs, we would need it to retry automatically. Otherwise, we're loosing 10-12 hours of tape transfer.
PenguinSSH
Enthusiast
 
Posts: 28
Liked: 2 times
Joined: Thu Feb 26, 2015 7:19 pm
Full Name: PenguinSSH

Re: v9 GFS Job Schedule Questions

Veeam Logoby Dima P. » Sat Feb 13, 2016 11:21 pm

Hi PenguinSSH,

It should be retried automatically if any source job is locked/failed (or running): it constantly checking the source jobs and if the required job is completed – start placing the files to tape. Moreover, it can keep retiring till the next scheduled GFS date (for the source disk jobs that overlap the tape GFS schedule).
Dima P.
Veeam Software
 
Posts: 6249
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: v9 GFS Job Schedule Questions

Veeam Logoby PenguinSSH » Mon Feb 15, 2016 2:05 pm

Hi Dima,

This has not been our experience so far with the GFS Tape jobs, if it fails because it is interrupted by a source backup job, it stays failed until we start it manually again.
PenguinSSH
Enthusiast
 
Posts: 28
Liked: 2 times
Joined: Thu Feb 26, 2015 7:19 pm
Full Name: PenguinSSH

Re: v9 GFS Job Schedule Questions

Veeam Logoby Dima P. » Tue Feb 16, 2016 6:27 pm

Thanks for the heads up. We are going to check this behavior in our lab – stay tuned.
Dima P.
Veeam Software
 
Posts: 6249
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: v9 GFS Job Schedule Questions

Veeam Logoby Dima P. » Sun Feb 21, 2016 4:51 pm

PenguinSSH,

You were right. If the GFS tape job gets interrupted by source jobs (for example, because of the merging process) – GFS job is going to be cancel. Thanks for bringing this up – we will discuss with the team how this behavior can be corrected.
Dima P.
Veeam Software
 
Posts: 6249
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: v9 GFS Job Schedule Questions

Veeam Logoby PenguinSSH » Sun Feb 21, 2016 10:49 pm

Hi Dima

It seems to me that there are a couple of processes within Veeam that could benefit from this. If a process such as tape backup is running and depends on the backup files, the VBKs should not be altered until the dependency is completed. So a kind of queue in this process with priority should be helpful.

In other words, merging process and backup file check would have less priority over something like backup, tape backup or backup copy. Once those are finished, the lower priority process could be triggered.

In my opinion, with the different processes such as merging, backup guard, replication from backup files will make it harder for processes depending on VBKs to complete properly when those are lengthy or depend on the original VBKs.

Thanks for the reply and keeping us in the loop.
PenguinSSH
PenguinSSH
Enthusiast
 
Posts: 28
Liked: 2 times
Joined: Thu Feb 26, 2015 7:19 pm
Full Name: PenguinSSH

Re: v9 GFS Job Schedule Questions

Veeam Logoby Shestakov » Mon Feb 22, 2016 10:33 am

PenguinSSH, thanks for the feedback.
By default backup and replication jobs have higher priority than backup copy and backup to tape since first two take a snapshot and actually preserve VMs state, while second two "just" copy existing backups on disk or tape.
You may switch the source backup job to basic forward incremental with no merges to avoid the situation like you face now.
Shestakov
Veeam Software
 
Posts: 4861
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: v9 GFS Job Schedule Questions

Veeam Logoby F.Henne » Mon Mar 07, 2016 8:25 am 1 person likes this post

The case of interrupted tape jobs due to source backup jobs running merge is a problen for me too. The way I've solved it so far is to use the Job Scripts option and run powershell scripts for increasing/decreasing the source jobs retention policy by a few days. This puts the merge process on hold for a set number of days and at least makes it possible to have the tape job running over several days.

The scripts I use right now are simple dirty fixes for the problem in that they are are only increasing and decreasing by a fixed integer. A cleaner and better solution would be to read the retention policy that exists as of today in your jobs and then store those in clixml (Export-Clixml) for use in the decrease script. I'll leave the scripts below if anyone is interested.

A proper solution from Veeams side would be nice though for tape jobs and forever incremental. If possible it would be nice if the source backup jobs took into consideration any tape jobs running against the repository and skip or postpone any merge processes for later. Perhaps not the best solution for everyone but those us who's got space enough to hold 2-3 extra days of incrementals every week/month shouldn't have any problems with it. Seeing as it is the merge process that makes the jobs fail.

increaseRetainCycle.ps1
Code: Select all
Add-PSSnapin veeampssnapin

$jobs = Get-VBRJob | ? {$_.IsBackupJob -eq $True}

$jobs | Foreach-Object {
$options = $_.GetOptions()
$options.BackupStorageOptions.RetainCycles += 4
$_.SetOptions($options)
}


decreaseRetainCycle.ps1
Code: Select all
Add-PSSnapin veeampssnapin

$jobs = Get-VBRJob | ? {$_.IsBackupJob -eq $True}

$jobs | Foreach-Object {
$options = $_.GetOptions()
if($options.BackupStorageOptions.RetainCycles -gt 20) {
$options.BackupStorageOptions.RetainCycles -= 4
$_.SetOptions($options)
}
}
F.Henne
Lurker
 
Posts: 1
Liked: 1 time
Joined: Wed Jan 14, 2015 4:03 pm
Full Name: Fredrik Henne

Re: v9 GFS Job Schedule Questions

Veeam Logoby Dima P. » Mon Mar 07, 2016 10:53 pm

Fredrik,

Thank you very much for sharing. We definitely looking into the solution to let the tape jobs wait for the source disk job if it was interrupted by whatever reason.
Dima P.
Veeam Software
 
Posts: 6249
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: v9 GFS Job Schedule Questions

Veeam Logoby pkelly_sts » Wed Mar 09, 2016 4:48 pm

I wonder if there's any scope for creating some kind of "Priority" flag, where we can choose (within reason) which jobs should have higher priority? Could also help with superceding GFS jobs if required (not sure if that side of things is working ok these days until I get onto v9)
[New Sig: PLEASE get GFS tape support for incrementals!!!]
pkelly_sts
Expert
 
Posts: 504
Liked: 55 times
Joined: Thu Jun 13, 2013 10:08 am
Full Name: Paul Kelly

Re: v9 GFS Job Schedule Questions

Veeam Logoby Dima P. » Tue Mar 15, 2016 4:59 pm

Hi Paul,

Setting the source job priority is not currently possible but will be added in the upcoming releases.
Dima P.
Veeam Software
 
Posts: 6249
Liked: 440 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: v9 GFS Job Schedule Questions

Veeam Logoby pkelly_sts » Wed Mar 16, 2016 9:18 am

Good to hear :)
[New Sig: PLEASE get GFS tape support for incrementals!!!]
pkelly_sts
Expert
 
Posts: 504
Liked: 55 times
Joined: Thu Jun 13, 2013 10:08 am
Full Name: Paul Kelly

Re: v9 GFS Job Schedule Questions

Veeam Logoby westCPS » Mon Mar 21, 2016 8:04 am

Thanks for all the informations.

Best regards
Werner
westCPS
Service Provider
 
Posts: 7
Liked: never
Joined: Wed Aug 28, 2013 10:44 am
Full Name: Werner Steinegger

[MERGED] GFS tape job scheduling

Veeam Logoby lowlander » Wed Mar 30, 2016 5:34 am

Hi,

is it possible to schedule a GFS tape job @ a specific time. Now, the job always starts @ 12:00AM, while we want to fire it up @ 14:00PM.

Thanks !
lowlander
Service Provider
 
Posts: 267
Liked: 20 times
Joined: Sun Dec 28, 2014 11:48 am

PreviousNext

Return to Tape



Who is online

Users browsing this forum: No registered users and 6 guests