Discussions specific to tape backups
Shestakov
Veeam Software
Posts: 6575
Liked: 649 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov » Feb 11, 2016 4:40 pm

Hello Werner,
We do receive the similar requests from time to time and thinking to implement backup window in one of the next releases.
Thanks!

PenguinSSH
Enthusiast
Posts: 28
Liked: 2 times
Joined: Feb 26, 2015 7:19 pm
Full Name: PenguinSSH
Contact:

Re: v9 GFS Job Schedule Questions

Post by PenguinSSH » Feb 12, 2016 5:22 pm

Can we get a retry option when the job fails. Seriously, if a job fails in the middle of the night because it was stopped by backup jobs, we would need it to retry automatically. Otherwise, we're loosing 10-12 hours of tape transfer.

Dima P.
Product Manager
Posts: 9911
Liked: 789 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Dima P. » Feb 13, 2016 11:21 pm

Hi PenguinSSH,

It should be retried automatically if any source job is locked/failed (or running): it constantly checking the source jobs and if the required job is completed – start placing the files to tape. Moreover, it can keep retiring till the next scheduled GFS date (for the source disk jobs that overlap the tape GFS schedule).

PenguinSSH
Enthusiast
Posts: 28
Liked: 2 times
Joined: Feb 26, 2015 7:19 pm
Full Name: PenguinSSH
Contact:

Re: v9 GFS Job Schedule Questions

Post by PenguinSSH » Feb 15, 2016 2:05 pm

Hi Dima,

This has not been our experience so far with the GFS Tape jobs, if it fails because it is interrupted by a source backup job, it stays failed until we start it manually again.

Dima P.
Product Manager
Posts: 9911
Liked: 789 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Dima P. » Feb 16, 2016 6:27 pm

Thanks for the heads up. We are going to check this behavior in our lab – stay tuned.

Dima P.
Product Manager
Posts: 9911
Liked: 789 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Dima P. » Feb 21, 2016 4:51 pm

PenguinSSH,

You were right. If the GFS tape job gets interrupted by source jobs (for example, because of the merging process) – GFS job is going to be cancel. Thanks for bringing this up – we will discuss with the team how this behavior can be corrected.

PenguinSSH
Enthusiast
Posts: 28
Liked: 2 times
Joined: Feb 26, 2015 7:19 pm
Full Name: PenguinSSH
Contact:

Re: v9 GFS Job Schedule Questions

Post by PenguinSSH » Feb 21, 2016 10:49 pm

Hi Dima

It seems to me that there are a couple of processes within Veeam that could benefit from this. If a process such as tape backup is running and depends on the backup files, the VBKs should not be altered until the dependency is completed. So a kind of queue in this process with priority should be helpful.

In other words, merging process and backup file check would have less priority over something like backup, tape backup or backup copy. Once those are finished, the lower priority process could be triggered.

In my opinion, with the different processes such as merging, backup guard, replication from backup files will make it harder for processes depending on VBKs to complete properly when those are lengthy or depend on the original VBKs.

Thanks for the reply and keeping us in the loop.
PenguinSSH

Shestakov
Veeam Software
Posts: 6575
Liked: 649 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov » Feb 22, 2016 10:33 am

PenguinSSH, thanks for the feedback.
By default backup and replication jobs have higher priority than backup copy and backup to tape since first two take a snapshot and actually preserve VMs state, while second two "just" copy existing backups on disk or tape.
You may switch the source backup job to basic forward incremental with no merges to avoid the situation like you face now.

F.Henne
Lurker
Posts: 1
Liked: 1 time
Joined: Jan 14, 2015 4:03 pm
Full Name: Fredrik Henne
Contact:

Re: v9 GFS Job Schedule Questions

Post by F.Henne » Mar 07, 2016 8:25 am 1 person likes this post

The case of interrupted tape jobs due to source backup jobs running merge is a problen for me too. The way I've solved it so far is to use the Job Scripts option and run powershell scripts for increasing/decreasing the source jobs retention policy by a few days. This puts the merge process on hold for a set number of days and at least makes it possible to have the tape job running over several days.

The scripts I use right now are simple dirty fixes for the problem in that they are are only increasing and decreasing by a fixed integer. A cleaner and better solution would be to read the retention policy that exists as of today in your jobs and then store those in clixml (Export-Clixml) for use in the decrease script. I'll leave the scripts below if anyone is interested.

A proper solution from Veeams side would be nice though for tape jobs and forever incremental. If possible it would be nice if the source backup jobs took into consideration any tape jobs running against the repository and skip or postpone any merge processes for later. Perhaps not the best solution for everyone but those us who's got space enough to hold 2-3 extra days of incrementals every week/month shouldn't have any problems with it. Seeing as it is the merge process that makes the jobs fail.

increaseRetainCycle.ps1

Code: Select all

Add-PSSnapin veeampssnapin

$jobs = Get-VBRJob | ? {$_.IsBackupJob -eq $True}

$jobs | Foreach-Object {
$options = $_.GetOptions()
$options.BackupStorageOptions.RetainCycles += 4
$_.SetOptions($options)
}
decreaseRetainCycle.ps1

Code: Select all

Add-PSSnapin veeampssnapin

$jobs = Get-VBRJob | ? {$_.IsBackupJob -eq $True}

$jobs | Foreach-Object {
$options = $_.GetOptions()
if($options.BackupStorageOptions.RetainCycles -gt 20) {
$options.BackupStorageOptions.RetainCycles -= 4
$_.SetOptions($options)
}
}

Dima P.
Product Manager
Posts: 9911
Liked: 789 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Dima P. » Mar 07, 2016 10:53 pm

Fredrik,

Thank you very much for sharing. We definitely looking into the solution to let the tape jobs wait for the source disk job if it was interrupted by whatever reason.

pkelly_sts
Expert
Posts: 568
Liked: 62 times
Joined: Jun 13, 2013 10:08 am
Full Name: Paul Kelly
Contact:

Re: v9 GFS Job Schedule Questions

Post by pkelly_sts » Mar 09, 2016 4:48 pm

I wonder if there's any scope for creating some kind of "Priority" flag, where we can choose (within reason) which jobs should have higher priority? Could also help with superceding GFS jobs if required (not sure if that side of things is working ok these days until I get onto v9)

Dima P.
Product Manager
Posts: 9911
Liked: 789 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Dima P. » Mar 15, 2016 4:59 pm

Hi Paul,

Setting the source job priority is not currently possible but will be added in the upcoming releases.

pkelly_sts
Expert
Posts: 568
Liked: 62 times
Joined: Jun 13, 2013 10:08 am
Full Name: Paul Kelly
Contact:

Re: v9 GFS Job Schedule Questions

Post by pkelly_sts » Mar 16, 2016 9:18 am

Good to hear :)

westCPS
Service Provider
Posts: 14
Liked: never
Joined: Aug 28, 2013 10:44 am
Full Name: Werner Steinegger
Contact:

Re: v9 GFS Job Schedule Questions

Post by westCPS » Mar 21, 2016 8:04 am

Thanks for all the informations.

Best regards
Werner

lowlander
Service Provider
Posts: 297
Liked: 21 times
Joined: Dec 28, 2014 11:48 am
Contact:

[MERGED] GFS tape job scheduling

Post by lowlander » Mar 30, 2016 5:34 am

Hi,

is it possible to schedule a GFS tape job @ a specific time. Now, the job always starts @ 12:00AM, while we want to fire it up @ 14:00PM.

Thanks !

Post Reply

Who is online

Users browsing this forum: Jeroenix and 9 guests