Discussions related to exporting backups to tape and backing up directly to tape.
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: v9 GFS Job Schedule Questions

Post by veremin »

The GFS backup to tape job doesn't start copying data immediately, instead it just seats and waits till a new point appears within 24 hours interval.

So, can you elaborate on why you want the GFS tape job to start at 2 PM?

Thanks.
lowlander
Service Provider
Posts: 450
Liked: 30 times
Joined: Dec 28, 2014 11:48 am
Location: The Netherlands
Contact:

[MERGED] Tape job GFS scheduling

Post by lowlander »

Hi,

we configured tape out with a GFS job, works pretty well for us ! @12:00AM the job hits the road and will process the available restorepoints. Can you please explain what the strategy for the GFS tape job is : will it do a kind of forward lookup for restorepoints available since @12:00, or will it do a lookback for restore points available (like a default copy job does) ?

Thanks !
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov » 1 person likes this post

Hi, it makes a forward lookup, waiting for new restore points.
Please review the thread for more information.
Thanks!
slmacquarie
Influencer
Posts: 11
Liked: 2 times
Joined: Feb 19, 2015 2:33 am
Full Name: Shane Ley
Contact:

Re: v9 GFS Job Schedule Questions

Post by slmacquarie »

I would very much appreciate it if someone would kindly provide some clarification on how this works in the following scenario:

Weekday backup job (Mon-Fri 22:00) with synthetic full on Friday. GFS (set to only do Monthly/Yearly - I have another tape job for daily/weekly to achieve incremental daily tapes w/full weekly tapes that runs after completion of this job) set to run on first Saturday of month (defaults to 12:00am start time).

What happens if the Backup job finishes before 11:59pm on Friday? My interpretation of this thread is that the job would not proceed?

If the Backup job finishes after 12:00am Saturday, does the weekly to tape job run (set to run after completion), followed by the GFS monthly job, or does the GFS job run first because it technically started before the backup job completed? If the latter, what will happen to the 'weekly to tape' job?

What happens if there are errors that occur in the backup job and it later retries? Does the synthetic full get processed before or after retry attempts? Will the weekly job run only after the retries, or will it run sans-retries? What about the GFS?
Dima P.
Product Manager
Posts: 14396
Liked: 1568 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Dima P. »

What happens if the Backup job finishes before 11:59pm on Friday? My interpretation of this thread is that the job would not proceed?
GFS job should wait the restore point for the set day. When the source job completed this restore point is going to be written to tape.
If the Backup job finishes after 12:00am Saturday, does the weekly to tape job run (set to run after completion), followed by the GFS monthly job, or does the GFS job run first because it technically started before the backup job completed? If the latter, what will happen to the 'weekly to tape' job?
Assume, they will start at the same time if you have two drives/two tapes available.
What happens if there are errors that occur in the backup job and it later retries?
If the restore point for the set day was not created, GFS tape job will pick closest restore point instead (if its incremental - it will make a virtual full backup).
Does the synthetic full get processed before or after retry attempts?
If you are talking about virtual full on tape - after.

P.S. For detailed information please refer to the Help Center article - GFS Tape Jobs
slmacquarie
Influencer
Posts: 11
Liked: 2 times
Joined: Feb 19, 2015 2:33 am
Full Name: Shane Ley
Contact:

Re: v9 GFS Job Schedule Questions

Post by slmacquarie »

Thanks Dima. Given that no backup is scheduled for Saturday, the day of my GFS to Tape, it seems like the GFS will wait 24h until midnight Saturday before it gives up waiting and writes Friday's synthetic full to tape - perhaps 20 hours after it could have written the tape.

On the other hand, if I set the GFS to run on Friday instead of Saturday, it is not clear to me whether it would erroneously detect the end of Thursday's backup (if it runs over into Friday morning) and then synthesize a virtual full of that or whether it would wait until Friday evening's backup to start. If the latter, wouldn't it give up after 24 hours (before the Friday backup completes, in the event it runs over into Saturday morning) and create a synthetic virtual full of Thursday's to write to the GFS tape?

I guess this all boils down to how intelligent the GFS scheduling code is and whether it works off of the start or end time of the source backup (or both). Unless it's really intelligent, I can see this becoming a problem for me next week - this will be the first automated GFS for me.

Perhaps the documentation could be updated to cover this in more detail?

If it's not sufficiently intelligent, the scenario above makes a case for a specific time window feature to be added to the GFS schedule dialog.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov »

The GFS logic is pretty intelligent. Even if you have the GFS-tape job scheduled on Friday and a source job starts on the Friday evening and still running on Saturday morning, the GFS job will wait for that particular job to be completed.
If the source job finally fails, the GFS job will take the previous successfully finished backup.
So I would suggest to schedule the tape-GFS job on Friday, otherwise(Saturday option) you will have all the tape processing happening on Sunday morning.
Thanks!
slmacquarie
Influencer
Posts: 11
Liked: 2 times
Joined: Feb 19, 2015 2:33 am
Full Name: Shane Ley
Contact:

Re: v9 GFS Job Schedule Questions

Post by slmacquarie » 2 people like this post

Thanks for clearing that up, Shestakov, your advice was most appreciated. I guess I should have assumed Veeam would 'just work', but coming from a Backup Exec background, I've been conditioned to expect the worst. Veeam is some really great software.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov »

Thanks for the kind words, Shane!
I`ve forwarded it to out R&D team.
Once you have a question or suggestion, don`t hesitate writing.
ekisner
Expert
Posts: 202
Liked: 34 times
Joined: Jul 26, 2012 8:04 pm
Full Name: Erik Kisner
Contact:

[MERGED] GFS Scheduling Granularity

Post by ekisner »

I've been experimenting with different tape schedules, trying to get things to complete in the time allotted. Lucky for me we have weekends.

Unfortunately, I still have a sub-optimal experience.

Since my file server tape job takes the longest, I've decided to start that one first. The rest can run during the week (so that they can run between source jobs and not get killed) if they must, though they need not if things work.

To that effect, my file server source job runs on a 12 hour rotation, with a blackout between Friday from 10pm till Monday at 10am. This means the source job will "skip" Friday evenings and Monday mornings. Which in theory gives me an extra 24 hours.

Unfortunately, I cannot tell the GFS tape job that it should start its backup at a certain time. "Friday" or "Saturday" is as granular as it gets. What I want/need is "Friday at 2pm", or some other way to differentiate "after the last contiguous backup" of the period (weekly, most of the time).
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov »

Hello Erik,
That`s the expected behavior. Please review the topic for more info.
We`ve taken into account your request to specify the start time for tape GFS job.
Thanks for the feedback!
nira99077
Novice
Posts: 3
Liked: never
Joined: Feb 25, 2010 11:53 pm
Full Name: Adrian Simpson
Contact:

Re: v9 GFS Job Schedule Questions

Post by nira99077 »

Hello Veeam Forum

Has there been any progress, changes or announcements about a GFS tape job automatically being able to restart or being able to prioritise the GFS tape job so it does not fail when the daily backup kicks in.

Although this post is now approaching a year old and it being taken to the Dev team as far back as Feb this year, Veeam B&R 9 update 2 still has this issue. I have an open support case with Veeam and mentioned this post and their response is "As far as the upcoming features Support doesn't receive any details for the upcoming releases , nor is it known by this department if it will be, or if it is even a concept in development." Obviously Support and Dev do not or are not allowed to speak which is a shame.

Simply failing the tape job does not seem good enough to me as archiving backups to tape for long term retention is one of the most important parts of meeting our compliance requirements and is probably equally important for many others using Veeam.

Regards
Adrian
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov »

Hello Adrian,
R&D team is here and the discussed option is going to be a part of new major release which is planned for the middle of November.
Thanks!
nira99077
Novice
Posts: 3
Liked: never
Joined: Feb 25, 2010 11:53 pm
Full Name: Adrian Simpson
Contact:

Re: v9 GFS Job Schedule Questions

Post by nira99077 »

Thanks for the prompt reply and the good news about the pending changes.
I look forward to the release.
Adrian
Adrian
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov »

You are welcome, Adrian!
By the way, RTM build has been released today, so Nov, 15th is going to be the date of GA release.
Jan Linders
Lurker
Posts: 1
Liked: never
Joined: Jun 28, 2013 7:07 am
Contact:

[MERGED] Add time to GFS schedule

Post by Jan Linders »

We are creating a new backup schedule.
At this moment a job with a GFS pool can only be started at 12:00 AM.
Does anyone know if there is a way to alter this time so backup jobs with GFS media pools can run in the afternoon or evening.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: v9 GFS Job Schedule Questions

Post by Shestakov »

Hello Jan and welcome to the community!
The option to start the job at particular time is not available. Please read the thread for explanation.
Thanks!
Post Reply

Who is online

Users browsing this forum: No registered users and 18 guests