v9 GFS Media Pool & Tape Job

Everything about backing up to tape

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby UT2015 » Fri Aug 12, 2016 8:21 am

I opened a case (ID# 01876213) and the support team can confirm that the GFS job should retry 3 times but they actually don't know why it didn't.

Just as expected...it took already 3 Messages (=more than 2 days) which in my opinion contained all relevant information, but the support does not know anything more...
UT2015
Expert
 
Posts: 120
Liked: 1 time
Joined: Tue Dec 15, 2015 1:07 pm

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby v.Eremin » Mon Aug 15, 2016 6:47 pm

Got it. I've asked our QA team to take a look at the mentioned ticket. Will update the topic once I have more information. Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby v.Eremin » Tue Aug 16, 2016 10:41 am

We've contacted your support engineer and now are going to investigate the said issue more closely. Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby v.Eremin » Tue Aug 16, 2016 1:33 pm

Ok, the issue has been analyzed thoroughly and below is the summary of our investigation:

- Under normal circumstances a GFS tape job should be retried after encountering an error
- Your conditions differ from the so-called circumstances, because your GFS job finished one day after the date that is scheduled for GFS restore point creation
- As the result the GFS job was not retried
- During its next cycle the GFS job will archive the missing data that has not been copied previously
- The described problem is addressed in 9.5

Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby nickl99 » Wed Oct 05, 2016 3:44 am

nunciate wrote:Just going to jump in on this one. I upgraded to v9 U1 today and was quite disappointed to find out that using a GFS media pool will not resolve my issues as it causes a new issue.

I am very surprised to see that you do not support incremental to tape with the GFS media pool. This is a very common scenario. Almost every place I have ever worked kept Incremental backups offsite for 7 days, Weekly for 1 Month and then Monthly for some longer term and yearly for even longer. In my case Monthly for 3 years and Yearly forever.

It makes absolutely no sense to not keep daily incremental backups offsite for at least 7 days. If I send my Full offsite on Saturday and have a catastrophic failure on Tuesday where I lose my production and backup data I will lose 3 days of data when I restore from tape. I understand this is an extremely rare scenario but it is one that we in IT always plan for and for the life of me I can't understand why you all wouldn't implement it here.

Using the current solution of multiple media pools for various retention is a complete pain in the backside.
First off you have to have a media pool for every retention period so 4 in my case.
Then you have multiply that with a media pool for each tape drive because they aren't smart enough to load balance across drives. I have 4 drives. So that means 16 Media Pools to manage in my case.
If you have multiple jobs using the same pool they all have to wait in line for the pool to be unlocked. What that fixed in v9? If I could simply have 1 media pool for each retention and the jobs could just use whatever free drives are available without locking the pool that would reduce management a bit. (EDIT) After doing some reading and playing around I answered my own question here. Parallel Processing for Tape drives is now available but not for GFS Media Pools. https://helpcenter.veeam.com/backup/hyp ... ssing.html (END EDIT)
Then to make things worse the backup jobs only allow you to choose Daily and Weekly pools so every month I have to edit 140+ jobs and change them from weekly to monthly pools. Then after that weekend I move them all back to Weekly pools.
It really is a lot to have to manage when this could be resolved by simply adding daily backups to the GFS rotation.


Yes I also dont understand why the GFS media pool doesnt allow parallel processing: it is the reason i WANT parallel processing. I have 2 drives in my loader and my GFS media pool is for the biggest job, but whilst this takes up tape drive 1, i want the non-GFS pools to parallel process when 2 tape jobs are running. Right now it waits until GFS media pool is finished before it can finally use 2 drives at once for the remaining non-GFS jobs.

WRT to incremental GFS: I'm trying to think through how\ or why maybe it isnt possible. And i think hit has something to do with the way Veeam handles Snapshots of changed blocks, and stores these as vbk fulls and vbi incrementals. Adding in a last step of incremental to tape fragments the chain of backups SO much that you will lose that nice Grandfather full tape having clean synthetics. But I know comvault manages it and at this stage it is looking as the main stand out feature comvault has over Veeam. Otherwise Veeam handles GFS in a way that I dont understand but their smarts does. So i just set it up and say GO, and it will do all the thinking/organising for me, and the tapes coming back you know then you can safely scratch and mark them as free, and any pool can now use.

Also for those having problems getting their Tape GFS job to kick off 24 hours after the last backup copy job or synthetics is created: have you tried just delaying your first GFS tape job for an extra week and letting Veeam build a weeks worth of nicely chained disk copies, at both repositories (doing the 3-2) before it kicks off the 1-out to tape. There is just a bit too much going on in the space of a few days for their smarts to happily write out a recent synthetic that has no job locks on them.
nickl99
Enthusiast
 
Posts: 26
Liked: 2 times
Joined: Wed Aug 03, 2016 5:09 am
Full Name: NICK LAING

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby nickl99 » Wed Oct 05, 2016 5:40 am

Question:

Why cant you include backup copy jobs as a source in GFS tape jobs? I have (before I read that you shouldnt) and it seems to be working ok?
nickl99
Enthusiast
 
Posts: 26
Liked: 2 times
Joined: Wed Aug 03, 2016 5:09 am
Full Name: NICK LAING

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby nickl99 » Thu Oct 06, 2016 2:15 am

Also, if Veeam doesnt support GFS Incremental backups, why in the Tape job using a GFS target does it show you the Full vs. Incremental current size expectation?

Imagescreenshot on pc
nickl99
Enthusiast
 
Posts: 26
Liked: 2 times
Joined: Wed Aug 03, 2016 5:09 am
Full Name: NICK LAING

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby v.Eremin » Thu Oct 06, 2016 11:09 am

Why cant you include backup copy jobs as a source in GFS tape jobs? I have (before I read that you shouldnt) and it seems to be working ok?

Actually, you can. Did you experience any particular issues while doing that?

Also, if Veeam doesnt support GFS Incremental backups, why in the Tape job using a GFS target does it show you the Full vs. Incremental current size expectation?

Seems like information label has been taken from normal media pool wizard as is. We'll remove it, so, thanks for raising that.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby nickl99 » Thu Oct 06, 2016 1:24 pm

Actually, you can. Did you experience any issues while doing that?

Its mentioned in the help guide that you 'cant'. See below. Just wondering if this should rather read "shouldnt", because it certainly lets you, but maybe there is some reasoning behind to recommend it as 'best practice'.

First note here:

"Do not use backup copy jobs with the GFS retention to create a GFS tape archive. The tape job do not archive the GFS restore points from disk."
nickl99
Enthusiast
 
Posts: 26
Liked: 2 times
Joined: Wed Aug 03, 2016 5:09 am
Full Name: NICK LAING

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby v.Eremin » Thu Oct 06, 2016 3:59 pm 1 person likes this post

Previously (v9 GA) there have been few issues with backup to tape job and GFS backup to tape job processing backup copy job that has GFS retention scheme enabled. Thus, we've added the said note.

Nowadays you can use backup copy job (with or without GFS retention) as a source for both a backup to tape and GFS backup to tape jobs without any issues.

Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby leithm » Fri Oct 14, 2016 9:53 pm

So my understanding is correct..

the 24hr gfs window is based upon the source backup execution time not the backup finish time.. so the source backups need to run after midnight if we want a GFS job to process them that day ?


This appears to be what is happening. Can you please simplify GFS and make it just grab the latest restore point regardless? I would like more flexibility around scheduling ..

Also another request for tape - Can we please have an option to prioritize tape over disk? I want my disk job to be held automatically if a tape job is copying a disk source file


Thanks,
leithm
Service Provider
 
Posts: 5
Liked: never
Joined: Thu May 19, 2016 12:52 am
Full Name: Leith Magon

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby v.Eremin » Mon Oct 17, 2016 11:37 am

so the source backups need to run after midnight if we want a GFS job to process them that day ?

This is expected behaviour, indeed. It can be tweaked via registry, though.

Can we please have an option to prioritize tape over disk?

Already addressed in 9.5.

Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby cmaier » Fri Nov 18, 2016 10:10 am

Hi,

Daily incrementals are not addressed in GFS pools in 9.5? Why not? I thought you recognized that almost everyone needs this?

Regards,
Christian
cmaier
Influencer
 
Posts: 23
Liked: 1 time
Joined: Mon Feb 24, 2014 4:01 pm
Full Name: Christian Maier

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby v.Eremin » Fri Nov 18, 2016 10:29 am

I thought you recognized that almost everyone needs this?

We do recognize that. Nevertheless, we cannot deliver everything within one release, especially if it's . (point) one.

I can rest assured that the matter will be given its full consideration down the road.

Thanks.
v.Eremin
Veeam Software
 
Posts: 13266
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: v9 GFS Media Pool & Tape Job

Veeam Logoby cmaier » Fri Nov 18, 2016 11:57 am

I didn't expect that this one is so complicated. However, if it's on the agenda I'm fine with that.
cmaier
Influencer
 
Posts: 23
Liked: 1 time
Joined: Mon Feb 24, 2014 4:01 pm
Full Name: Christian Maier

PreviousNext

Return to Tape



Who is online

Users browsing this forum: No registered users and 7 guests