Backup to Tape only last backup with reversed incremental

Discussions specific to tape backups

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby sbbots » Thu Feb 13, 2014 8:29 pm

v.Eremin wrote:Hi, Matt,
You mean sometimes it happens that there are more than two full backups in given directory that haven't been copied yet to tape mediums by file to tape job, and you want to copy only the latest file, right?

Exactly.

With 14 restore points, the backup repository will have a minimum of (3) and a maximum of (4) full backup VBK files in it at any given time. I cannot fit the entire repository on a single LTO-5 tape, which is what I want to use because no one is around on weekends to swap out multiple tapes. So when I run a semi-monthly tape backup using files-to-tape, I have a script that copies only the latest VBK file to another directory and then runs an unscheduled tape backup job which copies that directory to tape. It works just fine, but having an option that would let me schedule a files-to-tape job that goes to the backup repository itself and only copies the latest VBK file to tape would prevent the extra steps of having to copy that latest VBK to a new directory using a script...and then running the tape job.

If this is not possible, it isn't a big deal. My script already does the job fine. Thanks.
sbbots
Enthusiast
 
Posts: 96
Liked: 25 times
Joined: Fri Aug 16, 2013 5:44 pm
Full Name: Matt B

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby v.Eremin » Fri Feb 14, 2014 10:21 am

Got it. These forums are thoroughly monitored for potential features and improvement. So, thank you for the feedback; much appreciated.
v.Eremin
Veeam Software
 
Posts: 14241
Liked: 1066 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

[MERGED] process only last full

Veeam Logoby Isaksson » Fri Feb 14, 2014 10:49 am

Hello.
I am using incremental backup to disk with synthetic full every Saturday and i store 10 restore points. (so i will have more that just 1 full backup on disk)
I have two tape jobs, weekly and monthly just to have different retention policy on the tapes.

I am starting the tape job with powershell and in the script i am checking if it should be weekly or monthly tape job that should start.

I am not sure how Veeam is handling this but when i run the Monthly tape job (1 time a month) will it also duplicate to tape the full disk backup that the weekly job already has duplicated to tape?
Or will it only process the last full backup, and if not, is it possible to just duplicate the last full backup out to tape?
Isaksson
Influencer
 
Posts: 15
Liked: 1 time
Joined: Wed Jan 29, 2014 9:24 am
Full Name: Kristoffer Isaksson

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby foggy » Fri Feb 14, 2014 11:32 am

Kristoffer, as mentioned in this thread above, currently it is not possible to copy only latest .vbk file to tape using backup to tape job. A workaround is to use file to tape job in conjunction with the suggested script.
foggy
Veeam Software
 
Posts: 15736
Liked: 1182 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby bungle » Fri Feb 14, 2014 11:45 am

I have been running backup jobs (one VM per Job) and replication jobs (one VM per job), I have now added a tape library (24 slot 2 drive LTO 5). The schedule is full/synthetic backup Friday and incremental rest of week, I now need to copy my backup files to tape in a GF system (the full backup file for each VM created first Friday of month, media set monthly retension 1 year) (the full backup file created for each VM on Friday excluding the first Friday of month, media set weekly retension 1 month).

Because the D2D as been running for the past month with no tape drive connected there are between 5 and 3 full backups on the repositiories, when I now setup the backup to tape job it is going to include every full backup which is about 32 TB of data to go to LTO 5 (22 tapes), so the issue I have is this tape set which will contain the monthly full I want to retain for a year and weekly fulls I want to retain for a month.

What I need is to be able to select individual full backup files e.g. all the ones on disk that were created first Friday of month (monthly full), all the second Friday of month (weekly full) and so on.

I dont want to tie up 22 tapes (nearly half my stock level) for a year just for the February backup, I know going forward I can use the GFS workaround and once the fulls currently on disk are put to tape the next scheduled jobs will only do the last full but at the moment I need a solution to split the full backups into 3-4 tapes sets with different retension levels, any suggestions please.
bungle
Influencer
 
Posts: 11
Liked: 1 time
Joined: Thu Feb 06, 2014 1:53 pm
Full Name: Mark Neely

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby Isaksson » Fri Feb 14, 2014 11:56 am

Thanks for the reply.
I really hope that this feature (Process only last .vbk) will be added in the next version of Veeam.
Until then its hard to use the duplicate to Tape feature in a good way.
Isaksson
Influencer
 
Posts: 15
Liked: 1 time
Joined: Wed Jan 29, 2014 9:24 am
Full Name: Kristoffer Isaksson

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby MaartenK » Tue Feb 25, 2014 8:20 am

bungle wrote:........
Because the D2D as been running for the past month with no tape drive connected there are between 5 and 3 full backups on the repositiories, when I now setup the backup to tape job it is going to include every full backup which is about 32 TB of data to go to LTO 5 (22 tapes), so the issue I have is this tape set which will contain the monthly full I want to retain for a year and weekly fulls I want to retain for a month.

What I need is to be able to select individual full backup files e.g. all the ones on disk that were created first Friday of month (monthly full), all the second Friday of month (weekly full) and so on.
.......


Hi bungle,

As mentioned the script is an option. Or use Reverse Incremental backups instead. If you use this option there will be only one full backup on disk. This reduces space and backup to tape works good, and only backs up 1 *.vbk.

We use an extra Copy Job for a GFS option offsite. 3 week, 3 months etc. But the company also wants an tape backup.

But veeam must make an option in an upcoming patch to only backup the last full *.vbk file.
MaartenK
Service Provider
 
Posts: 25
Liked: 3 times
Joined: Thu Aug 25, 2011 7:45 am
Full Name: Maarten Kalkema

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby Escapo IT » Fri Feb 28, 2014 1:13 pm

MaartenK wrote:Or use Reverse Incremental backups instead. If you use this option there will be only one full backup on disk. This reduces space and backup to tape works good, and only backs up 1 *.vbk.

Unless you do an 'Active Full' backup at some point, then there will be 2 VBK files. I gather it is still recommended to periodically perform such a backup, so you will be faced with this scenario on occasion.
Escapo IT
Novice
 
Posts: 7
Liked: 4 times
Joined: Tue May 29, 2012 6:05 pm

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby foggy » Fri Feb 28, 2014 1:54 pm

Escapo IT wrote:I gather it is still recommended to periodically perform such a backup, so you will be faced with this scenario on occasion.

Yes, here are recommendations on the active full frequency for different backup modes.
foggy
Veeam Software
 
Posts: 15736
Liked: 1182 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby bungle » Wed Mar 05, 2014 7:57 pm

Okay so I thought I had sorted the backup to tape schedule, I accepted the first time a backup to tape job runs it will backup all vbk files so the first time the weekly backup ran I ended up with a set of 17x LTO5 tapes with upto 4x vbk for each VM.

The following Monday the weekly job ran again this time it contained 1x vbk for each VM and spanned 7x LTO5 tapes this is what I expected.

Again next time it run another set of 7x LTO5 tapes with just the 1x vbk for each VM everything fine so far.

This is where it went wrong, you see for compliance I need to have different retention for the tape jobs so Weekly is 4 weeks, Monthly is 12 months and Yearly is no append, all tape jobs run on Monday morning (the full backups run Friday evening and can run into Sunday evening), so I had two jobs scheduled to run at same time Weekly and Monthly, no problem I just disable the weekly job just before the first Monday of the month (when the monthly job runs) which I did then what happened was the Monthly ran and copied every vbk file to tape not the just latest as I expected, so another set of 17+ tapes which take nearly a week to run.

I can now assume when the next weekly runs instead of 1x vbk for each VM I will end up with 2 it will not register that last weeks full was offloaded to tape as it was under a different tape job and every monthly and yearly job set will span 17+ tapes.

So our calculation for number of tapes we required 7 x 12 = 84 and 7 x 4 = 28 Total tapes 112

Now looks like this 17 x 12 = 204 and 7 x 3 = 21 and 12 Total tapes 237 thousands of pounds in extra media costs

So I either scrap the Monthly and Yearly backup to tape jobs and just run weeklys with a retention period of 4 weeks for all sets and use a tape log to specify when media can be reused, fingers crossed that whoever is bringing the tapes back from the offsite fire safe returns with the right ones.

Or I change the backup to disk to jobs to create less Full backups (reverse incremental not recomended for tape plus offload to tape is 2+ days) so I still need a new full every week otherwise my weekly to tape doesnt work so I reduce the restore points from 30 to 10 this then reduces my capability of the nice quick restores from disk to half. :(
bungle
Influencer
 
Posts: 11
Liked: 1 time
Joined: Thu Feb 06, 2014 1:53 pm
Full Name: Mark Neely

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby v.Eremin » Thu Mar 06, 2014 7:35 am

Hi, Mark, if you're after GFS rotation scheme, you can switch backup mode to reversed incremental and use the workaround that I've proposed in the adjacent thread.

This way, you will have:

1) 7 Daily .vbk.
2) 4 Weekly .vbk.
3) 12 Monthly .vbk.

Thanks.
v.Eremin
Veeam Software
 
Posts: 14241
Liked: 1066 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby bungle » Thu Mar 06, 2014 9:01 pm

Thanks Vladimir

I will have a look and see if it would work in my environment.
bungle
Influencer
 
Posts: 11
Liked: 1 time
Joined: Thu Feb 06, 2014 1:53 pm
Full Name: Mark Neely

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby v.Eremin » Fri Mar 07, 2014 6:50 am

You're welcome. Feel free to contact us, should any help be needed. Thanks.
v.Eremin
Veeam Software
 
Posts: 14241
Liked: 1066 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby RPS » Mon Mar 10, 2014 12:51 am

v.Eremin wrote:Hi, Mark, if you're after GFS rotation scheme, you can switch backup mode to reversed incremental and use the workaround that I've proposed in the adjacent thread.

This way, you will have:

1) 7 Daily .vbk.
2) 4 Weekly .vbk.
3) 12 Monthly .vbk.

Thanks.


Is better GFS rotation support going to be added in future patches? I thought that this rotation was most commonly used and would have been easy to implement right off the bat.
RPS
Novice
 
Posts: 3
Liked: 1 time
Joined: Sun Mar 09, 2014 6:57 pm
Full Name: Paul Suttill

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby Dima P. » Tue Mar 11, 2014 10:03 am

Hello Paul,
We are looking in the possibility of implementing easy to use GFS rotation mechanism into VBR console, but there is no ETA on this so far. Thank you for your feedback!
Dima P.
Veeam Software
 
Posts: 7127
Liked: 512 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

PreviousNext

Return to Tape



Who is online

Users browsing this forum: Bing [Bot] and 1 guest