Backup to Tape only last backup with reversed incremental

Everything about backing up to tape

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby Shestakov » Tue Aug 04, 2015 7:40 am

Mike, your description of the product behavior is correct.
As was mentioned above, we are working on the corresponding functionality to be added in the next product releases.
Thanks for the feedback!
Shestakov
Veeam Software
 
Posts: 4850
Liked: 394 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

[MERGED] : Only the latest Full Backup to Tape

Veeam Logoby late » Wed Sep 02, 2015 7:59 am

Hi,

This probably has been asked earlier by someone else but let me do this once more. :) Currently we are running Forward Incrementals with Active Fulls on weekend. Then we have set Tape Jobs from Backups to save the fulls to tape. Tapes are changed every week and shipped offsite. The problem I am facing is that if there are more than one .VBK files in the repository for the VM in question then all the .VBK files are moved to tape. I would like only the latest full backup from the repository to be saved to tape. How can I achieve this?

Thanks!
late
Influencer
 
Posts: 10
Liked: never
Joined: Tue Mar 10, 2015 12:43 pm
Full Name: Late

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby v.Eremin » Wed Sep 02, 2015 8:31 am

There are several ways to achieve that. All of them are described in this thread and have some drawbacks.

Switch to reversed incremental and let a tap job copy only the latest point which is a full backup. Switch to forward forever incremental and let a tape job create a virtual full backup on desired basis. Leave everything as is, but use file to tape job, instead of backup to tape one, and put scripting into use. Within a script the latest full backup will be found and set as a source for a file to tape job.

Thanks.
v.Eremin
Veeam Software
 
Posts: 13255
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby late » Wed Sep 02, 2015 8:38 am

Thank you Vladimir!

According to earlier posts in this thread this function will be added to next releases. So it would be included in v9 am I correct?
late
Influencer
 
Posts: 10
Liked: never
Joined: Tue Mar 10, 2015 12:43 pm
Full Name: Late

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby v.Eremin » Wed Sep 02, 2015 9:16 am

According to the plan, it should be added in version 9, right. Thanks.
v.Eremin
Veeam Software
 
Posts: 13255
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby omitv » Mon Sep 07, 2015 9:13 am

I've tried joergr's script in v8 update2 but I receive following errors

Code: Select all
          Welcome to the Veeam Backup and Replication PowerShell Toolkit!

To list available commands, type Get-VBRCommand
To list available plugins, type Get-VBRPlugin
To open online documentation on all available commands, type Get-VBRToolkitDocumentation

       Copyright © Veeam Software AG. All rights reserved.


PS C:\Users\Bentsa> s:
PS S:\> cd .\Scripts
PS S:\Scripts> powershell.exe .\LatestFullToTape.ps1
dd-pssnapin : The term 'dd-pssnapin' is not recognized as the name of a cmdlet, function, script file, or operable
program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
At S:\Scripts\LatestFullToTape.ps1:1 char:1
+ dd-pssnapin veeampssnapin
+ ~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (dd-pssnapin:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException

Hardlink created for S:\Backups\veeam-hardlinks\Production VMs2015-09-06T220046.vbk <<===>> S:\Backups\Production VMs\Pr
oduction VMs2015-09-06T220046.vbk
## hardlinks ##
S:\Backups\veeam-hardlinks\
Start-VBRJob : The term 'Start-VBRJob' is not recognized as the name of a cmdlet, function, script file, or operable
program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again.
At S:\Scripts\LatestFullToTape.ps1:25 char:1
+ Start-VBRJob -Job "LatestFullToTape" -FullBackup
+ ~~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (Start-VBRJob:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException

PS S:\Scripts>
omitv
Influencer
 
Posts: 15
Liked: never
Joined: Sun Sep 29, 2013 2:37 pm

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby v.Eremin » Mon Sep 07, 2015 10:20 am

Seems that you've removed unintentionally one letter from the name of commandlet, thus, the issues. Please, replace dd-pssnapin with Add-PSSnapin. Thanks.
v.Eremin
Veeam Software
 
Posts: 13255
Liked: 968 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby mike.r » Mon Sep 07, 2015 11:33 am

Is there a release date for Version 9, or a detailed feature list ?
mike.r
Enthusiast
 
Posts: 32
Liked: 3 times
Joined: Wed Jun 03, 2015 7:00 am

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby Shestakov » Mon Sep 07, 2015 11:39 am

New features are announced in the Veeam Blog.
No exact release date yet, should be in Q4. Thanks!
Shestakov
Veeam Software
 
Posts: 4850
Liked: 394 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

[MERGED]Feature Request: Add ability to only process latest

Veeam Logoby skrause » Tue Sep 08, 2015 7:00 pm

Hello,

We have a retention policy that requires having one monthly full copy of our backups on tape and stored at an off-site cold storage facility. We had set up tape jobs in August to run on the first weekend of the month and at the time of creation, were asked to choose if we wanted all of the chains or just the most recent sent to tape on the first run of the job.

When the jobs ran this weekend, they copied all of the fulls which we did not want as we only wanted the most recent full.

I realize now that the jobs work like Backup Copy jobs where they grab anything new since the last job run. Would it be possible to add an option to allow us to just process the most recent chain on subsequent runs of the job (or better yet, is this part of the new GFS support in 9 :D )?

We can make do for now with re-creating the jobs every month but just having it run automatically would make our lives much easier.

Thanks.
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby Dima P. » Tue Sep 08, 2015 8:19 pm

Hey Steve,
Thanks for the feedback – we got this feature in the list of upcoming improvements for the next major release. Stay tuned for updates!
Dima P.
Veeam Software
 
Posts: 6231
Liked: 439 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby A.G. » Wed Sep 09, 2015 9:56 am

Hi, community!
I faced the same problem when backing data off site. I began to search workaround, but there was nothing useful.
We are using forward incremental backups with Synthetic Full every weekend and Active Full every first weekend.
And now I have two cmd with PoSh inside. First starts before Backup-To-Tape job, and the other starts after job completes.
Here they are:
create_last_full_hardlink.ps1
Code: Select all
function New-HardLink
{
    param
    (
        [Parameter(Mandatory=$true)]
        $OriginalFilePath,
        [Parameter(Mandatory=$true)]
        $MirroredFilePath
    )

    $signature = '
            [DllImport("Kernel32.dll")]
            public static extern bool CreateHardLink(string lpFileName,string lpExistingFileName,IntPtr lpSecurityAttributes);
    '
    Add-Type -MemberDefinition $signature -Name Creator -Namespace Link
    [Link.Creator]::CreateHardLink($MirroredFilePath,$OriginalFilePath,[IntPtr]::Zero)
}

$Source = (gci "E:\BackUp_Repository\Full_BackUp" -Filter "*.vbk" | sort "LastWriteTime" -Descending)[0]
$Destination = "E:\Virtual_BackUp_Repository\Full_BackUp\$($Source.Name)"
New-HardLink -OriginalFilePath $Source.FullName -MirroredFilePath $Destination
Start-Sleep 10

Add-PSSnapin veeampssnapin
Import-VBRBackup -Server "This server" -FileName $Destination
$BackupName = "Full_BackUp_imported"
$Backup = Get-VBRBackup -Name $BackupName
$Job = Get-VBRJob -Name "$BackupName"
$Backup.Update($Job)

Default repository is located at E:\BackUp_Repository. Default job is "Full_BackUp"
I've created Virtual Repository in "E:\Virtual_BackUp_Repository", then made a copy of backup job and named it "Full_BackUp_imported". This job stores data in virtual repository and will never be started.

The script searches for the most recent vbk file in the job folder and creates a hardlink for it in virtual repository (using function).
After hardlink created I import vbk file from virtual repository into Veeam B&R. I get new backup with name "Full_BackUp_imported". Then I update impoted backup with backup job (they have the same names).

Then job starts backing up hardlinked vbk file from virtual repository to tape drive (Resource Monitor shows that file is read from original location).
After backup completes another script executes
clear_last_full_hardlink_folder.ps1
Code: Select all
Add-PSSnapin veeampssnapin
$BackupName = "Full_BackUp_imported"
Remove-VBRBackup -Backup $BackupName -Confirm:$false

$Destination = "E:\Virtual_BackUp_Repository\Full_BackUp\*.*"
rd -Path $Destination -Force

I delete imported job from Veeam B&R and clear virtual repository.

Cmd files contain one string like
powershell -file PowerShell_script_file
A.G.
Lurker
 
Posts: 1
Liked: never
Joined: Tue Sep 08, 2015 2:32 pm
Full Name: Sergei

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby dan11 » Fri Sep 25, 2015 9:16 am

The workaround with hardlinks mentioned in this thread has some downsides which forced me to find a better solution. (which works very well for me).
I realized that I`m losing a lot of nice features in the restore process. It makes the restore from tape process way more complicated and involves more steps. Also the individual VMs aren't in the Veeam catalog anymore. (for example, enterprise manager can’t help you to find guest files from backups on tape…)
And you have no access to backup on Tape in restore wizard.

Here is what I’m doing right now:

- reversed incremental with active full once a month (Saturday evening).
- weekly backup to tape latest full (Saturday morning)

The trick is to do the active fulls after the backup to tape job on the same day. If you do it this way, the old Full backup is not changing anymore and is already on tape. So, the next weekend, you have two fulls in repository, but one is already on tape. Veeam backs up only the latest to tape.

There is only one point: If the backup to Tape job fails, you run in to the same old problem one week later (two full backups…) to solve this problem I use a Powershell script, which checks if the backup to tape job was successful or not. If not, it disables the active full options for all backup jobs and send me an email. The next day, another script enables the active full option for the next month...
dan11
Novice
 
Posts: 7
Liked: 1 time
Joined: Wed Feb 25, 2015 9:10 am

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby alando » Tue Sep 29, 2015 1:52 pm

Any news on this topic? Will this soon be implemented?
alando
Novice
 
Posts: 4
Liked: 1 time
Joined: Tue Sep 29, 2015 11:50 am

Re: Backup to Tape only last backup with reversed incrementa

Veeam Logoby Shestakov » Wed Sep 30, 2015 11:53 am

As was said above, it`s to be implemented in the upcoming major version, v9.
Shestakov
Veeam Software
 
Posts: 4850
Liked: 394 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

PreviousNext

Return to Tape



Who is online

Users browsing this forum: No registered users and 11 guests