-
- Veeam Software
- Posts: 21139
- Liked: 2141 times
- Joined: Jul 11, 2011 10:22 am
- Full Name: Alexander Fogelson
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Basically, Veeam B&R copies only files that have been changed since the latest backup, according to information about backups stored in its database. If you're observing different behavior, I suggest contacting support for investigation.
-
- Influencer
- Posts: 16
- Liked: 3 times
- Joined: Mar 17, 2014 2:11 pm
- Full Name: it
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Ok, so based upon what does it determine this ? And again, can this be obtained by using powershell.foggy wrote:Basically, Veeam B&R copies only files that have been changed since the latest backup, according to information about backups stored in its database. If you're observing different behavior, I suggest contacting support for investigation.
The backup file from the operating system's perspective hasn't been changed.
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
What retention policy is specified in the settings of given media pool? How many tape are you using? Most likely, the cassette containing previous backup data was overwritten, as the result, the corresponding data was removed from backup tape catalog and backup to tape job decided to copy the files anew.
Thanks.
Thanks.
-
- Influencer
- Posts: 13
- Liked: 1 time
- Joined: Apr 30, 2014 10:52 am
- Full Name: Steve
- Contact:
[MERGED] Backup only the latest vbk to tape
I'm running into issues with my Tape job, I think it'll make the most sense if I explain our backup plan first:
-Reverse incrementals are performed daily(7 days) to disk with Active Fulls on Saturday.
-For compliance purposes we copy those backups to tape M-F and store them in an on-site safe on a 4 week cycle with the final backup of the year retained indefinitely.
-After Saturday's Active Full is completed it's copied to a self-encrypting external HD for storage off-site which is rotated weekly. (I haven't set this up yet, but I assume it'll be a simple Backup Copy job?)
Since we only do tape on M-F I had to setup a time-based schedule for the tape job rather than using 'as new backups appear' and I have it set to not process incremental files, the problem is every Monday the job sees two full backups (the active full from Sat and the reverse incremental from Mon) to backup, we only use 1 tape nightly which isn't large enough to fit two full backups so I end up cancelling the backup the next morning and throughout the week it continues to see the two full backups to copy and requesting a second tape.
Is there a way to configure the tape job to backup only the latest full backup ignoring the others?
-Reverse incrementals are performed daily(7 days) to disk with Active Fulls on Saturday.
-For compliance purposes we copy those backups to tape M-F and store them in an on-site safe on a 4 week cycle with the final backup of the year retained indefinitely.
-After Saturday's Active Full is completed it's copied to a self-encrypting external HD for storage off-site which is rotated weekly. (I haven't set this up yet, but I assume it'll be a simple Backup Copy job?)
Since we only do tape on M-F I had to setup a time-based schedule for the tape job rather than using 'as new backups appear' and I have it set to not process incremental files, the problem is every Monday the job sees two full backups (the active full from Sat and the reverse incremental from Mon) to backup, we only use 1 tape nightly which isn't large enough to fit two full backups so I end up cancelling the backup the next morning and throughout the week it continues to see the two full backups to copy and requesting a second tape.
Is there a way to configure the tape job to backup only the latest full backup ignoring the others?
-
- Veeam Software
- Posts: 21139
- Liked: 2141 times
- Joined: Jul 11, 2011 10:22 am
- Full Name: Alexander Fogelson
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Steve, please review this thread for the answers. Basically, Veeam B&R copies files that have been changed since the latest backup and in your case both VBK files should be copied.
Btw, is it a requirement to get a new active full each week? It is a bit overkill, to say the least. With reversed incremental mode the need for performing active full backup isn’t that strong, one full every 1-3 months is more than enough.
Btw, is it a requirement to get a new active full each week? It is a bit overkill, to say the least. With reversed incremental mode the need for performing active full backup isn’t that strong, one full every 1-3 months is more than enough.
-
- Enthusiast
- Posts: 78
- Liked: 4 times
- Joined: Jan 12, 2012 3:45 am
- Full Name: claudiofolu
- Contact:
[MERGED] : Help with tape backup policy
Hello
We need some help/recommendation with a backup policy for our company.
We have defined the following policy:
365 restore point in disk - this is done by a backup job with weekly fulls
1 monthtly full backup to tape job for archive (never expire)
We are not sure how to accomplish that last, because when we set the Backup to Tape job, all the Full point are recorded to tape, and we need to have only one full for the current month in tape.
I know we have to use Backup Copy jobs but we are not sure how to set it up
We need some help/recommendation with a backup policy for our company.
We have defined the following policy:
365 restore point in disk - this is done by a backup job with weekly fulls
1 monthtly full backup to tape job for archive (never expire)
We are not sure how to accomplish that last, because when we set the Backup to Tape job, all the Full point are recorded to tape, and we need to have only one full for the current month in tape.
I know we have to use Backup Copy jobs but we are not sure how to set it up
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
As mentioned above, in order to achieve what you're after, you should utilize combination of file to tape job and hard links. Thanks.
-
- Novice
- Posts: 8
- Liked: never
- Joined: Nov 29, 2012 10:00 am
- Full Name: Patrik Malmros
- Contact:
[MERGED] : Tape latest VBK?
Hello!
I want to make monthly backups of the latest VBK to tape, to store offsite.
Today I runt Incremental with synthetic fulls every Friday, storing 4-5 full VBK´s on disk.
Each VBK is about 7TB and it´s to mcuh data to store all of them on tape every month. I only want to store the latest VBK on tape. Is that possible?
Should i change the Backup mode to Reverse incremental? In the guide it´s recommended to use Incremental with synthetic fulls for tape storage.
Br
Patrik
I want to make monthly backups of the latest VBK to tape, to store offsite.
Today I runt Incremental with synthetic fulls every Friday, storing 4-5 full VBK´s on disk.
Each VBK is about 7TB and it´s to mcuh data to store all of them on tape every month. I only want to store the latest VBK on tape. Is that possible?
Should i change the Backup mode to Reverse incremental? In the guide it´s recommended to use Incremental with synthetic fulls for tape storage.
Br
Patrik
-
- Product Manager
- Posts: 14720
- Liked: 1705 times
- Joined: Feb 04, 2013 2:07 pm
- Full Name: Dmitry Popov
- Location: Prague
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Patrik,
I’ve merged your post to the existing thread. Please, review the resolutions provided before. Thank you.
I’ve merged your post to the existing thread. Please, review the resolutions provided before. Thank you.
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Another workaround cane be found in in the adjacent thread; might be worth taking a look. Thanks.
-
- Novice
- Posts: 4
- Liked: never
- Joined: Nov 07, 2013 1:55 am
- Full Name: Stuart Montgomery
- Location: Sydney
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Why are "workarounds" being suggested?
Will Veeam make this a feature of v8?
The concept is simple, it should be simple to implement. A tickbox would be the only addition to the tape job gui needed.
Will Veeam make this a feature of v8?
The concept is simple, it should be simple to implement. A tickbox would be the only addition to the tape job gui needed.
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
According to the plan, version 8 should have this functionality. During job creation it would be possible to make a tape job copy either the full chain or part of the chain starting from the latest full backup. Thanks.
-
- Veteran
- Posts: 391
- Liked: 39 times
- Joined: Jun 08, 2010 2:01 pm
- Full Name: Joerg Riether
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
I am working on a new ps script which will do backup to tape only the latest full backup when using reverse increments. This will take some time, though, and some testing, because some objects have changed when using powershell with V8 and my original script has to be modified. I will get back to this thread when it´s ready.
BTW: Starting with V8 you can tell B+R to "synthesize" a full backup from a full+increments with a special schedule for tape backups. BUT this is not for reverse increment jobs from what i understand and from what i tested. BUT it would be possible to create a copy job from a reversed increment job and then let the backup to tape job attach the copy jobs files as source and then do the full synthetic schedule. That would work.
V8 offers many many different approaches to many many scenarios and ideas.
With newly introduced tape role as "agent" it would now be possible to control a huge veeam server farm plus streamers plus proxies and repositories from within a single veeam master control console. That enables very complex ideas and very complex scenarios to design.
Saying that - i guess this is the reason why they call it the "headcracker" inside of VEEAM
Best regards,
Joerg
BTW: Starting with V8 you can tell B+R to "synthesize" a full backup from a full+increments with a special schedule for tape backups. BUT this is not for reverse increment jobs from what i understand and from what i tested. BUT it would be possible to create a copy job from a reversed increment job and then let the backup to tape job attach the copy jobs files as source and then do the full synthetic schedule. That would work.
V8 offers many many different approaches to many many scenarios and ideas.
With newly introduced tape role as "agent" it would now be possible to control a huge veeam server farm plus streamers plus proxies and repositories from within a single veeam master control console. That enables very complex ideas and very complex scenarios to design.
Saying that - i guess this is the reason why they call it the "headcracker" inside of VEEAM
Best regards,
Joerg
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Hi, I'm not sure if you've noticed that or not, but with 8 it's now possible to instruct a backup to tape job to either copy a full chain or just a chain starting from the latest backup. You're given a choice during job creation. Thanks.
-
- Veteran
- Posts: 391
- Liked: 39 times
- Joined: Jun 08, 2010 2:01 pm
- Full Name: Joerg Riether
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Hi Vladimir,
that is correct but this was only a small part of what i wanted to accomplish. The main "headbanger" was the categorical tape erase, no matter what - even if last backup was a few hours ago. Please check my very first post in this thread.
Bets regards,
Joerg
that is correct but this was only a small part of what i wanted to accomplish. The main "headbanger" was the categorical tape erase, no matter what - even if last backup was a few hours ago. Please check my very first post in this thread.
Bets regards,
Joerg
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Got it. In this case, the best approach might be to utilize files to tape job, and update its source via the script (yes, it's now possible to do that without using creative workarounds). Thanks.
-
- Enthusiast
- Posts: 96
- Liked: 25 times
- Joined: Aug 16, 2013 5:44 pm
- Full Name: Matt B
Re: Backup to Tape only last backup with reversed incrementa
So basically nothing has changed. We still have to run scripts just to do a simple files-to-tape job that only copies the most recent VBK. Literally all it would have taken was an additional filter during job creation to "Only copy files created in the past X days" and scripts would no longer be necessary. Oh, but now I can run that script within the job instead of using Windows Scheduler. MIND BLOWN.v.Eremin wrote:Got it. In this case, the best approach might be to utilize files to tape job, and update its source via the script (yes, it's now possible to do that without using creative workarounds). Thanks.
This thread is one of the most viewed discussions in the tape forum (if not the entire forum) and I see MANY posts asking for exactly the same thing, mostly from SMB customers. If we didn't care about making Veeam better we wouldn't bother posting here, so this is disappointing.
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Hi, Matt, have you see the new option that I mentioned several posts earlier? With this option, now you can make newly-created backup to tape job copy only the chain that starts from the latest full backup.
Joergr's case is a little bit different and still might require additional scripting.
Thanks.
Joergr's case is a little bit different and still might require additional scripting.
Thanks.
-
- Enthusiast
- Posts: 32
- Liked: 4 times
- Joined: Nov 09, 2014 4:20 am
- Location: Australia
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Is there any way to set a Backup to Tape job to always use the "Latest" option to archive only the latest backup chain to tape permanently?
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
The option I was talking about applies only during job creation (whether a backup to tape job should copy the whole chain or only the portion that starts from the latest full backup). However, can I ask you what backup mode do the source backup jobs use? Thanks.
-
- Enthusiast
- Posts: 32
- Liked: 4 times
- Joined: Nov 09, 2014 4:20 am
- Location: Australia
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
I use forward incremental with transform
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Then, I would stick to new forward incremental forever backup mode, and let backup to tape job create synthesized full backup directly on tapes on whatever basis you want to. Thanks.
-
- Enthusiast
- Posts: 32
- Liked: 4 times
- Joined: Nov 09, 2014 4:20 am
- Location: Australia
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Do you know why the option to only copy the latest chain to tape is only available for new tape jobs?
I would think that once the logic has been coded it wouldn't be that difficult to flag the backup to tape job to do this each run not just the first.
Whilst the new incremental forever mode is a nice option I'm not convinced that modifying our backup jobs for this purpose is the best solution.
I would think that once the logic has been coded it wouldn't be that difficult to flag the backup to tape job to do this each run not just the first.
Whilst the new incremental forever mode is a nice option I'm not convinced that modifying our backup jobs for this purpose is the best solution.
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
The major concern reported by customers has been the fact that newly created backup to tape job starts to copy whole chain, instead of transferring only portion that starts from the latest full backup. The said functionality addresses this issue.justind wrote:Do you know why the option to only copy the latest chain to tape is only available for new tape jobs?
Also, we expect customers' switching to new backup mode (forward forever incremental backup), as it's more space conservative compared to forward incremental mode. So, it will make sense to apply this option only during job creation (whether or not to copy previous .vbk files). Once the switch is done, new full backups will not be needed on disks any longer.
Thanks.
-
- Enthusiast
- Posts: 32
- Liked: 4 times
- Joined: Nov 09, 2014 4:20 am
- Location: Australia
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Ok I can see how things are geared towards shifting people over to the forever forward incremental and using virtual synthesized full backups on tape. I still think the option to be able to permanently set the 'Latest' full only to tape would be handy as not everyone wants to move away from the Reverse Incremental/Transform mode.
If I were to move over to the forever incremental mode and wanted to synthesize a full backup to tape any time the tape job is run would I schedule this within the tape job 'Full Backup Schedule' to run on everyday of the week?
For example, if I run the Tape job on Thursday it will synthesize a full, if I run the job every Tuesday it will synthesize a full etc.
Also, if I do run an active full for whatever reason, how does that effect the synthesized full backup?
EDIT: The reason I ask about the active full is unlike the Backup Copy job settings there is no option to compact the full backup (that I can see anyway)
If I were to move over to the forever incremental mode and wanted to synthesize a full backup to tape any time the tape job is run would I schedule this within the tape job 'Full Backup Schedule' to run on everyday of the week?
For example, if I run the Tape job on Thursday it will synthesize a full, if I run the job every Tuesday it will synthesize a full etc.
Also, if I do run an active full for whatever reason, how does that effect the synthesized full backup?
EDIT: The reason I ask about the active full is unlike the Backup Copy job settings there is no option to compact the full backup (that I can see anyway)
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
Got it. Your voice is heard.I still think the option to be able to permanently set the 'Latest' full only to tape would be handy as not everyone wants to move away from the Reverse Incremental/Transform mode.
Correct.If I were to move over to the forever incremental mode and wanted to synthesize a full backup to tape any time the tape job is run would I schedule this within the tape job 'Full Backup Schedule' to run on everyday of the week?
Enabling full backup will return forward incremental mode. The synthesized schedule should stay intact.Also, if I do run an active full for whatever reason, how does that effect the synthesized full backup?
Adding compact full backup functionality to backup jobs that use forward increment forever mode is on our radar.EDIT: The reason I ask about the active full is unlike the Backup Copy job settings there is no option to compact the full backup (that I can see anyway)
Thanks.
-
- Enthusiast
- Posts: 96
- Liked: 25 times
- Joined: Aug 16, 2013 5:44 pm
- Full Name: Matt B
Re: Backup to Tape only last backup with reversed incrementa
How does this apply to Standard users who only have files-to-tape, as I have mentioned in my previous posts?v.Eremin wrote:Hi, Matt, have you see the new option that I mentioned several posts earlier? With this option, now you can make newly-created backup to tape job copy only the chain that starts from the latest full backup.
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
The said functionality applies only to backup to tape jobs. Copying the latest .vbk file via file to tape jobs still requires scripting, though. Thanks.
-
- Enthusiast
- Posts: 96
- Liked: 25 times
- Joined: Aug 16, 2013 5:44 pm
- Full Name: Matt B
Re: Backup to Tape only last backup with reversed incrementa
So if you own the lowly Standard edition don't bother making suggestions; You just get silly workarounds for things that could be easily fixed. That is really stupid.v.Eremin wrote:The said functionality applies only to backup to tape jobs. Copying the latest .vbk file via file to tape jobs still requires scripting, though. Thanks.
-
- Product Manager
- Posts: 20406
- Liked: 2298 times
- Joined: Oct 26, 2012 3:28 pm
- Full Name: Vladimir Eremin
- Contact:
Re: Backup to Tape only last backup with reversed incrementa
We’ve already tried to ease the life of those using backup to tape jobs by providing “copy only the latest chain” option (which has been one of the biggest requests we got). We may consider implementing the functionality mentioned by you down the road. So, thank you for the feedback.
Thanks.
Thanks.
Who is online
Users browsing this forum: No registered users and 13 guests