Backup files not deleted according to retention policy

Availability for the Modern Data Center

Re: Backup files not deleted according to retention policy

Veeam Logoby habibalby » Sun Mar 11, 2012 8:23 am

Hi,
Then this leaves me with a big Dilemma then :) I can't configure Veeam to backup full on every Saturday and Daily incremental from Sun-Thursday because it will keep two VBK files of 700 GB. Nor I can't run the Reversed Incremental to run on Saturday Full and from Sun-Thursday as incremental to dump it daily on tape. Then what is the perfect solution for that Veeam to dump Backup files on tape?

What is the best logic to retain disk space and daily backup to tapes as well as backup on disk for only 5 Working Days and 1 Full backup?
habibalby
Expert
 
Posts: 315
Liked: 21 times
Joined: Mon Jul 18, 2011 9:30 am
Location: Bahrain
Full Name: Hussain Al Sayed

Re: Backup files not deleted according to retention policy

Veeam Logoby Vitaliy S. » Sun Mar 11, 2012 8:33 am

There is no perfect solution and it's not about Veeam, this is how incremental mode and reversed incremental backup modes work. If your backup window allows offloading VBK files each day, then I would proceed with reversed incremental. Otherwise, you need to free up more space on the target storage and use forward incremental mode, that's it, pretty simple ;)
Vitaliy S.
Product Manager
 
Posts: 12108
Liked: 455 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Backup files not deleted according to retention policy

Veeam Logoby habibalby » Sun Mar 11, 2012 8:53 am

I can see that Reversed Incremental does the job a bet perfect, but this allow me to backup whole files on the Target Directory as a whole not only allowing me to backup the last file changed from the Daily Incremental of Veeam Backup!!! Correct me if I'm wrong.

I can see that with Reversed Incremental and Active Full backup on every Saturday, can do the job But, daily full backup of huge data to tapes, it's a bit headache.

Week-1
Saturday Full: VM.VBK
Sunday Incr: VM.VRB
Monday Incr: VM.VRB
Tuesday Incr: VM.VRB
Wednesday Incr: VM.VRB
Thursday Incr: VM.VRB

Week-2
Saturday Full: VM.VBK
Sunday Incr: VM.VRB "And it will delete Sunday from Week-1"
Monday Incr: VM.VRB "And it will delete Monday from week-1"
Tuesday Incr: VM.VRB "And it it will delete Tuesday from Week-1"
Wednesday Incr: VM.VRB "And it will delete Wednesday from Week-1"
Thursday Incr: VM.VRB "And it will delete Thursday from Week-1" and It will delete VBK from week-1

This will allow me with full back from Week-2 and I can go back to week-1 provided all the contents of 1 week offloaded to tape. !!!

Thanks,
habibalby
Expert
 
Posts: 315
Liked: 21 times
Joined: Mon Jul 18, 2011 9:30 am
Location: Bahrain
Full Name: Hussain Al Sayed

Re: Backup files not deleted according to retention policy

Veeam Logoby foggy » Sun Mar 11, 2012 9:41 am

With reversed incremental mode, the latest restore point is always a full VBK file. Btw, did you have a chance to review the backup methods description given in VBR user guide? It provides intuitive visual explanations of both modes, which are pretty easy to understand.
foggy
Veeam Software
 
Posts: 6678
Liked: 375 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Backup files not deleted according to retention policy

Veeam Logoby Vitaliy S. » Sun Mar 11, 2012 9:57 am

Not sure that I fully understand what you're saying, but, yes, you can backup the entire backup chain once a week.
Vitaliy S.
Product Manager
 
Posts: 12108
Liked: 455 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Backup files not deleted according to retention policy

Veeam Logoby habibalby » Sun Mar 11, 2012 10:03 am

hi Foggy,

No haven't gone through the user guide, I would appreciate if you can give me the link or as an attachment. So, the latest restore mode is full which means, if Symantec Backup or any Backup software runs on that file it will Reset the Archive-Bit which means for next Symantec Backup the VBK file will be considered as a Full Backup File :) And with Forward Incremental, it will Reset the Archive-Bit for all the file that Symantec Backup last runs and any new Forward Incremental it will not ejected into the VBK File but will create a VIB File.

If Symantec Backup runs as Full and last Reset Archive-Bit on VBK File past 1 Week, during the week any Symantec Incremental Job runs will take the latest VIB files which veeam generates them on daily basis. But this keeps exceeding the 7 Days Retention Policy and 7 Days Deleted VMs on Disk.

Is there any way I can select Forward Incremental to have 5 VIB files and 1 VBK File? At least in this option I don't have a problem with Symantec when it runs as Full backup and Incremental Backup.

I believe Veeam has to do something with regards to the Reset Archive-Bit when customer considering backing up to Tape.

Thanks,
habibalby
Expert
 
Posts: 315
Liked: 21 times
Joined: Mon Jul 18, 2011 9:30 am
Location: Bahrain
Full Name: Hussain Al Sayed

Re: Backup files not deleted according to retention policy

Veeam Logoby Vitaliy S. » Sun Mar 11, 2012 10:07 am

habibalby wrote:Is there any way I can select Forward Incremental to have 5 VIB files and 1 VBK File? At least in this option I don't have a problem with Symantec when it runs as Full backup and Incremental Backup.

No
Vitaliy S.
Product Manager
 
Posts: 12108
Liked: 455 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Backup files not deleted according to retention policy

Veeam Logoby habibalby » Sun Mar 11, 2012 10:08 am

Vitaliy S. wrote:Not sure that I fully understand what you're saying, but, yes, you can backup the entire backup chain once a week.


Hi Vitaliy,

Yes, I agree with you. With Reversed Incremental I can backup the entire backup Chain on a Weekly basis such as. Full Backup runs on Saturday, then Sun-Thursday as Incremental. which will leave me with 1 VBK File and 5 VIBs files. But this keep me at risk of not backing up on a daily basis and when something goes wrong on the target SAN Storage on last day of the week on Thursday, this will keep me to loose the entire back up of 1 week which will put me in a bad shape isn't ? :)
habibalby
Expert
 
Posts: 315
Liked: 21 times
Joined: Mon Jul 18, 2011 9:30 am
Location: Bahrain
Full Name: Hussain Al Sayed

Re: Backup files not deleted according to retention policy

Veeam Logoby foggy » Sun Mar 11, 2012 10:11 am

foggy
Veeam Software
 
Posts: 6678
Liked: 375 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Backup files not deleted according to retention policy

Veeam Logoby Vitaliy S. » Sun Mar 11, 2012 10:12 am

habibalby wrote:...this will keep me to loose the entire back up of 1 week which will put me in a bad shape isn't ?

Yes, that is why forward incremental backup mode is the best choice for tape backups.
Vitaliy S.
Product Manager
 
Posts: 12108
Liked: 455 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Backup files not deleted according to retention policy

Veeam Logoby habibalby » Sun Mar 11, 2012 11:37 am

Hi,
Is there a way to delete Particular Restore Point from the Backup? Or I have to delete it manually? Is it safe deleting restore particular restore point manually?

Veeam should introduce to delete Particular Restore point from Backups. Now in Backups, if I right-clicking the particular backup job, I have only two options, Remove from Backup and Delete From Disk. The option delete From Disk is a bit scary if I have backup chain of two weeks, for instant;

Week-1:
Sat - Full: VM.VBK
Sun - Incr: VM.VIB
Mon - Incr: VM.VIB
Tue - Incr: VM.VIB
Wed - Incr: VM.VIB
Thu - Incr: VM.VIB

Week-2:
Sat - Full: VM.VBK
Sun - Incr: VM.VIB
Mon - Incr: VM.VIB
Tue - Incr: VM.VIB
Wed - Incr: VM.VIB
Thu - Incr: VM.VIB

The option to delete from disk will delete a restore points of two weeks. What if I want to delete a VBK file which has got smaller VIBs files related to that particular VBK? All the VIBs files will be unusable, correct?

Thanks,
habibalby
Expert
 
Posts: 315
Liked: 21 times
Joined: Mon Jul 18, 2011 9:30 am
Location: Bahrain
Full Name: Hussain Al Sayed

Re: Backup files not deleted according to retention policy

Veeam Logoby foggy » Sun Mar 11, 2012 11:53 am

habibalby wrote:What if I want to delete a VBK file which has got smaller VIBs files related to that particular VBK? All the VIBs files will be unusable, correct

Correct. As well as deleting a VIB file in the middle of the chain will make the consequent VIBs unusable.
foggy
Veeam Software
 
Posts: 6678
Liked: 375 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Backup files not deleted according to retention policy

Veeam Logoby habibalby » Sun Mar 11, 2012 11:56 am

foggy wrote:
habibalby wrote:What if I want to delete a VBK file which has got smaller VIBs files related to that particular VBK? All the VIBs files will be unusable, correct

Correct. As well as deleting a VIB file in the middle of the chain will make the consequent VIBs unusable.


So, what is the solution for this? Backup everything to tape, then delete From Disk and re-create the job as full and so on? Veeam.com this is not practical at all. Now, I have to free one of my servers which has got 1.4 TB transfer the role to another VM. Install OpenFiler/iSCSI software on it, map the LUN to Veeam Machine to get things sort it out. My GOD :)
habibalby
Expert
 
Posts: 315
Liked: 21 times
Joined: Mon Jul 18, 2011 9:30 am
Location: Bahrain
Full Name: Hussain Al Sayed

Re: Backup files not deleted according to retention policy

Veeam Logoby habibalby » Sun Mar 11, 2012 11:59 am

Veeam.com should consider Snapshot Scenarios at least. Go To particular Backup/Restore Point, Delete Particular Backup/Restore Point, and Delete All Backup/Restore Points. That's another thing Veeam.com should consider i believe.

Thanks,
habibalby
Expert
 
Posts: 315
Liked: 21 times
Joined: Mon Jul 18, 2011 9:30 am
Location: Bahrain
Full Name: Hussain Al Sayed

Re: Backup files not deleted according to retention policy

Veeam Logoby dellock6 » Sun Mar 11, 2012 11:04 pm

If your concern is the space needed for two full backups, why don't you consider using Forward Incremental with synthetic full and transform?
It creates the next full backup combining the incremental files, so you will end up having only one full backup at a time on the disk, and leaves behind a chain of reverse incremental files. Once you offloaded the previous .vib files to tape there is no need to keep them on disk.
But remember, synthetic + transform puts a high load on the backup storage, generating 4 I/O for every bit taken from production storage.

Luca.
Luca Dell'Oca
EMEA Evangelist @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014
Veeam VMCE #1
dellock6
Veeam MVP
 
Posts: 2108
Liked: 390 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

PreviousNext

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], Google [Bot] and 12 guests