-
- Novice
- Posts: 8
- Liked: never
- Joined: Oct 13, 2010 1:04 pm
- Full Name: Boris Shubinsky
- Contact:
Backup files not deleted according to retention policy
My Veeam is currently set to 7 rollback points and for it to do a rollup on Sundays for the incremental. However, it does not appear to be rolling up (so I've got a ton of individual backups) and on top of that I've got 20 restore points instead of the 7.
Has anyone run into this problem?
Has anyone run into this problem?
-
- Chief Product Officer
- Posts: 31806
- Liked: 7300 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Rollback points and full backups
Keep in mind that incremental backup mode by definition requires all previous backup files (full and incremental) to be available to make restore from incremental backup possible. So, as long as last incremental backup file in backup chain must be restorable according to set retention policy, whole respective full + incremental backup chain will have to stay on disk (resulting in more backup files on disk then you may have expected). After last incremental backup file in backup chain falls out of your data retention policy (which happens only when retention policy reaches next full backup file), whole previous full backup chain is removed at once.
On the other hand, reversed incremental backup mode (or incremental mode with transform enabled, once transformation happened) removes older restore points immediately, as soon as they fall out of retention policy. This, and the fact that these backup modes allow to keep only one backup file on disk no matter of how long your retention policy is, make them a few times more space efficient than traditional incremental backup.
On the other hand, reversed incremental backup mode (or incremental mode with transform enabled, once transformation happened) removes older restore points immediately, as soon as they fall out of retention policy. This, and the fact that these backup modes allow to keep only one backup file on disk no matter of how long your retention policy is, make them a few times more space efficient than traditional incremental backup.
-
- Enthusiast
- Posts: 54
- Liked: never
- Joined: Jan 19, 2010 12:59 pm
- Contact:
Re: Rollback points and full backups
I'm also seeing this in version 5.0.1:
I have the setting 'keep number of rollback points' set to 14, backups run every weekday (+Saturday, see below).
I'm making forward incremental backups with synthetic full every Saturday.
Furthermore, I have a full (normal) backup setup every first Saturday of the month.
So, I would expect to have a VBK file, then 5 VIB files (mo-fr) and then another VBK file with 5 more VIBs.
This is working fine, however, I have an 'infinite' number of restore points now and it just keeps creating VBK with VIB chains and never cleans up anything.
I manually delete the VBK/VIB chains over a month old but that's not the best way.
Do I have something set-up wrong or might there be a bug?
I have the setting 'keep number of rollback points' set to 14, backups run every weekday (+Saturday, see below).
I'm making forward incremental backups with synthetic full every Saturday.
Furthermore, I have a full (normal) backup setup every first Saturday of the month.
So, I would expect to have a VBK file, then 5 VIB files (mo-fr) and then another VBK file with 5 more VIBs.
This is working fine, however, I have an 'infinite' number of restore points now and it just keeps creating VBK with VIB chains and never cleans up anything.
I manually delete the VBK/VIB chains over a month old but that's not the best way.
Do I have something set-up wrong or might there be a bug?
-
- Chief Product Officer
- Posts: 31806
- Liked: 7300 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Rollback points and full backups
No, this is exactly what most people tend to think for some reason, but it is incorrect assumption in case of traditional incremental backup... please read my explanation above carefully.rowdy wrote:So, I would expect to have a VBK file, then 5 VIB files (mo-fr) and then another VBK file with 5 more VIBs.
I guess I should try to visualize this based on your specific example...
Depending on specific day, in "best" case, with your retention and schedule you will have 14 files on disk (since you said your retention is 14 rollbacks):
Code: Select all
F I I I I I F I I I I I F I
Code: Select all
F I I I I i F I I I I I F I I I I I F I
-
- Chief Product Officer
- Posts: 31806
- Liked: 7300 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Rollback points and full backups
That said, with your 14 point retention policy and 6/7 backup schedule, you should not have more than 4 fulls on disk at any given moment. If you have more than 4 fulls, I would recommend opening a support case and providing full logs. It should be clear from logs if data retention policy is being processed correctly (or why it is not processed). One thing that is unusual in your case is that you only do backup 6 days of the week, and there is always a chance of bug with non-default settings.
-
- Enthusiast
- Posts: 54
- Liked: never
- Joined: Jan 19, 2010 12:59 pm
- Contact:
Re: Rollback points and full backups
Thanks for your reply.
I understand your drawing, however I don't fully understand it then. I will leave everything running a bit longer and stop manually deleting files and see what Veaam does
I understand your drawing, however I don't fully understand it then. I will leave everything running a bit longer and stop manually deleting files and see what Veaam does
-
- Influencer
- Posts: 10
- Liked: never
- Joined: Nov 30, 2010 5:19 pm
- Full Name: Colin Tyrrell
- Contact:
Restore Points
[merged]
Hi,
h0pefully a simple question.
When backing up my servers I have selected 14 restore points.
But when I do a restore, it seems there are jobs with considerbaly more than 14 points..24 points, 23 points etc.
What am I doing incorrectly?
Hi,
h0pefully a simple question.
When backing up my servers I have selected 14 restore points.
But when I do a restore, it seems there are jobs with considerbaly more than 14 points..24 points, 23 points etc.
What am I doing incorrectly?
-
- Influencer
- Posts: 10
- Liked: never
- Joined: Nov 30, 2010 5:19 pm
- Full Name: Colin Tyrrell
- Contact:
Re: Rollback points and full backups
I am Alexey
-
- Influencer
- Posts: 10
- Liked: never
- Joined: Nov 30, 2010 5:19 pm
- Full Name: Colin Tyrrell
- Contact:
Re: Rollback points and full backups
Hi,
should i create a new post on this?
It really is becoming an increasingly critical issue.
At the moment I seem to have little choice but to create new jobs in order to free up space.
For instance the new job is set yo use 7 restore points. after 9 days I'm up to 9 points.
Am i doing something silly?
should i create a new post on this?
It really is becoming an increasingly critical issue.
At the moment I seem to have little choice but to create new jobs in order to free up space.
For instance the new job is set yo use 7 restore points. after 9 days I'm up to 9 points.
Am i doing something silly?
-
- VP, Product Management
- Posts: 27377
- Liked: 2800 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Rollback points and full backups
Here is another topic explaning this behaviour, please have a look: Job Set for 14 Mount Points - 46 exist
If you have little space on your target storage, then you should probably switch to Reversed Inceremental backup mode.
Please have a look at the Excel table showing all the Pros and Cons of different backup modes: [FAQ] v5 : Frequently Asked Questions > Answers
If you have little space on your target storage, then you should probably switch to Reversed Inceremental backup mode.
Please have a look at the Excel table showing all the Pros and Cons of different backup modes: [FAQ] v5 : Frequently Asked Questions > Answers
-
- Novice
- Posts: 8
- Liked: never
- Joined: Oct 13, 2010 1:04 pm
- Full Name: Boris Shubinsky
- Contact:
Incremental backups and restore points
[merged]
Quick question: if I'm doing incremental backups with Veeam, the restore points to keep on disk number; does this refer to full backups, or incremental days? The reason is this:
I'm currently running incrementals with 4 days. I'm starting to run out of space - I tried doing a full backup to have it roll up the previous incrementals but it's still keeping them out there, which isn't helping my situation.
Quick question: if I'm doing incremental backups with Veeam, the restore points to keep on disk number; does this refer to full backups, or incremental days? The reason is this:
I'm currently running incrementals with 4 days. I'm starting to run out of space - I tried doing a full backup to have it roll up the previous incrementals but it's still keeping them out there, which isn't helping my situation.
-
- Novice
- Posts: 9
- Liked: never
- Joined: Dec 30, 2009 3:03 pm
- Full Name: Chris Steenkamp
- Contact:
Best way to backup.
[merged]
We cuurently backup all our virtuals to disk using Veeam. These backups, are then copied using MS DFS to our DR site.
Every weekend, we write the disk backups to tape, and move them off site. My problem is, I only want 8 backups on site here at Corporate, as we have limited disk space on our EVA. When I look at the backups, some of the servers have 32 and more restore points. What would be the best settings to ensure this.
We cuurently backup all our virtuals to disk using Veeam. These backups, are then copied using MS DFS to our DR site.
Every weekend, we write the disk backups to tape, and move them off site. My problem is, I only want 8 backups on site here at Corporate, as we have limited disk space on our EVA. When I look at the backups, some of the servers have 32 and more restore points. What would be the best settings to ensure this.
-
- Enthusiast
- Posts: 38
- Liked: 2 times
- Joined: May 17, 2010 7:41 pm
- Full Name: Christian Moeller
- Location: Denmark
- Contact:
Incremental jobs and retention
[merged]
Hi.
We are running Incremental jobs with weekly active full ones pr day and with retention set to 21 - but files older than 21 (days) doesnt seam to be deleted in the filesystem.
Have we misunderstanded the meaning of retention (I know that it isnt days! - but number of backups
Hi.
We are running Incremental jobs with weekly active full ones pr day and with retention set to 21 - but files older than 21 (days) doesnt seam to be deleted in the filesystem.
Have we misunderstanded the meaning of retention (I know that it isnt days! - but number of backups
-
- Enthusiast
- Posts: 38
- Liked: 2 times
- Joined: May 17, 2010 7:41 pm
- Full Name: Christian Moeller
- Location: Denmark
- Contact:
Re: Rollback points and full backups
This is really starting to be annoying - our backup destination ran full this night. We have retention set to 21 - but a couple of jobs now have 6 Full backup and all the incremental in between!
It works on some jobs, and not on others.
I have now done a manually clean-up (deleted the older files) and update to latest version 5.0.2 – ill keep an eye on the files the next couple of days.
It works on some jobs, and not on others.
I have now done a manually clean-up (deleted the older files) and update to latest version 5.0.2 – ill keep an eye on the files the next couple of days.
-
- VP, Product Management
- Posts: 27377
- Liked: 2800 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Rollback points and full backups
Christian, please look through this topic for better understanding retention policy and Forward Incremental backup mode. After that please make changes to your retention pocily, so you do not fill up the destination datastore.
-
- Enthusiast
- Posts: 38
- Liked: 2 times
- Joined: May 17, 2010 7:41 pm
- Full Name: Christian Moeller
- Location: Denmark
- Contact:
Re: Rollback points and full backups
I already did - if i have misunderstanded the way retention works please give me some advice.
-
- VP, Product Management
- Posts: 27377
- Liked: 2800 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Rollback points and full backups
Chrisitian,
Basically with Reversed Incremental mode the retention policy is a straight forward thing. If you define 7 restore points to keep, then you'll have 1 VBK and 6 VRB files.
However, with Forward Incremental backup mode it is getting a little bit more complex. Generally speaking you'll have twice more restore points available on the disk compared to the retention policy settings.
Tom has posted a pretty detailed explanation on the previous page of this very topic. In addition to this, please look through these topics more carefully: v5 Restore Point Bug? and Job Set for 14 Mount Points - 46 exist
On top of that, what is your retention policy now (still 21?) and how have you scheduled your backup jobs?
Thanks.
Basically with Reversed Incremental mode the retention policy is a straight forward thing. If you define 7 restore points to keep, then you'll have 1 VBK and 6 VRB files.
However, with Forward Incremental backup mode it is getting a little bit more complex. Generally speaking you'll have twice more restore points available on the disk compared to the retention policy settings.
Tom has posted a pretty detailed explanation on the previous page of this very topic. In addition to this, please look through these topics more carefully: v5 Restore Point Bug? and Job Set for 14 Mount Points - 46 exist
On top of that, what is your retention policy now (still 21?) and how have you scheduled your backup jobs?
Thanks.
-
- Enthusiast
- Posts: 38
- Liked: 2 times
- Joined: May 17, 2010 7:41 pm
- Full Name: Christian Moeller
- Location: Denmark
- Contact:
Re: Rollback points and full backups
I believe that the reason is that I have some deleted VMs inside thoose jobs that won't cleanup!
I have updated to latest veeam version which i can se that is able to handle this (deleted VM retension days) - I hope that it is solved for now.
I'm able to conclude this in about a week or so.
I have updated to latest veeam version which i can se that is able to handle this (deleted VM retension days) - I hope that it is solved for now.
I'm able to conclude this in about a week or so.
-
- Enthusiast
- Posts: 94
- Liked: 6 times
- Joined: Apr 21, 2011 7:37 pm
- Contact:
Re: Old Restore Points not Automatically Purging
[merged]
I am having the same issue. I have a backup job with a retention policy of 14 but Veeam shows 26 restore points. Running 5.0.2.230
I am having the same issue. I have a backup job with a retention policy of 14 but Veeam shows 26 restore points. Running 5.0.2.230
-
- Influencer
- Posts: 10
- Liked: never
- Joined: May 23, 2011 1:33 pm
- Full Name: Matt
- Contact:
Limit Restore Points Not Working
[merged]
We have Veeam Backup & Replication version 5.0.1.198 (32bit) installed on Windows Server 2008 that is backing up from ESXi 4.1 to a Linux back-end. We have it configured to do Synthetic incremental backups for VMs with a limit on the restore points to keep on disk set at 28. However, we have found that the backups are not being purged as they should be.
Information about the server properties:
Elevate account to root is selected, but 'add account to sudoers file automatically' is not (attempts to add automatically always fail, the account was added manually and is a member of wheel which we have set for not requiring password for now).
Backup files are being created as Root:Root with a mask of 644. The Linux server build is a Gentoo 2.6 Kernel.
Please provide assistance on what else in the configuration there may be to have the old files properly purged.
Thank you,
--
We have Veeam Backup & Replication version 5.0.1.198 (32bit) installed on Windows Server 2008 that is backing up from ESXi 4.1 to a Linux back-end. We have it configured to do Synthetic incremental backups for VMs with a limit on the restore points to keep on disk set at 28. However, we have found that the backups are not being purged as they should be.
Information about the server properties:
Elevate account to root is selected, but 'add account to sudoers file automatically' is not (attempts to add automatically always fail, the account was added manually and is a member of wheel which we have set for not requiring password for now).
Backup files are being created as Root:Root with a mask of 644. The Linux server build is a Gentoo 2.6 Kernel.
Please provide assistance on what else in the configuration there may be to have the old files properly purged.
Thank you,
--
-
- Lurker
- Posts: 1
- Liked: never
- Joined: Nov 22, 2010 8:55 pm
- Full Name: Tobias Wieland
- Contact:
restore points settings ignored
[merged]
Hello,
we have two VMs running VBR 5.0.2 in site locations where small ESXI 4.1.0 clusters are placed. The setting "restore points to keep on disk" = 7 is being ignored. I.e. one VM backed up has a vbk file of 2011-04-30 and 33 vib files. I modified the setting to 14 days and re-run the job without errors but the amount of restore points was not corrected.
I am really confused since we use VBR in the same version for our big central clusters in our main location without these problems. The only difference is that it is a VM using option Virtual Appliance in the site locations while we have physical servers in our main location using option "Direct SAN Access".
Hello,
we have two VMs running VBR 5.0.2 in site locations where small ESXI 4.1.0 clusters are placed. The setting "restore points to keep on disk" = 7 is being ignored. I.e. one VM backed up has a vbk file of 2011-04-30 and 33 vib files. I modified the setting to 14 days and re-run the job without errors but the amount of restore points was not corrected.
I am really confused since we use VBR in the same version for our big central clusters in our main location without these problems. The only difference is that it is a VM using option Virtual Appliance in the site locations while we have physical servers in our main location using option "Direct SAN Access".
Re: Rollback points and full backups
Tobias, most probably you didn't specify the schedule to create synthetic full backup. Since you have only 1 VBK file, older incremental points can not be removed according to retention policy, because they cannot exist without "parental" VBK. Please go through the current topic if more information needed.
-
- Veteran
- Posts: 261
- Liked: 29 times
- Joined: May 03, 2011 12:51 pm
- Full Name: James Pearce
- Contact:
Backup not purging restore points
[merged]
My backup jobs don't seem to be ever purging any old copies - is there some trick to this? My jobs specify the default 14 restore points, yet the client is showing 20+ on some VMs (basically they've not been purged since job creation, it seems).
Many thanks
My backup jobs don't seem to be ever purging any old copies - is there some trick to this? My jobs specify the default 14 restore points, yet the client is showing 20+ on some VMs (basically they've not been purged since job creation, it seems).
Many thanks
-
- Influencer
- Posts: 13
- Liked: never
- Joined: Jun 01, 2011 8:11 am
- Contact:
Too many restore points
[merged]
Hi,
Our backup job is set to keep 14 restore points, at the moment we have 20.
Its causing a bit of a problem it terms of disk space.
Should the last backup not be removed once we get to 14?
thanks
Hi,
Our backup job is set to keep 14 restore points, at the moment we have 20.
Its causing a bit of a problem it terms of disk space.
Should the last backup not be removed once we get to 14?
thanks
-
- Veteran
- Posts: 392
- Liked: 33 times
- Joined: Jul 18, 2011 9:30 am
- Full Name: Hussain Al Sayed
- Location: Bahrain
- Contact:
Retention Policy / Period - Disk Space
[merged]
Hi,
I have setup backup jobs with settings:
Restore Points to Keep on Disk: 5 Days
Delete VMs Retention Period: 7 Days
I have noticed that when I run the Backup after 7 Days or even 10 / 15 Days, still the old backup exists and are not being deleted. This causes the Targets become Full and I cannot run Backup anymore..
How can I get rid of the old Backup if the backup expired based on the Retention Period?
Thanks,
Hi,
I have setup backup jobs with settings:
Restore Points to Keep on Disk: 5 Days
Delete VMs Retention Period: 7 Days
I have noticed that when I run the Backup after 7 Days or even 10 / 15 Days, still the old backup exists and are not being deleted. This causes the Targets become Full and I cannot run Backup anymore..
How can I get rid of the old Backup if the backup expired based on the Retention Period?
Thanks,
-
- Enthusiast
- Posts: 58
- Liked: never
- Joined: Jan 01, 2006 1:01 am
Too much restore points
[merged]
Hi,
We have a job that should be having max 5 restore points, and a max retention of 7 days. Still, the job has 10 restore points availible for restore. I have a lot of jobs like that. Anyone any idea why this is possible?
I have to mention that we use sequenced jobs and some of the jobs got started manually using the "Start Job" button in the past days.
Regards,
Joris
Hi,
We have a job that should be having max 5 restore points, and a max retention of 7 days. Still, the job has 10 restore points availible for restore. I have a lot of jobs like that. Anyone any idea why this is possible?
I have to mention that we use sequenced jobs and some of the jobs got started manually using the "Start Job" button in the past days.
Regards,
Joris
-
- Lurker
- Posts: 1
- Liked: never
- Joined: Jul 28, 2011 6:53 pm
- Full Name: pim molenbrugge
- Contact:
Re: Rollback points and full backups
hi all,
had the same situation. Our problem was that the day we chose to compact the incrementals (saterday) was NOT in the schedule for the job (only mon-fri).One we added satuday problem was solved. Kind of strange however that veeam lets you create the job this way. Would be nice to have a check implemented that avoids this kind of errors.
pim
had the same situation. Our problem was that the day we chose to compact the incrementals (saterday) was NOT in the schedule for the job (only mon-fri).One we added satuday problem was solved. Kind of strange however that veeam lets you create the job this way. Would be nice to have a check implemented that avoids this kind of errors.
pim
-
- Chief Product Officer
- Posts: 31806
- Liked: 7300 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Rollback points and full backups
Yes, I believe this is fixed in v6. Thanks!
Who is online
Users browsing this forum: Valdereth and 244 guests