Rentention Policy not working?

[richardb]

Hi,

in the backup job, "Keep backups for 40 days" is configured. This is what my backup directory currently looks like:

Code: Select all

12.11.2022  20:13         2.279.864 WORKSTATION.vbm
16.09.2022  18:01   607.272.718.336 WORKSTATION2022-09-16T173632.vbk
17.09.2022  11:50    14.890.758.144 WORKSTATION2022-09-17T124708.vib
18.09.2022  14:04    20.326.301.696 WORKSTATION2022-09-18T150125.vib
19.09.2022  09:34     4.394.426.368 WORKSTATION2022-09-19T103324.vib
20.09.2022  09:24     3.934.408.704 WORKSTATION2022-09-20T102252.vib
21.09.2022  09:05     3.502.505.984 WORKSTATION2022-09-21T100352.vib
22.09.2022  09:43     8.166.891.520 WORKSTATION2022-09-22T104137.vib
23.09.2022  11:02     4.740.952.064 WORKSTATION2022-09-23T120126.vib
24.09.2022  10:01    40.123.277.312 WORKSTATION2022-09-24T105552.vib
25.09.2022  08:42     3.860.889.600 WORKSTATION2022-09-25T094108.vib
26.09.2022  08:39     9.230.569.472 WORKSTATION2022-09-26T093722.vib
27.09.2022  08:18     3.030.249.472 WORKSTATION2022-09-27T091707.vib
28.09.2022  12:27     6.263.803.904 WORKSTATION2022-09-28T132525.vib
29.09.2022  08:03     3.947.507.712 WORKSTATION2022-09-29T090223.vib
30.09.2022  08:56     4.113.592.320 WORKSTATION2022-09-30T095508.vib
01.10.2022  09:39     4.297.613.312 WORKSTATION2022-10-01T103752.vib
02.10.2022  10:44     5.785.649.152 WORKSTATION2022-10-02T114256.vib
02.10.2022  12:06   603.352.760.320 WORKSTATION2022-10-02T114713.vbk
03.10.2022  10:07    12.914.778.112 WORKSTATION2022-10-03T110537.vib
04.10.2022  09:10     4.863.135.744 WORKSTATION2022-10-04T100909.vib
05.10.2022  10:03     3.398.168.576 WORKSTATION2022-10-05T110224.vib
06.10.2022  09:04     6.457.761.792 WORKSTATION2022-10-06T100239.vib
07.10.2022  08:54     3.809.325.056 WORKSTATION2022-10-07T095325.vib
08.10.2022  09:13     8.162.836.480 WORKSTATION2022-10-08T101125.vib
09.10.2022  11:21     7.221.424.128 WORKSTATION2022-10-09T121938.vib
10.10.2022  09:22    15.255.592.960 WORKSTATION2022-10-10T101952.vib
10.10.2022  19:01   610.456.801.280 WORKSTATION2022-10-10T185309.vbk
11.10.2022  09:36     2.083.274.752 WORKSTATION2022-10-11T103537.vib
13.10.2022  08:51    10.130.382.848 WORKSTATION2022-10-13T094910.vib
14.10.2022  09:09     3.884.417.024 WORKSTATION2022-10-14T100756.vib
15.10.2022  09:15     7.382.228.992 WORKSTATION2022-10-15T101409.vib
15.10.2022  17:51   614.284.193.792 WORKSTATION2022-10-15T173621.vbk
16.10.2022  11:25     4.378.890.240 WORKSTATION2022-10-16T122338.vib
17.10.2022  08:16    16.537.722.880 WORKSTATION2022-10-17T091308.vib
19.10.2022  08:35     4.757.364.736 WORKSTATION2022-10-19T093424.vib
20.10.2022  09:33     5.021.011.968 WORKSTATION2022-10-20T103222.vib
21.10.2022  09:32     6.234.976.256 WORKSTATION2022-10-21T103055.vib
22.10.2022  12:08     5.923.102.720 WORKSTATION2022-10-22T130710.vib
22.10.2022  13:55   604.326.436.864 WORKSTATION2022-10-22T134233.vbk
23.10.2022  15:22    36.359.536.640 WORKSTATION2022-10-23T161640.vib
24.10.2022  09:56    22.805.139.456 WORKSTATION2022-10-24T105339.vib
25.10.2022  09:32     5.145.116.672 WORKSTATION2022-10-25T103109.vib
26.10.2022  09:42     4.744.716.288 WORKSTATION2022-10-26T104054.vib
27.10.2022  09:46     9.403.297.792 WORKSTATION2022-10-27T104439.vib
28.10.2022  09:03     9.193.078.784 WORKSTATION2022-10-28T100210.vib
29.10.2022  10:44     3.402.465.280 WORKSTATION2022-10-29T114323.vib
29.10.2022  12:49   615.772.225.536 WORKSTATION2022-10-29T123529.vbk
30.10.2022  11:19    17.848.840.192 WORKSTATION2022-10-30T111706.vib
31.10.2022  11:45    10.881.552.384 WORKSTATION2022-10-31T114309.vib
01.11.2022  16:18     3.528.589.312 WORKSTATION2022-11-01T161739.vib
02.11.2022  10:29     1.868.840.960 WORKSTATION2022-11-02T102808.vib
03.11.2022  11:23     4.413.714.432 WORKSTATION2022-11-03T112222.vib
04.11.2022  11:03     5.705.109.504 WORKSTATION2022-11-04T110212.vib
05.11.2022  12:36     8.190.025.728 WORKSTATION2022-11-05T123455.vib
05.11.2022  15:02   620.813.471.744 WORKSTATION2022-11-05T134836.vbk
06.11.2022  13:54     6.394.200.064 WORKSTATION2022-11-06T135310.vib
07.11.2022  12:14     4.336.861.184 WORKSTATION2022-11-07T121237.vib
08.11.2022  18:13     8.402.264.064 WORKSTATION2022-11-08T181137.vib
09.11.2022  10:45     5.131.513.856 WORKSTATION2022-11-09T104355.vib
10.11.2022  11:39    22.392.000.512 WORKSTATION2022-11-10T113538.vib
11.11.2022  09:51     4.326.469.632 WORKSTATION2022-11-11T095013.vib
12.11.2022  11:02     4.590.174.208 WORKSTATION2022-11-12T110107.vib

Apparently there are way more than 40 backups. Why are old backups not deleted? From my understanding, the first chain (2022-09-16 --> 2022-10-02) should have been deleted at this point.

Is this a bug or can someone clarify that? If further information are needed, please let me know.

Best regards
Richard

[Mildur]

Hi Richard

Restore points will be deleted after „retention + 1 days“.
I assume they should be removed by now?
Also important to consider that for Veeam Agent for Windows workstation the retention depends on the days a restore point was created successfully.
https://helpcenter.veeam.com/docs/agent ... tml?ver=50

On 2022-10-18 one is missing. So that day doesn‘t count towards the 40 days retention.

Thanks
Fabian

[richardb]

Hi Fabian,

thank you for your fast response.

> I assume they should be removed by now?

Unfortunately not. My backups also now fail, because there is not enough disk space available anymore. I checked the job logs, but there is no indication that deletion of old backups is tried.

I could delete all old backups and start from scratch, but I'd like to understand, why deletion does not work.

> On 2022-10-18 one is missing. So that day doesn‘t count towards the 40 days retention.

I am aware of the missing day. But still:

From "02.10.2022 12:06 603.352.760.320 WORKSTATION2022-10-02T114713.vbk"
to "12.11.2022 11:02 4.590.174.208 WORKSTATION2022-11-12T110107.vib"
there are 45 successful days of snapshots.

Any idea?

Richard

[MarkBoothmaa]

It looks like you have either synthetic or active full's set to run weekly so your actual retention will be +7 days on top of that as the chain has to be a minimum of 40 points

[Mildur]

@richardb
Retention is applied at the end of the backup job.
If there is no space left for a new backup to be successful, retention will not be applied.

Please delete the oldest chain manually and try the job again.
If the oldest backups still not getting deleted next weekend, a support case would be required.
Make sure that you have enough storage to store 40-47 days of successful backups. if not, lower the retention or buy new storage.

Thanks
Fabian

[richardb]

active full's set to run weekly

I do manually once a week an active full backup.

so your actual retention will be +7 days

Sorry if I miss something here. I don't get, why the oldest chain is still needed. See my comments below:

Code: Select all

12.11.2022  20:13         2.279.864 WORKSTATION.vbm
16.09.2022  18:01   607.272.718.336 WORKSTATION2022-09-16T173632.vbk
17.09.2022  11:50    14.890.758.144 WORKSTATION2022-09-17T124708.vib
18.09.2022  14:04    20.326.301.696 WORKSTATION2022-09-18T150125.vib
19.09.2022  09:34     4.394.426.368 WORKSTATION2022-09-19T103324.vib
20.09.2022  09:24     3.934.408.704 WORKSTATION2022-09-20T102252.vib
21.09.2022  09:05     3.502.505.984 WORKSTATION2022-09-21T100352.vib
22.09.2022  09:43     8.166.891.520 WORKSTATION2022-09-22T104137.vib
23.09.2022  11:02     4.740.952.064 WORKSTATION2022-09-23T120126.vib
24.09.2022  10:01    40.123.277.312 WORKSTATION2022-09-24T105552.vib
25.09.2022  08:42     3.860.889.600 WORKSTATION2022-09-25T094108.vib
26.09.2022  08:39     9.230.569.472 WORKSTATION2022-09-26T093722.vib
27.09.2022  08:18     3.030.249.472 WORKSTATION2022-09-27T091707.vib
28.09.2022  12:27     6.263.803.904 WORKSTATION2022-09-28T132525.vib
29.09.2022  08:03     3.947.507.712 WORKSTATION2022-09-29T090223.vib
30.09.2022  08:56     4.113.592.320 WORKSTATION2022-09-30T095508.vib
01.10.2022  09:39     4.297.613.312 WORKSTATION2022-10-01T103752.vib
02.10.2022  10:44     5.785.649.152 WORKSTATION2022-10-02T114256.vib (from here upwards, old backup chain - not needed anymore to due retention policy?)
02.10.2022  12:06   603.352.760.320 WORKSTATION2022-10-02T114713.vbk
03.10.2022  10:07    12.914.778.112 WORKSTATION2022-10-03T110537.vib
04.10.2022  09:10     4.863.135.744 WORKSTATION2022-10-04T100909.vib
05.10.2022  10:03     3.398.168.576 WORKSTATION2022-10-05T110224.vib
06.10.2022  09:04     6.457.761.792 WORKSTATION2022-10-06T100239.vib
07.10.2022  08:54     3.809.325.056 WORKSTATION2022-10-07T095325.vib (from here the end = 40 backups)
08.10.2022  09:13     8.162.836.480 WORKSTATION2022-10-08T101125.vib
09.10.2022  11:21     7.221.424.128 WORKSTATION2022-10-09T121938.vib
10.10.2022  09:22    15.255.592.960 WORKSTATION2022-10-10T101952.vib
10.10.2022  19:01   610.456.801.280 WORKSTATION2022-10-10T185309.vbk
11.10.2022  09:36     2.083.274.752 WORKSTATION2022-10-11T103537.vib
13.10.2022  08:51    10.130.382.848 WORKSTATION2022-10-13T094910.vib
14.10.2022  09:09     3.884.417.024 WORKSTATION2022-10-14T100756.vib
15.10.2022  09:15     7.382.228.992 WORKSTATION2022-10-15T101409.vib
15.10.2022  17:51   614.284.193.792 WORKSTATION2022-10-15T173621.vbk
16.10.2022  11:25     4.378.890.240 WORKSTATION2022-10-16T122338.vib
17.10.2022  08:16    16.537.722.880 WORKSTATION2022-10-17T091308.vib
19.10.2022  08:35     4.757.364.736 WORKSTATION2022-10-19T093424.vib
20.10.2022  09:33     5.021.011.968 WORKSTATION2022-10-20T103222.vib
21.10.2022  09:32     6.234.976.256 WORKSTATION2022-10-21T103055.vib
22.10.2022  12:08     5.923.102.720 WORKSTATION2022-10-22T130710.vib
22.10.2022  13:55   604.326.436.864 WORKSTATION2022-10-22T134233.vbk
23.10.2022  15:22    36.359.536.640 WORKSTATION2022-10-23T161640.vib
24.10.2022  09:56    22.805.139.456 WORKSTATION2022-10-24T105339.vib
25.10.2022  09:32     5.145.116.672 WORKSTATION2022-10-25T103109.vib
26.10.2022  09:42     4.744.716.288 WORKSTATION2022-10-26T104054.vib
27.10.2022  09:46     9.403.297.792 WORKSTATION2022-10-27T104439.vib
28.10.2022  09:03     9.193.078.784 WORKSTATION2022-10-28T100210.vib
29.10.2022  10:44     3.402.465.280 WORKSTATION2022-10-29T114323.vib
29.10.2022  12:49   615.772.225.536 WORKSTATION2022-10-29T123529.vbk
30.10.2022  11:19    17.848.840.192 WORKSTATION2022-10-30T111706.vib
31.10.2022  11:45    10.881.552.384 WORKSTATION2022-10-31T114309.vib
01.11.2022  16:18     3.528.589.312 WORKSTATION2022-11-01T161739.vib
02.11.2022  10:29     1.868.840.960 WORKSTATION2022-11-02T102808.vib
03.11.2022  11:23     4.413.714.432 WORKSTATION2022-11-03T112222.vib
04.11.2022  11:03     5.705.109.504 WORKSTATION2022-11-04T110212.vib
05.11.2022  12:36     8.190.025.728 WORKSTATION2022-11-05T123455.vib
05.11.2022  15:02   620.813.471.744 WORKSTATION2022-11-05T134836.vbk
06.11.2022  13:54     6.394.200.064 WORKSTATION2022-11-06T135310.vib
07.11.2022  12:14     4.336.861.184 WORKSTATION2022-11-07T121237.vib
08.11.2022  18:13     8.402.264.064 WORKSTATION2022-11-08T181137.vib
09.11.2022  10:45     5.131.513.856 WORKSTATION2022-11-09T104355.vib
10.11.2022  11:39    22.392.000.512 WORKSTATION2022-11-10T113538.vib
11.11.2022  09:51     4.326.469.632 WORKSTATION2022-11-11T095013.vib
12.11.2022  11:02     4.590.174.208 WORKSTATION2022-11-12T110107.vib (last backup)

Retention is applied at the end of the backup job.

I cannot confirm this. In the meantime, I've lowered the retention time to 30 days. After starting the job, old backups were deleted immediately (otherwise, the job would have failed, due to no disk space available).

Backups run now successfully again.

[Mildur]

(from here the end = 40 backups)

You told us, that you have configured a retention of 40 days. Retention for workstations is "days with successful backups". You have to count each day with a successfull backup. Not the amount of restore points in the repository. There can be multiple restore points per day.
I see that you have two backups on each day when a full backup was created. A full backup and the incremental. And you have some days without any backup.



Another example how the retention works for workstation.
- You have configured a retention of 40 days.
- You have configured a full backup each saturday.
- You let the machine only run on saturday.

Veeam Agent will create for 40 weeks full backups before removing the oldest one. Just because the backup never run on another day.

[richardb]

Hi Fabian,

this is awesome, thank you very much for your detailed explanation! I missed/overlooked the fact, that there were two backups on some days. Now I fully understand what was going on.

Best regards
Richard