Comprehensive data protection for all workloads
Post Reply
skrause
Veteran
Posts: 487
Liked: 106 times
Joined: Dec 08, 2014 2:58 pm
Full Name: Steve Krause
Contact:

Feature Request - Retention policies for File Indexes/Logs for old jobs

Post by skrause »

I have been somewhat annoyed by this over the years and today, as I am patching my Veeam infrastructure, I decided it was time to post this.

Right now, the guest file indexes for servers that are backed up are never deleted. So if you have a backup server that has been running for a year+, even if your longest retention doesn't meet that, you still end up having the indexes going back to the first time the job ran. For file servers with a lot of files, that can take up a lot of space when it all adds up.

Job logs are similar in that they are pretty much never deleted.

Obviously, the retention policy logic for file indexes would need more thought due to potential GFS restore points etc. But I would think that a "garbage collection" task on job logs that was adjustable and ran regularly to prune logs older than a certain age (6m/1y/etc) would be somewhat easier to implement.

I know I could write scripts and schedule a task in Windows on all the servers, but it would be nice to have it included with the application.
Steve Krause
Veeam Certified Architect
PetrM
Veeam Software
Posts: 3264
Liked: 528 times
Joined: Aug 28, 2013 8:23 am
Full Name: Petr Makarov
Location: Prague, Czech Republic
Contact:

Re: Feature Request - Retention policies for File Indexes/Logs for old jobs

Post by PetrM »

Hi Steve,

Maybe I'm missing something but the default period for storing historical indexing data is 3 months. Did you check what is the retention period for indexes in your environment?

Speaking about logs, I'd suggest to refer to this KB in which you can find more fine-tuning options for logs rotation.

Thanks!
foggy
Veeam Software
Posts: 21073
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Feature Request - Retention policies for File Indexes/Logs for old jobs

Post by foggy »

A couple of topics for further reading: cleaning up vbrcatalog folder and VBRCatalog folder growing in size.
skrause
Veteran
Posts: 487
Liked: 106 times
Joined: Dec 08, 2014 2:58 pm
Full Name: Steve Krause
Contact:

Re: Feature Request - Retention policies for File Indexes/Logs for old jobs

Post by skrause »

PetrM wrote: Aug 11, 2021 8:33 pm Maybe I'm missing something but the default period for storing historical indexing data is 3 months. Did you check what is the retention period for indexes in your environment?

Speaking about logs, I'd suggest to refer to this KB in which you can find more fine-tuning options for logs rotation.
I am speaking of on the B&R server not on the Enterprise manager. I have indexes going back to the beginning of time (for the B&R server) in the VBRcatalog folder.
Steve Krause
Veeam Certified Architect
PetrM
Veeam Software
Posts: 3264
Liked: 528 times
Joined: Aug 28, 2013 8:23 am
Full Name: Petr Makarov
Location: Prague, Czech Republic
Contact:

Re: Feature Request - Retention policies for File Indexes/Logs for old jobs

Post by PetrM »

I understood but it should work on the related Veeam B&R server as well. Do you have a support case for this issue?

Thanks!
skrause
Veteran
Posts: 487
Liked: 106 times
Joined: Dec 08, 2014 2:58 pm
Full Name: Steve Krause
Contact:

Re: Feature Request - Retention policies for File Indexes/Logs for old jobs

Post by skrause »

No, because this has been a behavior I have experienced with every B&R component for years so I made the assumption it was working "as intended" thus the feature request.
Steve Krause
Veeam Certified Architect
PetrM
Veeam Software
Posts: 3264
Liked: 528 times
Joined: Aug 28, 2013 8:23 am
Full Name: Petr Makarov
Location: Prague, Czech Republic
Contact:

Re: Feature Request - Retention policies for File Indexes/Logs for old jobs

Post by PetrM »

Hi Steve,

I've got your point and asked my colleagues from QA to check the behavior. I'll update the topic as soon as I hear back from them.

Thanks!
PetrM
Veeam Software
Posts: 3264
Liked: 528 times
Joined: Aug 28, 2013 8:23 am
Full Name: Petr Makarov
Location: Prague, Czech Republic
Contact:

Re: Feature Request - Retention policies for File Indexes/Logs for old jobs

Post by PetrM »

@skrause Could you you please reach out our support team and share a case ID? Our QA confirmed that Veeam B&R must store indexes for existing restore points only and Enterprise Manager stores indexes according to its retention settings. The behavior described in your previous post looks like a technical issue.

Thanks!
Post Reply

Who is online

Users browsing this forum: Google [Bot], olafurh, Semrush [Bot] and 116 guests