Standalone backup agent for Microsoft Windows servers and workstations (formerly Veeam Endpoint Backup FREE)
Post Reply
ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Orphaned file on repository

Post by ejenner »

Hi guys,

What is the correct way to establish whether or not a file on a repository is required for backup?

I've got a file I suspect has become detached from backup and not sure if it is safe to delete it.

These are the checks I've made, but I wondered what the official correct way is to solve this:

1. Checked the date, it is 04/03/2020 (UK date format DD/MM/YYYY) but the retention is 35 days (daily backups)
2. Another .VBK full file exists but it is from a few days ago 26/05/2020
3. If you attempt a restore it shows one full file and all the other increments to support 35 days of retention
4. When you check files on disk through the Veeam B&R console using 'properties' for the backup on disk the rogue .VBK file isn't listed

I'm worried about deleting the file in case there is some ongoing operation that requires it.

The repository has filled up, which is what caught my attention and caused me to look for possible files to delete. Could it have failed to continue to process due to full repository and left a merge job half completed causing a large .VBK to remain on the disk?

Shestakov
Expert
Posts: 7328
Liked: 773 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Orphaned file on repository

Post by Shestakov »

Hi EJ,
What setting of full backups do you have set?
If the suspicious VBK has ~30 dependent increments, no wonder the VBK is still there as retention of the latest VIBs is not over yet.
Thanks

ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: Orphaned file on repository

Post by ejenner »

Where would I get that information for you? Are you talking about forward / reverse incremental? It's a Windows Agent job so I don't think I can configure that.

Shestakov
Expert
Posts: 7328
Liked: 773 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Orphaned file on repository

Post by Shestakov »

You can check it in the policy/job settings.
You cannot set reverse incremental backup method in agent jobs, however active and synthetic full backups are supported.

ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: Orphaned file on repository

Post by ejenner »

So does a 'synthetic full' reforumlate the files on the repository and potentially leave an old file behind? Maybe if the process was interrupted perhaps?

Shestakov
Expert
Posts: 7328
Liked: 773 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Orphaned file on repository

Post by Shestakov »

Synthetic full creates full backup from increments and leaves the oldest chain to remain until it's removed in accordance with the retention policy.
If you share your settings I can tell better, but for now my guess is the older chain is not removed as not all increments are outdated yet.

ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: Orphaned file on repository

Post by ejenner »

Here are the screenshots of the settings:

Image

Image

Image

Image

Image


Here are the files on the repository. It has split the files across two SOBR extents:

Folder 1:

Image


Folder 2:

Image


It looks to me like the 16TB file is unnecessary. Is there any chance it is still being used? That's what I'm trying to work out.

Shestakov
Expert
Posts: 7328
Liked: 773 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Orphaned file on repository

Post by Shestakov »

Thanks for the details.
Do you have any restore points between March, 4th and April, 29th?
If no, you have 35 restore points (1 full + 34 increments) in the chain from the mentioned 16 TB full backup and June, 1st. And new chain starting from .vbk (full backup) made on June 1st 18:15.
The 16 TB full backup will be automatically removed when you have 35 restore points in the new chain, i.e. in the beginning of July in a case you backup once a day.
If you remove the file, you will not be able to restore from any backup of the first backup chain.

ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: Orphaned file on repository

Post by ejenner »

Maybe... bear in mind this screenshot taken today is a day or two later than the screenshots above so 29th of April could be the same as 30th April today?

Image

Shestakov
Expert
Posts: 7328
Liked: 773 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Orphaned file on repository

Post by Shestakov »

If full backup used to be 29th April and now 30th, your chain is used forever forward incremental method. And 42 TB file from June, 1st is from another chain.
Thus, the 16 TB is used in the active backup chain and cannot be removed.
Does it answer your question?
Thanks

ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: Orphaned file on repository

Post by ejenner »

Hmm... only issue with that is the disparity in full-backup file sizes. During that time the size of the data will be relatively static, not much change. So it does not make sense for an older restore to be 16TB and 30~days later it is 42TB.

Shestakov
Expert
Posts: 7328
Liked: 773 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Orphaned file on repository

Post by Shestakov »

Are you sure these 16TB and 42TB backup files were created by the same job?
Based on your posts 42TB file could be created by another job.

ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: Orphaned file on repository

Post by ejenner »

The source volume is a 40TB volume. It's all video files so already compressed.

ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: Orphaned file on repository

Post by ejenner »

This file is still on the disk with the same size and date.

Additionally, I've checked the backup properties in the 'Disk' area where the backup files are listed and that file is NOT shown in the list of files for that backup.

I wish there was an official way of checking for orphan files as some of them can be quite large. I'd really like to delete this file but I don't know if it has to be retained for the backup to function.

I can think of ways around this issue like testing restorations with the file renamed (and so missing from the repository) but that hasn't been suggested as a solution so I'd be reluctant to try that in case it breaks the backup chain.

Dima P.
Product Manager
Posts: 11557
Liked: 1003 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Orphaned file on repository

Post by Dima P. »

EJ,

Can you open backup file properties via Home > Backups > Disk node? It should list all the restore points from the backup chain. Cheers!

ejenner
Expert
Posts: 510
Liked: 83 times
Joined: Mar 23, 2018 4:43 pm
Full Name: EJ
Location: London
Contact:

Re: Orphaned file on repository

Post by ejenner »

yes, if you open that location the file isn't shown there.

Dima P.
Product Manager
Posts: 11557
Liked: 1003 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Orphaned file on repository

Post by Dima P. »

Then it's safe to delete it. I usually suggest to rename or move backup and give job a day or two prior deleting it. Cheers!

Post Reply

Who is online

Users browsing this forum: crackocain and 19 guests