Discussions related to using object storage as a backup target.
Post Reply
barrett27
Enthusiast
Posts: 34
Liked: 4 times
Joined: May 18, 2022 1:58 pm
Contact:

S3 "on object storage" size

Post by barrett27 »

Hi,
when I go into the properties of a backup under "Home > Backups > Object Storage" I can see two sizes:
"Backup size" and inside parentheses "xx TB on Object Storage"

How Veeam calculates the size inside parentheses? I have a full backup which the two sizes are strongly different (48 TB?!):
Image

Our s3 is growing quickly and I need to understand if there are "unwanted" files using too much space

Thank you

db
jorgedlcruz
Veeam Software
Posts: 1356
Liked: 613 times
Joined: Jul 17, 2015 6:54 pm
Full Name: Jorge de la Cruz
Contact:

Re: S3 "on object storage" size

Post by jorgedlcruz »

Hello Barret,
I can not see the restore points which you can see once you press the object on the top left square. But anyways something seems really odd looking at this picture.

If you have not yet opened a Support Case, I would recommend you to open one, so we can check if this is a bug somehow.

Meanwhile, I will check if I can get my hands on the logic that calculates this specific value.

Please share the Support ticket with us; thanks!
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software

@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
barrett27
Enthusiast
Posts: 34
Liked: 4 times
Joined: May 18, 2022 1:58 pm
Contact:

Re: S3 "on object storage" size

Post by barrett27 »

Hello Jorge,
I've just opened the case n. 05637088 adding more details.

Thank you

db
barrett27
Enthusiast
Posts: 34
Liked: 4 times
Joined: May 18, 2022 1:58 pm
Contact:

Re: S3 "on object storage" size

Post by barrett27 »

This is the situation of the backup both on disk (left) and on object storage (right)
Image

db
barrett27
Enthusiast
Posts: 34
Liked: 4 times
Joined: May 18, 2022 1:58 pm
Contact:

Re: S3 "on object storage" size

Post by barrett27 »

As I mentioned in the case, it is some time that Veeam is trying to offload these restore points failing often.
Maybe each of these attempts write data that Veeam "forget" and object storage accumulates?

db
jorgedlcruz
Veeam Software
Posts: 1356
Liked: 613 times
Joined: Jul 17, 2015 6:54 pm
Full Name: Jorge de la Cruz
Contact:

Re: S3 "on object storage" size

Post by jorgedlcruz »

Hello, barret,
I saw your reply on the support ticket. I think at this time is better for Support to try to investigate what is going on; it might be what you described, and if that is the case it sounds like a bug, because the offload tasks always retry after failures, meaning that the blocks/objects that you have already uploaded are there, and we continue from there.

Let's give Support some time to see in the logs, and on the S3 bucket to see where is this coming from. Do you have any other backups going to the same bucket? Perhaps old jobs there?

Thanks!
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software

@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
barrett27
Enthusiast
Posts: 34
Liked: 4 times
Joined: May 18, 2022 1:58 pm
Contact:

Re: S3 "on object storage" size

Post by barrett27 »

Thank you Jorge,
Anything about the size in parentheses? Is there any chance to get it using Powershell or SQL?

db
jorgedlcruz
Veeam Software
Posts: 1356
Liked: 613 times
Joined: Jul 17, 2015 6:54 pm
Full Name: Jorge de la Cruz
Contact:

Re: S3 "on object storage" size

Post by jorgedlcruz »

Hello Barret,
I am asking internally to see if I can find out more about this.
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software

@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
jorgedlcruz
Veeam Software
Posts: 1356
Liked: 613 times
Joined: Jul 17, 2015 6:54 pm
Full Name: Jorge de la Cruz
Contact:

Re: S3 "on object storage" size

Post by jorgedlcruz » 2 people like this post

Hello,
I've asked internally, and Oleg Feoktistov is the master as usual. We agreed that this behavior should be investigated further as it appears that every failed offload, if it is not retried for some reason, keeps adding more into that field, this is not confirmed, so please keep working with Support.

That field can be retrieved using this code, which is unsupported as we are calling some DB classes:

Code: Select all

$backup = Get-VBRBackup -Name 'Backup to SOBR with Azure'
$shadowBackups = $backup.FindShadowCapacityTierCopies()
foreach ($shadowBackup in $shadowBackups)
{
  $index = [Veeam.Backup.DBManager.CDBManager]::Instance.BackupArchiveIndex.FindByShadowBackupId($shadowBackup.Id)
  $shadowBackup | select Name, @{n='ObjectStorageSizeGB';e={[Math]::Round($index.UsedSize/1GB, 1)}}
}
If you are curious, you can find it as well inside the Database, here - [Backup.Model.BackupArchiveIndices] used_size

But as said, I think Support will investigate and come with a final answer if this is a bug or not.

Thanks! Keep us posted
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software

@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
mcz
Veeam Legend
Posts: 835
Liked: 172 times
Joined: Jul 19, 2016 8:39 am
Full Name: Michael
Location: Rheintal, Austria
Contact:

Re: S3 "on object storage" size

Post by mcz »

barrett27 wrote: Sep 22, 2022 2:17 pm Anything about the size in parentheses?
My observation is that the size in parentheses normally is smaller and represents the actual amount of data on the object storage. So in my case I've got 30 TB of restore points (in total) and only 10 TB (in parantheses) on the object storage - due to the implemented deduplication.
jorgedlcruz
Veeam Software
Posts: 1356
Liked: 613 times
Joined: Jul 17, 2015 6:54 pm
Full Name: Jorge de la Cruz
Contact:

Re: S3 "on object storage" size

Post by jorgedlcruz »

It should be, yes Michael. I think Barret has hit some kind of bug, etc. Let's see what Tech support confirms.
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software

@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
GregorS
Veeam ProPartner
Posts: 48
Liked: 11 times
Joined: Apr 10, 2013 12:11 pm
Full Name: Gregor Smerke
Location: Ljubljana, SI - Slovenia
Contact:

Re: S3 "on object storage" size

Post by GregorS »

I am just "subscribing" to this thread as I have a similar problem on Oracle Cloud Object Storage where failed deletions after expired retention accumulate blocks - as I understand it. I have not open a support case yet. Is there already a tool available which finds blocks in a bucket that do not belong to a backup and deletes them?
Mildur
Product Manager
Posts: 8549
Liked: 2223 times
Joined: May 13, 2017 4:51 pm
Full Name: Fabian K.
Location: Switzerland
Contact:

Re: S3 "on object storage" size

Post by Mildur »

Hi Gregor

Oracle Cloud Object Storage is incompatible with Veeam Backup & Replication. It's not supported.

Please use only Object Storage which is on our Veeam Ready list or in the unofficial compatibility list.
https://www.veeam.com/alliance-partner- ... get&page=1
object-storage-f52/unoffizial-compatibi ... 56956.html

Thanks
Fabian
Product Management Analyst @ Veeam Software
Post Reply

Who is online

Users browsing this forum: No registered users and 17 guests