-
- Enthusiast
- Posts: 38
- Liked: 4 times
- Joined: May 18, 2022 1:58 pm
- Contact:
S3 "on object storage" size
Hi,
when I go into the properties of a backup under "Home > Backups > Object Storage" I can see two sizes:
"Backup size" and inside parentheses "xx TB on Object Storage"
How Veeam calculates the size inside parentheses? I have a full backup which the two sizes are strongly different (48 TB?!):
Our s3 is growing quickly and I need to understand if there are "unwanted" files using too much space
Thank you
db
when I go into the properties of a backup under "Home > Backups > Object Storage" I can see two sizes:
"Backup size" and inside parentheses "xx TB on Object Storage"
How Veeam calculates the size inside parentheses? I have a full backup which the two sizes are strongly different (48 TB?!):
Our s3 is growing quickly and I need to understand if there are "unwanted" files using too much space
Thank you
db
-
- Veeam Software
- Posts: 1495
- Liked: 655 times
- Joined: Jul 17, 2015 6:54 pm
- Full Name: Jorge de la Cruz
- Contact:
Re: S3 "on object storage" size
Hello Barret,
I can not see the restore points which you can see once you press the object on the top left square. But anyways something seems really odd looking at this picture.
If you have not yet opened a Support Case, I would recommend you to open one, so we can check if this is a bug somehow.
Meanwhile, I will check if I can get my hands on the logic that calculates this specific value.
Please share the Support ticket with us; thanks!
I can not see the restore points which you can see once you press the object on the top left square. But anyways something seems really odd looking at this picture.
If you have not yet opened a Support Case, I would recommend you to open one, so we can check if this is a bug somehow.
Meanwhile, I will check if I can get my hands on the logic that calculates this specific value.
Please share the Support ticket with us; thanks!
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
-
- Enthusiast
- Posts: 38
- Liked: 4 times
- Joined: May 18, 2022 1:58 pm
- Contact:
Re: S3 "on object storage" size
Hello Jorge,
I've just opened the case n. 05637088 adding more details.
Thank you
db
I've just opened the case n. 05637088 adding more details.
Thank you
db
-
- Enthusiast
- Posts: 38
- Liked: 4 times
- Joined: May 18, 2022 1:58 pm
- Contact:
Re: S3 "on object storage" size
This is the situation of the backup both on disk (left) and on object storage (right)
db
db
-
- Enthusiast
- Posts: 38
- Liked: 4 times
- Joined: May 18, 2022 1:58 pm
- Contact:
Re: S3 "on object storage" size
As I mentioned in the case, it is some time that Veeam is trying to offload these restore points failing often.
Maybe each of these attempts write data that Veeam "forget" and object storage accumulates?
db
Maybe each of these attempts write data that Veeam "forget" and object storage accumulates?
db
-
- Veeam Software
- Posts: 1495
- Liked: 655 times
- Joined: Jul 17, 2015 6:54 pm
- Full Name: Jorge de la Cruz
- Contact:
Re: S3 "on object storage" size
Hello, barret,
I saw your reply on the support ticket. I think at this time is better for Support to try to investigate what is going on; it might be what you described, and if that is the case it sounds like a bug, because the offload tasks always retry after failures, meaning that the blocks/objects that you have already uploaded are there, and we continue from there.
Let's give Support some time to see in the logs, and on the S3 bucket to see where is this coming from. Do you have any other backups going to the same bucket? Perhaps old jobs there?
Thanks!
I saw your reply on the support ticket. I think at this time is better for Support to try to investigate what is going on; it might be what you described, and if that is the case it sounds like a bug, because the offload tasks always retry after failures, meaning that the blocks/objects that you have already uploaded are there, and we continue from there.
Let's give Support some time to see in the logs, and on the S3 bucket to see where is this coming from. Do you have any other backups going to the same bucket? Perhaps old jobs there?
Thanks!
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
-
- Enthusiast
- Posts: 38
- Liked: 4 times
- Joined: May 18, 2022 1:58 pm
- Contact:
Re: S3 "on object storage" size
Thank you Jorge,
Anything about the size in parentheses? Is there any chance to get it using Powershell or SQL?
db
Anything about the size in parentheses? Is there any chance to get it using Powershell or SQL?
db
-
- Veeam Software
- Posts: 1495
- Liked: 655 times
- Joined: Jul 17, 2015 6:54 pm
- Full Name: Jorge de la Cruz
- Contact:
Re: S3 "on object storage" size
Hello Barret,
I am asking internally to see if I can find out more about this.
I am asking internally to see if I can find out more about this.
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
-
- Veeam Software
- Posts: 1495
- Liked: 655 times
- Joined: Jul 17, 2015 6:54 pm
- Full Name: Jorge de la Cruz
- Contact:
Re: S3 "on object storage" size
Hello,
I've asked internally, and Oleg Feoktistov is the master as usual. We agreed that this behavior should be investigated further as it appears that every failed offload, if it is not retried for some reason, keeps adding more into that field, this is not confirmed, so please keep working with Support.
That field can be retrieved using this code, which is unsupported as we are calling some DB classes:
If you are curious, you can find it as well inside the Database, here - [Backup.Model.BackupArchiveIndices] used_size
But as said, I think Support will investigate and come with a final answer if this is a bug or not.
Thanks! Keep us posted
I've asked internally, and Oleg Feoktistov is the master as usual. We agreed that this behavior should be investigated further as it appears that every failed offload, if it is not retried for some reason, keeps adding more into that field, this is not confirmed, so please keep working with Support.
That field can be retrieved using this code, which is unsupported as we are calling some DB classes:
Code: Select all
$backup = Get-VBRBackup -Name 'Backup to SOBR with Azure'
$shadowBackups = $backup.FindShadowCapacityTierCopies()
foreach ($shadowBackup in $shadowBackups)
{
$index = [Veeam.Backup.DBManager.CDBManager]::Instance.BackupArchiveIndex.FindByShadowBackupId($shadowBackup.Id)
$shadowBackup | select Name, @{n='ObjectStorageSizeGB';e={[Math]::Round($index.UsedSize/1GB, 1)}}
}
But as said, I think Support will investigate and come with a final answer if this is a bug or not.
Thanks! Keep us posted
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
-
- Veeam Legend
- Posts: 945
- Liked: 221 times
- Joined: Jul 19, 2016 8:39 am
- Full Name: Michael
- Location: Rheintal, Austria
- Contact:
Re: S3 "on object storage" size
My observation is that the size in parentheses normally is smaller and represents the actual amount of data on the object storage. So in my case I've got 30 TB of restore points (in total) and only 10 TB (in parantheses) on the object storage - due to the implemented deduplication.
-
- Veeam Software
- Posts: 1495
- Liked: 655 times
- Joined: Jul 17, 2015 6:54 pm
- Full Name: Jorge de la Cruz
- Contact:
Re: S3 "on object storage" size
It should be, yes Michael. I think Barret has hit some kind of bug, etc. Let's see what Tech support confirms.
Jorge de la Cruz
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
Senior Product Manager | Veeam ONE @ Veeam Software
@jorgedlcruz
https://www.jorgedelacruz.es / https://jorgedelacruz.uk
vExpert 2014-2024 / InfluxAce / Grafana Champion
-
- Veeam ProPartner
- Posts: 55
- Liked: 12 times
- Joined: Apr 10, 2013 12:11 pm
- Full Name: Gregor Smerke
- Location: Ljubljana, SI - Slovenia
- Contact:
Re: S3 "on object storage" size
I am just "subscribing" to this thread as I have a similar problem on Oracle Cloud Object Storage where failed deletions after expired retention accumulate blocks - as I understand it. I have not open a support case yet. Is there already a tool available which finds blocks in a bucket that do not belong to a backup and deletes them?
-
- Product Manager
- Posts: 9848
- Liked: 2607 times
- Joined: May 13, 2017 4:51 pm
- Full Name: Fabian K.
- Location: Switzerland
- Contact:
Re: S3 "on object storage" size
Hi Gregor
Oracle Cloud Object Storage is incompatible with Veeam Backup & Replication. It's not supported.
Please use only Object Storage which is on our Veeam Ready list or in the unofficial compatibility list.
https://www.veeam.com/alliance-partner- ... get&page=1
object-storage-f52/unoffizial-compatibi ... 56956.html
Thanks
Fabian
Oracle Cloud Object Storage is incompatible with Veeam Backup & Replication. It's not supported.
Please use only Object Storage which is on our Veeam Ready list or in the unofficial compatibility list.
https://www.veeam.com/alliance-partner- ... get&page=1
object-storage-f52/unoffizial-compatibi ... 56956.html
Thanks
Fabian
Product Management Analyst @ Veeam Software
Who is online
Users browsing this forum: Google [Bot] and 7 guests