Discussions related to using object storage as a backup target.
Post Reply
squebel
Service Provider
Posts: 169
Liked: 16 times
Joined: Sep 27, 2019 5:06 pm
Contact:

How many versions of this object??

Post by squebel »

Hello,
We are finally starting to test out object lock on our StorageGrid 11.9 platform with Veeam in Governance mode. It seems to work really well out of the box but digging into some of the data consumption I have found some stuff that is really weird around versioning of objects. When I run the "list-object-versions" command with the aws s3ap cli "aws s3api --no-verify-ssl --endpoint https://endpointip:10443 list-object-versions --bucket bucket2 --key Veeam/Backup/backups/Clients/fullpathtoobject" I get back a MASSIVE response from the system showing what appears to be hundreds of versions of this one object. That just doesn't make sense to me. If I put a single object out there by myself and run the same command on that object, I do not get any versions.

Why I'm asking is I'm seeing data being kept when I don't think it should be. Data just continues to grow because versions of the object are not being deleted and can't be deleted because of the object lock and lifecycle of versioned objects.
veremin
Product Manager
Posts: 20655
Liked: 2374 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: How many versions of this object??

Post by veremin » 1 person likes this post

In general, using immutability increases the number of objects stored in the object storage, as we try to protect the state of the entire backup chain at a given moment of time and apply immutability to all blocks corresponding to this state. The specified retention period is effectively extended by the immutability period and the generation period. You can read more about this in our User Guide.

The additional objects you see might be related to this behavior.

Thanks!
sfirmes
Veeam Software
Posts: 320
Liked: 150 times
Joined: Jul 24, 2018 8:38 pm
Full Name: Stephen Firmes
Contact:

Re: How many versions of this object??

Post by sfirmes » 1 person likes this post

I assume your "fullpathtobject" is pointing to a single object? If so, you should open a Veeam support case since we don't expect to see multiple versions for a single object due to our use of unique object keys. If you open a support case, please post the case# here so that we can track it internally.

Thanks
Steve Firmes | Senior Solutions Architect, Product Management - Alliances @ Veeam Software
squebel
Service Provider
Posts: 169
Liked: 16 times
Joined: Sep 27, 2019 5:06 pm
Contact:

Re: How many versions of this object??

Post by squebel »

That's right, Steve. The full path is "Veeam/Backup/backups/Clients/{6e1f9024-2d6f-4cd9-ab38-28ecf2c50930}/b42d482d-b030-487d-ae03-ae542e5329c6/CloudStg/Data/{8406717e-4bdb-446b-bf7b-fc346036fd93}/{08ae2567-f184-4286-8c0a-834f5f0c0d05}/10274_e3fb0e648f78c1069344a554b96584c8_00000000000000000000000000000000"

And this is after just the initial Full backup of a single vm that the aws s3api cli call gives me back that huge list of versions.

I will open a case. Thank you.
Post Reply

Who is online

Users browsing this forum: No registered users and 16 guests