-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Usage of Job in Capacity tier
Is there anyway to find out the object usage (in GB/TB) of a single job in the scenario where multiple jobs are targeting a single SOBR? I'm thinking of the figure of actual usage after the deduplication due to hashing.
-
- Chief Product Officer
- Posts: 31624
- Liked: 7119 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Usage of Job in Capacity tier
@Shestakov does Veeam ONE have such a report?
-
- Veteran
- Posts: 7328
- Liked: 781 times
- Joined: May 21, 2014 11:03 am
- Full Name: Nikita Shestakov
- Location: Prague
- Contact:
Re: Usage of Job in Capacity tier
There are reports, such as Job History, showing how much data each job transfers to scale-out repository.
However, none of them shows how much backups data created by those jobs is moved to the object storage later on.
Could you clarify your goal, please? Do you need to know size of backups on the object storage or you want to know amount of transferred data?
However, none of them shows how much backups data created by those jobs is moved to the object storage later on.
Could you clarify your goal, please? Do you need to know size of backups on the object storage or you want to know amount of transferred data?
-
- Veeam Software
- Posts: 492
- Liked: 175 times
- Joined: Jul 21, 2015 12:38 pm
- Full Name: Dustin Albertson
- Contact:
Re: Usage of Job in Capacity tier
@Shestakov A couple of scenarios pop into my head on this request.
1. VCSP - reporting tenant usage across a SOBR with multiple tenant jobs.
2. Enterprise - reporting usage from jobs linked to departments/divisions. - I know that they could setup individual SOBRs and then report a bit differently but most would probably be setup in a use case where multiple jobs are going to a single sobr.
@obroni Can you confirm what your specific use case is?
1. VCSP - reporting tenant usage across a SOBR with multiple tenant jobs.
2. Enterprise - reporting usage from jobs linked to departments/divisions. - I know that they could setup individual SOBRs and then report a bit differently but most would probably be setup in a use case where multiple jobs are going to a single sobr.
@obroni Can you confirm what your specific use case is?
Dustin Albertson | Director of Product Management - Cloud & Applications | Veeam Product Management, Alliances
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
#1 is exactly my use case.
Want to understand how much capacity a customer is using in terms of archive storage.
Want to understand how much capacity a customer is using in terms of archive storage.
-
- Chief Product Officer
- Posts: 31624
- Liked: 7119 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Usage of Job in Capacity tier
In that case @Vitaliy S. also needs to be summoned here as VAC PM.
-
- VP, Product Management
- Posts: 27301
- Liked: 2775 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Usage of Job in Capacity tier
This is not possible today (planned for next updates of VAC), however, @chris.arceneaux has created a script that allows reporting on capacity tier usage per tenant.
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
Just to clarify this is for a normal Veeam B&R installation being used in a multi tenant IaaS scenario, so in my head, not sure VAC would be where I would expect to see it.
I was more thinking it would be shown when right clicking on the backup under Backups->Object Storage. The current reported size seems to be based on the total logical size of the full backup files stored in S3, where I want to understand how much actual space is being used.
I was more thinking it would be shown when right clicking on the backup under Backups->Object Storage. The current reported size seems to be based on the total logical size of the full backup files stored in S3, where I want to understand how much actual space is being used.
-
- VP, Product Management
- Posts: 27301
- Liked: 2775 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Usage of Job in Capacity tier
Ok, then it seems like we need to have this reporting in Veeam ONE (for the IaaS scenario).
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
Vitaliy that sounds more like what I was expecting. Or if this information could be generated via powershell that would probably also be fine for my requirements.
-
- Veteran
- Posts: 7328
- Liked: 781 times
- Joined: May 21, 2014 11:03 am
- Full Name: Nikita Shestakov
- Location: Prague
- Contact:
Re: Usage of Job in Capacity tier
Noted for future updates of Veeam ONE. Thanks
-
- VeeaMVP
- Posts: 678
- Liked: 364 times
- Joined: Jun 24, 2019 1:39 pm
- Full Name: Chris Arceneaux
- Location: Georgia, USA
- Contact:
Re: Usage of Job in Capacity tier
@obroni As Vitaliy mentioned, I currently have two scripts for reporting Capacity Tier usage.
- VBR - Per Jobs usage numbers (what you're looking for)
- VCC - Per Tenant usage numbers
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
Thanks @chris.arceneaux . Did you send the scripts? I couldn't see anything when I looked.
-
- VeeaMVP
- Posts: 678
- Liked: 364 times
- Joined: Jun 24, 2019 1:39 pm
- Full Name: Chris Arceneaux
- Location: Georgia, USA
- Contact:
Re: Usage of Job in Capacity tier
No problem. Please check your private message again.
-
- Veeam Software
- Posts: 492
- Liked: 175 times
- Joined: Jul 21, 2015 12:38 pm
- Full Name: Dustin Albertson
- Contact:
Re: Usage of Job in Capacity tier
@chris.arceneaux Why dont you put them in the veeamhub repo?
Dustin Albertson | Director of Product Management - Cloud & Applications | Veeam Product Management, Alliances
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
Thanks.
I've run the script but not convinced the numbers are correct? The 3 jobs that copy to object storage are showing as:
UsedObjectGB : 78246.91
UsedObjectGB : 69476.83
UsedObjectGB : 45113
But total object usage on repository is: 41.7TB
Are these pre-compression or something like that, or am I confusing the numbers?
I've run the script but not convinced the numbers are correct? The 3 jobs that copy to object storage are showing as:
UsedObjectGB : 78246.91
UsedObjectGB : 69476.83
UsedObjectGB : 45113
But total object usage on repository is: 41.7TB
Are these pre-compression or something like that, or am I confusing the numbers?
-
- VeeaMVP
- Posts: 678
- Liked: 364 times
- Joined: Jun 24, 2019 1:39 pm
- Full Name: Chris Arceneaux
- Location: Georgia, USA
- Contact:
Re: Usage of Job in Capacity tier
Values are being pulled from Backup Job metadata. Please check the numbers shown in your console (see screenshots) to see how they match up and let us know.
Console view:
Script output:
Here's another POV showing actual usage from the object storage itself:
Console view:
Script output:
Here's another POV showing actual usage from the object storage itself:
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
Ah ok, that might explain it then. That's what originally prompted this thread, that object storage total for each job, seems equal to the logical size of all the compressed full backups, rather than after object deduplication and thus the actual underlying storage being consumed?
-
- VeeaMVP
- Posts: 678
- Liked: 364 times
- Joined: Jun 24, 2019 1:39 pm
- Full Name: Chris Arceneaux
- Location: Georgia, USA
- Contact:
Re: Usage of Job in Capacity tier
If that is the case, can you please open a support case on this for visibility? The backup job metadata should have the correct numbers to be used for usage reporting.
Please post the case number as well so I can assist.
Please post the case number as well so I can assist.
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
Case ref 04057065 raised
-
- Veteran
- Posts: 563
- Liked: 173 times
- Joined: Nov 15, 2019 4:09 pm
- Full Name: Alex Heylin
- Contact:
Re: Usage of Job in Capacity tier
Did this get resolved so the script can report the actual usage of the S3, and if so please will you consider adding the scripts to Github @chris.arceneaux?
Thanks
Thanks
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
As far as I can tell this is still an issue
-
- VP, Product Management
- Posts: 27301
- Liked: 2775 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Usage of Job in Capacity tier
There were no changes in how Veeam B&R calculates usage since there were no major releases yet. I've asked our QA team to review this in v11. Once I have more information, I will update the thread.
-
- Service Provider
- Posts: 19
- Liked: 2 times
- Joined: Dec 20, 2016 3:16 pm
- Contact:
Re: Usage of Job in Capacity tier
Was this script added to the veeam hub or is it possible to get it via different means ?
-
- VeeaMVP
- Posts: 678
- Liked: 364 times
- Joined: Jun 24, 2019 1:39 pm
- Full Name: Chris Arceneaux
- Location: Georgia, USA
- Contact:
Re: Usage of Job in Capacity tier
The script in question was never released publicly as it used undocumented API calls that are no longer valid using the latest version of our product.
Starting with Veeam Service Provider Console v5, Performance/Capacity/Archive Tier usage is now accessible via:
Starting with Veeam Service Provider Console v5, Performance/Capacity/Archive Tier usage is now accessible via:
- Web UI by generating a Quota Usage Report
- RESTful API: GET - /api/v3/organizations/companies/usage
-
- Expert
- Posts: 131
- Liked: 22 times
- Joined: Nov 21, 2014 10:50 pm
- Full Name: Nick Fisk
- Contact:
Re: Usage of Job in Capacity tier
I believe the new Service Provider Console handles scenario #2 which was highlighted near the top of the thread.
Has any progress been made towards scenario #1, calculating usage of a "tenant" in a shared SOBR repository in VB&R, as you would find in a MSP's IaaS platform?
Has any progress been made towards scenario #1, calculating usage of a "tenant" in a shared SOBR repository in VB&R, as you would find in a MSP's IaaS platform?
-
- VP, Product Management
- Posts: 27301
- Liked: 2775 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Usage of Job in Capacity tier
Actually, the Service Provider Console resolves the 1st case (reporting tenant usage across a SOBR with multiple tenant jobs), but not yet the 2nd where SOBR is used remotely/on-premises and is not part of the VCC infrastructure.
Who is online
Users browsing this forum: Google [Bot], rhys.hammond and 13 guests