Discussions specific to the VMware vSphere hypervisor
Post Reply
jjblaster
Influencer
Posts: 12
Liked: 2 times
Joined: Apr 03, 2012 3:03 pm
Full Name: Jeremy Scott
Contact:

Calculate change rate

Post by jjblaster » May 18, 2012 4:39 pm

We are running Veeam v6 Build 181

Our current repository storage is getting upgraded. I have been tasked to calculate the VM change rate and need some advice.

The data that will be used spans a 30 day period of backups.

1. Best way to get this done?

2. Any automated tools that can be used to get this done?

3. The correct formula to calculate the change rate?

4. Calculate the dedup and compression ratios?

Thanks in advance.

Gostev
SVP, Product Management
Posts: 24473
Liked: 3413 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Calculate change rate

Post by Gostev » May 18, 2012 8:14 pm

Best way would be to backup a subset of your infrastructure for 1 week to some storage, and then extrapolate the results for the whole infrastructure and required retention.
Obviously, things like change rate, dedupe and compression ratio vary cannot be predicted or calculated with some formula in advance, as they vary depending on workload.

jjblaster
Influencer
Posts: 12
Liked: 2 times
Joined: Apr 03, 2012 3:03 pm
Full Name: Jeremy Scott
Contact:

Re: Calculate change rate

Post by jjblaster » May 18, 2012 8:54 pm

I do not have the resources to do that unfortunately.

I understand there is no exact formula to get the results I'm looking for more of a rule of thumb.

There has to be a way to extract the data from the database. Has anyone done this?

Data to extract -

VM total size
Data backed up due to change total size
Compression ratio average
Dedup ratio average

Might be bit much to ask huh lol

Gostev
SVP, Product Management
Posts: 24473
Liked: 3413 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Calculate change rate

Post by Gostev » May 18, 2012 9:03 pm

Oh, so you already have some backups created. This certainly makes everything much easier. Please see here, this should get you started. Thanks!

jjblaster
Influencer
Posts: 12
Liked: 2 times
Joined: Apr 03, 2012 3:03 pm
Full Name: Jeremy Scott
Contact:

Re: Calculate change rate

Post by jjblaster » May 21, 2012 8:30 pm

Thanks so much Gostev this is exactly what I was looking for. One more question, which field would represent the change rate it seems that it is the "Processed Used Size" but just wanted to double check. Thanks again.


SELECT TOP 1000 [id]
,[job_name]
,[state]
,[creation_time]
,[end_time]
,[job_type]
,[is_startfull]
,[operation]
,[processed_objects]
,[total_objects]
,[result]
,[total_size]
,[processed_size]
,[processed_used_size]
,[progress]
,[is_retry]
,[avg_speed]
,[read_size]
,[stored_size]
,[failed]
,[usn]
FROM [VeeamBackup].[dbo].[ReportSessionsView]
where [creation_time] > '2012-03-18 16:00:00.000' and [creation_time] < '2012-03-19 07:00:00.000'
order by [creation_time] desc;

Gostev
SVP, Product Management
Posts: 24473
Liked: 3413 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Calculate change rate

Post by Gostev » May 21, 2012 9:01 pm

Judging on the field names, [read_size] should be what you are looking for (sum of all blocks that VMware changed block tracking reported as changed).

jjblaster
Influencer
Posts: 12
Liked: 2 times
Joined: Apr 03, 2012 3:03 pm
Full Name: Jeremy Scott
Contact:

Re: Calculate change rate

Post by jjblaster » May 22, 2012 7:51 pm

I think the problem with the [read_size], please correct me if I am wrong, but in the summary of a completed job there is - Processed - Read - Transferred.

I know the change rate of the VM is not the same as the transferred rate but that is what I need since that is the rate of change that will be incurred by the storage where the repository is located.

I cannot find a transfer field in the database to extract. What do you think?

Gostev
SVP, Product Management
Posts: 24473
Liked: 3413 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Calculate change rate

Post by Gostev » May 22, 2012 8:45 pm

[stored_size]

jjblaster
Influencer
Posts: 12
Liked: 2 times
Joined: Apr 03, 2012 3:03 pm
Full Name: Jeremy Scott
Contact:

Re: Calculate change rate

Post by jjblaster » May 25, 2012 9:23 pm

Thanks for all your help Gostev I gotz it :)

SAVANTIS
Novice
Posts: 6
Liked: never
Joined: Oct 24, 2013 5:55 am
Full Name: Helpdesk Savantis
Contact:

Re: Calculate change rate

Post by SAVANTIS » Nov 14, 2013 6:15 pm

Hi all,

This topic helps alot, thanks.

How do I extend the query so that I can display the change rate per vm in a job? Or even, if possible per disk in a vm?

We seem to have a very high rate change which causes problems with our offsite replicas.


Help would be very appreciated.

Greets,

Pim

Gostev
SVP, Product Management
Posts: 24473
Liked: 3413 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Calculate change rate

Post by Gostev » Nov 14, 2013 7:26 pm

Hi, actually this topic is 1.5 years old now. We've had some advancements around B&R reporting since then... these days, Veeam ONE provides all these reports natively, so you no longer need to hack around our database. In fact, the query above might not even be compatible with v7 database at all. Hope this helps!

SAVANTIS
Novice
Posts: 6
Liked: never
Joined: Oct 24, 2013 5:55 am
Full Name: Helpdesk Savantis
Contact:

Re: Calculate change rate

Post by SAVANTIS » Nov 15, 2013 3:48 am

Hi Gostev,


thanks for your reply. Of course we have looked into Veeam One. Maybe in the (near) future we will use these reporting functions.


But for the time being I have to analyse our change rates into quite some detail, just to be able to analyse (and solve) our replication issues, which is part of a external project.

The impact of installing Veeam One (even if its a trial) is too large (meaning time, effort and resources) at this time.

Thanks again.

Post Reply

Who is online

Users browsing this forum: Baidu [Spider] and 11 guests