Calculate change rate

[jjblaster]

We are running Veeam v6 Build 181

Our current repository storage is getting upgraded. I have been tasked to calculate the VM change rate and need some advice.

The data that will be used spans a 30 day period of backups.

1. Best way to get this done?

2. Any automated tools that can be used to get this done?

3. The correct formula to calculate the change rate?

4. Calculate the dedup and compression ratios?

Thanks in advance.

[Gostev]

Best way would be to backup a subset of your infrastructure for 1 week to some storage, and then extrapolate the results for the whole infrastructure and required retention.
Obviously, things like change rate, dedupe and compression ratio vary cannot be predicted or calculated with some formula in advance, as they vary depending on workload.

[jjblaster]

I do not have the resources to do that unfortunately.

I understand there is no exact formula to get the results I'm looking for more of a rule of thumb.

There has to be a way to extract the data from the database. Has anyone done this?

Data to extract -

VM total size
Data backed up due to change total size
Compression ratio average
Dedup ratio average

Might be bit much to ask huh lol

[Gostev]

Oh, so you already have some backups created. This certainly makes everything much easier. Please see here, this should get you started. Thanks!

[jjblaster]

Thanks so much Gostev this is exactly what I was looking for. One more question, which field would represent the change rate it seems that it is the "Processed Used Size" but just wanted to double check. Thanks again.


SELECT TOP 1000 [id]
,[job_name]
,[state]
,[creation_time]
,[end_time]
,[job_type]
,[is_startfull]
,[operation]
,[processed_objects]
,[total_objects]
,[result]
,[total_size]
,[processed_size]
,[processed_used_size]
,[progress]
,[is_retry]
,[avg_speed]
,[read_size]
,[stored_size]
,[failed]
,[usn]
FROM [VeeamBackup].[dbo].[ReportSessionsView]
where [creation_time] > '2012-03-18 16:00:00.000' and [creation_time] < '2012-03-19 07:00:00.000'
order by [creation_time] desc;

[Gostev]

Judging on the field names, [read_size] should be what you are looking for (sum of all blocks that VMware changed block tracking reported as changed).

[jjblaster]

I think the problem with the [read_size], please correct me if I am wrong, but in the summary of a completed job there is - Processed - Read - Transferred.

I know the change rate of the VM is not the same as the transferred rate but that is what I need since that is the rate of change that will be incurred by the storage where the repository is located.

I cannot find a transfer field in the database to extract. What do you think?

[Gostev]

[stored_size]

[jjblaster]

Thanks for all your help Gostev I gotz it

[SAVANTIS]

Hi all,

This topic helps alot, thanks.

How do I extend the query so that I can display the change rate per vm in a job? Or even, if possible per disk in a vm?

We seem to have a very high rate change which causes problems with our offsite replicas.


Help would be very appreciated.

Greets,

Pim

[Gostev]

Hi, actually this topic is 1.5 years old now. We've had some advancements around B&R reporting since then... these days, Veeam ONE provides all these reports natively, so you no longer need to hack around our database. In fact, the query above might not even be compatible with v7 database at all. Hope this helps!

[SAVANTIS]

Hi Gostev,


thanks for your reply. Of course we have looked into Veeam One. Maybe in the (near) future we will use these reporting functions.


But for the time being I have to analyse our change rates into quite some detail, just to be able to analyse (and solve) our replication issues, which is part of a external project.

The impact of installing Veeam One (even if its a trial) is too large (meaning time, effort and resources) at this time.

Thanks again.