Veeam Backup Statistics

Availability for the Always-On Enterprise

Veeam Backup Statistics

Veeam Logoby HJAdams123 » Wed Sep 19, 2012 2:50 pm

Hello and Good Day Veeam Community...

I am right in the middle of a Veeam B & R evaluation. I noticed that if you go to Backups - Disk and select a Backup Job, right click and select Properties, you can get detailed information about your backup footprint over time. I had a few questions though on what some of the figures mean?

Say for instance the de-dupe ratio. Does that percentage mean the percentage of data that was found to be deduplicated? Or does the dedup ratio mean the reduction of data as a result of deduplication? And then where does the compression ratio come in? Does that percentage only work against data that has already been de-duped? I guess what I am asking is, does de-dupe happen first, and then whats left over from that is compressed? I am just trying to make sense of the numbers....

For example, I am looking at the properties of one of my backup jobs in the Veeam B&R console under Backups - Disks (right click one and select properties) This job is a reverse incremental, and I don't do active fulls or anything like that. On a particular day, I got this figures....

Data Size: 5.3GB
Backup Size: 833.4MB
De-Dupe Ratio: 84%
Compress Ratio: 18%

So, if I understand correctly, de-duplication reduced that backup size by 84%, which is 5.3GB - 4.5= 800MB. So we are left with 800MB after de-dupe. Then compression comes in and reduces that by another 18%. So, 800MB -144MB now equals 656MB. Now 656MB does not equal 833MB. I thought that 833.4MB figure was the result of de-dupe and compression. Or perhaps I am not working with the numbers correctly? Can someone claify how these numbers relate?
HJAdams123
Enthusiast
 
Posts: 57
Liked: 14 times
Joined: Mon Jul 16, 2012 1:54 pm
Full Name: Harold Adams

Re: Veeam Backup Statistics

Veeam Logoby foggy » Wed Sep 19, 2012 3:14 pm

Harold, the correct math is as follows: 84% dedupe ratio means that the data was deduped to the 84% size of the original data, the same with compression ratio. So having initially 5.3GB deduped to 84% and then compressed to 18% (5.3 * 0,84 * 0,18) you get somewhere close to the reported backup size.
foggy
Veeam Software
 
Posts: 15087
Liked: 1110 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Veeam Backup Statistics

Veeam Logoby HJAdams123 » Wed Sep 19, 2012 4:47 pm

So this is a case in which lower percentage numbers are better....better in that compared to the original datasize how much data is actually written to the repository...
HJAdams123
Enthusiast
 
Posts: 57
Liked: 14 times
Joined: Mon Jul 16, 2012 1:54 pm
Full Name: Harold Adams

Re: Veeam Backup Statistics

Veeam Logoby foggy » Thu Sep 20, 2012 8:06 am

Correct.
foggy
Veeam Software
 
Posts: 15087
Liked: 1110 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

[MERGED] : Dedupe and Compression clarification

Veeam Logoby ccitrano » Wed Feb 20, 2013 2:46 pm

All,

Can I get some quick input on interpreting this output from a job that I ran. I was recreating some jobs and switching them to a forward incremental model. This job reflects the first run, which would be a full backup. I agree with the Total size and the Backup Size number which make me pretty happy. I'm trying to understand the Dedupe and Compression numbers so that I can experiment. What does 1.1x mean in terms of Deduping and 4.0x in terms of Compression? I am using the default compression and dedupe options in the job.


Tuesday, February 19, 2013 8:00:13 PM
Success 8 Start time 8:00:13 PM Total size 1.1 TB Backup size 172.0 GB
Warning 0 End time 11:01:36 PM Data read 769.5 GB Dedupe 1.1x
Error 0 Duration 3:01:23 Transferred 195.4 GB Compression 4.0x
Details
Name Status Start time End time Size Read Transferred Duration Details
CLT-SQ826 Success 8:01:37 PM 8:14:39 PM 160.0 GB 43.3 GB 16.7 GB 0:13:01
CLT-SQ828 Success 8:14:45 PM 8:44:53 PM 160.0 GB 134.4 GB 32.1 GB 0:30:07
CLT-SQ822 Success 8:44:56 PM 9:20:57 PM 180.0 GB 164.0 GB 32.3 GB 0:36:01
CLT-SQ827 Success 9:20:59 PM 9:53:34 PM 160.0 GB 139.3 GB 39.1 GB 0:32:34
CLT-SQ825 Success 9:53:36 PM 10:05:26 PM 80.0 GB 40.7 GB 13.2 GB 0:11:49
CLT-SQ821 Success 10:05:28 PM 10:24:25 PM 100.0 GB 84.0 GB 19.6 GB 0:18:57
CLT-SQ823 Success 10:24:28 PM 10:53:37 PM 160.0 GB 144.0 GB 34.4 GB 0:29:09
CLT-SQ824 Success 10:53:39 PM 11:01:30 PM 160.0 GB 19.8 GB 7.9 GB 0:07:50
ccitrano
Influencer
 
Posts: 18
Liked: never
Joined: Tue May 24, 2011 9:28 pm
Full Name: Chuck Citrano

Re: Veeam Backup Statistics

Veeam Logoby v.Eremin » Wed Feb 20, 2013 3:13 pm

1.1x means that the data was deduped to (1/1.1)*100%= 91% size of the original data. The same situation with compression: (1/4)*100% = 25%

Having aforesaid points in mind we get these numbers:

769.5*0.91*0.25 = 175,061

175,061 is approximately equal to the reported backup size.

Hope this helps.
Thanks.
v.Eremin
Veeam Software
 
Posts: 13558
Liked: 1006 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Veeam Backup Statistics

Veeam Logoby StefanSpecht » Fri Jul 04, 2014 12:11 pm

Hi,

I try to understand the backup statistics, and try to understand where exactly compression and deduplication happens.
We using several virtual proxy servers, one physical backup server and a NetApp CIFS repository, and my current understanding for a full backup is as follows:

(1) The virtual proxy reads all blocks from disk, except zero-data blocks, swap files etc.
(2) Proxy compresses all data that has been read
(3) These compressed data is transfered to the target-side transport service. Most of the time this the physical backup server, as it is near to the NetApp
(4) Target-side transport service deduplicates the received data
(5) Target-side transport service deduplicates writes deduplicated data to disk

Is that correct so far?

This is what I get from the Backup Report:

Total Size -> 764 GB
Data Read -> 718,1 GB
Data Transferred -> 451,6 GB
Backup Size -> 420.6 GB
Deduplication -> 1.7 x (1/1,7) *100 % = 58,82% from originzal size ( -> - 41,18)
Compression -> 1.1 x (1/1,1)*100% = 91% from original size (-> - 9%)

My calculation would be as follows; but I get completly diffrent values:


764 GB (Toal Size) - Zero-blocks,swap-files = 718,1 GB (Data Read)
718,1 GB (Data Read) - 9% Compression = 653 GB (Data Transferred)
653 GB (Data Transferred) - 41,18% Deduplication = 384 GB (Backup Size)

What I am also confused about is, that from the real time statistics for this job, I can see:
Data Read -> 718,1 GB
Data Transferred -> 451,6 GB (1,6 x)

I see that 451,6 GB x 1,6 = 718,1 GB. But how does this relate to the 1,1x and 1,7x from the report?

Stefan
StefanSpecht
Influencer
 
Posts: 16
Liked: never
Joined: Tue Aug 17, 2010 12:21 pm
Full Name: Stefan Specht

Re: Veeam Backup Statistics

Veeam Logoby foggy » Mon Jul 21, 2014 9:56 am 2 people like this post

Stefan, your understanding is basically correct. The confusion comes from the fact that compression and deduplication values from the Backup Report relate to the backup file size (in relation to the total data size), not the data read and transferred during the job session. So maths should be as follows:

764 GB / 1.7 / 1.1 = 410GB, which is somewhere close to the reported 420GB size of the resulting backup file.
foggy
Veeam Software
 
Posts: 15087
Liked: 1110 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Veeam Backup Statistics

Veeam Logoby rpraseet » Wed Mar 22, 2017 6:36 am

foggy wrote:Harold, the correct math is as follows: 84% dedupe ratio means that the data was deduped to the 84% size of the original data, the same with compression ratio. So having initially 5.3GB deduped to 84% and then compressed to 18% (5.3 * 0,84 * 0,18) you get somewhere close to the reported backup size.


Thanks for this. It was helpful for me as well. I am also trying to find data volume that changes daily by looking at the incremental backup size.

Success 110 | Start time 16:30:02 | Total size 6.0 TB | Backup size 806.8 GB
Warning 0 | End time 17:56:42 | Data read 106.8 GB | Dedupe 4.5x
Error 0 Duration 1:26:40 | Transferred 58.9 GB | Compression 1.7x

The latest vbk file has a size of 806 GB and the vrb files are all around 50 to 60 GB. How could i calculate an average daily data change with this informa
rpraseet
Lurker
 
Posts: 2
Liked: never
Joined: Wed Mar 22, 2017 5:58 am
Full Name: Ravi Praseeth

Re: Veeam Backup Statistics

Veeam Logoby foggy » Wed Mar 22, 2017 12:47 pm

rpraseet wrote:Data read 106.8 GB

Hi Ravi, this is the daily data change for this job run.
foggy
Veeam Software
 
Posts: 15087
Liked: 1110 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot] and 44 guests