Comprehensive data protection for all workloads
Post Reply
m.novelli
Veeam ProPartner
Posts: 346
Liked: 40 times
Joined: Dec 29, 2009 12:48 pm
Full Name: Marco Novelli
Location: Asti - Italy
Contact:

Interpreting statistics about compression and deduplication

Post by m.novelli » Dec 15, 2010 8:01 am

Hi friends, some questions about compression and deduplication statistics regarding a backup job with incremental mode and transformation of previous full backups chains into rollbacks:

- what means a deduplication ratio of 99% for incremental backups? It means really high dedupe or no dedupe?

- compression ratio for VRB files generated from transformation is 100%, that means no compression? On disk I can see that VRB files are near the double than VIB files

A side note: transformation of previous full backups chains into rollbacks for a 1TB VBK file took about 23 hours on this Veeam Backup Server (Dell R710 with 4 vCPU Intel E5620, VBK located on an iSCSI Dell MD3000i with SATA hard drives). For this customer is not a big issue, but I have other customer with bigger HW infrastructures where a so long transformation time will be unacceptable considering that in the meanwhile the Veeam Backup would process other jobs

Thanks for any explanation

Marco

Gostev
SVP, Product Management
Posts: 23879
Liked: 3213 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by Gostev » Dec 15, 2010 10:20 am

Hi Marco, please see here for the explanation.

Also, please note that transformation process can be fully offloaded to target when backing up to Linux target, thus it will not be affecting your backup server. If the customer is using version 5.0.1, we would be interested to take a look at transformation log to see what makes the transformation run so long. Thanks!

m.novelli
Veeam ProPartner
Posts: 346
Liked: 40 times
Joined: Dec 29, 2009 12:48 pm
Full Name: Marco Novelli
Location: Asti - Italy
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by m.novelli » Dec 15, 2010 10:45 am

I've updated this customer to Veeam 5.0.1 yesterday, I'll wait the weekend to have a new transformation process and I'll send the logs to Veeam Support

Regarding VRB files generated from transformation process, is correct that are not compressed? This is a quite bit waste of disk space

Marco

Gostev
SVP, Product Management
Posts: 23879
Liked: 3213 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by Gostev » Dec 15, 2010 11:39 am

Everything is compressed if you have compression enabled (which is the default setting). That includes VRB, VBK and VIB. You may want to do active full backup on existing 5.0 job though, because 5.0 had a bug resulting in VBK growth during transform, and as you know VBK cannot shrink itself without full backup (can only reuse unused blocks).

m.novelli
Veeam ProPartner
Posts: 346
Liked: 40 times
Joined: Dec 29, 2009 12:48 pm
Full Name: Marco Novelli
Location: Asti - Italy
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by m.novelli » Dec 15, 2010 12:02 pm

Right, last weekend my VBK growth from 950 GB to 1200 GB during transformation and I was wondering why!

You are guru

Marco

Gostev
SVP, Product Management
Posts: 23879
Liked: 3213 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by Gostev » Dec 15, 2010 12:21 pm

Nah, I just read release notes for 5.0.1 ;)

ctchang
Expert
Posts: 115
Liked: 1 time
Joined: Sep 15, 2010 3:12 pm
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by ctchang » Dec 20, 2010 10:14 am

Sorry to interrupt, but where can I see dedup/compression ratio in the backup result report?
I couldn't find it anywhere. :cry:

Vitaliy S.
Product Manager
Posts: 22140
Liked: 1382 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by Vitaliy S. » Dec 20, 2010 10:22 am

Jack, just navigate to Backups, choose any backup job on the right pane and then click Properties, everything you need should be right there :wink:

ctchang
Expert
Posts: 115
Liked: 1 time
Joined: Sep 15, 2010 3:12 pm
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by ctchang » Dec 20, 2010 10:28 am

Vitaliy S. wrote:Jack, just navigate to Backups, choose any backup job on the right pane and then click Properties, everything you need should be right there :wink:
Thanks, but I was really asking where can I find the compression ratio in my backup result?
ie, after a job is completed, there is a reported compression ratio as described by the one who started this post.

Vitaliy S.
Product Manager
Posts: 22140
Liked: 1382 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by Vitaliy S. » Dec 20, 2010 10:54 am

Oh... I see, but compression and deduplication ratios can only be observed in the backup properties and not in the sessions history, that is why you couldn't find it.

Gostev
SVP, Product Management
Posts: 23879
Liked: 3213 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by Gostev » Dec 20, 2010 1:16 pm

ctchang wrote:Sorry to interrupt, but where can I see dedup/compression ratio in the backup result report?
I couldn't find it anywhere. :cry:
Actually, we have already discussed this with you just 1 month ago here.

ctchang
Expert
Posts: 115
Liked: 1 time
Joined: Sep 15, 2010 3:12 pm
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by ctchang » Dec 20, 2010 1:31 pm

Gostev wrote: Actually, we have already discussed this with you just 1 month ago here.
wow...I almost forgot it after busy with our vmw project for the past months.
Your memory must be huge to fit in all the little details. :lol:
Thanks again. :o

m.novelli
Veeam ProPartner
Posts: 346
Liked: 40 times
Joined: Dec 29, 2009 12:48 pm
Full Name: Marco Novelli
Location: Asti - Italy
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by m.novelli » Dec 27, 2010 11:56 am

Gostev wrote:Hi Marco, please see here for the explanation.

Also, please note that transformation process can be fully offloaded to target when backing up to Linux target, thus it will not be affecting your backup server. If the customer is using version 5.0.1, we would be interested to take a look at transformation log to see what makes the transformation run so long. Thanks!
After updating to Veeam 5.0.1 the transformation process took 32 hours for a 1,1 TB VBK file

I'll send the logs to support

Marco

m.novelli
Veeam ProPartner
Posts: 346
Liked: 40 times
Joined: Dec 29, 2009 12:48 pm
Full Name: Marco Novelli
Location: Asti - Italy
Contact:

Re: Interpreting statistics about compression and deduplicat

Post by m.novelli » Dec 27, 2010 3:21 pm

I've opened the ticket ID#547864

Marco

Post Reply

Who is online

Users browsing this forum: Majestic-12 [Bot] and 42 guests