-
- Veeam ProPartner
- Posts: 564
- Liked: 103 times
- Joined: Dec 29, 2009 12:48 pm
- Full Name: Marco Novelli
- Location: Asti - Italy
- Contact:
Interpreting statistics about compression and deduplication
Hi friends, some questions about compression and deduplication statistics regarding a backup job with incremental mode and transformation of previous full backups chains into rollbacks:
- what means a deduplication ratio of 99% for incremental backups? It means really high dedupe or no dedupe?
- compression ratio for VRB files generated from transformation is 100%, that means no compression? On disk I can see that VRB files are near the double than VIB files
A side note: transformation of previous full backups chains into rollbacks for a 1TB VBK file took about 23 hours on this Veeam Backup Server (Dell R710 with 4 vCPU Intel E5620, VBK located on an iSCSI Dell MD3000i with SATA hard drives). For this customer is not a big issue, but I have other customer with bigger HW infrastructures where a so long transformation time will be unacceptable considering that in the meanwhile the Veeam Backup would process other jobs
Thanks for any explanation
Marco
- what means a deduplication ratio of 99% for incremental backups? It means really high dedupe or no dedupe?
- compression ratio for VRB files generated from transformation is 100%, that means no compression? On disk I can see that VRB files are near the double than VIB files
A side note: transformation of previous full backups chains into rollbacks for a 1TB VBK file took about 23 hours on this Veeam Backup Server (Dell R710 with 4 vCPU Intel E5620, VBK located on an iSCSI Dell MD3000i with SATA hard drives). For this customer is not a big issue, but I have other customer with bigger HW infrastructures where a so long transformation time will be unacceptable considering that in the meanwhile the Veeam Backup would process other jobs
Thanks for any explanation
Marco
-
- Chief Product Officer
- Posts: 31800
- Liked: 7298 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Interpreting statistics about compression and deduplicat
Hi Marco, please see here for the explanation.
Also, please note that transformation process can be fully offloaded to target when backing up to Linux target, thus it will not be affecting your backup server. If the customer is using version 5.0.1, we would be interested to take a look at transformation log to see what makes the transformation run so long. Thanks!
Also, please note that transformation process can be fully offloaded to target when backing up to Linux target, thus it will not be affecting your backup server. If the customer is using version 5.0.1, we would be interested to take a look at transformation log to see what makes the transformation run so long. Thanks!
-
- Veeam ProPartner
- Posts: 564
- Liked: 103 times
- Joined: Dec 29, 2009 12:48 pm
- Full Name: Marco Novelli
- Location: Asti - Italy
- Contact:
Re: Interpreting statistics about compression and deduplicat
I've updated this customer to Veeam 5.0.1 yesterday, I'll wait the weekend to have a new transformation process and I'll send the logs to Veeam Support
Regarding VRB files generated from transformation process, is correct that are not compressed? This is a quite bit waste of disk space
Marco
Regarding VRB files generated from transformation process, is correct that are not compressed? This is a quite bit waste of disk space
Marco
-
- Chief Product Officer
- Posts: 31800
- Liked: 7298 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Interpreting statistics about compression and deduplicat
Everything is compressed if you have compression enabled (which is the default setting). That includes VRB, VBK and VIB. You may want to do active full backup on existing 5.0 job though, because 5.0 had a bug resulting in VBK growth during transform, and as you know VBK cannot shrink itself without full backup (can only reuse unused blocks).
-
- Veeam ProPartner
- Posts: 564
- Liked: 103 times
- Joined: Dec 29, 2009 12:48 pm
- Full Name: Marco Novelli
- Location: Asti - Italy
- Contact:
Re: Interpreting statistics about compression and deduplicat
Right, last weekend my VBK growth from 950 GB to 1200 GB during transformation and I was wondering why!
You are guru
Marco
You are guru
Marco
-
- Chief Product Officer
- Posts: 31800
- Liked: 7298 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Interpreting statistics about compression and deduplicat
Nah, I just read release notes for 5.0.1
-
- Expert
- Posts: 115
- Liked: 1 time
- Joined: Sep 15, 2010 3:12 pm
- Contact:
Re: Interpreting statistics about compression and deduplicat
Sorry to interrupt, but where can I see dedup/compression ratio in the backup result report?
I couldn't find it anywhere.
I couldn't find it anywhere.
-
- VP, Product Management
- Posts: 27368
- Liked: 2799 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Interpreting statistics about compression and deduplicat
Jack, just navigate to Backups, choose any backup job on the right pane and then click Properties, everything you need should be right there
-
- Expert
- Posts: 115
- Liked: 1 time
- Joined: Sep 15, 2010 3:12 pm
- Contact:
Re: Interpreting statistics about compression and deduplicat
Thanks, but I was really asking where can I find the compression ratio in my backup result?Vitaliy S. wrote:Jack, just navigate to Backups, choose any backup job on the right pane and then click Properties, everything you need should be right there
ie, after a job is completed, there is a reported compression ratio as described by the one who started this post.
-
- VP, Product Management
- Posts: 27368
- Liked: 2799 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: Interpreting statistics about compression and deduplicat
Oh... I see, but compression and deduplication ratios can only be observed in the backup properties and not in the sessions history, that is why you couldn't find it.
-
- Chief Product Officer
- Posts: 31800
- Liked: 7298 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Interpreting statistics about compression and deduplicat
Actually, we have already discussed this with you just 1 month ago here.ctchang wrote:Sorry to interrupt, but where can I see dedup/compression ratio in the backup result report?
I couldn't find it anywhere.
-
- Expert
- Posts: 115
- Liked: 1 time
- Joined: Sep 15, 2010 3:12 pm
- Contact:
Re: Interpreting statistics about compression and deduplicat
wow...I almost forgot it after busy with our vmw project for the past months.Gostev wrote: Actually, we have already discussed this with you just 1 month ago here.
Your memory must be huge to fit in all the little details.
Thanks again.
-
- Veeam ProPartner
- Posts: 564
- Liked: 103 times
- Joined: Dec 29, 2009 12:48 pm
- Full Name: Marco Novelli
- Location: Asti - Italy
- Contact:
Re: Interpreting statistics about compression and deduplicat
After updating to Veeam 5.0.1 the transformation process took 32 hours for a 1,1 TB VBK fileGostev wrote:Hi Marco, please see here for the explanation.
Also, please note that transformation process can be fully offloaded to target when backing up to Linux target, thus it will not be affecting your backup server. If the customer is using version 5.0.1, we would be interested to take a look at transformation log to see what makes the transformation run so long. Thanks!
I'll send the logs to support
Marco
-
- Veeam ProPartner
- Posts: 564
- Liked: 103 times
- Joined: Dec 29, 2009 12:48 pm
- Full Name: Marco Novelli
- Location: Asti - Italy
- Contact:
Re: Interpreting statistics about compression and deduplicat
I've opened the ticket ID#547864
Marco
Marco
Who is online
Users browsing this forum: lando_uk and 188 guests