Best Practice for MS Server 2012 DeDup Repo

Availability for the Always-On Enterprise

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby lightsout » Wed Jan 20, 2016 8:34 pm

I'm upgrading too, but at least in concept, I would say yes. Bitlooker should be turned on though!
lightsout
Expert
 
Posts: 188
Liked: 48 times
Joined: Thu Apr 10, 2014 4:13 pm

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby foggy » Thu Jan 21, 2016 12:10 pm

Currently there're no contraindications to using Windows deduplication on scale-out repository extents.
foggy
Veeam Software
 
Posts: 15303
Liked: 1133 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby lightsout » Thu Jan 21, 2016 2:24 pm

I guess the other interesting one is per-VM VBKs. I don't see this increasing the de-dup ratio, but more smaller VBK is probably a better situation than fewer very large VBKs due to the processing time for each time.
lightsout
Expert
 
Posts: 188
Liked: 48 times
Joined: Thu Apr 10, 2014 4:13 pm

[MERGED] v9 and Windows Repository with Dedupe enabled

Veeam Logoby asris » Wed Jan 27, 2016 5:07 pm

We're currently implementing v9. We have a Windows2KR2 proxy with a repository on a 2TB volume that is dedupe enabled.

When I create a backup job and point it to that repository can I just use the defaults settings? Or is there a preferred configuration for that type of repository?
asris
Novice
 
Posts: 6
Liked: 2 times
Joined: Wed Jan 13, 2016 8:53 pm
Full Name: ASRIS

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby foggy » Wed Jan 27, 2016 5:15 pm

You can find settings recommended for Windows dedupe repository in this thread.
foggy
Veeam Software
 
Posts: 15303
Liked: 1133 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby asris » Wed Jan 27, 2016 11:02 pm 1 person likes this post

Thanks Foggy. I found the KB2023 which recommends formatting the volume with the /L switch and allocation size of 64K which is similar to what i've seen on this thread. I also don't see any mention of Storage compatibility settings or Backup job settings. For me, I only select to "decompress before storing". It would be great for Veeam to optimize the setting choices when adding a Windows dedupe repository.

Anyhow, our setup consists of backup jobs storing on a 2TB Windows volume with 7-14 restore points. I have a backup copy job that copies those backups to an onsite Data Domain. I have a another backup copy job that copies the backups to an offsite Data Domain.

So is it even worth it to enable the Deduplication on the Windows volume? My only concern is its affect on Instant VM recovery performance.
asris
Novice
 
Posts: 6
Liked: 2 times
Joined: Wed Jan 13, 2016 8:53 pm
Full Name: ASRIS

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby foggy » Thu Jan 28, 2016 12:11 pm

asris wrote:I also don't see any mention of Storage compatibility settings or Backup job settings.

You can find other recommended settings in this thread as well, for example, in this post.

asris wrote:So is it even worth it to enable the Deduplication on the Windows volume? My only concern is its affect on Instant VM recovery performance.

Indeed, having deduplication on the primary storage does not comply with our general recommendations.
foggy
Veeam Software
 
Posts: 15303
Liked: 1133 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby Choodee » Sat Feb 27, 2016 5:47 pm

Great thread. What is the recommended setting for creating a new backup repository on a windows server 2012 dedup volume? Should the options below be checked?

Align backup file data blocks
Decompress Backup Data Block before storing

Thanks
Choodee
Influencer
 
Posts: 18
Liked: 3 times
Joined: Sat Mar 03, 2012 4:30 pm
Full Name: Sandee Dela Cruz

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby Gostev » Sat Feb 27, 2016 7:39 pm

No, since Windows uses variable block size for dedupe.
Yes, otherwise you will get no dedupe at all.
Gostev
Veeam Software
 
Posts: 21622
Liked: 2411 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby Choodee » Sat Feb 27, 2016 8:58 pm 3 people like this post

I just wanted to summarize what I found useful in this thread for others who are combing through. Thank you everyone for their contribution.

I read through the whole thing and summarized to the following important points.
veeam-backup-replication-f2/best-practice-for-ms-server-2012-dedup-repo-t14002-165.html

Window Server 2012 Dedup Best Practice:

Format the Windows Server Volume by using 'Large File Records'
https://www.veeam.com/kb2023

1. It is important to format the volume with large NTFS File Record Segment (FRS) (4096 bytes instead of 1024 by default) as you could face NTFS limitation errors in future. You could verify FRS size with the following command:
fsutil fsinfo ntfsinfo <volume pathname>

Command to reformat NTFS volume with larger FRS (/L):
format <volume pathname> /L

2. Use maximum NTFS allocation unit size(cluster size) of 64Kb.
Considering option mentioned in pt. 1, two commands should be united into one:
format <volume pathname> /A:64K /L

3. Avoid growth of files more than 1TB;
4. For Backup jobs preferred backup method is Forward Incremental with Active Full backups enabled. (Forever Incremental will also work since synthetic fulls are automatically created when the last retention point is met and rolled up).

Veeam Settings:

Backup Repository:
No - Align backup file data blocks
Yes - Decompress Backup Data Block before storing

Backup/Backup Copy/Replication Jobs:
Enable inline data deduplication - Yes
Exclude swap file blocks from processing - Yes
​Compression Level - None
Storage Optimization - LAN target

Veeam Notes:
Format the disk using the command line "/L" for "large size file records".
Also format using 64KB cluster size.
Use Windows 2012 R2. Apply all patches as some rollups have improvements to dedup.
Use Active full jobs with Incrementals or Forever Incrementals.
Turn Veeam's compression to "None" and use the "LAN target" block size. Veeam's inline deduplication can stay on.
Windows Server Dedup Notes:
Modify the garbage collection schedule to run daily rather than weekly.
Try to keep your VBK files below 1TB in size - Microsoft doesn't official support files bigger than this. Large files take a long time to dedup and will have to be fully reprocessed if the process is interrupted.
Use multiple volumes, where possible. Windows dedup is single threaded, but it can process multiple volumes at once. Although bigger volumes mean better dedup ratios!
Configure your dedup process to run once a day, and for as long as possible.
Choodee
Influencer
 
Posts: 18
Liked: 3 times
Joined: Sat Mar 03, 2012 4:30 pm
Full Name: Sandee Dela Cruz

[MERGED] : MS Windows 2012R2 deduplication compression setti

Veeam Logoby HussainMahfood » Tue May 03, 2016 12:57 pm

Hi,

I have Dedupe-friendly compression in a daily job backup setting to MS WIndows 2012 R2 De-duplication as best practice.

My question if I change this to High compression would I still benefit from deduplcation or not?



Note: I know that High compression will effect 10x higher CPU usage which I do not care about
HussainMahfood
Enthusiast
 
Posts: 35
Liked: 7 times
Joined: Mon Jun 24, 2013 9:43 am
Full Name: Hussain Mahfood

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby foggy » Tue May 03, 2016 1:06 pm

The higher compression level, the lower deduplication ratio you will get for the backup files.
foggy
Veeam Software
 
Posts: 15303
Liked: 1133 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby v.Eremin » Tue May 03, 2016 1:08 pm

The deduplication will still be there, though its rates are likely to be affected negatively. So, I don't think it's worth it. Thanks.
v.Eremin
Veeam Software
 
Posts: 13734
Liked: 1027 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby lightsout » Tue May 03, 2016 1:13 pm

Agreed. I think Windows' dedup does better without any compression from my testing.
lightsout
Expert
 
Posts: 188
Liked: 48 times
Joined: Thu Apr 10, 2014 4:13 pm

Re: Best Practice for MS Server 2012 DeDup Repo

Veeam Logoby HussainMahfood » Tue May 03, 2016 1:18 pm

As I would need to offload these files later to a tape backup.

if these files are uncompressed in the deduplication then will be offloaded uncompressed to backup to tape job
HussainMahfood
Enthusiast
 
Posts: 35
Liked: 7 times
Joined: Mon Jun 24, 2013 9:43 am
Full Name: Hussain Mahfood

PreviousNext

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot] and 1 guest