Comprehensive data protection for all workloads
Post Reply
AlexL
Service Provider
Posts: 88
Liked: 5 times
Joined: Aug 24, 2010 8:55 am
Full Name: Alex
Contact:

NTFS cluster size recommendation

Post by AlexL »

Is there a recommendation on the NTFS cluster size to use? I'm using 6.1 with a local/iSCSI repository on a NAS.
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: NTFS cluster size recommendation

Post by dellock6 »

Hi Alex, you mean the cluster size to be used in the storage to be used as local repository for Veeam backups? Interesting question, I never thought really about this issue, always used the default block size used by NTFS during first format. Do not know if changing the block size can increase backup performances.

Luca.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
AlexL
Service Provider
Posts: 88
Liked: 5 times
Joined: Aug 24, 2010 8:55 am
Full Name: Alex
Contact:

Re: NTFS cluster size recommendation

Post by AlexL »

defaults are not always the best, for block based SAN like our old EMC CX3-20 it's best to follow vendor guidelines, the seem to recommend 8K instead of the default 4K. For SQL or Exchange it's better to use 32K or even 64K. But I digress, I've done an initial format at 64K thinking that if VEEAM uses 1MB blocks for local storage I might as well use the largest cluster size. And no worries about slack either with the huge backup files.

Still, I'd like VEEAM to make an "official" statement regarding NTFS cluster size.

PS.. we use reverse incrementals with weekly transforms, perhaps that has special of different specs than normal daily backups
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: NTFS cluster size recommendation

Post by dellock6 »

Uhm, I do not think job types have specific block size configuration, since compression level and target type are configured anyway, regardless the kind of job you choose.

Luca.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: NTFS cluster size recommendation

Post by Vitaliy S. »

There are no NTFS cluster size recommendations you should follow for the backup repository servers. I would recommend using the default values.
joergr
Veteran
Posts: 391
Liked: 39 times
Joined: Jun 08, 2010 2:01 pm
Full Name: Joerg Riether
Contact:

Re: NTFS cluster size recommendation

Post by joergr »

Correct, leave it at default. Please also read http://www.tomshardware.co.uk/forum/267 ... ance-gains

Best regards,
Joerg
m.novelli
Veeam ProPartner
Posts: 504
Liked: 84 times
Joined: Dec 29, 2009 12:48 pm
Full Name: Marco Novelli
Location: Asti - Italy
Contact:

Re: NTFS cluster size recommendation

Post by m.novelli »

Hi guys, I would like to resurrect this thread talking about RAID cluster size for Veeam Backup repository

Generally I use Dell servers with H700 or H710 controllers and 2 TB SATA disks in RAID5 configuration. When configuring the RAID generally I use 512 KB or 1 MB cluster size, leaving later the NTFS cluster size at default Windows settings

What do you think? I use big cluster sizes at RAID level just because it seems right to me, but I've never studied deeper about that topic

Cheers :)

Marco
dellock6
Veeam Software
Posts: 6137
Liked: 1928 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: NTFS cluster size recommendation

Post by dellock6 »

Hi Marco,
for best performances you should align the raid cluster size to the file system you are going to use or a multiple of it to avoid unalignment. This is no more a problem from 2008 and above, since it rounds alignment with the initial 1024 kb block.

NTFS default is 4 kb , but only up to 16 Tb (2^64 clusters). Above it, you need to use larger blocks, up to the maximum of 64 kb. If the volume is dedicated to Veeam backups, you can also use a larger block size; you are not going to waste partially written blocks, since all files will be way larger than that value.
Honestly, I never did estensive tests on this configuration, but for Veeam backup storage I used 64kb raid blocks and 64kb NTFS blocks as a best practice, but I say it again with no validation by numbers. I would suspect performance increase would be anyway smaller if compared to other components as controller cache, ram, and compression/deduplication levels.

Luca.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Post Reply

Who is online

Users browsing this forum: Gostev and 155 guests