Comprehensive data protection for all workloads
HendersonD
Expert
Posts: 118
Liked: 4 times
Joined: Jul 23, 2011 12:35 am

ReFS for repository, best practice?

Post by HendersonD » Aug 07, 2018 11:56 am

I started reading through several very long threads on this forum about using ReFS for a Veeam repository. I had a hard time gleaning current best practice around using ReFS. I have a Nimble CS300 array that I will use to present a LUN to our physical proxy server which is running Windows Server 2016 build 1607.
  1. When I go to mount and format this LUN on the Windows server, what cluster size should I choose?
  2. We currently backup to a LUN presented to this same Windows 2016 server but this LUN is formatted NTFS. Are there different settings from within Veeam I should be using if the target is ReFS as opposed to NTFS?
  3. Lastly, is ReFS ready for production? Stable?

Mike Resseler
Product Manager
Posts: 5457
Liked: 574 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: ReFS for repository, best practice?

Post by Mike Resseler » Aug 07, 2018 12:28 pm

Hi HendersonD,

1. We advice 64k as clustersize
2. No. Once you create a repository on that ReFS lun, veeam will detect it and use it if possible
3. Yes, and no. Yes: All patches applied, enough RAM/CPU to the server and not petabytes of data. Microsoft is still working on some fixes that will come but no idea when. The major issues however seem to be gone

HendersonD
Expert
Posts: 118
Liked: 4 times
Joined: Jul 23, 2011 12:35 am

Re: ReFS for repository, best practice?

Post by HendersonD » Aug 07, 2018 2:09 pm

We backup a total of 5.5TB so the amount is not huge. Our new physical proxy server has 2 CPUs with 16 cores each running at 2.6GHz, 64GB RAM, and 10 gig network connection. It sounds like we are fine here

We use the following settings for our current backup job for Windows VMs to an NTFS formatted volume. When we go to ReFS, none of these should change, correct?
  1. Forever forward incremental with a 30 day retention
  2. Backup file health check once a month
  3. Removed deleted items after 14 days and defragment/compact full backup once a month
  4. Compression level optimal and Storage Optimization set to local target
  5. Change block tracking enabled
  6. Backup from storage snapshots enabled since we have a Nimble array
  7. Application aware processing is enabled

Gostev
SVP, Product Management
Posts: 24017
Liked: 3254 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: ReFS for repository, best practice?

Post by Gostev » Aug 07, 2018 3:54 pm

You don't need any changes. But you will have more flexibility around backup modes, for example enabling periodic synthetic fulls will not require extra disk space with ReFS. Which in turn removes the need to do periodic defragment/compact (as synthetic full does it implicitly).

Pretty much the only concern when switching to ReFS is the amount of RAM on the backup repository server, which you have plenty for your data size.

HendersonD
Expert
Posts: 118
Liked: 4 times
Joined: Jul 23, 2011 12:35 am

Re: ReFS for repository, best practice?

Post by HendersonD » Aug 07, 2018 4:07 pm

So it sounds like I should turn off defragment/compact full backup entirely and do a synthentic full. If I have a 30 day retention, how often should I do a synthetic full? Once a week?

Gostev
SVP, Product Management
Posts: 24017
Liked: 3254 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: ReFS for repository, best practice?

Post by Gostev » Aug 07, 2018 4:47 pm

Most users do it once a week on the weekend.

HendersonD
Expert
Posts: 118
Liked: 4 times
Joined: Jul 23, 2011 12:35 am

Re: ReFS for repository, best practice?

Post by HendersonD » Aug 07, 2018 4:52 pm

Perfect, thanks for the help. The only trouble we will have is storage space. I need to create a new LUN on our Nimble array and connect it to our physical proxy server. I will format this volume as ReFS and can point backup jobs to it. Unfortunately right now I do not have enough space on our Nimble array to create a volume of the size I need. Of course the current volume on the Nimble array (NTFS on proxy) will completely go away eventually. As I transition I need to have both LUNs in place.

Jeff M
Influencer
Posts: 16
Liked: 1 time
Joined: Jan 13, 2015 4:31 am
Full Name: Jeffrey Michael James
Location: 8th Street & Boston Avenue Box 43051 Lubbock, TX 79409-3051
Contact:

Re: ReFS for repository, best practice?

Post by Jeff M » Aug 13, 2018 2:39 am

Ok, no need to defrag & compact using REFS & Synthetics. What about storage level protection guard? I am running 64k Cluster REFS on Dell FC Storage. My repos are all SOBR and this is our built out Win & Linux Agent backup system. I thought I remember reading REFS does self healing of corruption - like storage level protection guard. Is there a need for health checks running REFS? :?:

Jeff J
Jeff M. James
Data Center Operations
Technology Operations & Systems Management
Texas Tech University System
Office: (806) 834-4407 | Mobile: (806) 535-4228
jeff.james@ttu.edu | http://www.texastech.edu/it/tosm/

Mike Resseler
Product Manager
Posts: 5457
Liked: 574 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: ReFS for repository, best practice?

Post by Mike Resseler » Aug 13, 2018 4:59 am

Jeff,

REFS will find corruption indeed. But self-healing depends on how it is deployed. It can only do self-healing in a storage spaces or storage spaces direct scenario. So keep that in mind. Another reason why we always work with the 3-2-1 rule. So make sure that your primary backups located on the ReFS repository are also being copied somewhere else

HendersonD
Expert
Posts: 118
Liked: 4 times
Joined: Jul 23, 2011 12:35 am

Re: ReFS for repository, best practice?

Post by HendersonD » Aug 13, 2018 8:07 am

I have a Nimble array that I will be using to present a LUN to my physical Veeam proxy server via iSCSI. This will be a mapped drive to this proxy server which runs Windows Server 2016. Under ReFS will "Storage=level corruption guard" work? Under my backup jobs right now using NTFS I have the "Perform backup files health check" checked and schedule of once a month.

gummett
Veeam Software
Posts: 29
Liked: 5 times
Joined: Jan 30, 2017 9:23 am
Full Name: Ed Gummett
Contact:

Re: ReFS for repository, best practice?

Post by gummett » Aug 13, 2018 11:58 am

One more thing to bear in mind if you’re using SAN storage for repos: unmap isn’t available for ReFS. So your volume will become thick-provisioned over time and you will not be able to reclaim unused space.
Ed Gummett
Systems Engineer UK & Ireland
Veeam Software

HendersonD
Expert
Posts: 118
Liked: 4 times
Joined: Jul 23, 2011 12:35 am

Re: ReFS for repository, best practice?

Post by HendersonD » Aug 13, 2018 2:18 pm

Without unmap is ReFS even a good choice for repos? We keep 30 days worth of backups through Veeam but it sounds like over a 6-8 month time period we could actually fill the repo is the space that was used for backups that are long gone (older than 30 days) is never freed up

kennyb
Service Provider
Posts: 3
Liked: never
Joined: Apr 05, 2017 9:34 pm
Full Name: Ken Barhite
Contact:

Re: ReFS for repository, best practice?

Post by kennyb » Aug 13, 2018 4:11 pm

Should compression level be set to "Dedupe friendly". I thought I read somewhere that is recommended for ReFS.

Mike Resseler
Product Manager
Posts: 5457
Liked: 574 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: ReFS for repository, best practice?

Post by Mike Resseler » Aug 14, 2018 5:23 am

@Ken,

I actually see no reason to use Dedupe Friendly when you land you backups on a ReFS repository. The recommendation would be to create a full backup there first, then incrementals with synthetic full in between (as Gostev said, once a week is used a lot).

@HendersonD: I misread something yesterday. We do advice to leave storage-level corruption guard on. It might look like overkill but hey... They are your backup files :-). Only when you run it in S2D or classic storage spaces I think it is not needed

HendersonD
Expert
Posts: 118
Liked: 4 times
Joined: Jul 23, 2011 12:35 am

Re: ReFS for repository, best practice?

Post by HendersonD » Aug 16, 2018 3:04 pm

I have just about everything configured on my ReFS repository and my new backup jobs that point towards this repository. Just need help with two last settings
  1. Under repository settings should I enable "Use per-VM backup files"? I have a Nimble storage array where I have carved out a LUN. This LUN is presented to my physical proxy server running Windows Server 2016. After formatting as ReFS with 64K block size it shows as the F: drive on this server. There are two iSCSI 10 gig connections from the proxy server to this datastore
  2. On the backup job under Storage...Advanced...Storage tab is the compression level setting. The choices are None, Dedup-friendly, Optimal (recommended), High, and Extreme. Which one should I choose? I am not using the dedup built into our proxy server under Windows Server 2016

Post Reply

Who is online

Users browsing this forum: Google [Bot], Karinne and 23 guests