ReFS 3.1 goodies and Scale Out Repositories

Availability for the Always-On Enterprise

ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby dkvello » Fri Nov 18, 2016 4:41 pm

So, how does this work when You use scale out repo's ?
Particularly together with the Performance Policy option.
dkvello
Service Provider
 
Posts: 90
Liked: 8 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Oslo, Norway
Full Name: Dag Kvello

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby dellock6 » Fri Nov 18, 2016 5:05 pm 1 person likes this post

I suggest to stick to data locality mode, otherwise you may lose the benefits of block cloning for synthetic fulls, as block still have to be physically moved from one extent to the other. Think about sobr+refs exactly like grouping multiple dedup appliances like datadomain or storeonce in a sobr, it can be done, but the benefits of block cloning are there only if the entire chain is in the same repository.
Other than that, SOBR with multiple refs extents is a great design, probably only second to the use of Storage Space Direct.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5047
Liked: 1330 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby dkvello » Fri Nov 18, 2016 5:21 pm

I had my suspicions :-)
So, S2D with ReFS 3.1 is preferable to Scale Out repo's in 9.5 ?
dkvello
Service Provider
 
Posts: 90
Liked: 8 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Oslo, Norway
Full Name: Dag Kvello

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby tsightler » Fri Nov 18, 2016 5:34 pm

Simple answer: it doesn't! :)

More complex answer, obviously to be able to use block clone the blocks have to be on the same ReFS volume. Since SOBR represents extents of different storage, there's no real way to take advantage of ReFS enhanced synthetics with this configuration. To use ReFS + SOBR it's highly recommend to use data locality policy, however, even in this case there's a few things to look out for, specifically, if any extent fills up, and backups are redirected to other nodes, you will lose the enhanced capabilities for merge and/or GFS. Also, if you evacuate nodes, block clone is not preserved, so if you have mulitple block cloned synthetic fulls in a chain, they will require space for each full in the target.
tsightler
Veeam Software
 
Posts: 4769
Liked: 1737 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby tsightler » Fri Nov 18, 2016 5:37 pm

dkvello wrote:So, S2D with ReFS 3.1 is preferable to Scale Out repo's in 9.5 ?

Just remember that it has it's own limitations, like nodes have to be very similar, and all backup data within a single share has to traverse in/out via the owner node, so you can't fully exploit the bandwidth of all nodes without also creating shares spread across multiple nodes, but then you'd still need separate repos (potentially aggregated with SOBR) for these shares and block clone won't work across these separate extents either.
tsightler
Veeam Software
 
Posts: 4769
Liked: 1737 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby dkvello » Fri Nov 18, 2016 6:21 pm

Yeah, so it's a bit of back to square one again. To get scalability (both size and parallel I/O) AND all ReFS goods I have to move away from both Scale Out Repo's (both Locality and Performance policies) and S2D and start "partioning" my backup-jobs again. These jobs to that single-volume repository and so forth.

I consider the "One node does all the writing" topology of S2D a major design-flaw of a scale-out storage system.
dkvello
Service Provider
 
Posts: 90
Liked: 8 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Oslo, Norway
Full Name: Dag Kvello

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby Gostev » Fri Nov 18, 2016 8:20 pm

dkvello wrote:To get scalability (both size and parallel I/O) AND all ReFS goods I have to move away from both Scale Out Repo's

Why move away from SOBR? With per-VM chains and Data Locality policy you gets both scalability AND ReFS goods.
Gostev
Veeam Software
 
Posts: 21396
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby dkvello » Mon Nov 21, 2016 9:43 am

Well, If i wanted to use S2D I would have to.

I'll drop S2D and switch my Performance SOBR to Locality SOBR and use ReFS 3.1 - I allready user per-vm chains.
dkvello
Service Provider
 
Posts: 90
Liked: 8 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Oslo, Norway
Full Name: Dag Kvello

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby dellock6 » Mon Nov 21, 2016 1:10 pm

There is still a design case for S2D and SOBR together, let me explain quickly: with S2D, even if you have a scale-out cluster, one volume is owned at a given point by only one of the nodes, so CPU and Memory used to run that volume is comparable to a single SS server, with "just" mode disk space in the backend coming from the other nodes. A suggestion for the design is to create at a minimum the same amount of volumes as the number of nodes you have. This is because S2D technology will automatically spread the ownership of the volumes to every possible node. So say you have 4 nodes and 4 volumes, each node at a given point in time will own a volume. In this way you will be able to leverage the compute power of the entire cluster.

But then you have again 4 different volumes, and here is where SOBR comes into play to aggregate those volumes into the same entity.

Luca
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5047
Liked: 1330 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby tsightler » Mon Nov 21, 2016 5:24 pm

I have exactly this setup in my lab, but I'd say it sounds better in theory than practice. The problem with this model is that you can't really aggregate the space, you still end up with 4 different volumes, and if SOBR fills up one of those volumes and spills over to another, the benefits of ReFS block clone are lost and then you risk even more space when the next synthetic operation occurs. Effectively, you lose the ability to leverage block clone across the entirety of the storage, and instead can only use it within sub-pools of that storage, and you risk possible cascading effects if any one extent overruns. At that point it's difficult to understand how S2D + SOBR is better than just standalone servers + SOBR, other than some obvious availability advantages if you were to lose a node.
tsightler
Veeam Software
 
Posts: 4769
Liked: 1737 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby dellock6 » Mon Nov 21, 2016 8:01 pm

Indeed the choice is a bit hard to do, I see two advantages in this design tough:
- being able to expand a volume via scaling-out and still keep the single namespace, but with SOBR and per-vm chains this is becoming less a problem
- redundancy, has I have multiple copies of the blocks spread over the S2D cluster, while SOBR is more a federation of single storage systems, but at any point in time I only have one copy of the data. But again, storage spaces with mirror or parity and integrity streams makes this issue less a problem.

For now I'm suggesting multiple single storage spaces machines grouped together with SOBR. Also because, the other issue is that this latter design only requires Windows 2016 standard edition, while S2D needs the Datacenter edition. It's not a HUGE difference, but still it's a difference that may impact some customer design.
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5047
Liked: 1330 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby tsightler » Mon Nov 21, 2016 11:25 pm

Sure, I agree on the redundancy/availability, but don't follow regarding a single namespace as what we are specifically talking about is that you need a volume for every node so expanding via scale out requires adding a volume, and thus adding a new namespace, not expanding an existing one, unless you decide you don't care about using the new node for ingest.

I see potential in the design, but it's just not quite ideal. If Veeam could run the repo agents on the nodes directly, and target the local CSV on each node, now then we'd have something! I actually tried to do this, but Veeam is confused by the CSV and thinks it has no space, and even so, without some enhancements it wouldn't know it was the same ReFS volume and could leverage block clone.
tsightler
Veeam Software
 
Posts: 4769
Liked: 1737 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby DaStivi » Thu Jan 19, 2017 3:02 pm

Hi, how is REFS Block cloning behaving when using dynamic disks in windows, and extending the disks with new refs volumes?

when extending an sobr with a new refs volume, and choosing "Data locality", will the next backup will be than a full when the space on the 1st volume is full?
DaStivi
Enthusiast
 
Posts: 50
Liked: 4 times
Joined: Tue Jun 30, 2015 9:13 am
Full Name: Stephan Lang

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby Gostev » Fri Jan 20, 2017 1:43 am

All ReFS goodies are within a single ReFS volume only.
Gostev
Veeam Software
 
Posts: 21396
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: ReFS 3.1 goodies and Scale Out Repositories

Veeam Logoby DaStivi » Fri Jan 20, 2017 7:10 am

ok thx... i thougt that...

and what about sobr and the policies, hows Veeam behaving when one extend is getting full on disk space, is Veeam dooing a new full on the next extend and then utilize the refs goodies again on next incr. backup?
DaStivi
Enthusiast
 
Posts: 50
Liked: 4 times
Joined: Tue Jun 30, 2015 9:13 am
Full Name: Stephan Lang

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: dgapinski, vishalgupta and 29 guests