Comprehensive data protection for all workloads
allankjaer
Service Provider
Posts: 12
Liked: never
Joined: Apr 09, 2014 9:11 am
Full Name: Allan Kjaer
Contact:

ReFS 3.0 and Dedup

Post by allankjaer » Jan 26, 2019 11:38 am

In the what's new document for Veeam B&R 9.5 Update 4 is says:

Added experimental support for block cloning on deduplicated files for Windows Server 2019 ReFS. To enable this functionality,
create ReFSDedupeBlockClone (DWORD) value under HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication
registry key on the backup server.

But what value should the reg (DWORD) have?

Gostev
SVP, Product Management
Posts: 23652
Liked: 3127 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: ReFS 3.0 and Dedup

Post by Gostev » Jan 27, 2019 12:56 am

1

kghague-ccx
Lurker
Posts: 1
Liked: never
Joined: Jan 31, 2019 5:44 pm
Full Name: Karl Hague
Contact:

Re: ReFS 3.0 and Dedup

Post by kghague-ccx » Jan 31, 2019 5:47 pm

And this is set on each Repo server which has a deduped ReFS volume or only the primary backup server?

Gostev
SVP, Product Management
Posts: 23652
Liked: 3127 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: ReFS 3.0 and Dedup

Post by Gostev » Jan 31, 2019 9:25 pm

This is only on the backup server.

jrick
Service Provider
Posts: 21
Liked: 1 time
Joined: Jan 31, 2018 9:31 am
Full Name: Julien Rick
Location: Luxembourg
Contact:

Re: ReFS 3.0 and Dedup

Post by jrick » Feb 06, 2019 8:47 am

I'm currently testing ReFS with Dedup on server 2019, I have added the ReFSDedupeBlockClone DWORD value to my backup server (Win server 2016).
My test job is configured to create a daily synth full but don't use the block clone feature.

An idea why?

doktornotor
Enthusiast
Posts: 31
Liked: 8 times
Joined: Mar 07, 2018 12:57 pm
Contact:

Re: ReFS 3.0 and Dedup

Post by doktornotor » Feb 06, 2019 3:39 pm 1 person likes this post

Probably because it requires Server 2019? :idea:

HannesK
Veeam Software
Posts: 2354
Liked: 282 times
Joined: Sep 01, 2014 11:46 am
Location: Austria
Contact:

Re: ReFS 3.0 and Dedup

Post by HannesK » Feb 06, 2019 3:56 pm

correct, that key is only working on Windows 2019

DonZoomik
Enthusiast
Posts: 92
Liked: 20 times
Joined: Nov 25, 2016 1:56 pm
Contact:

Re: ReFS 3.0 and Dedup

Post by DonZoomik » Feb 06, 2019 7:07 pm 1 person likes this post

On WS2019 I saw it already working on one very short chain. Wasn't particularly fast but there's a lot of IO load going on.

DonZoomik
Enthusiast
Posts: 92
Liked: 20 times
Joined: Nov 25, 2016 1:56 pm
Contact:

Re: ReFS 3.0 and Dedup

Post by DonZoomik » Feb 10, 2019 1:17 pm

I hit my first compact and it seems that fast clone is not fast on deduplicated ReFS. It's seems to just copy (not clone - free space on volume is reducing about as fast) blocks to new file and target file is not deduplicated (size on disk = size).
Currently I'd say that it's no faster (if not slower) than NTFS deduplication-based compact.

DonZoomik
Enthusiast
Posts: 92
Liked: 20 times
Joined: Nov 25, 2016 1:56 pm
Contact:

Re: ReFS 3.0 and Dedup

Post by DonZoomik » Feb 11, 2019 8:33 am

I hit a bigger compact and it's just as slow as with NTFS deduplication, about 6 hours to compact ~2,5TB of VBKs.
Is this expected? ReFS volume was created on WS2019, chain was restarted using active full on WS2019 on ReFS (eg all data has always been on this ReFS volume) and job log shows that "[fast clone]" is being utilized.

HannesK
Veeam Software
Posts: 2354
Liked: 282 times
Joined: Sep 01, 2014 11:46 am
Location: Austria
Contact:

Re: ReFS 3.0 and Dedup

Post by HannesK » Feb 11, 2019 8:36 am

Hello,
if the job log says that "fast clone" is used, then it seems unexpected to me. Could you please open a support case and share the case number here?

Thanks,
Hannes

DonZoomik
Enthusiast
Posts: 92
Liked: 20 times
Joined: Nov 25, 2016 1:56 pm
Contact:

Re: ReFS 3.0 and Dedup

Post by DonZoomik » Feb 11, 2019 9:55 am

#03408303

j.forsythe
Influencer
Posts: 15
Liked: 4 times
Joined: Jan 06, 2016 10:26 am
Full Name: John P. Forsythe
Contact:

Re: ReFS 3.0 and Dedup

Post by j.forsythe » Feb 12, 2019 2:22 pm

Hi.
What is the file size limit for ReFS + DeDup at Server 2019?
Thank you!
:)

DonZoomik
Enthusiast
Posts: 92
Liked: 20 times
Joined: Nov 25, 2016 1:56 pm
Contact:

Re: ReFS 3.0 and Dedup

Post by DonZoomik » Feb 12, 2019 2:31 pm

Only first 4TB of a file is processed by deduplication but there is no hard file size limit. 64TB volume limit places some practical limits though.

YoMarK
Enthusiast
Posts: 40
Liked: 2 times
Joined: Jul 13, 2009 12:50 pm
Full Name: Mark
Location: The Netherlands
Contact:

Re: ReFS 3.0 and Dedup

Post by YoMarK » Feb 15, 2019 2:16 pm

What is to be expected with ReFS 3.0(with dedup) on Windows 2019 compared to ReFS 2016/2019 without dedup in a case where you use per-VM backups and everything fast-clone/Syntectic full's?
As I expect offline duplication now also is able to dedup the whole volume instead of only the backup chain(fast clone), but does someone know how effective it really is in this scenario? Veeam: some lab test you are willing to share? :)

Post Reply

Who is online

Users browsing this forum: Majestic-12 [Bot], olso and 32 guests