ReFS is getting dedup!

Availability for the Always-On Enterprise

ReFS is getting dedup!

Veeam Logoby nmdange » Fri Jul 14, 2017 3:23 am

From https://blogs.windows.com/windowsexperi ... TgQXWHW.97
Efficiency
Data Deduplication available for ReFS
New Data Deduplication DataPort API for optimized ingress/egress
Space efficiency with ReFS Compaction

So when is Veeam going to support the new api :lol:
nmdange
Expert
 
Posts: 203
Liked: 58 times
Joined: Thu Aug 20, 2015 9:30 pm

Re: ReFS is getting dedup!

Veeam Logoby Mike Resseler » Fri Jul 14, 2017 6:07 am

Lol... When it is ready :-D

Obviously we will look into this and look at the API's. But since this is a first preview, I guess it gives Veeam some time ;-)
Mike Resseler
Veeam Software
 
Posts: 3281
Liked: 365 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: ReFS is getting dedup!

Veeam Logoby dellock6 » Fri Jul 14, 2017 7:46 am

I'd prefer first to see blockclone api become stable, before adding even more features to ReFS. I've seen the same with BTRFS in its infancy, they were tying to add more and more and the basecode took a long time before it became stable in its core. I hope MS will not follow the same path...
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5061
Liked: 1341 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: ReFS is getting dedup!

Veeam Logoby Mike Resseler » Fri Jul 14, 2017 7:48 am

@Luca,

I have been told (but not confirmed) that a lot of stability fixes are implemented. Obviously since it is not confirmed it will be wait and see first... But this is still a preview so I hope testing will be done (besides us) and feedback delivered to MSFT
Mike Resseler
Veeam Software
 
Posts: 3281
Liked: 365 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: ReFS is getting dedup!

Veeam Logoby nmdange » Fri Jul 14, 2017 2:33 pm

I'll definitely be running the preview build on some dev Hyper-V and SOFS hosts I have. Having a backup repository with the preview build to test ReFS stability might be a bit harder for me, thought maybe I can create a test VM as a repository and have an extra test backup copy job with GFS to try and trigger the ReFS issue. Probably not a good idea to have my primary backups stored on a preview build :)
nmdange
Expert
 
Posts: 203
Liked: 58 times
Joined: Thu Aug 20, 2015 9:30 pm

Re: ReFS is getting dedup!

Veeam Logoby Mike Resseler » Fri Jul 14, 2017 2:48 pm

I would agree not to store your primary backups on there ;-)
Mike Resseler
Veeam Software
 
Posts: 3281
Liked: 365 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: ReFS is getting dedup!

Veeam Logoby rkovhaev » Fri Jul 14, 2017 6:25 pm 1 person likes this post

buckle up for a rough ride?
rkovhaev
Veeam Software
 
Posts: 33
Liked: 12 times
Joined: Mon May 17, 2010 6:49 pm
Location: hockey night in canada
Full Name: Rustam

Re: ReFS is getting dedup!

Veeam Logoby ITP-Stan » Mon Jul 17, 2017 8:24 am

I really can't see how the block cloning and dedupe feature will work nicely together.
ITP-Stan
Veeam ProPartner
 
Posts: 72
Liked: 7 times
Joined: Mon Feb 18, 2013 10:45 am
Full Name: Stan (IF-IT4U)

Re: ReFS is getting dedup!

Veeam Logoby SBarrett847 » Mon Jul 17, 2017 8:46 am

Thinking about it I can't see why it wouldn't, in fact I can see even greater savings for GFS cloning. Time will tell.

Also listed is RefS Compaction - I wonder what that is?
SBarrett847
Service Provider
 
Posts: 170
Liked: 28 times
Joined: Tue Feb 02, 2016 5:02 pm
Full Name: Stephen Barrett

Re: ReFS is getting dedup!

Veeam Logoby mkaec » Mon Jul 17, 2017 2:19 pm 2 people like this post

It's not mentioned in Microsoft's blog post, but Gostev's community digest email states that dedup on ReFS will be an implementation of the engine that is currently used with NTFS. I'm saddened to to hear that. I was hoping for a dedup engine based around block cloning. This type of engine wouldn't be able to offer compression, but it would eliminate rehydration penalties and the need for garbage collection. Garbage collection was the reason we turned off dedup on our file server. Dedup would run and then the next Veeam incremental would be huge. Our repository could not sustain taking in so many large incrementals.
mkaec
Expert
 
Posts: 185
Liked: 48 times
Joined: Thu Jul 16, 2015 1:31 pm
Full Name: Marc K


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: ac3v3, Bing [Bot], Daithi, Google [Bot], jensenjk, JimmyO, spiritie and 46 guests