Btrfs fast clone

Hyper-V specific discussions

Btrfs fast clone

Veeam Logoby Robvil » Mon Jan 09, 2017 7:29 pm

Hi,

I am currently using a Synology DS1815+ for my primary repository. The big issues with this is the extreme slow synthetic backup via SMB share. 48 hours for 5TB.
I read on Synology.com, DSM 6.1 will have support for btrfs fast clone via SMB connections.

Question: Will this provide the same funtionality as Win2016 Refs 3.1 regarding only making a pointer to identical data?

Robert
Robvil
Enthusiast
 
Posts: 54
Liked: 5 times
Joined: Mon Oct 03, 2016 12:41 pm
Full Name: Robert

Re: Btrfs fast clone

Veeam Logoby Andreas Neufert » Wed Jan 11, 2017 9:15 am

Hi Robert,
I think the software (Veeam) need to actively support this. And it is not planned in the short term.

30MB/s speed (2x for read write) isn´t that good. Is it a 1GbE network?

Maybe you can add the Synology as iSCSI volume to the Veeam Server and format it with ReFS 3.1 (when used with Windows 2016) to use the new block cloning.

Please describe as well how the setup is done.
Were is the B&R Server located? What Mount Server is selected for the repository? Which is the Gateway Server for the Repository?
Network connections and speed?

Backup Mode and Settings (SF+I ? Compression? InlineDedup? Per VM chain or per Job chain?...)
Andreas Neufert
Veeam Software
 
Posts: 2201
Liked: 360 times
Joined: Wed May 04, 2011 8:36 am
Location: Germany
Full Name: @AndyandtheVMs Veeam PM

Re: Btrfs fast clone

Veeam Logoby Robvil » Wed Jan 11, 2017 1:13 pm

I think the software (Veeam) need to actively support this. And it is not planned in the short term.
A: ok

30MB/s speed (2x for read write) isn´t that good. Is it a 1GbE network?
A: 2x1Gbit/s bond til Cisco

Maybe you can add the Synology as iSCSI volume to the Veeam Server and format it with ReFS 3.1 (when used with Windows 2016) to use the new block cloning.
A: A good idea. Maybe i´ll try this at a point

Please describe as well how the setup is done.
Were is the B&R Server located?
A: Same subnet/Lan as the repository with bonded 1Gbit/s nics

What Mount Server is selected for the repository?
A: Not sure what you mean? From the Veeam server, repository is configured as a SMB share

Which is the Gateway Server for the Repository?
A: Veeam server

Network connections and speed?
A: Bondet multiply 1Gbit/s nic´s where Synology is configured with SMB version 3

Backup Mode and Settings (SF+I ? Compression? InlineDedup? Per VM chain or per Job chain?...)
A: Forever incremental with compression and inline de-dupe. Per Job chain.
Robvil
Enthusiast
 
Posts: 54
Liked: 5 times
Joined: Mon Oct 03, 2016 12:41 pm
Full Name: Robert

Re: Btrfs fast clone

Veeam Logoby Andreas Neufert » Wed Jan 11, 2017 3:04 pm

You can try if per VM chain will speed up the Merge and Backup process as more streams are started to the target storage
Andreas Neufert
Veeam Software
 
Posts: 2201
Liked: 360 times
Joined: Wed May 04, 2011 8:36 am
Location: Germany
Full Name: @AndyandtheVMs Veeam PM

Re: Btrfs fast clone

Veeam Logoby Robvil » Wed Jan 11, 2017 8:25 pm

You can try if per VM chain will speed up the Merge and Backup process as more streams are started to the target storage
A: I think i´m confused. Can you explain the difference in Veeam how-to?

Just testet with a iSCSI connected drive with IOMeter to the synology and with 256Kbit access test (tried different read/write modes) - here I get from 50MBps to 85MBps.
Testing with 4Kbit access I get 8MBps to 10MBps ....

Volume is formattet with 64kb block size (both synology and OS).
Robvil
Enthusiast
 
Posts: 54
Liked: 5 times
Joined: Mon Oct 03, 2016 12:41 pm
Full Name: Robert

Re: Btrfs fast clone

Veeam Logoby Andreas Neufert » Wed Jan 11, 2017 9:14 pm

OK I assume that you had tested with a single stream (IO Meter).

The Standard Veeam Setting is a "Per Job" chain. That means you backup 20VMs with it´s 40 VM disks to a single backup file per restore point. So a single write stream is used.
If you enable "Per VM chain" at the Repository settings, for each VM a own backup chain is created at target storage. How many in parallel depends on the Proxy and Repository task count setting. So at least you will see 2-4 write Streams per Job.
That way you teaming will be better used as well.

If you then use Win2016 with ReFS 3.1 formated block volume (iSCSI) and it´s "Fast-Merge" processes, this would be the optimum for your storage.
Andreas Neufert
Veeam Software
 
Posts: 2201
Liked: 360 times
Joined: Wed May 04, 2011 8:36 am
Location: Germany
Full Name: @AndyandtheVMs Veeam PM

Re: Btrfs fast clone

Veeam Logoby Robvil » Sat Jan 14, 2017 7:02 am

I´m confused. I have added 2 ekstra 4TB drives to my raid5 for more IO, so i now have a total of 6 disks in raid level.
Last night the full incremental took 2 hours and 9 minuttes to complete vs. 48 hours on my 4 disks raid5.

Is there a raid penalty in linux raid with 4 disks in raid5 vs. more disks...
Robvil
Enthusiast
 
Posts: 54
Liked: 5 times
Joined: Mon Oct 03, 2016 12:41 pm
Full Name: Robert

Re: Btrfs fast clone

Veeam Logoby Andreas Neufert » Sat Jan 14, 2017 7:47 am

2 more discs will increase speed, it depends really on the raod controller and storage. Maybe adding 2 discs repaired something in the storage.
Andreas Neufert
Veeam Software
 
Posts: 2201
Liked: 360 times
Joined: Wed May 04, 2011 8:36 am
Location: Germany
Full Name: @AndyandtheVMs Veeam PM

Re: Btrfs fast clone

Veeam Logoby Robvil » Sat Jan 14, 2017 10:06 am

ds1815+ is software raid. There was no raid/volumes errors acording to the synology box.
Robvil
Enthusiast
 
Posts: 54
Liked: 5 times
Joined: Mon Oct 03, 2016 12:41 pm
Full Name: Robert

Re: Btrfs fast clone

Veeam Logoby Andreas Neufert » Mon Jan 16, 2017 8:55 am

I had that before. Slow performance with connection drops. Synology Support has a tool that you can run on the storage that checks for data corruption or some internal logic stuff. In the customer case the raid needed to be initialized from scratch (with copy of data elsewhere) and after that it performed really good and stable.
Andreas Neufert
Veeam Software
 
Posts: 2201
Liked: 360 times
Joined: Wed May 04, 2011 8:36 am
Location: Germany
Full Name: @AndyandtheVMs Veeam PM


Return to Microsoft Hyper-V



Who is online

Users browsing this forum: No registered users and 4 guests