Copy Job merge slow (REFS)

Availability for the Always-On Enterprise

Copy Job merge slow (REFS)

Veeam Logoby skumflum » Tue Feb 14, 2017 7:21 am

We rushed out and installed Windows 2016 to utilize the new REFS/VEEAM 9.5 feature. Our most pressing concern was to bring down the merge time of the Copy Jobs but it has not.
Currently it takes over 120 hours to merge 4TB incremental into the 30TB VBK file. It is using [fast clone] so I guess that REFS features is detected and used.

The backup SAN is not blistering fast but it’s not a slow NAS (12x6TB SAS 7K HPE MSA 2040)

Is this to be expected?
skumflum
Enthusiast
 
Posts: 27
Liked: 1 time
Joined: Mon Jun 13, 2016 6:51 am
Full Name: Søren Emig

Re: Copy Job merge slow (REFS)

Veeam Logoby foggy » Tue Feb 14, 2017 10:46 am

Hi Søren, what were the speeds prior moving to Windows 2016?
foggy
Veeam Software
 
Posts: 14482
Liked: 1057 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Copy Job merge slow (REFS)

Veeam Logoby skumflum » Tue Feb 14, 2017 11:56 am

Aprox the same
skumflum
Enthusiast
 
Posts: 27
Liked: 1 time
Joined: Mon Jun 13, 2016 6:51 am
Full Name: Søren Emig

Re: Copy Job merge slow (REFS)

Veeam Logoby foggy » Tue Feb 14, 2017 12:49 pm

I'd contact support with this, since the speed indeed doesn't look expected in case fastclone is fully utilized.
foggy
Veeam Software
 
Posts: 14482
Liked: 1057 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Copy Job merge slow (REFS)

Veeam Logoby kubimike » Tue Feb 14, 2017 9:33 pm

its so funny I saw this. I have another post going on about how my Windows 2016 box experiences random freezes and BSOD. Microsoft turned on some features to tag things in memory. Now when doing a [fast clone] to make a synthetic full it went from 20 seconds to 2 hours 45 mins on any job.
kubimike
Expert
 
Posts: 200
Liked: 22 times
Joined: Fri Feb 03, 2017 2:34 pm
Full Name: MikeO

Re: Copy Job merge slow (REFS)

Veeam Logoby skumflum » Tue Feb 14, 2017 11:27 pm

It must be related.
skumflum
Enthusiast
 
Posts: 27
Liked: 1 time
Joined: Mon Jun 13, 2016 6:51 am
Full Name: Søren Emig

Re: Copy Job merge slow (REFS)

Veeam Logoby Salm » Tue Feb 14, 2017 11:36 pm

This may or may not be related, but how did you guys format your ReFS volumes ?

See veeam-backup-replication-f2/refs-4k-horror-story-t40629.html

This is a memory issue, but who knows what else it could cause.
Salm
Enthusiast
 
Posts: 25
Liked: 2 times
Joined: Sun Jan 15, 2017 7:39 pm
Location: France

Re: Copy Job merge slow (REFS)

Veeam Logoby skumflum » Wed Feb 15, 2017 1:22 pm

It is formatet 4K... I must have made a error as I thought that it was 64K.

But even though it's 4K there also seems to be problems with 64K?

The merge resultet in a unresponsive repository and BSOD. After a reboot I could not access the drive and diskpart just froze up. After 30-40 min it came back
skumflum
Enthusiast
 
Posts: 27
Liked: 1 time
Joined: Mon Jun 13, 2016 6:51 am
Full Name: Søren Emig

Re: Copy Job merge slow (REFS)

Veeam Logoby kubimike » Wed Feb 15, 2017 5:54 pm 1 person likes this post

not aware of any issues with 64k. If you look in the event log filter system event id 1001. Curious what the bugcheck is
kubimike
Expert
 
Posts: 200
Liked: 22 times
Joined: Fri Feb 03, 2017 2:34 pm
Full Name: MikeO

Re: Copy Job merge slow (REFS)

Veeam Logoby btmaus » Wed Feb 15, 2017 9:59 pm 1 person likes this post

Using 64K formatted ReFS here. Have been migrating more and more of my Daily backup jobs over to it from a dedupe appliance. So far, has been extremely fast and not a single issue. Make sure you are using 64K!
btmaus
Expert
 
Posts: 123
Liked: 8 times
Joined: Fri Jul 17, 2015 9:02 am
Full Name: Glenn L


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: antasik, baber, Bing [Bot] and 17 guests