CRAZY slow replication between 2x 2016 hosts

Discussions specific to the Microsoft Hyper-V hypervisor

CRAZY slow replication between 2x 2016 hosts

Veeam Logoby mvalpreda » Thu Jan 04, 2018 2:24 am

Veeam 9.5u3 on 2x Windows Server 2016 hosts

Replication jobs are CRAZY slow. Single 900GB VM with ~560GB of data took nearly 8.5 hours. Having the same issue with another couple of VMs and the job has been running for just over 11 hours and has only processed 288GB and transferred 167GB. Veeam reports the bottleneck as the network. Throughput graphs show quick bursts of data transfer with then 30-60 seconds of no data moving.

Machines are on the same switch, no VLANs. If I copy a large file from one host to the other and vice versa I get full gigabit wire speed. Backups from either machine to a Synology over iSCSI get 100mb/sec. Only replication jobs are slow slow slow slow slow.

Case 2453689
mvalpreda
Enthusiast
 
Posts: 38
Liked: 1 time
Joined: Wed May 06, 2015 10:57 pm
Full Name: Mark Valpreda

Re: CRAZY slow replication between 2x 2016 hosts

Veeam Logoby Mike Resseler » Thu Jan 04, 2018 7:27 am

Hi Mark,

thanks for posting the case number. Please keep working with our engineers. Any change you have throttling rules between the two hosts and/or data mover components of Veeam?

Cheers
Mike
Mike Resseler
Veeam Software
 
Posts: 4523
Liked: 486 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: CRAZY slow replication between 2x 2016 hosts

Veeam Logoby mvalpreda » Thu Jan 04, 2018 3:15 pm

No rules at all. Just a vanilla install of Veeam and then added the replication target. Done this a lot of times before, just never seen it run so slow.
mvalpreda
Enthusiast
 
Posts: 38
Liked: 1 time
Joined: Wed May 06, 2015 10:57 pm
Full Name: Mark Valpreda

Re: CRAZY slow replication between 2x 2016 hosts

Veeam Logoby Mike Resseler » Thu Jan 04, 2018 5:13 pm

Mark,

Since you already have a case number, please keep working with the engineers. Hopefully they can see in the logs what is going on

Mike
Mike Resseler
Veeam Software
 
Posts: 4523
Liked: 486 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: CRAZY slow replication between 2x 2016 hosts

Veeam Logoby mvalpreda » Thu Jan 04, 2018 7:10 pm

Interesting.....I saw SQL was using ~3.5GB of RAM. Cut that down to 1GB through SQL Management Studio and now it is working much faster.
mvalpreda
Enthusiast
 
Posts: 38
Liked: 1 time
Joined: Wed May 06, 2015 10:57 pm
Full Name: Mark Valpreda

Re: CRAZY slow replication between 2x 2016 hosts

Veeam Logoby Mike Resseler » Fri Jan 05, 2018 6:35 am

As in our SQL? Or a SQL server that you are replicating?
Mike Resseler
Veeam Software
 
Posts: 4523
Liked: 486 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler

Re: CRAZY slow replication between 2x 2016 hosts

Veeam Logoby mvalpreda » Fri Jan 05, 2018 2:57 pm

Sorry.....yes....SQL Express for Veeam. Connected to the database instance and set the memory to 1024 from unlimited and it is running a lot better. Seemed like a strange fix.
mvalpreda
Enthusiast
 
Posts: 38
Liked: 1 time
Joined: Wed May 06, 2015 10:57 pm
Full Name: Mark Valpreda

Re: CRAZY slow replication between 2x 2016 hosts

Veeam Logoby Mike Resseler » Mon Jan 08, 2018 6:53 am

I notice that your case is still running so please continue with it. I believe the engineer has requested to run a few tools for measurements.

For that SQL thing. It is not really strange. SQL itself is known to "eat" all the memory it can get. (For example, if you have a VM that can grow its memory at request and that is running a SQL box... :-)). But it seems that in your case when it takes that memory (although only 3.5 GB) the system starts to slow-down. Does the B&R server has enough RAM? But it could also be an underlying disk issue.

Anyway, I hope that our engineers find something after the results of the tools
Mike
Mike Resseler
Veeam Software
 
Posts: 4523
Liked: 486 times
Joined: Fri Feb 08, 2013 3:08 pm
Location: Belgium, the land of the fries, the beer, the chocolate and the diamonds...
Full Name: Mike Resseler


Return to Microsoft Hyper-V



Who is online

Users browsing this forum: No registered users and 10 guests