Host-based backup of Microsoft Hyper-V VMs.
Post Reply
LThibx
Service Provider
Posts: 58
Liked: 7 times
Joined: May 06, 2014 4:02 pm
Full Name: Lonnie J Thibodeaux
Contact:

Backup Jobs & Backup Copy Jobs - Slow Transfer Performance

Post by LThibx »

I recently reworked my VB&R Infrastructure (primarily added a new TrueNAS setup as my local Veeam Repository.
Recently updated to V11 on local instance and my Cloud Connect instance (Azure)
Gigabit internal network. 100Mbs symmetrical fiber WAN.
After porting all my BJs & BCJs to the TrueNAS, started running my jobs, and most everything is going smoothly.
But I have questions about transfer speeds:
BJs are getting around 11MBs (88 Mbs) backup speed - seems should be much more than that on a Gigabit network.

BCJs speed. Typically is 1 to 2 MBs, and have seen it drop below that periodically.
I do have a 40 Mbs throttling rule during business hours, but this should still be around 5 MBs transfer.
I will monitor speed during after hours to see if it is different.

I have looked at all network points:
TrueNAS1 Network: 10+ MBs thruput
HV3 Transport server - 75 Mbs (9.37 MBs)
VBR1 - VB&R VM Ethernet - 150 Kbps - This seems to be the issue
HV2 (Hyper-V that hosts VBR1 - 184 Kbps - Coincides with speed on VBR1

So at this point seems that VBR1 (VM) & HV2 (Host) network seem to be the bottleneck.
What can I check to fix this performance issue.

Thanks
Lonnie
foggy
Veeam Software
Posts: 21071
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Backup Jobs & Backup Copy Jobs - Slow Transfer Performance

Post by foggy »

Hi Lonnie, what do jobs report as the primary bottleneck?
LThibx
Service Provider
Posts: 58
Liked: 7 times
Joined: May 06, 2014 4:02 pm
Full Name: Lonnie J Thibodeaux
Contact:

Re: Backup Jobs & Backup Copy Jobs - Slow Transfer Performance

Post by LThibx »

Well actually the BCJs that are going to VCC haven't completed yet, so they are not reporting that yet.
Basically first run since getting RPs on the new NAS.
Currently I have two of them running concurrently, one is reporting around 4MBs (Max 8 MBs), this job is 5% complete
The second BCJ is currently showing 0 KB, and last message is Waiting for backup infrastructure resources availability.
At times both of them go to 0 KB for a while.
That is puzzling, the only two jobs running. the VBR1 VM is 4 vCPUs, 16 GB Ram.
I have my repository set for 10 concurrent jobs.

I have one BCJ that is local archive, so it is reading NAS backups (iSCSI target), and populating NAS archives (different iSCSI target)...all on same NAS.
It showed an overall thruput of 38 MBs. That job showed Primary bottleneck: Source

I'll have to figure out how to get screenshots attached here.

Lonnie
Mildur
Product Manager
Posts: 8717
Liked: 2287 times
Joined: May 13, 2017 4:51 pm
Full Name: Fabian K.
Location: Switzerland
Contact:

Re: Backup Jobs & Backup Copy Jobs - Slow Transfer Performance

Post by Mildur »

It would be better to upload the logs to a support case. :) Support should find the bottleneck in the logs.
Product Management Analyst @ Veeam Software
LThibx
Service Provider
Posts: 58
Liked: 7 times
Joined: May 06, 2014 4:02 pm
Full Name: Lonnie J Thibodeaux
Contact:

Re: Backup Jobs & Backup Copy Jobs - Slow Transfer Performance

Post by LThibx »

Ok, I will wait for these jobs to finish, and then create a support case and send them the logs.
If i have something of value, I will report it back here.

Thanks
foggy
Veeam Software
Posts: 21071
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Backup Jobs & Backup Copy Jobs - Slow Transfer Performance

Post by foggy »

Looks like TrueNAS is a bottleneck for the backup copy jobs - remember that those do random read. Let support review the setup closely to confirm this.
Post Reply

Who is online

Users browsing this forum: No registered users and 17 guests