Do you use on-host or off-host backup proxies? If it is the first case, then in order to get better performance I would suggest binding it to the Hyper-V host. In this case traffic will go from the proxy (Hyper-V host) to the backup repository directly.