Proxy>Proxy Network Traffic

Availability for the Always-On Enterprise

Proxy>Proxy Network Traffic

Veeam Logoby stevil » Thu Sep 29, 2016 9:55 am

I have three proxies, when my backup job runs it uses all three proxies to backup, no problem. When checking the network traffic on each proxy it seems that the three proxies will send their backup data to each other, rather than directly to the NAS. So, one proxy may be sending data to our NAS at 1Gb, but 30MB/sec of that data is coming from another proxy. It's as though the proxy is being used as a gateway to the CIFS share on the NAS. This is a perVM backup job so there should be no gateway. I would have thought each proxy would max out at 1Gb direct to the NAS, I've no idea why I'm seeing this random traffic between the proxies. Is this normal behaviour?
stevil
Enthusiast
 
Posts: 94
Liked: never
Joined: Thu Sep 02, 2010 2:23 pm
Location: Manchester, UK
Full Name: Steve Buckley

Re: Proxy>Proxy Network Traffic

Veeam Logoby Shestakov » Thu Sep 29, 2016 10:02 am

Hello Steve,
What transport mode is used for your jobs?
If no traffic redirections are made backup data goes from proxy directly to the chosen repository.
Do you also have machines having several roles(backup server, proxy, repository)?
Thanks!
Shestakov
Veeam Software
 
Posts: 4951
Liked: 407 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Proxy>Proxy Network Traffic

Veeam Logoby stevil » Thu Sep 29, 2016 10:23 am

all the proxies use hot-add (confirmed in the job log) The three proxies are dedicated. It's worth noting that it's not always the same proxy receiving data from another, it can be the other way around and in fact in both directions. o, taking an example of just two proxies, they might be sending to each other AND both sending to the NAS at the same time.
stevil
Enthusiast
 
Posts: 94
Liked: never
Joined: Thu Sep 02, 2010 2:23 pm
Location: Manchester, UK
Full Name: Steve Buckley

Re: Proxy>Proxy Network Traffic

Veeam Logoby Shestakov » Thu Sep 29, 2016 10:27 am

The described routing behavior indeed looks strange.
Are all the proxies connected to the repository?
Shestakov
Veeam Software
 
Posts: 4951
Liked: 407 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Proxy>Proxy Network Traffic

Veeam Logoby foggy » Thu Sep 29, 2016 10:58 am

There's still a chance of traffic going through another server even in case of per-VM backup chains - when VM has several disks, all are written to repository through a single gateway.
foggy
Veeam Software
 
Posts: 14904
Liked: 1096 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Proxy>Proxy Network Traffic

Veeam Logoby stevil » Thu Sep 29, 2016 11:26 am

Ah OK, so if a VM has 12 disks say, and they are split 4 per proxy, one proxy would act as the gateway for that particular VM backup and all the data would go through it? Almost as though the backup job is dedicating one proxy as a gateway for each one VM.
I can understand this approach when using compression, you're leveraging the CPU power of the other proxies, network probably isn't the bottleneck. In my case I have no compression enabled, so all I really want is direct to proxy transfers. I don't know if it's possible to get around this. FYI, the target is a SOBR, three repo's on three different IPs that are actually all sat on the same NAS, I'm trying to get 3Gb throughput to it (NIC bonding wasn't reliable enough).
stevil
Enthusiast
 
Posts: 94
Liked: never
Joined: Thu Sep 02, 2010 2:23 pm
Location: Manchester, UK
Full Name: Steve Buckley

Re: Proxy>Proxy Network Traffic

Veeam Logoby foggy » Thu Sep 29, 2016 11:41 am 1 person likes this post

stevil wrote:Ah OK, so if a VM has 12 disks say, and they are split 4 per proxy, one proxy would act as the gateway for that particular VM backup and all the data would go through it? Almost as though the backup job is dedicating one proxy as a gateway for each one VM.

Correct.

You can split your jobs and specify a single proxy explicitly for each of them to avoid unnecessary traffic. Btw, why do you disable compression?
foggy
Veeam Software
 
Posts: 14904
Liked: 1096 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Proxy>Proxy Network Traffic

Veeam Logoby stevil » Thu Sep 29, 2016 11:43 am

OK, that won't work really for the way we have everything configured. No compression as it's doing to a Dell DR4300 which has dedupe/compression on it already. Dell do have a source side dedupe driver that gives around 7Gbps transfer for our jobs over a 1Gb link, which is awesome, but doesn't work with veeam properly and does occasionally lock up proxies etc... Hence looking at trying to increase throughput another way.
stevil
Enthusiast
 
Posts: 94
Liked: never
Joined: Thu Sep 02, 2010 2:23 pm
Location: Manchester, UK
Full Name: Steve Buckley

Re: Proxy>Proxy Network Traffic

Veeam Logoby foggy » Thu Sep 29, 2016 11:53 am

Makes sense in case it is a dedupe appliance, indeed. What is your current bottleneck, btw?
foggy
Veeam Software
 
Posts: 14904
Liked: 1096 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Proxy>Proxy Network Traffic

Veeam Logoby stevil » Thu Sep 29, 2016 11:58 am

I have 3 x 1Gb nics in the DR4300, I'm getting about 2.3Gbps I'd say at best. This is due to the inter proxy transfers hogging part of the bandwidth. I considered moving the VM's to the same host so they would go through the vswitch at 10Gb to each other, but then the host only has 1 NIC facing the nas on this VLAN! So, I have to keep the VM proxies separate to get the maximum bandwidth using 3 physical esx hosts.
The bottleneck is obviously our 1Gb network at this particular site. 10Gb is a no-go, still too expensive for this site.
stevil
Enthusiast
 
Posts: 94
Liked: never
Joined: Thu Sep 02, 2010 2:23 pm
Location: Manchester, UK
Full Name: Steve Buckley


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot] and 31 guests