Lots of Backup Proxy performance/connection failures

Real-time performance monitoring and troubleshooting

Lots of Backup Proxy performance/connection failures

Veeam Logoby pufferdude » Mon Feb 02, 2015 9:36 pm

I opened case #00741896 on this, but came here to see if others are seeing anything similar:

I upgraded to Veeam B&R 8 and Veeam ONE 8 back to back, so I'm not sure which one of these is the culprit, but ever since the upgrade I'm being inundated with three errors:

"Backup performance data collection failure", "Backup repository connection failure", and "Backup proxy connection failure."

These are not continual and seem to happen at random times, but always grouped together and they always self-resolve. Typically they happen 2-3 times/day. Nothing has changed in the infrastructure other than the Veeam server itself (new host) and nothing really seems to be affected by these errors... backup, replication, and copy jobs are all completing normally.

Is this something I should be concerned with, or is Veeam B&R/Monitor 8 just *really* sensitive compared to 7?
pufferdude
Expert
 
Posts: 126
Liked: 4 times
Joined: Thu Jul 02, 2009 8:26 pm
Full Name: Jim

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby Vitaliy S. » Tue Feb 03, 2015 9:59 am

Hi Jim,

We have updated the collection engine compared to v7 to make it more scalable, so the issue with frequent disconnects is not expected. Does this happen on a particular time? What does your support engineer say on this?

Thanks!
Vitaliy S.
Veeam Software
 
Posts: 19574
Liked: 1104 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby ExpertTrigger » Wed Feb 04, 2015 9:24 pm

I have almost the same issues happening with my install of Veeam One 8.0. But, i only get the "Backup performance data collection failure" message throughout the day, not the other messages. At first I thought maybe it had something to do with latency when backup jobs were running, but it occurs when no jobs of any kind are running. I also only happens on my 2 virtual proxies. My proxy on the main physical server/repository never complains. Also, the performance stats cpu/ram on the virtual proxies are not stressed when it occurs.

My case number is #00741716
ExpertTrigger
Influencer
 
Posts: 13
Liked: 3 times
Joined: Tue Jan 22, 2013 5:36 am

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby pufferdude » Wed Feb 04, 2015 9:51 pm

I did a webex with support this morning and he tweaked some settings for the timeout (made it longer) when Monitor asks for this data. It's run all day without an alert, but I'll know for sure if it's fixed if I don't get any overnight. Unfortunately I can't tell you the exact settings he modified as he did things so fast and was in the settings app as well as regedit.
pufferdude
Expert
 
Posts: 126
Liked: 4 times
Joined: Thu Jul 02, 2009 8:26 pm
Full Name: Jim

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby ExpertTrigger » Wed Feb 04, 2015 9:57 pm

My webex is setup for tomorrow. One thing I'm wondering is if I'm polling for data less often, would that not make my data less accurate? Because it's polling for information less often? I'm sure it's something I'm misunderstanding, but it's something I'll want to ask tomorrow.
ExpertTrigger
Influencer
 
Posts: 13
Liked: 3 times
Joined: Tue Jan 22, 2013 5:36 am

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby pufferdude » Wed Feb 04, 2015 10:15 pm

Well speak of the devil... 10 min after I typed that message, I got a backup proxy connection failure alert, so the timeout adjustments didn't fix my issue. Support also said something about lots of fixes in this area coming out in patch 1, so I guess I just need to wait for that. As long as my actual Veeam jobs are running smoothly (and they are) I'm gonna consider these false positives.
pufferdude
Expert
 
Posts: 126
Liked: 4 times
Joined: Thu Jul 02, 2009 8:26 pm
Full Name: Jim

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby Vitaliy S. » Thu Feb 05, 2015 2:52 pm

ExpertTrigger wrote:My webex is setup for tomorrow. One thing I'm wondering is if I'm polling for data less often, would that not make my data less accurate? Because it's polling for information less often? I'm sure it's something I'm misunderstanding, but it's something I'll want to ask tomorrow

It will not make your monitoring and reporting capabilities less accurate, I believe our support team just fine-tunes the default timeouts. Let me check your support case in our system.

pufferdude wrote: I got a backup proxy connection failure alert, so the timeout adjustments didn't fix my issue. Support also said something about lots of fixes in this area coming out in patch 1, so I guess I just need to wait for that.

Yes, it's coming, but I would confirm with your support engineer that the problem you experience is indeed fixed in that patch.
Vitaliy S.
Veeam Software
 
Posts: 19574
Liked: 1104 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby JamesHickmott » Thu Feb 05, 2015 11:01 pm

I'm having these same issues to. It appears it also happens more often now i have increased the number of backup jobs.
JamesHickmott
Novice
 
Posts: 4
Liked: 1 time
Joined: Thu Feb 05, 2015 10:58 pm
Full Name: James Hickmott

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby Vitaliy S. » Fri Feb 06, 2015 11:32 am

James, what's your case ID for this issue?
Vitaliy S.
Veeam Software
 
Posts: 19574
Liked: 1104 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby JamesHickmott » Sun Feb 08, 2015 11:38 pm

Hi Vitaliy,

Haven't logged a case yet, was just researching the issue first to see if anyone else had similar problems and a solution
JamesHickmott
Novice
 
Posts: 4
Liked: 1 time
Joined: Thu Feb 05, 2015 10:58 pm
Full Name: James Hickmott

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby JamesHickmott » Tue Feb 10, 2015 6:09 am

Support was super quick fixing my issue by doing the following:

modify the Backup performance data collection failure alarm > Rules >
Event Name:
VeeamBpPerfCollectionFailed
- Ignore after: 6
- Trigger after: 5
JamesHickmott
Novice
 
Posts: 4
Liked: 1 time
Joined: Thu Feb 05, 2015 10:58 pm
Full Name: James Hickmott

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby Shestakov » Tue Feb 10, 2015 3:13 pm

James, could you provide your support case number please?
Thanks!
Shestakov
Veeam Software
 
Posts: 4863
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby Vitaliy S. » Sat Feb 14, 2015 4:32 pm

Playing with ignore/trigger after makes this alarm less sensitive to short connection drops, that's why I would still recommend contacting our support team for further debug logs review.
Vitaliy S.
Veeam Software
 
Posts: 19574
Liked: 1104 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby JamesHickmott » Sun Feb 15, 2015 10:07 pm 1 person likes this post

Support case number was 00746441
JamesHickmott
Novice
 
Posts: 4
Liked: 1 time
Joined: Thu Feb 05, 2015 10:58 pm
Full Name: James Hickmott

Re: Lots of Backup Proxy performance/connection failures

Veeam Logoby Vitaliy S. » Thu Feb 26, 2015 11:37 am

For all future readers - if you experience the same problem, please apply our latest patch which is now GA > http://www.veeam.com/kb1986
Vitaliy S.
Veeam Software
 
Posts: 19574
Liked: 1104 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Next

Return to Monitoring



Who is online

Users browsing this forum: No registered users and 4 guests