Lots of Backup Proxy performance/connection failures

[pufferdude]

I opened case #00741896 on this, but came here to see if others are seeing anything similar:

I upgraded to Veeam B&R 8 and Veeam ONE 8 back to back, so I'm not sure which one of these is the culprit, but ever since the upgrade I'm being inundated with three errors:

"Backup performance data collection failure", "Backup repository connection failure", and "Backup proxy connection failure."

These are not continual and seem to happen at random times, but always grouped together and they always self-resolve. Typically they happen 2-3 times/day. Nothing has changed in the infrastructure other than the Veeam server itself (new host) and nothing really seems to be affected by these errors... backup, replication, and copy jobs are all completing normally.

Is this something I should be concerned with, or is Veeam B&R/Monitor 8 just *really* sensitive compared to 7?

[Vitaliy S.]

Hi Jim,

We have updated the collection engine compared to v7 to make it more scalable, so the issue with frequent disconnects is not expected. Does this happen on a particular time? What does your support engineer say on this?

Thanks!

[ExpertTrigger]

I have almost the same issues happening with my install of Veeam One 8.0. But, i only get the "Backup performance data collection failure" message throughout the day, not the other messages. At first I thought maybe it had something to do with latency when backup jobs were running, but it occurs when no jobs of any kind are running. I also only happens on my 2 virtual proxies. My proxy on the main physical server/repository never complains. Also, the performance stats cpu/ram on the virtual proxies are not stressed when it occurs.

My case number is #00741716

[pufferdude]

I did a webex with support this morning and he tweaked some settings for the timeout (made it longer) when Monitor asks for this data. It's run all day without an alert, but I'll know for sure if it's fixed if I don't get any overnight. Unfortunately I can't tell you the exact settings he modified as he did things so fast and was in the settings app as well as regedit.

[ExpertTrigger]

My webex is setup for tomorrow. One thing I'm wondering is if I'm polling for data less often, would that not make my data less accurate? Because it's polling for information less often? I'm sure it's something I'm misunderstanding, but it's something I'll want to ask tomorrow.

[pufferdude]

Well speak of the devil... 10 min after I typed that message, I got a backup proxy connection failure alert, so the timeout adjustments didn't fix my issue. Support also said something about lots of fixes in this area coming out in patch 1, so I guess I just need to wait for that. As long as my actual Veeam jobs are running smoothly (and they are) I'm gonna consider these false positives.

[Vitaliy S.]

My webex is setup for tomorrow. One thing I'm wondering is if I'm polling for data less often, would that not make my data less accurate? Because it's polling for information less often? I'm sure it's something I'm misunderstanding, but it's something I'll want to ask tomorrow

It will not make your monitoring and reporting capabilities less accurate, I believe our support team just fine-tunes the default timeouts. Let me check your support case in our system.

I got a backup proxy connection failure alert, so the timeout adjustments didn't fix my issue. Support also said something about lots of fixes in this area coming out in patch 1, so I guess I just need to wait for that.

Yes, it's coming, but I would confirm with your support engineer that the problem you experience is indeed fixed in that patch.

[JamesHickmott]

I'm having these same issues to. It appears it also happens more often now i have increased the number of backup jobs.

[Vitaliy S.]

James, what's your case ID for this issue?

[JamesHickmott]

Hi Vitaliy,

Haven't logged a case yet, was just researching the issue first to see if anyone else had similar problems and a solution

[JamesHickmott]

Support was super quick fixing my issue by doing the following:

modify the Backup performance data collection failure alarm > Rules >
Event Name:
VeeamBpPerfCollectionFailed
- Ignore after: 6
- Trigger after: 5

[Shestakov]

James, could you provide your support case number please?
Thanks!

[Vitaliy S.]

Playing with ignore/trigger after makes this alarm less sensitive to short connection drops, that's why I would still recommend contacting our support team for further debug logs review.

[JamesHickmott]

Support case number was 00746441

[Vitaliy S.]

For all future readers - if you experience the same problem, please apply our latest patch which is now GA > http://www.veeam.com/kb1986

[jodo234]

Hi,

since yesterday I experience this problem ... even though I installed the newest Veeam 8 Patch, I am on version 8.0.0.2030

I get these two every 5minutes, after about 1 minute they resolve:
Backup repository connection failure
Backup proxy connection failure

What can I do?

[veremin]

Just curios - haven't you installed any Windows Updates recently by any chance?

[jodo234]

I replied on your linked topic.