Veeam One Hyper-V alert confusion

Monitoring and reporting for Veeam Backup & Replication, VMware vSphere and Microsoft Hyper-V

Veeam One Hyper-V alert confusion

Veeam Logoby ekhouser614 » Thu Apr 21, 2016 3:52 pm

I have been using Veeam One for some time now in testing and have only a week ago went full production and seem be either confused on a couple report/errors or they are mis-reporting data. The first one is the "Host Average Memory Pressure" . alert. I have two Hyper-V hosts, each with 192 GB of RAM and each host only lightly used. If I select one of the hosts and select the Memory tab, the Data is as follows:
Units Latest Min Avg Max
Hyper-V Services Memory Consumed GB 49.56 49.39 49.73 51.77
Hyper-V Services Memory Usage % 25.81 25.72 25.90 26.95
Memory Consumed GB 44.78 44.62 44.96 47.00
Memory Usage % 23.32 23.23 23.41 24.96

These metrics are, to me, very small. I have a couple VMs which periodically run into memory pressure issues, but not the hosts themselves and this alert is for the host itself. The second host is very close to this one as far as usage goes.

The second alert that confuses me is, for the VM itself, some will receive the "Hyper-V snapshot size" alert. We do not use snapshots as a practice so I am not understanding where this alert comes from. I will though, it only appears for VMs that have gone through a P2V migration. All other VMs do not reflect snapshot alerts
ekhouser614
Influencer
 
Posts: 13
Liked: never
Joined: Wed Aug 19, 2015 5:23 pm
Full Name: Eric Houser

Re: Veeam One Hyper-V alert confusion

Veeam Logoby Vitaliy S. » Thu Apr 21, 2016 8:26 pm

Hi Eric,

1. Do you use dynamic or static memory for VMs located on the host in question?
2. What VMs do you see these alarms for? Are you running backup jobs by any chance against these VMs?

Thanks!
Vitaliy S.
Veeam Software
 
Posts: 19542
Liked: 1098 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Veeam One Hyper-V alert confusion

Veeam Logoby ekhouser614 » Thu Apr 21, 2016 8:34 pm

For the VMs in question, dynamic and this happens whether or not a backup is running. The confusing part is, there is an alert for VM memory pressure, which I understand since the VM is reaching it's threshold but this alert says the host itself is always at approximately 90%--which it's no where close.
ekhouser614
Influencer
 
Posts: 13
Liked: never
Joined: Wed Aug 19, 2015 5:23 pm
Full Name: Eric Houser

Re: Veeam One Hyper-V alert confusion

Veeam Logoby Vitaliy S. » Thu Apr 21, 2016 8:52 pm

Memory pressure is calculated based on the potential memory demand from VMs configure with dynamic memory.

As for the second issue (with snapshots) presence, can you confirm that you don't have any avhdx files present on the volume?
Vitaliy S.
Veeam Software
 
Posts: 19542
Liked: 1098 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Veeam One Hyper-V alert confusion

Veeam Logoby Shestakov » Thu Apr 21, 2016 10:20 pm

Eric,
I`m also curious what thresholds are set for the alarmed hosts? Have you changed the default settings? What values(pikes) are reported by the triggered alarms?
Thanks!
Shestakov
Veeam Software
 
Posts: 4854
Liked: 394 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Veeam One Hyper-V alert confusion

Veeam Logoby ekhouser614 » Fri Apr 22, 2016 1:34 pm

The alerts are default, but in looking at the Alarm settings for Hyper-V>Host Average Memory Pressure, it is a warning at 80% and Error at 90%. The aggregate of all VMs on the individual host would not total 80 or 90% even at max on the dynamic memory. Now, I will say, this is a fail-over cluster, and with all VMs on one host, this may be, but not with the separation of VMs on different hosts. Would it be looking at all VMs on one host to calculate this? Also, there are no avhdx or avhd files on the hosts at all.
ekhouser614
Influencer
 
Posts: 13
Liked: never
Joined: Wed Aug 19, 2015 5:23 pm
Full Name: Eric Houser

Re: Veeam One Hyper-V alert confusion

Veeam Logoby Vitaliy S. » Fri Apr 22, 2016 2:07 pm

ekhouser614 wrote:Also, there are no avhdx or avhd files on the hosts at all.

In this case open a support case, cause snapshot alarm only works if it detects VM snapshots (aka checkpoints).
Vitaliy S.
Veeam Software
 
Posts: 19542
Liked: 1098 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Veeam One Hyper-V alert confusion

Veeam Logoby ekhouser614 » Fri Apr 22, 2016 3:06 pm

I will, but any idea about the memory alert?
ekhouser614
Influencer
 
Posts: 13
Liked: never
Joined: Wed Aug 19, 2015 5:23 pm
Full Name: Eric Houser

Re: Veeam One Hyper-V alert confusion

Veeam Logoby Shestakov » Fri Apr 22, 2016 4:09 pm

Memory Pressure is a calculation of how much memory the host wants divided by the amount of memory it currently has. I would check the next metrics same time when the Memory Pressure alarm was triggered:
Memory Available which indicates the amount of physical memory (in MB) immediately available for allocation.
Memory Pages showing if and how often system uses hard drive to store and retrieve memory associated data.

When applications host`s VMs want more memory than it currently has, the host swaps memory pages to hard drive. You can observe Memory pressure around 100% and low Memory available.
If these counters had the mentioned behavior, you had a lack of memory for a short period of time, if the counters were stable for that time, probably Hyper-V or Veeam ONE provided wrong numbers, you can compare Veeam ONE results and perfmon to find out the issue.
Thanks!
Shestakov
Veeam Software
 
Posts: 4854
Liked: 394 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Veeam One Hyper-V alert confusion

Veeam Logoby ekhouser614 » Fri Apr 22, 2016 4:39 pm

And this is where this alert is confusing. I understand that when a child VM demands more memory than it has, or, it has a memory pressure above a threshold would send an alert but, this is "host" memory--not vm memory. If every vm went to 100% memory on this host, it can only have a maximum of 62 GB which is 30% of the total installed on the server. In looking at the performance of the host itself, it's barely touched since it has 192 GB of installed RAM so this is where the confusion is.
ekhouser614
Influencer
 
Posts: 13
Liked: never
Joined: Wed Aug 19, 2015 5:23 pm
Full Name: Eric Houser

Re: Veeam One Hyper-V alert confusion

Veeam Logoby ekhouser614 » Fri Apr 22, 2016 4:41 pm

And to further this, the explanation is also a little confusing since it states, the alert could in fact mean an "over-commitment" from all VMs, which on this host is impossible.
ekhouser614
Influencer
 
Posts: 13
Liked: never
Joined: Wed Aug 19, 2015 5:23 pm
Full Name: Eric Houser

Re: Veeam One Hyper-V alert confusion

Veeam Logoby Shestakov » Fri Apr 22, 2016 5:08 pm

I see your point and you are right.
If so, I would compare Hyper-V and Veeam ONE results to check if VeeamONE collects correct data. Since you are up to contact technical support with another issue, I would ask them for an assistance with this one as well.
Shestakov
Veeam Software
 
Posts: 4854
Liked: 394 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Veeam One Hyper-V alert confusion

Veeam Logoby ekhouser614 » Fri Apr 22, 2016 6:22 pm

What I notice is, every hour on the hour, the pages/sec go through the roof at over 46,000, but memory doesn't budge, and CPU stays below 10%. I do notice as well, using processexplorer, the veeamagent.exe is the process attributed to the high I/O I see on both disk and network. I have a backup that runs each hour on a VM with Exchange installed. It corresponds to these timeframes as well. Is this to be expected? We use off-host proxies, but the Veeam server is a VM. The disks these are on are 15k SAS drives using CSVs on a server.
ekhouser614
Influencer
 
Posts: 13
Liked: never
Joined: Wed Aug 19, 2015 5:23 pm
Full Name: Eric Houser

Re: Veeam One Hyper-V alert confusion

Veeam Logoby Shestakov » Sat Apr 23, 2016 11:56 am

Where do you have the high Memory pages/sec values(proxy VM/host/other VM)?
ekhouser614 wrote:We use off-host proxies, but the Veeam server is a VM.

So you have another HyperV with a backup proxy VM which processes VMs from the primary host? That is not the best practice.
Shestakov
Veeam Software
 
Posts: 4854
Liked: 394 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: Veeam One Hyper-V alert confusion

Veeam Logoby ekhouser614 » Sat Apr 23, 2016 2:17 pm

The proxy is a physical server, not a VM on another non-clustered host. The high memory pages are on the hosts that are clustered. What I can't find though is a good explanation of how we have the proxy setup. I read one place the proxy must have "direct access" to the shared storage such as iscsi to a SAN and other places it just needs "access to the host and VMs". The proxy is just another physical server with Hyper-V role installed and the clustered hosts are on the same LAN. Is this also not best practice? If so, I will need to just use on-host backups and not use off-host proxies.
ekhouser614
Influencer
 
Posts: 13
Liked: never
Joined: Wed Aug 19, 2015 5:23 pm
Full Name: Eric Houser

Next

Return to Veeam ONE



Who is online

Users browsing this forum: No registered users and 4 guests