utilization >1hr flattening min/max/avg values

Real-time performance monitoring and troubleshooting

Re: utilization >1hr flattening min/max/avg values

Veeam Logoby Vitaliy S. » Thu Dec 17, 2015 11:34 am

ccatlett1984 wrote:I will add this comment, the way averaging is computed, gives false data with the undersized/oversized vm reports.

Over-sized/under-sized reports are using buffers of 30% to address this, so that every performance spike (if it happens on regular basis) will be "accounted" in the recommendation.

michaelB wrote:Ok, I'll just try to explain what I'm doing with veeamONE actually.
We have a new VMware infrastructur with new Servers(ESXi hosts) and new datastores. The datastores have different performance features. The first half of them have a really good IOPS performance and average throughput. The other half is the opposite and have really good throughput performance and averagy IOPS. Now I'm analyzing with veeamONE which datastore is the best for each VM. It would be easy to say "store all database VMs to the first datastore and all like filetransfer VMs to the second", but our case is not that simple. Our VMs are performing differently and often they use their full ressources only for a short period of time(5min-2hours). Even if its a short period of time it is really important for us that the VMs get as much performance as they can get in this time.
Now, if I use veeamONE i need a long period of time (1-2 weeks) to fully analyze the VMs. For example, my threshold to choose one of the good perfoming IOPS datastores is >750 IOPS and the chart would show me it is more than one peak. VeeamONE tells me now for one VM "Datastore IO usage maximum 200 and multiple peaks at 200 IOPS - past week", so i would choose one of the other Datastores whith lower IO performance. But this information is simply wrong, cause in reality the peaks are about 1000 IOPS and I would choose the wrong Datastore.
Now luckily I know this behavior. Strangly if I analyze with a custom interval only the peak, it seems like I get the correct maximum value (>1000, 2 days ago). So the correct data seems to be stored but not to be shown in the past week view. I could now analyze each peak for a big amount of VMs and different performance types, but this would be really uncomfortable.
Veeam and VeeamONE is new for me and may be I'll get the informations which I need if I know more about the reporting features.

That's a perfect usage scenario for Veeam ONE. Automating VM placement or giving recommendations on where to put VM sounds like a good feature request. For your analysis I would also recommend to review our datastore performance assessment report that would correlate latency, IOPs and write/read rate over the historical time period.
Vitaliy S.
Veeam Software
 
Posts: 19960
Liked: 1145 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

[MERGED] Datastore IO

Veeam Logoby risingflight » Tue Jan 05, 2016 2:31 am

Hi everyone,

On one of my VM i can see Datastore IO when i set the interval for last one hour.

Obect Counter Units Latest Minimum Average Maximum
VM1 Datastore I/O Number 30 16 168 5300


When i set the interval to one day, the maximum value is changed it comes to around 1600.

I am confused here with the chart option of maximum. From where is it taking this maximum value,
i belive sometime back it might have reached 5300 but in last one hour interval it did not reach to 5300 and for one day hows it showing 1600.
Experts exlain me clearly
risingflight
Influencer
 
Posts: 23
Liked: never
Joined: Sun Nov 29, 2015 6:04 pm
Full Name: RisingFlight

Re: utilization >1hr flattening min/max/avg values

Veeam Logoby Vitaliy S. » Tue Jan 05, 2016 6:12 pm

Hi,

Currently it is expected behavior due to way how historical data is stored in the database for long time reporting. Please check out this thread for more info.

Thanks!
Vitaliy S.
Veeam Software
 
Posts: 19960
Liked: 1145 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

[MERGED] Experts explain me about Disk I/O

Veeam Logoby risingflight » Thu Jan 28, 2016 7:11 pm

I am using Veeam 9.
I have select Datastore and clicked on Tab Disk I/O
Under Chart Options : Stack by VMs, Chart view : Datastore I/O ,

For one VM i have selected Period : Past hour, I could see
Latest 700 Minimum 0 Average 63 Maximum 700

For the same VM i changed the period to past one week. I could see
Latest 0 Minimum 0 Average 2 Maximum 190

for past one month i could see.
Latest 0 Minimum 0 Average 2 Maximum 85

How are these units calculated.
I was asked this question by my officer, for past one hour if maximum is 700, then for one month also maximum should be 700
how come it is 85. Hows veeam calculating
risingflight
Influencer
 
Posts: 23
Liked: never
Joined: Sun Nov 29, 2015 6:04 pm
Full Name: RisingFlight

Re: utilization >1hr flattening min/max/avg values

Veeam Logoby Shestakov » Thu Jan 28, 2016 11:43 pm

Hello,
As was mentioned above in this topic:
Shestakov wrote:Veeam ONE collects 20-second samples from ESXi and shows it during the day or so(depends on the settings), then it aggregates 20-second values to 5-minutes intervals and shows the average value and so on up to 2-hour averages. At the same time Veeam ONE remembers the max. sample value

Please read the thread and ask additional questions if you have any. Thanks!
Shestakov
Veeam Software
 
Posts: 5140
Liked: 430 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

[MERGED] Disk "Errors/min" different maximum values

Veeam Logoby ankl » Wed Apr 26, 2017 10:11 am

Hi there,

I've deployed the free version of Veeam ONE and after several days I discovered that one of my virtual machines have intermittent virtual disk issues with spikes of high disk Errors/min values. To investigate this I started to watch virtual disk chart for this particular virtual machine. On the past hour chart period I see a spike of, say, 32 Errors/min. The very same value has been displayed on the chart legend on the Maximum column. Naturally, i switched to the past day period of chart display. What I see has puzzled me - the maximum value of Errors/min has changed to 18. I switched to past week view, and maximum value has changed again - now to 5!

Until now, I believed this field should display a maximum counter value that has been observed during particular period of time. Like every 10 minutes you check your thermometer and record temperature readings. So if the maximum temperature registered during past hour is higher, than the maximum temperature registered during past day or week, this value become a new maximum - not only for the past hour, but for any period in the past from the current point in time.

Now I'm totally lost. Could anyone explain me a concept how do you calculate this disk Errors/min maximum field values over different periods of time? Help, please.
ankl
Lurker
 
Posts: 2
Liked: 1 time
Joined: Wed Apr 26, 2017 9:03 am
Full Name: ankl

Re: utilization >1hr flattening min/max/avg values

Veeam Logoby Shestakov » Wed Apr 26, 2017 12:35 pm 1 person likes this post

Hi ankl and welcome to the community!
The reason of the behavior is performance data averaging which is explained above.
Thanks!
Shestakov
Veeam Software
 
Posts: 5140
Liked: 430 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: utilization >1hr flattening min/max/avg values

Veeam Logoby ankl » Wed Apr 26, 2017 1:15 pm 1 person likes this post

Re-sampling the historical performance data per se is very common among monitoring/reporting products. Because of that the intermittent spikes of some values are being integrated to the smooth and more or less constant value on the historical graph. I've seen this many times myself.
But the maximum is still maximum. You could draw your graph with averaged over time data, but keep the maximum values untouched - for the record and display. Anyway, you could not "average" a maximum values. After that they become "average" data, not maximum values. And you already have the "Average" column in the performance chart legend.
In my opinion, the "Maximum" column in its current implementation is confusing, to say least; you either shouldn't resample/average maximum values over time at all or drop this column altogether.

Howbeit, thanks for the explanation.
And, BTW, great product overall, thanks!
ankl
Lurker
 
Posts: 2
Liked: 1 time
Joined: Wed Apr 26, 2017 9:03 am
Full Name: ankl

Re: utilization >1hr flattening min/max/avg values

Veeam Logoby Shestakov » Wed Apr 26, 2017 2:26 pm

I cannot disagree with you, but from the other hand if we say: "Here is the graph and that`s a maximal value", the question will be: "Why I don`t see the maximal value on the graph?"
We will think how to deal with both objections, because both look fair.
Thanks for thee kind words about the product!
Shestakov
Veeam Software
 
Posts: 5140
Liked: 430 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Previous

Return to Monitoring



Who is online

Users browsing this forum: No registered users and 1 guest