Discussions specific to the Microsoft Hyper-V hypervisor
pterpumpkin
Influencer
Posts: 22
Liked: 1 time
Joined: Jun 14, 2016 9:36 am
Full Name: Pter Pumpkin
Contact:

Re: Disconnecting D drives

Post by pterpumpkin » Apr 04, 2018 11:26 pm

Hi all!

We're are having the exact same issue.

Very random, and very hard to replicate.

I have tried setting a low storage QoS (500 IOPS and ~10 MB/s max throughput) on the C:\ and D:\ drives of a VM that has been affected, then running IO Meter to simulate high disk IO/latency. The disk queue lengths were 150+, but when backing up the server we were unable to replicate the issue.

Anyone else had any luck?


Pter

willa.t
Novice
Posts: 6
Liked: 1 time
Joined: Nov 25, 2013 3:33 pm
Full Name: Thomas Willa
Contact:

Re: Disconnecting D drives

Post by willa.t » Apr 06, 2018 6:33 am

Hi Peter,

please try the follow:
- Make Heavy IO
- Create Checkpoint manuel over VMM or Hyper-V
- Delete Checkpoint in the following 60 sec.
Now you should get the Disk Warning on the Disk with high IOs

Regrads, Thomas

pterpumpkin
Influencer
Posts: 22
Liked: 1 time
Joined: Jun 14, 2016 9:36 am
Full Name: Pter Pumpkin
Contact:

Re: Disconnecting D drives

Post by pterpumpkin » Apr 08, 2018 8:55 pm

Hi willa.t,

That is what i did, however i was unable to replicate.


Pter

willa.t
Novice
Posts: 6
Liked: 1 time
Joined: Nov 25, 2013 3:33 pm
Full Name: Thomas Willa
Contact:

Re: Disconnecting D drives

Post by willa.t » Apr 10, 2018 10:53 am

Hi Peter,

is it possible to deactivate your QoS Storage Policy. I have to generate round about 20-30k IOPS for reproducing this issue

Thomas

pterpumpkin
Influencer
Posts: 22
Liked: 1 time
Joined: Jun 14, 2016 9:36 am
Full Name: Pter Pumpkin
Contact:

Re: Disconnecting D drives

Post by pterpumpkin » May 21, 2018 9:40 pm

Hi willa.t,

Tried disabling storage QoS.

We have been unable to replicate the issue still. We've tried generating 100K+ IOPS of all different block sizes and read/write ratios. The disk queue length & latency is very high, but we still can't reproduce the issue.

We have noticed that all but one of the servers this has happened to (about 10 in total now) have had either an MS database or an Oracle database on them. Unsure if related or coincidence.

We have an MS case open, but it's not getting very far as they can't replicate it either.

Has anyone else had this issue?!


Pter.

willa.t
Novice
Posts: 6
Liked: 1 time
Joined: Nov 25, 2013 3:33 pm
Full Name: Thomas Willa
Contact:

Re: Disconnecting D drives

Post by willa.t » Jun 13, 2018 6:34 am

Hello Pter,

that is curious. In our szenario we can reproduce it on this way. Anyway I have good news from our MS Call. So the issue is confirmed from MS and they are working on it. Unfortunately it is categorized as High Risk Bug and it will takes time for testing. The final release date for this fix is planend on August.

Thomas

pterpumpkin
Influencer
Posts: 22
Liked: 1 time
Joined: Jun 14, 2016 9:36 am
Full Name: Pter Pumpkin
Contact:

Re: Disconnecting D drives

Post by pterpumpkin » Jun 13, 2018 9:36 pm

Hi willa.t,

We have a case open with Microsoft, but we have made zero progress with them.

Would it be possible to get your case number so that we can get them to cross reference?


Thanks!
Pter.

willa.t
Novice
Posts: 6
Liked: 1 time
Joined: Nov 25, 2013 3:33 pm
Full Name: Thomas Willa
Contact:

Re: Disconnecting D drives

Post by willa.t » Jun 14, 2018 7:48 am

You have PM :-)

jason.
Novice
Posts: 3
Liked: never
Joined: Jul 11, 2018 4:24 am
Full Name: Jason
Contact:

Re: Disconnecting D drives

Post by jason. » Sep 10, 2018 12:25 am

Hey everyone!!

Is there any word back from MS yet?

We've been lucky enough to has this issue too...

Tx

nmdange
Expert
Posts: 348
Liked: 82 times
Joined: Aug 20, 2015 9:30 pm
Contact:

Re: Disconnecting D drives

Post by nmdange » Sep 11, 2018 10:10 pm

I've had this issue intermittently as well. I think the fix may have been included in the August 30th CU. I'll be applying the September CU soon so hopefully that will resolve the problem.

https://support.microsoft.com/en-us/help/4343884
Addresses an issue that occurs when performing backup of a Virtual Machine (VM) or removing VM snapshots in a guest OS on Windows Server 2016. A “153 disk error” appears because the I/O takes longer than expected.

Post Reply

Who is online

Users browsing this forum: No registered users and 4 guests