Discussions specific to the VMware vSphere hypervisor
Gostev
SVP, Product Management
Posts: 25149
Liked: 3700 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: vSphere 5.5 tests done?

Post by Gostev » Oct 30, 2013 4:05 pm

donativo wrote:It canceled and failed over to network mode. In exactly this second the whole ESX gives me a purple screen of death! I thought it was just an error. Tried again, and it happened again just in this second where it failed over to network mode. So something is really not working there.
I concur. We've been doing stress testing of our vSphere 5.5 support code for the past few weeks, and we've seen plenty of PSODs with ESXi 5.5 under heavy load... it is prone to crashing like no other ESXi version before. I like to say, Windows Vista was solid as a rock comparing to ESXi 5.5 (and this says a lot).

Of course, we are using all the same hosts that were previously running older ESXi versions, and those were solid. So, things are not looking good for ESXi 5.5.

We have some ideas on what specifically is causing this, confirming them right now by eliminating a suspect from the equation, and will be opening a support case with VMware soon.

P.S. Specifically regarding hot add not working, this is the known interoperability issue between vSphere 5.5 and VDDK 5.1 that is resolved in VDDK 5.5.

dkvello
Service Provider
Posts: 93
Liked: 12 times
Joined: Jan 01, 2006 1:01 am
Full Name: Dag Kvello
Location: Oslo, Norway
Contact:

Re: vSphere 5.5 tests done?

Post by dkvello » Oct 30, 2013 10:07 pm

Hmm, I've got some 120 hosts running on 5.5 (on mulitple sites, IBM and HP Hardware) and have not seen any PSOD's or other instability. All sites run Fiber-channel storage (IBM Storwize, EmC VNX, HP 3PAR).
I've only encountered API problems with Veeam 7 against ESXi 5.5 hosts when using SAN based backup, so I've moved to Network for the time being.
What exacttly do You suspect being the culprit in your PSOD endeavours?

Gostev
SVP, Product Management
Posts: 25149
Liked: 3700 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: vSphere 5.5 tests done?

Post by Gostev » Oct 31, 2013 11:49 am

E1000E vNIC under heavy load.

Vasko
Influencer
Posts: 11
Liked: 1 time
Joined: Oct 31, 2013 12:11 pm
Full Name: Felix Geschwindner
Contact:

Re: vSphere 5.5 tests done?

Post by Vasko » Oct 31, 2013 12:19 pm

Gostev wrote:E1000E vNIC under heavy load.
I maybe have a confirmation on weird E1000E behavior:

I'm building a new AD Environment based on ESXi 5.5. Default Adapter when adding NIC to Machine in vSphere WebClient 5.5 is E1000E which I didn't change.
In the process of investigating sync issues between two DCs/Exchange Servers, I figured out that every packet that's been received/send by an E1000E has its last 8bytes set to ZEROS. Disabling FlowControl and/or Checksum offload didn't help a bit.
After I changed the Adapter to VMXNET3 the Problems went away.

Maybe this helps your tests.

Greetings,
Vasko

dkvello
Service Provider
Posts: 93
Liked: 12 times
Joined: Jan 01, 2006 1:01 am
Full Name: Dag Kvello
Location: Oslo, Norway
Contact:

Re: vSphere 5.5 tests done?

Post by dkvello » Oct 31, 2013 3:28 pm

Gostev wrote:E1000E vNIC under heavy load.
Ah, I haven't used Flexible or E1000 for many years. Only VMXNET variants for as long as I can remember. No wonder I haven't run into any of those PSOD's or W2K12 + E1000 problems.

Gostev
SVP, Product Management
Posts: 25149
Liked: 3700 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: vSphere 5.5 tests done?

Post by Gostev » Oct 31, 2013 4:02 pm

The problem here is that E1000E is the default choice for the new VMs since vSphere 5.0.

jsurcombe
Lurker
Posts: 1
Liked: never
Joined: Nov 01, 2013 3:54 pm
Contact:

Re: vSphere 5.5 tests done?

Post by jsurcombe » Nov 01, 2013 4:01 pm

The E1000E NIC seems to cause a PSODs with Windows 2012 R2 or Windows 8.1 guests on (at least) vSphere 5.1 U1 and vSphere 5.5 when under network load. Changing the NIC to VMXNET3 is the recommended workaround until the next update of vSphere 5.5. I suspect a lot of people are going to hit this, because the E1000E NIC is the default for Windows 2012 guests (and there's no separate option for 2012 R2).

See https://communities.vmware.com/message/2297546

jamerson
Expert
Posts: 313
Liked: 18 times
Joined: May 01, 2013 9:54 pm
Full Name: Julien
Contact:

Re: vSphere 5.5 tests done?

Post by jamerson » Nov 03, 2013 9:19 pm

i have installed Veeam 7 on ESXI 5.5 i've created a backup job,
it works really ( 2008R2 ), i backedup both DC and Exchange

donativo
Lurker
Posts: 2
Liked: never
Joined: Oct 28, 2013 6:04 am
Full Name: Alexander Bonzoll

Re: vSphere 5.5 tests done?

Post by donativo » Nov 05, 2013 10:21 am

mysidia wrote: If you can reproduce that condition on separate hardware, it seems you stumbled upon a nasty ESXi bug -- Even if Veeam is utterly broken, it should not be capable of crashing ESXi with API calls.

I do think the vSphere community could potentially benefit if you can get more info on the purple screen condition and report the purple screen issue to VMware, as you may have exposed a bug that also has security ramifications for ESXi.
i think vmware and its community figured this out already.
https://communities.vmware.com/message/2297546

I will also give it a try to change the NIC on my Server 2012 r2 VM to VMXNET3 or E1000. But unless Server 2012R2 is not supported anyway by Veeam I will wait.

smuzzey
Lurker
Posts: 2
Liked: never
Joined: Nov 05, 2013 6:08 pm
Contact:

Re: vSphere 5.5 tests done?

Post by smuzzey » Nov 05, 2013 6:14 pm

jamerson wrote:i have installed Veeam 7 on ESXI 5.5 i've created a backup job,
it works really ( 2008R2 ), i backedup both DC and Exchange
I did the same and have been running it for a while. Hottadd doesn't work but everything else was working fine so on my small cluster so I upgraded to 5.5. For a couple of weeks it was running fine until Friday when it started giving me trouble. All but one of my VM's give me failed to open VDDK disk errors. The strange part is nothing was changed and one VM still backs up fine.

Anyway I put in a ticket and just as I thought they won't deal with it because it's 5.5 so I guess I'll be using VSphere data protection until Veeam gets a working version for us. The did mention late next month but that's subject to change.

jp34
Enthusiast
Posts: 47
Liked: 1 time
Joined: Dec 22, 2009 8:31 am
Full Name: JP
Contact:

Re: vSphere 5.5 tests done?

Post by jp34 » Nov 12, 2013 1:32 pm

Hi all,
I don't understand if the issue comes from vCenter or ESXi version...
Would veeam 7 work fine backing up VMs running on an ESXi 5.0 managed by a vCenter Appliance 5.5 ?
Thanks in advance.

foggy
Veeam Software
Posts: 18458
Liked: 1589 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: vSphere 5.5 tests done?

Post by foggy » Nov 12, 2013 1:38 pm

Some customers have reported above the successful Veeam B&R operation on this kind of setup, however full official vSphere 5.5 support will be available in the upcoming Veeam B&R v7 R2 release only.

Morat
Influencer
Posts: 13
Liked: 1 time
Joined: Jul 28, 2011 12:56 pm
Contact:

Re: vSphere 5.5 tests done?

Post by Morat » Nov 12, 2013 1:56 pm

I did see somewhere that there would be a patch2 for Veeam7.0 and it would support VMWare 5.5 - any news from anywhere?
Cheers,
Morat

edit: clearly I missed a page :)

Does anyone know if R2 is expected any time soon? If it's going to be next year then I'll need to upgrade to VMWare 5.1 then 5.5 when I'd rather go from 5.0 direct to 5.5.

foggy
Veeam Software
Posts: 18458
Liked: 1589 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: vSphere 5.5 tests done?

Post by foggy » Nov 12, 2013 2:05 pm 2 people like this post

We decided to refer to the patch 2 as Veeam B&R v7 R2 release due to the amount of new functionality it brings. So Patch #2 and v7 R2 update is the same release that will be out in several days.

Morat
Influencer
Posts: 13
Liked: 1 time
Joined: Jul 28, 2011 12:56 pm
Contact:

Re: vSphere 5.5 tests done?

Post by Morat » Nov 12, 2013 2:07 pm

Hurrah \o/

thanks foggy.
Morat

smuzzey
Lurker
Posts: 2
Liked: never
Joined: Nov 05, 2013 6:08 pm
Contact:

Re: vSphere 5.5 tests done?

Post by smuzzey » Nov 12, 2013 6:18 pm

Excellent this is good to hear

jja
Enthusiast
Posts: 45
Liked: 8 times
Joined: Nov 13, 2013 6:40 am
Full Name: Jannis Jacobsen
Contact:

Re: vSphere 5.5 tests done?

Post by jja » Nov 13, 2013 6:57 am

Ah, can't wait to get this version.
We upgraded to v7 last friday, guess we should have waited 2 weeks more.. :)
Ah well, all the backups seems to work for now.

Will the "R2" release be a full upgrade job?

-j

foggy
Veeam Software
Posts: 18458
Liked: 1589 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: vSphere 5.5 tests done?

Post by foggy » Nov 13, 2013 7:08 am 1 person likes this post

It will not be a new full product build, but an update that is applied to the current installation.

scott.anderson
Service Provider
Posts: 64
Liked: 8 times
Joined: Sep 14, 2011 6:48 am
Full Name: Scott Anderson
Contact:

Re: vSphere 5.5 tests done?

Post by scott.anderson » Nov 14, 2013 1:06 am

When when when ?! :) Today or tomorrow?

superdekster
Influencer
Posts: 12
Liked: 6 times
Joined: Oct 23, 2013 9:32 am
Full Name: Aleksandr Alpatov
Contact:

Re: vSphere 5.5 tests done?

Post by superdekster » Nov 14, 2013 3:24 am

November as Gostev said :)

antivir
Enthusiast
Posts: 63
Liked: never
Joined: Nov 04, 2009 2:39 pm
Full Name: Andrew
Contact:

Re: vSphere 5.5 tests done?

Post by antivir » Nov 14, 2013 3:47 am


jja
Enthusiast
Posts: 45
Liked: 8 times
Joined: Nov 13, 2013 6:40 am
Full Name: Jannis Jacobsen
Contact:

Re: vSphere 5.5 tests done?

Post by jja » Nov 14, 2013 9:17 am

I upgraded from v7 build x.690 to the R2 patch now.
Looks very good.
Now the web client plugin works as it should aswell :)

Good job!

-j

Gostev
SVP, Product Management
Posts: 25149
Liked: 3700 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: vSphere 5.5 tests done?

Post by Gostev » Nov 14, 2013 1:49 pm

Yep, vSphere 5.5 tests are now done ;) so I am locking down this thread. Thanks everyone for your patience!

Locked

Who is online

Users browsing this forum: No registered users and 18 guests