Discussions specific to the VMware vSphere hypervisor
mwvme
Veeam Software
Posts: 128
Liked: 26 times
Joined: Dec 05, 2015 10:19 pm
Full Name: Michael White
Location: Calgary, Alberta Canada
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by mwvme » Mar 20, 2016 9:28 pm 1 person likes this post

Want to mention that I have been running v9 on U2 since the day it came out. No issues for me. All good.

Michael
Michael White
Field Product Manager
https://notesfrommwhite.net
@mwVme

jamerson
Expert
Posts: 295
Liked: 17 times
Joined: May 01, 2013 9:54 pm
Full Name: Julien
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by jamerson » Mar 20, 2016 10:22 pm

can we update to u2 now or have to wait for veeam ?
internally we have to update to u2 for security reasons but if the backup is not working than we can't .

ashleyw
Service Provider
Posts: 146
Liked: 20 times
Joined: Oct 28, 2010 10:55 pm
Full Name: Ashley Watson
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by ashleyw » Mar 21, 2016 12:25 am 1 person likes this post

unfortunately we've updated our development system - we are seeing terrible performance and blocking IOs.

We read down the support notes and see this bomb shell:
General Storage Issues

New Issue ESXi 6.0 Update 2 hosts connected to certain storage arrays with a particular version of the firmware might see I/O timeouts and subsequent aborts
When ESXi 6.0 Update 2 hosts connected to certain storage arrays with a particular version of the firmware send requests for SMART data to the storage array, and if the array responds with a PDL error, the PDL response behavior in 6.0 update 2 might result in a condition where these failed commands are continuously retried thereby blocking other commands. This error results in widespread I/O timeouts and subsequent aborts.

Also, the ESXi hosts might take a long time to reconnect to the vCenter Server after reboot or the hosts might go into a Not Responding state in the vCenter Server. Storage-related tasks such as HBA rescan might take a very long time to complete.

Workaround: To resolve this issue, see Knowledge Base article 2133286.
We are running Cisco UCS hooking up to HP MSA and IBM DS SANs (both via fibre).
We are seeing the same behavior after disabling the smartd daemon to see if that helps.

Code: Select all

2016-03-21T00:22:51.935Z cpu8:38771)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x12 (0x439dc0e690c0, 0) to dev "naa.600c0ff000da597fba0a954b01000000" on path vmhba1:C0:T1:L4" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE
yep - VMware seem to have dropped another lemon of a release.
any suppor tnote that starts off with;
This is a known issue affecting VMware ESXi 6.0.
Currently, there is no resolution.
is a good reason to hang back....sigh.

Gostev
Veeam Software
Posts: 23114
Liked: 2916 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Gostev » Mar 21, 2016 12:51 am

Hi, Ashley. Huge thanks for sharing your experience with the community! I bet this will save many people some sleepless night.

Gostev
Veeam Software
Posts: 23114
Liked: 2916 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Gostev » Mar 21, 2016 12:52 am

jamerson wrote:can we update to u2 now or have to wait for veeam ?
internally we have to update to u2 for security reasons but if the backup is not working than we can't .
In regards to Veeam functionality, we're not seeing any issues in our testing so far.

ashleyw
Service Provider
Posts: 146
Liked: 20 times
Joined: Oct 28, 2010 10:55 pm
Full Name: Ashley Watson
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by ashleyw » Mar 21, 2016 2:59 am 1 person likes this post

We have ran further tests on our farm.
We disabled the smartd process as per the URL;
https://kb.vmware.com/selfservice/micro ... Id=2133286

We found the performance at the storage layer was still abysmal and we were seeing IO blocks still.
We then decided to reboot the host after disabling the smartd service, and now the servers are running fine after this.
So I can only guess there must be something in the start up sequence that changes behavior when the smartd service id disabled at boot time.

For a minute there we thought we'd have to roll back the hypervisors! phew!

JoseKo
Lurker
Posts: 1
Liked: never
Joined: Mar 22, 2016 1:20 pm
Full Name: Jose Ortiz
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by JoseKo » Mar 22, 2016 1:25 pm

I've updated VCenter and hosts to ESXi 6U2 -- all seems fine. My biggest question is whether I am able to update my storage from VSAN 6.1 to VSAN 6.2, also known as "disk format version 3".

ESXi6U2 corrects lots of problems with previous version, therefore it is a necessity for us to embrace U2 rather soon. We appreciate Veeam's collaboration to validate the new environment as son a possible.

homerjnick
Expert
Posts: 205
Liked: 35 times
Joined: Feb 20, 2012 4:13 pm
Full Name: Nick Mahlitz
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by homerjnick » Mar 22, 2016 4:30 pm

Jeepers...we are on ESXi 5.1 with View 5.3.4 with Veeam 9 all on IBM HS22 Blades running off an IBM Storwize V5000...

Awaiting to install Cisco UCS Blades where we were planning to go to ESXi 6U2, View 6.2.2 with Veeam 9U1 but this project will stall as we keep waiting for a stable release of ESXi6!

The fact that the IO error is seen on IBM SAN's with Cisco UCS blades means at the moment NO CHANCE!

And VMWare's very on KB Support site is down at present!

skrause
Expert
Posts: 363
Liked: 65 times
Joined: Dec 08, 2014 2:58 pm
Full Name: Steve Krause
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by skrause » Mar 22, 2016 5:36 pm

If you are running Storwize, you won't have the same experiences as the other user who mentioned they were having issues with his IBM SAN as he said he is running a D series which is a totally different codebase than the Storwize/SVC code.
Steve Krause
Veeam Certified Architect

homerjnick
Expert
Posts: 205
Liked: 35 times
Joined: Feb 20, 2012 4:13 pm
Full Name: Nick Mahlitz
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by homerjnick » Mar 22, 2016 5:38 pm

Yeah but I can't access the KB to see what storage/vendors are affected...a list would be great!

EDIT...link is back up with no mention as to which vendors affected...seems you either need to disable the SMART daemon or contact your storage vendor to see if they have a firmware to stop the PDL...

lbenaglia
Novice
Posts: 3
Liked: 1 time
Joined: Oct 03, 2012 8:04 am
Full Name: Lorenzo Benaglia
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by lbenaglia » Mar 23, 2016 10:35 am 1 person likes this post

Hi all,

Yesterday I applied the Update 2 on two different vSphere 6 clusters:

1) 12 Cisco B230 M2, UCS Manager 2.2(6d), Cisco UCS 6248UP and Nexus 5548UP connected to Pure Storage //m20 via FC (Purity 4.5.5)
2) 4 HP DL180 Gen9, switch HP FF 5700-40XG-2QSFP+, HP SN6000B 16Gb 48-port/48-port Active Fibre Channel Switch conneted to Pure Storage FA-405 (Purity 4.5.5)

In both cases I don't have any IO or backup issues using Veeam 8 Update 3. I'm waiting for Veeam 9 Update 1 to upgrade the backup servers and the proxies.

Ciao!

--
Lorenzo

m.novelli
Veeam ProPartner
Posts: 337
Liked: 38 times
Joined: Dec 29, 2009 12:48 pm
Full Name: Marco Novelli
Location: Asti - Italy
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by m.novelli » Mar 23, 2016 8:18 pm

Dell PowerVault MD3460 with SAS connections and December 2015 firmware seems to be NOT affected, vSphere upgraded 4 days ago, so far no issues.

Dell PowerVault MD3x owners should be on the safe side

Ciao, Marco

Gostev
Veeam Software
Posts: 23114
Liked: 2916 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Gostev » Mar 23, 2016 10:25 pm

Veeam 9 Update 1 will become generally available tomorrow, and we still have no issues to report on ESX 6 Update 2 based on our testing to date. Granted, we are testing only with Veeam 9 Update 1, but it should not make any difference comparing to Veeam 8 Update 3. Thanks!

lbenaglia
Novice
Posts: 3
Liked: 1 time
Joined: Oct 03, 2012 8:04 am
Full Name: Lorenzo Benaglia
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by lbenaglia » Mar 25, 2016 7:24 pm

Today Cody Hosterman confirmed in this post that Pure Storage Flash Arrays are not susceptible to the PDL bug:
http://www.codyhosterman.com/2016/03/re ... lasharray/

Ciao!

--
Lorenzo

danielvaknin
Veeam ProPartner
Posts: 3
Liked: never
Joined: Nov 01, 2015 3:33 pm
Full Name: Daniel Vaknin
Contact:

[MERGED] v8 U3 with vCenter 6.0 U2

Post by danielvaknin » Mar 30, 2016 10:12 am

Hi all,

We are considering an upgrade to our vCenter server from vCenter 5.5 U2 to vCenter 6.0 U1/2.
I saw that U2 just came out a few days ago and wanted to know if it is compatible with our Veeam version.
We are using Veam B&R v8 U3 (build 2084).

Thanks!

Post Reply

Who is online

Users browsing this forum: No registered users and 21 guests