Veeam 9 Update 1 and ESX 6 Update 2

VMware specific discussions

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby mwvme » Sun Mar 20, 2016 9:28 pm 1 person likes this post

Want to mention that I have been running v9 on U2 since the day it came out. No issues for me. All good.

Michael
mwvme
Veeam Software
 
Posts: 70
Liked: 18 times
Joined: Sat Dec 05, 2015 10:19 pm
Location: Calgary, Alberta Canada
Full Name: Michael White

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby jamerson » Sun Mar 20, 2016 10:22 pm

can we update to u2 now or have to wait for veeam ?
internally we have to update to u2 for security reasons but if the backup is not working than we can't .
jamerson
Expert
 
Posts: 257
Liked: 16 times
Joined: Wed May 01, 2013 9:54 pm
Full Name: Julien

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby ashleyw » Mon Mar 21, 2016 12:25 am 1 person likes this post

unfortunately we've updated our development system - we are seeing terrible performance and blocking IOs.

We read down the support notes and see this bomb shell:
General Storage Issues

New Issue ESXi 6.0 Update 2 hosts connected to certain storage arrays with a particular version of the firmware might see I/O timeouts and subsequent aborts
When ESXi 6.0 Update 2 hosts connected to certain storage arrays with a particular version of the firmware send requests for SMART data to the storage array, and if the array responds with a PDL error, the PDL response behavior in 6.0 update 2 might result in a condition where these failed commands are continuously retried thereby blocking other commands. This error results in widespread I/O timeouts and subsequent aborts.

Also, the ESXi hosts might take a long time to reconnect to the vCenter Server after reboot or the hosts might go into a Not Responding state in the vCenter Server. Storage-related tasks such as HBA rescan might take a very long time to complete.

Workaround: To resolve this issue, see Knowledge Base article 2133286.

We are running Cisco UCS hooking up to HP MSA and IBM DS SANs (both via fibre).
We are seeing the same behavior after disabling the smartd daemon to see if that helps.
Code: Select all
2016-03-21T00:22:51.935Z cpu8:38771)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x12 (0x439dc0e690c0, 0) to dev "naa.600c0ff000da597fba0a954b01000000" on path vmhba1:C0:T1:L4" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE

yep - VMware seem to have dropped another lemon of a release.
any suppor tnote that starts off with;
This is a known issue affecting VMware ESXi 6.0.
Currently, there is no resolution.

is a good reason to hang back....sigh.
ashleyw
Service Provider
 
Posts: 137
Liked: 16 times
Joined: Thu Oct 28, 2010 10:55 pm
Full Name: Ashley Watson

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby Gostev » Mon Mar 21, 2016 12:51 am

Hi, Ashley. Huge thanks for sharing your experience with the community! I bet this will save many people some sleepless night.
Gostev
Veeam Software
 
Posts: 21396
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby Gostev » Mon Mar 21, 2016 12:52 am

jamerson wrote:can we update to u2 now or have to wait for veeam ?
internally we have to update to u2 for security reasons but if the backup is not working than we can't .

In regards to Veeam functionality, we're not seeing any issues in our testing so far.
Gostev
Veeam Software
 
Posts: 21396
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby ashleyw » Mon Mar 21, 2016 2:59 am 1 person likes this post

We have ran further tests on our farm.
We disabled the smartd process as per the URL;
https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2133286

We found the performance at the storage layer was still abysmal and we were seeing IO blocks still.
We then decided to reboot the host after disabling the smartd service, and now the servers are running fine after this.
So I can only guess there must be something in the start up sequence that changes behavior when the smartd service id disabled at boot time.

For a minute there we thought we'd have to roll back the hypervisors! phew!
ashleyw
Service Provider
 
Posts: 137
Liked: 16 times
Joined: Thu Oct 28, 2010 10:55 pm
Full Name: Ashley Watson

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby JoseKo » Tue Mar 22, 2016 1:25 pm

I've updated VCenter and hosts to ESXi 6U2 -- all seems fine. My biggest question is whether I am able to update my storage from VSAN 6.1 to VSAN 6.2, also known as "disk format version 3".

ESXi6U2 corrects lots of problems with previous version, therefore it is a necessity for us to embrace U2 rather soon. We appreciate Veeam's collaboration to validate the new environment as son a possible.
JoseKo
Lurker
 
Posts: 1
Liked: never
Joined: Tue Mar 22, 2016 1:20 pm
Full Name: Jose Ortiz

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby homerjnick » Tue Mar 22, 2016 4:30 pm

Jeepers...we are on ESXi 5.1 with View 5.3.4 with Veeam 9 all on IBM HS22 Blades running off an IBM Storwize V5000...

Awaiting to install Cisco UCS Blades where we were planning to go to ESXi 6U2, View 6.2.2 with Veeam 9U1 but this project will stall as we keep waiting for a stable release of ESXi6!

The fact that the IO error is seen on IBM SAN's with Cisco UCS blades means at the moment NO CHANCE!

And VMWare's very on KB Support site is down at present!
homerjnick
Expert
 
Posts: 203
Liked: 35 times
Joined: Mon Feb 20, 2012 4:13 pm
Full Name: Nick Mahlitz

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby skrause » Tue Mar 22, 2016 5:36 pm

If you are running Storwize, you won't have the same experiences as the other user who mentioned they were having issues with his IBM SAN as he said he is running a D series which is a totally different codebase than the Storwize/SVC code.
Steve Krause
Veeam Certified Architect
skrause
Expert
 
Posts: 296
Liked: 45 times
Joined: Mon Dec 08, 2014 2:58 pm
Full Name: Steve Krause

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby homerjnick » Tue Mar 22, 2016 5:38 pm

Yeah but I can't access the KB to see what storage/vendors are affected...a list would be great!

EDIT...link is back up with no mention as to which vendors affected...seems you either need to disable the SMART daemon or contact your storage vendor to see if they have a firmware to stop the PDL...
homerjnick
Expert
 
Posts: 203
Liked: 35 times
Joined: Mon Feb 20, 2012 4:13 pm
Full Name: Nick Mahlitz

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby lbenaglia » Wed Mar 23, 2016 10:35 am 1 person likes this post

Hi all,

Yesterday I applied the Update 2 on two different vSphere 6 clusters:

1) 12 Cisco B230 M2, UCS Manager 2.2(6d), Cisco UCS 6248UP and Nexus 5548UP connected to Pure Storage //m20 via FC (Purity 4.5.5)
2) 4 HP DL180 Gen9, switch HP FF 5700-40XG-2QSFP+, HP SN6000B 16Gb 48-port/48-port Active Fibre Channel Switch conneted to Pure Storage FA-405 (Purity 4.5.5)

In both cases I don't have any IO or backup issues using Veeam 8 Update 3. I'm waiting for Veeam 9 Update 1 to upgrade the backup servers and the proxies.

Ciao!

--
Lorenzo
lbenaglia
Novice
 
Posts: 3
Liked: 1 time
Joined: Wed Oct 03, 2012 8:04 am
Full Name: Lorenzo Benaglia

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby m.novelli » Wed Mar 23, 2016 8:18 pm

Dell PowerVault MD3460 with SAS connections and December 2015 firmware seems to be NOT affected, vSphere upgraded 4 days ago, so far no issues.

Dell PowerVault MD3x owners should be on the safe side

Ciao, Marco
m.novelli
Veeam ProPartner
 
Posts: 299
Liked: 35 times
Joined: Tue Dec 29, 2009 12:48 pm
Location: Asti - Italy
Full Name: Marco Novelli

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby Gostev » Wed Mar 23, 2016 10:25 pm

Veeam 9 Update 1 will become generally available tomorrow, and we still have no issues to report on ESX 6 Update 2 based on our testing to date. Granted, we are testing only with Veeam 9 Update 1, but it should not make any difference comparing to Veeam 8 Update 3. Thanks!
Gostev
Veeam Software
 
Posts: 21396
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Veeam 9 Update 1 and ESX 6 Update 2

Veeam Logoby lbenaglia » Fri Mar 25, 2016 7:24 pm

Today Cody Hosterman confirmed in this post that Pure Storage Flash Arrays are not susceptible to the PDL bug:
http://www.codyhosterman.com/2016/03/recent-esxi-6-storage-bugs-and-the-flasharray/

Ciao!

--
Lorenzo
lbenaglia
Novice
 
Posts: 3
Liked: 1 time
Joined: Wed Oct 03, 2012 8:04 am
Full Name: Lorenzo Benaglia

[MERGED] v8 U3 with vCenter 6.0 U2

Veeam Logoby danielvaknin » Wed Mar 30, 2016 10:12 am

Hi all,

We are considering an upgrade to our vCenter server from vCenter 5.5 U2 to vCenter 6.0 U1/2.
I saw that U2 just came out a few days ago and wanted to know if it is compatible with our Veeam version.
We are using Veam B&R v8 U3 (build 2084).

Thanks!
danielvaknin
Veeam ProPartner
 
Posts: 3
Liked: never
Joined: Sun Nov 01, 2015 3:33 pm
Full Name: Daniel Vaknin

PreviousNext

Return to VMware vSphere



Who is online

Users browsing this forum: No registered users and 7 guests