Discussions specific to the VMware vSphere hypervisor
mkretzer
Expert
Posts: 556
Liked: 124 times
Joined: Dec 17, 2015 7:17 am
Contact:

Veeam 9 Update 1 and ESX 6 Update 2

Post by mkretzer » Mar 16, 2016 2:08 pm

Hello,

is Veeam Update 1 supported with ESX 6 Update 2?

Markus

Gostev
SVP, Product Management
Posts: 24812
Liked: 3572 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam Update 1 and ESX 6 Update 2

Post by Gostev » Mar 16, 2016 7:42 pm

Hello, we have not completed the testing it yet, as it just became available today. We will update once we hear back from our QC. Thanks!

mkretzer
Expert
Posts: 556
Liked: 124 times
Joined: Dec 17, 2015 7:17 am
Contact:

Re: Veeam Update 1 and ESX 6 Update 2

Post by mkretzer » Mar 16, 2016 9:07 pm

Hello,

at least VC 6U2 seems to work with Veeam 9U1.

Markus

Gostev
SVP, Product Management
Posts: 24812
Liked: 3572 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam Update 1 and ESX 6 Update 2

Post by Gostev » Mar 16, 2016 9:12 pm

Indeed, usually these updates are non-breaking, and until recently we did not even test them before declaring support, as they never ever broke anything. However, we had to change our practices recently due to all the major quality issues that have started plaguing VMware in 2015, so now we do require at least "smoke testing" to complete on our side before declaring the official support. Thanks!

mkretzer
Expert
Posts: 556
Liked: 124 times
Joined: Dec 17, 2015 7:17 am
Contact:

Re: Veeam Update 1 and ESX 6 Update 2

Post by mkretzer » Mar 17, 2016 6:25 am

That means if we have any issue we will not get help now?

Since we have to install new ESX today we thought it might be best to use the new version...

How long will Veeam need for initial tests? Should we install ESX 6 Update1b with all patches but update2 on the new hosts? That VC is already updated should not be an issue as data is transfered by ESX server correct?

What do you recommend?

Markus

Gostev
SVP, Product Management
Posts: 24812
Liked: 3572 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam Update 1 and ESX 6 Update 2

Post by Gostev » Mar 17, 2016 2:13 pm

No, we certainly will not turn you in support just because you are using Update 2. Rather, we will investigate the issue with you and if it turns to be caused by Update 2, we will provide you the required hot fix (if the issue can be fixed on our side). In the end, it is in our best interest to become compatible with Update 2 ASAP.

I recommend going with Update 2 in your case, since the risk is quite low (it should not have too many differences with Update 1b, since it's been just a few weeks since the latter was released).

All initial tests should be completed by the end of the week.

tinto1970
Enthusiast
Posts: 81
Liked: 28 times
Joined: Sep 26, 2013 8:40 am
Full Name: Alessandro Tinivelli
Location: Bologna, Italy
Contact:

Re: Veeam Update 1 and ESX 6 Update 2

Post by tinto1970 » Mar 17, 2016 4:38 pm

I'm taking the risk too, in a little and not as critical cluster, because I'm worried about some issues u2 should resolve (i.e. multipath related).

Tomorrow morning i will post if something went wrong or not ;)
Alessandro Tinivelli aka Tinto
@tinto1970

Gostev
SVP, Product Management
Posts: 24812
Liked: 3572 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam Update 1 and ESX 6 Update 2

Post by Gostev » Mar 17, 2016 4:40 pm 1 person likes this post

After the first day of testing we have not seen any issues so far.

rreed
Expert
Posts: 354
Liked: 72 times
Joined: Jun 30, 2015 6:06 pm
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by rreed » Mar 17, 2016 5:18 pm

Glad I stumbled onto this, we'll be rolling VMware u2 probably next week per an internal requirement - THAT SNMP ACTUALLY WORK W/ VCENTERS W/ EXTERNAL PSC'S. :evil: :evil: :evil: Anyways, likely by end of next week or early week after I can help report back if Veeam gets bent out of shape about it.

At that, I have not yet rolled Veeam u1 but need to look at the release notes to see if I should.
VMware 6
Veeam B&R v9
Dell DR4100's
EMC DD2200's
EMC DD620's
Dell TL2000 via PE430 (SAS)

tinto1970
Enthusiast
Posts: 81
Liked: 28 times
Joined: Sep 26, 2013 8:40 am
Full Name: Alessandro Tinivelli
Location: Bologna, Italy
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by tinto1970 » Mar 18, 2016 8:28 am 1 person likes this post

all went fine here with u2 (vcenter on windows, embedded, datastore iscsi)
Alessandro Tinivelli aka Tinto
@tinto1970

Nobody
Influencer
Posts: 13
Liked: never
Joined: Apr 18, 2011 11:32 am
Full Name: Andreas Girrbach
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Nobody » Mar 18, 2016 8:40 am

Are you also doing QC against Veeam 8 Update 3 and ESXi 6.0u2?

We are not on Veeam 9 yet and will be forced to update to vCenter 6.0u2 as soon as possible.
vCenter 6.0u1 was a ton of bugs and u2 makes it slightly better, but still some remaining.

I'm glad that we do not suffer the same pain with backups as we have with the vCenter...

tinto1970
Enthusiast
Posts: 81
Liked: 28 times
Joined: Sep 26, 2013 8:40 am
Full Name: Alessandro Tinivelli
Location: Bologna, Italy
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by tinto1970 » Mar 18, 2016 9:00 am 3 people like this post

Nobody wrote: We are not on Veeam 9.
why? :)
Alessandro Tinivelli aka Tinto
@tinto1970

Nobody
Influencer
Posts: 13
Liked: never
Joined: Apr 18, 2011 11:32 am
Full Name: Andreas Girrbach
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Nobody » Mar 18, 2016 1:25 pm

tinto1970 wrote: why? :)
Still working on fixing VMware Bugs, no time to update working Veeam :roll:

Gostev
SVP, Product Management
Posts: 24812
Liked: 3572 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Gostev » Mar 19, 2016 1:33 am

Nobody wrote:Are you also doing QC against Veeam 8 Update 3 and ESXi 6.0u2?
No, we are only testing the current version. However, I don't foresee v8 U3 having any issues if v9 does not have them, which is the case so far.

mkretzer
Expert
Posts: 556
Liked: 124 times
Joined: Dec 17, 2015 7:17 am
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by mkretzer » Mar 19, 2016 2:28 pm 1 person likes this post

Ok no issues here as well with update 2.

Using Veeam 9U1 and direct SAN backup.

mwvme
Expert
Posts: 163
Liked: 33 times
Joined: Dec 05, 2015 10:19 pm
Full Name: Michael White
Location: Calgary, Alberta Canada
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by mwvme » Mar 20, 2016 9:28 pm 1 person likes this post

Want to mention that I have been running v9 on U2 since the day it came out. No issues for me. All good.

Michael
Michael White
Field Product Manager
https://notesfrommwhite.net
@mwVme

jamerson
Expert
Posts: 313
Liked: 18 times
Joined: May 01, 2013 9:54 pm
Full Name: Julien
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by jamerson » Mar 20, 2016 10:22 pm

can we update to u2 now or have to wait for veeam ?
internally we have to update to u2 for security reasons but if the backup is not working than we can't .

ashleyw
Service Provider
Posts: 154
Liked: 20 times
Joined: Oct 28, 2010 10:55 pm
Full Name: Ashley Watson
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by ashleyw » Mar 21, 2016 12:25 am 1 person likes this post

unfortunately we've updated our development system - we are seeing terrible performance and blocking IOs.

We read down the support notes and see this bomb shell:
General Storage Issues

New Issue ESXi 6.0 Update 2 hosts connected to certain storage arrays with a particular version of the firmware might see I/O timeouts and subsequent aborts
When ESXi 6.0 Update 2 hosts connected to certain storage arrays with a particular version of the firmware send requests for SMART data to the storage array, and if the array responds with a PDL error, the PDL response behavior in 6.0 update 2 might result in a condition where these failed commands are continuously retried thereby blocking other commands. This error results in widespread I/O timeouts and subsequent aborts.

Also, the ESXi hosts might take a long time to reconnect to the vCenter Server after reboot or the hosts might go into a Not Responding state in the vCenter Server. Storage-related tasks such as HBA rescan might take a very long time to complete.

Workaround: To resolve this issue, see Knowledge Base article 2133286.
We are running Cisco UCS hooking up to HP MSA and IBM DS SANs (both via fibre).
We are seeing the same behavior after disabling the smartd daemon to see if that helps.

Code: Select all

2016-03-21T00:22:51.935Z cpu8:38771)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x12 (0x439dc0e690c0, 0) to dev "naa.600c0ff000da597fba0a954b01000000" on path vmhba1:C0:T1:L4" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE
yep - VMware seem to have dropped another lemon of a release.
any suppor tnote that starts off with;
This is a known issue affecting VMware ESXi 6.0.
Currently, there is no resolution.
is a good reason to hang back....sigh.

Gostev
SVP, Product Management
Posts: 24812
Liked: 3572 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Gostev » Mar 21, 2016 12:51 am

Hi, Ashley. Huge thanks for sharing your experience with the community! I bet this will save many people some sleepless night.

Gostev
SVP, Product Management
Posts: 24812
Liked: 3572 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Gostev » Mar 21, 2016 12:52 am

jamerson wrote:can we update to u2 now or have to wait for veeam ?
internally we have to update to u2 for security reasons but if the backup is not working than we can't .
In regards to Veeam functionality, we're not seeing any issues in our testing so far.

ashleyw
Service Provider
Posts: 154
Liked: 20 times
Joined: Oct 28, 2010 10:55 pm
Full Name: Ashley Watson
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by ashleyw » Mar 21, 2016 2:59 am 1 person likes this post

We have ran further tests on our farm.
We disabled the smartd process as per the URL;
https://kb.vmware.com/selfservice/micro ... Id=2133286

We found the performance at the storage layer was still abysmal and we were seeing IO blocks still.
We then decided to reboot the host after disabling the smartd service, and now the servers are running fine after this.
So I can only guess there must be something in the start up sequence that changes behavior when the smartd service id disabled at boot time.

For a minute there we thought we'd have to roll back the hypervisors! phew!

JoseKo
Lurker
Posts: 1
Liked: never
Joined: Mar 22, 2016 1:20 pm
Full Name: Jose Ortiz
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by JoseKo » Mar 22, 2016 1:25 pm

I've updated VCenter and hosts to ESXi 6U2 -- all seems fine. My biggest question is whether I am able to update my storage from VSAN 6.1 to VSAN 6.2, also known as "disk format version 3".

ESXi6U2 corrects lots of problems with previous version, therefore it is a necessity for us to embrace U2 rather soon. We appreciate Veeam's collaboration to validate the new environment as son a possible.

homerjnick
Expert
Posts: 211
Liked: 35 times
Joined: Feb 20, 2012 4:13 pm
Full Name: Nick Mahlitz
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by homerjnick » Mar 22, 2016 4:30 pm

Jeepers...we are on ESXi 5.1 with View 5.3.4 with Veeam 9 all on IBM HS22 Blades running off an IBM Storwize V5000...

Awaiting to install Cisco UCS Blades where we were planning to go to ESXi 6U2, View 6.2.2 with Veeam 9U1 but this project will stall as we keep waiting for a stable release of ESXi6!

The fact that the IO error is seen on IBM SAN's with Cisco UCS blades means at the moment NO CHANCE!

And VMWare's very on KB Support site is down at present!

skrause
Expert
Posts: 438
Liked: 91 times
Joined: Dec 08, 2014 2:58 pm
Full Name: Steve Krause
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by skrause » Mar 22, 2016 5:36 pm

If you are running Storwize, you won't have the same experiences as the other user who mentioned they were having issues with his IBM SAN as he said he is running a D series which is a totally different codebase than the Storwize/SVC code.
Steve Krause
Veeam Certified Architect

homerjnick
Expert
Posts: 211
Liked: 35 times
Joined: Feb 20, 2012 4:13 pm
Full Name: Nick Mahlitz
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by homerjnick » Mar 22, 2016 5:38 pm

Yeah but I can't access the KB to see what storage/vendors are affected...a list would be great!

EDIT...link is back up with no mention as to which vendors affected...seems you either need to disable the SMART daemon or contact your storage vendor to see if they have a firmware to stop the PDL...

lbenaglia
Novice
Posts: 3
Liked: 1 time
Joined: Oct 03, 2012 8:04 am
Full Name: Lorenzo Benaglia
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by lbenaglia » Mar 23, 2016 10:35 am 1 person likes this post

Hi all,

Yesterday I applied the Update 2 on two different vSphere 6 clusters:

1) 12 Cisco B230 M2, UCS Manager 2.2(6d), Cisco UCS 6248UP and Nexus 5548UP connected to Pure Storage //m20 via FC (Purity 4.5.5)
2) 4 HP DL180 Gen9, switch HP FF 5700-40XG-2QSFP+, HP SN6000B 16Gb 48-port/48-port Active Fibre Channel Switch conneted to Pure Storage FA-405 (Purity 4.5.5)

In both cases I don't have any IO or backup issues using Veeam 8 Update 3. I'm waiting for Veeam 9 Update 1 to upgrade the backup servers and the proxies.

Ciao!

--
Lorenzo

m.novelli
Veeam ProPartner
Posts: 355
Liked: 40 times
Joined: Dec 29, 2009 12:48 pm
Full Name: Marco Novelli
Location: Asti - Italy
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by m.novelli » Mar 23, 2016 8:18 pm

Dell PowerVault MD3460 with SAS connections and December 2015 firmware seems to be NOT affected, vSphere upgraded 4 days ago, so far no issues.

Dell PowerVault MD3x owners should be on the safe side

Ciao, Marco

Gostev
SVP, Product Management
Posts: 24812
Liked: 3572 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by Gostev » Mar 23, 2016 10:25 pm

Veeam 9 Update 1 will become generally available tomorrow, and we still have no issues to report on ESX 6 Update 2 based on our testing to date. Granted, we are testing only with Veeam 9 Update 1, but it should not make any difference comparing to Veeam 8 Update 3. Thanks!

lbenaglia
Novice
Posts: 3
Liked: 1 time
Joined: Oct 03, 2012 8:04 am
Full Name: Lorenzo Benaglia
Contact:

Re: Veeam 9 Update 1 and ESX 6 Update 2

Post by lbenaglia » Mar 25, 2016 7:24 pm

Today Cody Hosterman confirmed in this post that Pure Storage Flash Arrays are not susceptible to the PDL bug:
http://www.codyhosterman.com/2016/03/re ... lasharray/

Ciao!

--
Lorenzo

danielvaknin
Veeam ProPartner
Posts: 3
Liked: never
Joined: Nov 01, 2015 3:33 pm
Full Name: Daniel Vaknin
Contact:

[MERGED] v8 U3 with vCenter 6.0 U2

Post by danielvaknin » Mar 30, 2016 10:12 am

Hi all,

We are considering an upgrade to our vCenter server from vCenter 5.5 U2 to vCenter 6.0 U1/2.
I saw that U2 just came out a few days ago and wanted to know if it is compatible with our Veeam version.
We are using Veam B&R v8 U3 (build 2084).

Thanks!

Post Reply

Who is online

Users browsing this forum: Andreas Neufert and 20 guests