ESXi 6.0 Express Patch 6 breaks CBT

VMware specific discussions

ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby svenh » Thu Jun 16, 2016 8:36 pm

Hi!

Just a little heads up:

http://www.running-system.com/take-care ... p-cbt-bug/

Short synopsis: "There is an issue with Change Block Tracking (CBT) in Express Patch 6 for ESXi 6 (Build 3825889) that can affect your backup if your backup software relies on CBT."

Affected are Windows VMs on HW version 7 to 11 and with any VMware Tools version on both thin and thick provisioned disks while doing backups with quiesced snapshots.

Solutions so far:
  • don't use quiesced, i.e. application-aware snapshots
  • or downgrade to a older ESXi6 version
If you have been hit, you have to reset your CBT data after fixing the problem (as usual with CBT problems).
svenh
Enthusiast
 
Posts: 26
Liked: 5 times
Joined: Thu Jan 21, 2016 12:56 pm
Location: Germany
Full Name: Sven Hartge

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby mkretzer » Thu Jun 16, 2016 9:00 pm

Does somebody know already if this means corrupted backups or only slow backups because CBT is just not working? From the article it sounds like CBT is just not working and the backups should be ok...
mkretzer
Expert
 
Posts: 342
Liked: 74 times
Joined: Thu Dec 17, 2015 7:17 am

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby justind » Fri Jun 17, 2016 12:35 am

What on earth has happened to VMware? Every patch they release either fixes or breaks CBT then requires a CBT reset.

I don't recall a time (since ESX 3 anyway) where i have had to revert patches. Or downgrade VM tools mind you either.

The numpties even have the hide to send out an email asking for beta testers for vSphere.Next... maybe they should focus on vSphere.Now!!!
justind
Enthusiast
 
Posts: 29
Liked: 4 times
Joined: Sun Nov 09, 2014 4:20 am
Location: Australia

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby dkrimmer » Mon Jun 20, 2016 5:58 am

mkretzer wrote:Does somebody know already if this means corrupted backups or only slow backups because CBT is just not working? From the article it sounds like CBT is just not working and the backups should be ok...


Can anybody please confirm that (other than the last CBT bug) this newly introduced bug doesn't mean corrupt backups which B&R has no way to detect? While extended backup time due to unavailability of CBT is bad, unnoticed backup corruptions are of course much worse. Thanks.
dkrimmer
Lurker
 
Posts: 2
Liked: never
Joined: Tue May 12, 2015 3:21 pm

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby lando_uk » Tue Jun 21, 2016 4:36 pm

I'm still running patch 3380124 (Update 1b) on my newer hosts, as I think this was the only patch that had no real issues.

I've updated vcenter to U2, but this whole upgrade project seems to be dragging on forever as there's no new build that is good and I'm too wary of upgrading my good 5.1 hosts.
lando_uk
Expert
 
Posts: 247
Liked: 18 times
Joined: Thu Oct 17, 2013 10:02 am
Location: UK
Full Name: Mark

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby ashman70 » Tue Jun 21, 2016 5:53 pm 1 person likes this post

With the mess that was 5.5 and its patches and updates that caused purple screens, most of my customers are still running 5.1 and I see no reason to move them until VMWare sorts out this mess. Version 6 was looking promising until these updates and patches started causing havok.
ashman70
Expert
 
Posts: 196
Liked: 12 times
Joined: Tue Dec 04, 2012 2:18 pm
Full Name: Both

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby DaveWatkins » Tue Jun 21, 2016 9:49 pm

This bug only appears to affect Veeam if you're using VMWare quiescense. If you're not (and I'm guessing most people aren't because it's terrible) and just using normal AAP then it supposedly doesn't affect you.

That's pointed out in the link but is probably worth putting here. So for the most part we should all be fine.
DaveWatkins
Expert
 
Posts: 273
Liked: 68 times
Joined: Sun Dec 13, 2015 11:33 pm

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby kjstech » Wed Jun 22, 2016 6:32 pm

3 of my hosts are on this patch level of 6.0 and 5 hosts are still on the latest patch level for 5.0.

I'm not updating my 5 other hosts until a new patch comes out (expected late july) that fixes ESXi 6.0 and vSphere replication 6.1 hostd crashes with "Panic: Assert Failed: "!repDiskInfo->GetDiskReplicationId().empty()" @ bora/vim/hostd/hbrsvc/ReplicationConfig.cpp:769" if you try to vMotion a replicated VM where only 1 (of many) disks are configured to replicate.
kjstech
Expert
 
Posts: 142
Liked: 14 times
Joined: Fri Jan 17, 2014 4:12 pm
Full Name: Keith S

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby Gostev » Fri Jun 24, 2016 12:22 am

Gostev
Veeam Software
 
Posts: 21621
Liked: 2411 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby Tibo » Tue Jul 05, 2016 3:20 pm

Can anyone confirm that this bug does not affect Veeam when using Veeam Application Aware Processing ?
Tibo
Influencer
 
Posts: 10
Liked: never
Joined: Fri May 20, 2011 8:15 am
Full Name: Tibo

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby Vitaliy S. » Tue Jul 05, 2016 3:43 pm

Since Veeam AAIP does not use VMware Tools Quiescence, AAIP-enabled Veeam backup jobs are not affected by this.
Vitaliy S.
Veeam Software
 
Posts: 19966
Liked: 1145 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

[MERGED] Incremental virtual machine backups effectively run

Veeam Logoby mcvosi » Tue Sep 06, 2016 4:03 pm

mcvosi
Enthusiast
 
Posts: 33
Liked: 3 times
Joined: Tue Jun 14, 2011 1:55 pm
Full Name: Matthew Vaughan

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby mcvosi » Tue Sep 06, 2016 4:15 pm

Guess I was late to the party on this...

But yes, QA has really slipped at VMware these days. Every time I think I patch to a stable build something breaks with each new "fix."
mcvosi
Enthusiast
 
Posts: 33
Liked: 3 times
Joined: Tue Jun 14, 2011 1:55 pm
Full Name: Matthew Vaughan

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby Zew » Wed Sep 07, 2016 7:11 pm 2 people like this post

mcvosi wrote:Guess I was late to the party on this...

But yes, QA has really slipped at VMware these days. Every time I think I patch to a stable build something breaks with each new "fix."


Funny I had an argument with someone on IRC, the cisco channel I believe I was in at the time, (I'm in many of them), to which he kept saying ESXi6 is solid and suggested to move to it. Which I replied back with endless KB's from VMware on how terrible QA has been on it and that CBT in general has broke multiple times. The amount of links i had to reference has near endless... I asked for any references on its stability which I received none.
Zew
Expert
 
Posts: 179
Liked: 39 times
Joined: Tue Mar 17, 2015 9:50 pm
Full Name: Aemilianus Kehler

Re: ESXi 6.0 Express Patch 6 breaks CBT

Veeam Logoby albertwt » Tue Jul 25, 2017 11:19 pm

So does this problem finally fixed by VMware in the latest VMware vCenter Server 6.0 Update 3 https://docs.vmware.com/en/VMware-vSphe ... notes.html ?

or this is something that is addressed in Veeam Backup & Replication Update 3 ?
--
/* Veeam software enthusiast user & supporter ! */
albertwt
Expert
 
Posts: 621
Liked: 20 times
Joined: Thu Nov 05, 2009 12:24 pm
Location: Sydney, NSW

Next

Return to VMware vSphere



Who is online

Users browsing this forum: No registered users and 1 guest