Bunch of servers VSS Writer Errror 0x800423f4

Availability for the Always-On Enterprise

Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby infused » Wed Sep 07, 2016 11:29 pm

Getting this on a bunch of servers with the new Azure AD Sync tool installed. Searched around, but not getting a lot.

Veeam Error:

Code: Select all
Unable to release guest. Error: Unfreeze error (over VIX): [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{a65faa63-5ea8-4ebc-9dbd-a0c4db26912a}]. Instance ID: [{6323fe10-0205-47df-b015-4a5ff60c31e2}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]
Error: Unfreeze error (over VIX): [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{a65faa63-5ea8-4ebc-9dbd-a0c4db26912a}]. Instance ID: [{6323fe10-0205-47df-b015-4a5ff60c31e2}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]


On the server, the VSS error in event log is error 0x800423f4 when PrepareForSnapShot

There's no other SQL services on the server, nor is there any other backup software.

Any ideas?
http://www.infused.co.nz - My Blog.
infused
Enthusiast
 
Posts: 95
Liked: 4 times
Joined: Sat Apr 20, 2013 9:25 am
Full Name: Hayden Kirk

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby Gostev » Wed Sep 07, 2016 11:36 pm

Hi, please include support case ID for this issue, as requested when you click New Topic. Thanks!
Gostev
Veeam Software
 
Posts: 21444
Liked: 2362 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby infused » Thu Sep 08, 2016 12:09 am

Haven't made one yet, but happy to go and make one? I'm pretty sure this isn't a Veeam issue, but something to do with how the AD Azure Connect client upgrades on the new version. I can't find much information on this as the new AD Connect is quite new.
http://www.infused.co.nz - My Blog.
infused
Enthusiast
 
Posts: 95
Liked: 4 times
Joined: Sat Apr 20, 2013 9:25 am
Full Name: Hayden Kirk

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby infused » Thu Sep 08, 2016 1:41 am 1 person likes this post

Fixed it. Wrote up a little guide on how to fix it: http://www.tecfused.com/2016/09/veeam-b ... d-connect/
http://www.infused.co.nz - My Blog.
infused
Enthusiast
 
Posts: 95
Liked: 4 times
Joined: Sat Apr 20, 2013 9:25 am
Full Name: Hayden Kirk

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby hyvokar » Mon Sep 12, 2016 8:30 am

Hi!

We also have this problem. Azure ad connect auto-updates itself and I believe that the permissions on the db are reset after that resulting the error.
Would like to hear if anyone has overcome this.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 256
Liked: 16 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby jrp76 » Wed Apr 12, 2017 6:56 pm

Anyone else have any luck with this? We are experiencing it as well here a half year later. Does the repair for SQL always prompt for the media? I assume this is installed with the Azure AD Connect package?
jrp76
Novice
 
Posts: 7
Liked: never
Joined: Wed Mar 15, 2017 9:33 pm
Full Name: Jon Pletcher

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby Daniel N. » Thu May 04, 2017 6:27 am

It didn't ask me for the media. Hope this works.
Daniel N.
Enthusiast
 
Posts: 28
Liked: 3 times
Joined: Sun Feb 15, 2015 7:03 am

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby Daniel N. » Thu May 04, 2017 7:54 am

Yay, it worked. I hope this doesn't happen again. Else it would be great if you guys could talk to Microsoft and work out a definitive solution.
Daniel N.
Enthusiast
 
Posts: 28
Liked: 3 times
Joined: Sun Feb 15, 2015 7:03 am

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby SdC » Fri May 19, 2017 7:19 am 2 people like this post

It was happening again on our customers servers after recent Windows "quality" rollups that I previously fixed manually with the procedure in the blog mentioned above. So I wrote a crude little powershell script to automate the process. I've ran it on about 25 servers in different domains successfully, and a reboot is not required.
I hope this helps.

Code: Select all
stop-service -displayname "Microsoft Azure AD Sync"
$FQlogonaccount = Get-WmiObject -Class Win32_Service | ? { $_.displayname -match "Microsoft Azure AD Sync"} | select Startname
$split = $FQlogonaccount.startname.Split("\"[0])
$username = $split[1]
$sqlprocess = Get-WmiObject -Query "Select * from Win32_Process where name = 'sqlservr.exe'" |
Select Name, Handle, @{Label='Owner';Expression={$_.GetOwner().User}} | ? { $_.owner -match $username} | select handle | Out-String
$sqlpid= $sqlprocess.Split("`n")[3]
Stop-Process -id $sqlpid -force
start-process -filepath "MsiExec.exe" -argumentlist "/f {6C026A91-640F-4A23-8B68-05D589CC6F18}" -wait
Start-Service -displayname "Microsoft Azure AD Sync"
SdC
Lurker
 
Posts: 2
Liked: 2 times
Joined: Fri May 19, 2017 7:03 am

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby omf » Wed Jun 21, 2017 4:23 pm

Thanks for these notes - we've been having the exact same issue.
omf
Lurker
 
Posts: 1
Liked: never
Joined: Mon Nov 16, 2009 10:05 pm
Full Name: Oscar Fowler

[MERGED] Jobs failing on Azure AD Sync SQL express database

Veeam Logoby damadhatter » Sat Jul 15, 2017 11:31 pm

I am having an odd issues that seems to be spreading like the plague. It has not hit 3 of my clients and one of them twice. This is causing jobs to fail on Windows 2012R2 & Windows 2016 VMware VMs. Guest indexing and application processing is enabled. The common theme on these servers is the following: Domain Controller & Azure AD Sync (for Office 365 password sync).

The jobs fail with this error:

Code: Select all
7/13/2017 11:02:30 PM :: Error: Unfreeze error: [Backup job failed.
Cannot create a shadow copy of the volumes containing writer's data.
A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{a65faa63-5ea8-4ebc-9dbd-a0c4db26912a}]. Instance ID: [{d9561457-108c-410a-bda9-034d41a92cfb}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]

I opened a support case on this in the past, and support wanted me to run SQL Management Studio to gather SQL logs. I installed SQL Management Studio but no SQL instances were found. They had me list the VSS writers and found this:
Code: Select all
Writer name: 'SqlServerWriter'
   Writer Id: {a65faa63-5ea8-4ebc-9dbd-a0c4db26912a}
   Writer Instance Id: {abebd680-a45c-4c72-9ac9-26ee988057c9}
   State: [8] Failed
   Last error: Non-retryable error

Support had me stop the SQLWriter service and the job was successful. Support then had me delete the service as they seemed to think it wasn't needed. This resolved the issue at this customer for a short period of time, it then came back to that customer and hit a few others.

I am quite perplexed at what is going on, things worked great for some time and all of a sudden fall apart. I have 10 clients running Azure AD Sync so unsure why its only hitting 3 clients. Anyone seen anything like this? I know by default a SQL Server 2012 Express LocalDB (a light version of SQL Server Express) is installed with Azure AD Sync so that is likely the culprit, but why randomly does Veeam hang up on this DB?
damadhatter
Enthusiast
 
Posts: 26
Liked: never
Joined: Fri Feb 21, 2014 5:15 am
Full Name: Chris A

Re: Jobs failing on Azure AD Sync SQL express database

Veeam Logoby v.Eremin » Mon Jul 17, 2017 4:49 pm

I have 10 clients running Azure AD Sync so unsure why its only hitting 3 clients.

Are you running application aware backups for all of them or just for three mentioned ones? Seems like a third-party VSS provider is a root cause of the experienced behaviour, similar to the problem discussed here.Thanks.
v.Eremin
Veeam Software
 
Posts: 13433
Liked: 988 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Jobs failing on Azure AD Sync SQL express database

Veeam Logoby damadhatter » Mon Jul 17, 2017 5:00 pm

I found the issue, looks like Azure AD updates itself and messes things up, go Microsoft!
damadhatter
Enthusiast
 
Posts: 26
Liked: never
Joined: Fri Feb 21, 2014 5:15 am
Full Name: Chris A

Re: Jobs failing on Azure AD Sync SQL express database

Veeam Logoby v.Eremin » Mon Jul 17, 2017 5:49 pm

Any particular update to blame? Might be helpful for future readers.
v.Eremin
Veeam Software
 
Posts: 13433
Liked: 988 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Jobs failing on Azure AD Sync SQL express database

Veeam Logoby damadhatter » Mon Jul 17, 2017 5:52 pm

I actually found it on this forum, I should have searched more before I actually made my post, shame on me!

veeam-backup-replication-f2/bunch-of-servers-vss-writer-errror-0x800423f4-t37483.html
damadhatter
Enthusiast
 
Posts: 26
Liked: never
Joined: Fri Feb 21, 2014 5:15 am
Full Name: Chris A

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], DonZoomik, Google [Bot], jpdusty and 73 guests