Availability for the Always-On Enterprise
bertus02
Novice
Posts: 5
Liked: never
Joined: Sep 18, 2017 1:23 pm
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by bertus02 » Sep 19, 2017 1:11 pm

Perhaps check your event logs to see if AD Connect upgraded around the time the VSS errors started.

"With the connectivity to Azure AD verified, it is time to look into the eventlogs. Start the event viewer and look in the Application eventlog. Add an eventlog filter for the source Azure AD Connect Upgrade and the event id range 300-399."

RobertMallett
Novice
Posts: 4
Liked: never
Joined: Aug 15, 2017 12:20 pm
Full Name: Robert Mallett
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by RobertMallett » Sep 19, 2017 2:20 pm

I can see Azure AD Connect Upgrade - Persisted state loaded successfully. Of course I'm not seeing any errors at present as everything is a sit should be - as soon as I get a fail I'll look up the logs around that time.

damadhatter
Enthusiast
Posts: 26
Liked: never
Joined: Feb 21, 2014 5:15 am
Full Name: Chris A
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by damadhatter » Sep 21, 2017 6:19 pm

This continues to happen for me every 3-4 days, quite annoying. I found this script while searching for other people having this issue,

stop-service -displayname “Microsoft Azure AD Sync”
$FQlogonaccount = Get-WmiObject -Class Win32_Service | ? { $_.displayname -match “Microsoft Azure AD Sync”} | select Startname
$split = $FQlogonaccount.startname.Split(“\”[0])
$username = $split[1]
$sqlprocess = Get-WmiObject -Query “Select * from Win32_Process where name = ‘sqlservr.exe'” |
Select Name, Handle, @{Label=’Owner’;Expression={$_.GetOwner().User}} | ? { $_.owner -match $username} | select handle | Out-String
$sqlpid= $sqlprocess.Split(“`n”)[3]
Stop-Process -id $sqlpid -force
start-process -filepath “MsiExec.exe” -argumentlist “/f {6C026A91-640F-4A23-8B68-05D589CC6F18}” -wait
Start-Service -displayname “Microsoft Azure AD Sync”

Script found in the comments section of this posting. http://www.tecfused.com/2016/09/veeam-b ... d-connect/

Still would be nice to figure out a fix to prevent the initial failure, wish Veeam could work with Microsoft on the issue.

hyvokar
Service Provider
Posts: 304
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by hyvokar » Oct 18, 2017 5:23 am

After first reported over a year ago, this still is a problem (and very annoying one). Is there anything Veeam can do to help it's customers?
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

mamosorre84
Enthusiast
Posts: 48
Liked: 5 times
Joined: Oct 24, 2016 3:56 pm
Full Name: Marco Sorrentino
Location: Ancona - Italy
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by mamosorre84 » Oct 26, 2017 7:30 am

Hi guys, any news? The solution "repair LocalDB and reboot" didn't fix for me, I had to restart VSS Writers failed manually..

rasmusan
Enthusiast
Posts: 40
Liked: never
Joined: Jan 20, 2015 9:03 pm
Full Name: Rasmus Andersen
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by rasmusan » Oct 27, 2017 5:56 am

Hi

Anyone found solution to this?

I have several customers started reporting this error in during the last week - all related to VMs with Azure AD Connect. It seems it has updated itself on 19/10 after which the issues has started. Repair and reboot does not fix issue


/Rasmus

hyvokar
Service Provider
Posts: 304
Liked: 19 times
Joined: Nov 21, 2014 10:05 pm
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by hyvokar » Oct 27, 2017 6:50 am

Faced this problem again last week. Finally got fed up randomly rebooting servers dunring day time and scheduled a daily reboot every night just before backup. This workaround sucks just a little bit less than manually rebooting every time backup fails.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE

bertus02
Novice
Posts: 5
Liked: never
Joined: Sep 18, 2017 1:23 pm
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by bertus02 » Oct 27, 2017 4:44 pm

Is Veeam aware of the issues we are facing with Azure AD Connect? This is becoming tedious to manually reboot 5+ ad connect servers. I have been contemplating adding the script mentioned in this task to the pre-freeze script in the job. Has anyone tested this workaround?
Image

bertus02
Novice
Posts: 5
Liked: never
Joined: Sep 18, 2017 1:23 pm
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by bertus02 » Oct 27, 2017 11:01 pm

I added the script mentioned on page 1 to the pre-freeze script and it resolved the issue on one of our Azure AD connect servers. We went from the following to success. I will be rolling the fix out to our other servers as it pops up.

"Unable to release guest. Error: Unfreeze error: [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{a65faa63-5ea8-4ebc-9dbd-a0c4db26912a}]. Instance ID: [{c0c13030-f827-4f40-b0d8-b8f5d4f32edd}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]
Error: Unfreeze error: [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{a65faa63-5ea8-4ebc-9dbd-a0c4db26912a}]. Instance ID: [{c0c13030-f827-4f40-b0d8-b8f5d4f32edd}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]

Deon
Veeam Software
Posts: 24
Liked: 8 times
Joined: Jun 26, 2014 7:02 pm
Full Name: Denis Churaev
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by Deon » Oct 28, 2017 2:51 pm

Good afternoon,

I see a bunch of questions directed to nowhere/without a response, all asking if Veeam is aware of it.
I participate in support activity so I do know that this issue is known, however it does not seem to have a strict solution, and even Microsoft DPM has an issue with it from time to time, because it lies in problems with VSS framework.

For anyone having such issue, I would advise to open a multivendor support case in Veeam to be connected with Microsoft support for a resolution, at least it would be the most reliable way to go in my opinion.
Of course you could try to reach Microsoft by yourself, but sometimes it may be more handy to have an engineer assisting you from our end as well, just to be sure we look at the issue from different perspectives.

SdC
Novice
Posts: 3
Liked: 2 times
Joined: May 19, 2017 7:03 am
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by SdC » Oct 30, 2017 6:48 am

damadhatter wrote:This continues to happen for me every 3-4 days, quite annoying. I found this script while searching for other people having this issue,

stop-service -....
soft Azure AD Sync”

Script found in the comments section of this posting. http://www.tecfused.com/2016/09/veeam-b ... d-connect/

Still would be nice to figure out a fix to prevent the initial failure, wish Veeam could work with Microsoft on the issue.
That is my script and it is also on THIS VERY THREAD ON PAGE 1, right above some other posts you made :wink:

mcz
Expert
Posts: 213
Liked: 26 times
Joined: Jul 19, 2016 8:39 am
Full Name: Michael
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by mcz » Oct 30, 2017 3:44 pm

I'm having the same issue and I wonder if you could exclude this VSS writer from backup?

bdufour
Enthusiast
Posts: 91
Liked: 13 times
Joined: Nov 01, 2017 8:52 pm
Full Name: blake dufour
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by bdufour » Nov 01, 2017 9:01 pm

ive been experiencing this issue - i found this - https://social.technet.microsoft.com/Fo ... errecovery

typically, i have to restart the server for it to complete a backup/rep. it usually requires a restart every few day as related to Azure AD Sync updating likely and causing issues with permissions. i changed the log on account of the SQL server VSS writer service to a domain service account with proper permissions to the DB. for now that seemed to solve it. i will give an update in a week or so to confirm whether or not the issue has resurfaced.

reaperhammer
Enthusiast
Posts: 26
Liked: 7 times
Joined: Aug 18, 2016 7:59 pm
Full Name: Will S
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by reaperhammer » Nov 02, 2017 12:57 am 1 person likes this post

I use the script on this page to fix the issue temporarily
http://www.tecfused.com/2017/10/veeam-b ... -31102017/

As a permanent fix you can update the SQL VSS writer by using any full installer for SQL and selecting “Upgrade from SQL 2005, 2008…” then follow the wizard and reboot, or select “New SQL Server Stand-alone installation…”and selecting only This can fix the ADSync backup as well as break the backup for other SQL instances if there are any on the same server so better take a test backup right after doing this and rollback if any other strange things happen.Another option is to move ADSync database to a SQL Express or Standard instance on the same server or another server: https://social.technet.microsoft.com/wi ... ation.aspx

Or the less recommended option of disabling Azure AD connect updates
https://docs.microsoft.com/en-us/azure/ ... ic-upgrade

mcz
Expert
Posts: 213
Liked: 26 times
Joined: Jul 19, 2016 8:39 am
Full Name: Michael
Contact:

Re: Bunch of servers VSS Writer Errror 0x800423f4

Post by mcz » Nov 02, 2017 7:40 am

Yeah, I tried to upgrade SQL Server to the Version 2016 and since then the issue seems to be gone.

Post Reply

Who is online

Users browsing this forum: patrick.shea, rickrbyrne, vhernandez and 40 guests