Bunch of servers VSS Writer Errror 0x800423f4

Availability for the Always-On Enterprise

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby bertus02 » Tue Sep 19, 2017 1:11 pm

Perhaps check your event logs to see if AD Connect upgraded around the time the VSS errors started.

"With the connectivity to Azure AD verified, it is time to look into the eventlogs. Start the event viewer and look in the Application eventlog. Add an eventlog filter for the source Azure AD Connect Upgrade and the event id range 300-399."
bertus02
Novice
 
Posts: 5
Liked: never
Joined: Mon Sep 18, 2017 1:23 pm

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby RobertMallett » Tue Sep 19, 2017 2:20 pm

I can see Azure AD Connect Upgrade - Persisted state loaded successfully. Of course I'm not seeing any errors at present as everything is a sit should be - as soon as I get a fail I'll look up the logs around that time.
RobertMallett
Novice
 
Posts: 4
Liked: never
Joined: Tue Aug 15, 2017 12:20 pm
Full Name: Robert Mallett

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby damadhatter » Thu Sep 21, 2017 6:19 pm

This continues to happen for me every 3-4 days, quite annoying. I found this script while searching for other people having this issue,

stop-service -displayname “Microsoft Azure AD Sync”
$FQlogonaccount = Get-WmiObject -Class Win32_Service | ? { $_.displayname -match “Microsoft Azure AD Sync”} | select Startname
$split = $FQlogonaccount.startname.Split(“\”[0])
$username = $split[1]
$sqlprocess = Get-WmiObject -Query “Select * from Win32_Process where name = ‘sqlservr.exe'” |
Select Name, Handle, @{Label=’Owner’;Expression={$_.GetOwner().User}} | ? { $_.owner -match $username} | select handle | Out-String
$sqlpid= $sqlprocess.Split(“`n”)[3]
Stop-Process -id $sqlpid -force
start-process -filepath “MsiExec.exe” -argumentlist “/f {6C026A91-640F-4A23-8B68-05D589CC6F18}” -wait
Start-Service -displayname “Microsoft Azure AD Sync”

Script found in the comments section of this posting. http://www.tecfused.com/2016/09/veeam-b ... d-connect/

Still would be nice to figure out a fix to prevent the initial failure, wish Veeam could work with Microsoft on the issue.
damadhatter
Enthusiast
 
Posts: 26
Liked: never
Joined: Fri Feb 21, 2014 5:15 am
Full Name: Chris A

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby hyvokar » Wed Oct 18, 2017 5:23 am

After first reported over a year ago, this still is a problem (and very annoying one). Is there anything Veeam can do to help it's customers?
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 292
Liked: 18 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby mamosorre84 » Thu Oct 26, 2017 7:30 am

Hi guys, any news? The solution "repair LocalDB and reboot" didn't fix for me, I had to restart VSS Writers failed manually..
mamosorre84
Enthusiast
 
Posts: 46
Liked: 5 times
Joined: Mon Oct 24, 2016 3:56 pm
Location: Ancona - Italy
Full Name: Marco Sorrentino

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby rasmusan » Fri Oct 27, 2017 5:56 am

Hi

Anyone found solution to this?

I have several customers started reporting this error in during the last week - all related to VMs with Azure AD Connect. It seems it has updated itself on 19/10 after which the issues has started. Repair and reboot does not fix issue


/Rasmus
rasmusan
Enthusiast
 
Posts: 38
Liked: never
Joined: Tue Jan 20, 2015 9:03 pm
Full Name: Rasmus Andersen

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby hyvokar » Fri Oct 27, 2017 6:50 am

Faced this problem again last week. Finally got fed up randomly rebooting servers dunring day time and scheduled a daily reboot every night just before backup. This workaround sucks just a little bit less than manually rebooting every time backup fails.
Bed?! Beds for sleepy people! Lets get a kebab and go to a disco!
MS MCSA, MCITP, MCTS, MCP
VMWare VCP5-DCV
Veeam VMCE
hyvokar
Service Provider
 
Posts: 292
Liked: 18 times
Joined: Fri Nov 21, 2014 10:05 pm

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby bertus02 » Fri Oct 27, 2017 4:44 pm

Is Veeam aware of the issues we are facing with Azure AD Connect? This is becoming tedious to manually reboot 5+ ad connect servers. I have been contemplating adding the script mentioned in this task to the pre-freeze script in the job. Has anyone tested this workaround?
Image
bertus02
Novice
 
Posts: 5
Liked: never
Joined: Mon Sep 18, 2017 1:23 pm

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby bertus02 » Fri Oct 27, 2017 11:01 pm

I added the script mentioned on page 1 to the pre-freeze script and it resolved the issue on one of our Azure AD connect servers. We went from the following to success. I will be rolling the fix out to our other servers as it pops up.

"Unable to release guest. Error: Unfreeze error: [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{a65faa63-5ea8-4ebc-9dbd-a0c4db26912a}]. Instance ID: [{c0c13030-f827-4f40-b0d8-b8f5d4f32edd}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]
Error: Unfreeze error: [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [SqlServerWriter]. Class ID: [{a65faa63-5ea8-4ebc-9dbd-a0c4db26912a}]. Instance ID: [{c0c13030-f827-4f40-b0d8-b8f5d4f32edd}]. Writer's state: [VSS_WS_FAILED_AT_PREPARE_SNAPSHOT]. Error code: [0x800423f4].]
bertus02
Novice
 
Posts: 5
Liked: never
Joined: Mon Sep 18, 2017 1:23 pm

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby Deon » Sat Oct 28, 2017 2:51 pm

Good afternoon,

I see a bunch of questions directed to nowhere/without a response, all asking if Veeam is aware of it.
I participate in support activity so I do know that this issue is known, however it does not seem to have a strict solution, and even Microsoft DPM has an issue with it from time to time, because it lies in problems with VSS framework.

For anyone having such issue, I would advise to open a multivendor support case in Veeam to be connected with Microsoft support for a resolution, at least it would be the most reliable way to go in my opinion.
Of course you could try to reach Microsoft by yourself, but sometimes it may be more handy to have an engineer assisting you from our end as well, just to be sure we look at the issue from different perspectives.
Deon
Veeam Software
 
Posts: 24
Liked: 8 times
Joined: Thu Jun 26, 2014 7:02 pm
Full Name: Denis Churaev

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby SdC » Mon Oct 30, 2017 6:48 am

damadhatter wrote:This continues to happen for me every 3-4 days, quite annoying. I found this script while searching for other people having this issue,

stop-service -....
soft Azure AD Sync”

Script found in the comments section of this posting. http://www.tecfused.com/2016/09/veeam-b ... d-connect/

Still would be nice to figure out a fix to prevent the initial failure, wish Veeam could work with Microsoft on the issue.


That is my script and it is also on THIS VERY THREAD ON PAGE 1, right above some other posts you made :wink:
SdC
Novice
 
Posts: 3
Liked: 2 times
Joined: Fri May 19, 2017 7:03 am

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby mcz » Mon Oct 30, 2017 3:44 pm

I'm having the same issue and I wonder if you could exclude this VSS writer from backup?
mcz
Expert
 
Posts: 204
Liked: 19 times
Joined: Tue Jul 19, 2016 8:39 am
Full Name: Michael

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby bdufour » Wed Nov 01, 2017 9:01 pm

ive been experiencing this issue - i found this - https://social.technet.microsoft.com/Fo ... errecovery

typically, i have to restart the server for it to complete a backup/rep. it usually requires a restart every few day as related to Azure AD Sync updating likely and causing issues with permissions. i changed the log on account of the SQL server VSS writer service to a domain service account with proper permissions to the DB. for now that seemed to solve it. i will give an update in a week or so to confirm whether or not the issue has resurfaced.
bdufour
Novice
 
Posts: 7
Liked: 3 times
Joined: Wed Nov 01, 2017 8:52 pm
Full Name: blake dufour

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby reaperhammer » Thu Nov 02, 2017 12:57 am 1 person likes this post

I use the script on this page to fix the issue temporarily
http://www.tecfused.com/2017/10/veeam-b ... -31102017/

As a permanent fix you can update the SQL VSS writer by using any full installer for SQL and selecting “Upgrade from SQL 2005, 2008…” then follow the wizard and reboot, or select “New SQL Server Stand-alone installation…”and selecting only This can fix the ADSync backup as well as break the backup for other SQL instances if there are any on the same server so better take a test backup right after doing this and rollback if any other strange things happen.Another option is to move ADSync database to a SQL Express or Standard instance on the same server or another server: https://social.technet.microsoft.com/wi ... ation.aspx

Or the less recommended option of disabling Azure AD connect updates
https://docs.microsoft.com/en-us/azure/ ... ic-upgrade
reaperhammer
Enthusiast
 
Posts: 25
Liked: 7 times
Joined: Thu Aug 18, 2016 7:59 pm
Full Name: Will S

Re: Bunch of servers VSS Writer Errror 0x800423f4

Veeam Logoby mcz » Thu Nov 02, 2017 7:40 am

Yeah, I tried to upgrade SQL Server to the Version 2016 and since then the issue seems to be gone.
mcz
Expert
 
Posts: 204
Liked: 19 times
Joined: Tue Jul 19, 2016 8:39 am
Full Name: Michael

PreviousNext

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Google [Bot] and 42 guests