VSS Writer failures when backing up Oracle database server

#1 VM Backup : Modern Data Protection for VMware vSphere and Microsoft Hyper-V

VSS Writer failures when backing up Oracle database server

Veeam Logoby PaulOliver » Mon Mar 18, 2013 9:34 am

We have an Oracle 11g database server on Windows 2008 R2 which I'm trying to backup & replicate using Veeam B&R 6.5

Whenever the backup or replication job runs I get VSS writer errors preventing the job from completing. When the job retries a few minutes later it generally runs ok which I suspect means that the VSS snapshot is timing out but has completed by the time the Veeam process retries.

Code: Select all
Unable to release guest. Error: Unfreeze error: [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [Oracle VSS Writer - LIVE]. Class ID: [{26d02976-b909-43ad-af7e-62a4f625e372}]. Instance ID: [{87d92348-6579-4bfb-ae57-d1bc449bc156}]. Writer's state: [VSS_WS_FAILED_AT_POST_SNAPSHOT]. Error code: [0x800423f3].]
Error: Unfreeze error: [Backup job failed. Cannot create a shadow copy of the volumes containing writer's data. A VSS critical writer has failed. Writer name: [Oracle VSS Writer - LIVE]. Class ID: [{26d02976-b909-43ad-af7e-62a4f625e372}]. Instance ID: [{87d92348-6579-4bfb-ae57-d1bc449bc156}]. Writer's state: [VSS_WS_FAILED_AT_POST_SNAPSHOT]. Error code: [0x800423f3].]


Searching around it appears that people have experienced similar errors when backing up MS Excahnge servers but I've not found any reports of problems with an Oracle database server.
PaulOliver
Lurker
 
Posts: 1
Liked: never
Joined: Fri Oct 28, 2011 12:16 pm
Full Name: Paul Oliver

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby dellock6 » Mon Mar 18, 2013 10:58 am

Hi Paul,
I've found on Microsoft webiste this interesting list of VSS states:
http://msdn.microsoft.com/en-us/library ... 79(v=vs.85).aspx
Your error seems to happen "after" snapshot creation, so this could be the reason why during the retry the VSS invokation succeeds. There are sadly no further explanations on MS website about "why" it happens...

About finding no other cases on Oracle, maybe is because the majority of customers run Oracle on linux, so there is no VSS at all there.

Luca.
Luca Dell'Oca
EMEA Evangelist @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014
Veeam VMCE #1
dellock6
Veeam MVP
 
Posts: 1979
Liked: 366 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby d.popov » Mon Mar 18, 2013 11:03 am

Hello Paul,

First step is to gather some background info:

- Double check that VSS service is running under backed up server. (restarting VSS service could also help)
- Check the windows even log regarding VSS Writer errors.

Also it would be great to get the following output from the cmd on the backed up server:

Code: Select all
vssadmin list writers
vssadmin list providers

Regarding the Error code: [0x800423f3] its typical Microsoft transiet error - when a transient error occurs, this usually indicates that one or more VSS
writer(s) has returned an error.
d.popov
Veeam Software
 
Posts: 451
Liked: 22 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby yajith » Mon Jun 03, 2013 8:38 am

Hello Everyone,

I'm also experiencing this issue when trying to backup a similar Windows environment running SAP with Oracle DB. Witnessed the same issue on two systems actually.
Appreciate some advice on fixing this.

@PaulOliver Hope you were able to resolve this issue ?

--
Backup job failed. Cannot create a shadow copy of the volumes containing writer's data.

A VSS critical writer has failed.

Writer name: [Oracle VSS Writer - XDV].
Class ID: [{26d02976-b909-43ad-af7e-62a4f625e372}].
Instance ID: [{e4e9c9c3-b52e-411d-a7c0-4156451474e7}].
Writer's state: [VSS_WS_FAILED_AT_POST_SNAPSHOT]. Error code: [0x800423f3].]
--
yajith
Member
 
Posts: 11
Liked: never
Joined: Fri Sep 02, 2011 6:36 am
Full Name: Yajith Dayarathna

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby d.popov » Mon Jun 03, 2013 10:52 am 1 person likes this post

Hello Yajith,

I would start from re installing Oracle VSS Writer component, the main idea is that Veeam uses VSS writer preinstalled with Oracle. And due the time out (20secons for VSS snapshotting) - you got the error and as a result a failed job.
Please try to uninstall VSS service; reboot Oracle server and install back VSS.

Thank you.
d.popov
Veeam Software
 
Posts: 451
Liked: 22 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby foggy » Mon Jun 03, 2013 4:09 pm 1 person likes this post

I would also check with the VSS writer vendor (XDV) regarding this issue. Btw, we have another existing thread with Oracle VSS Writer issues, worth reviewing.
foggy
Veeam Software
 
Posts: 6325
Liked: 343 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby yajith » Mon Jun 03, 2013 4:21 pm

@foggy If i'm not mistaken, XDV is the name of the system that is running SAP (with Oracle). I will check further from oracle end if there is any clue that i can find from the database logs.

@d.popov it is a little difficult to uninstall anything from this system. I have restarted VSS services, rebooted the server without any improvement.

I was having this same issue on two systems. Suddenly when i was trying to backup one of them today, it ran successfully on one of the systems. This is without doing any changes at Veeam end. I'm trying to find out if any change was done at the application which may have contributed.
yajith
Member
 
Posts: 11
Liked: never
Joined: Fri Sep 02, 2011 6:36 am
Full Name: Yajith Dayarathna

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby foggy » Mon Jun 03, 2013 4:28 pm

It would be much appreciated if you could get back with the results of your findings as such issues seem to become quite typical. Thanks!
foggy
Veeam Software
 
Posts: 6325
Liked: 343 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby rurouni » Tue Sep 10, 2013 9:51 am

I got the same problem here on two of my Windows Server with oracle VSS writers.
sometimes the backup works fine, some other it ends with this error:

Code: Select all
09/09/2013 21:02:16 :: Unable to release guest. Details: Unfreeze error: [Backup job failed.
Cannot create a shadow copy of the volumes containing writer's data.
A VSS critical writer has failed. Writer name: [Oracle VSS Writer - PL1]. Class ID: [{26d02976-b909-43ad-af7e-62a4f625e372}]. Instance ID: [{300690b1-4fb3-4339-a05a-153e9a4338a0}]. Writer's state: [VSS_WS_FAILED_AT_POST_SNAPSHOT]. Error code: [0x800423f3].]


vssadmin list writers prints out this:
Code: Select all
Writer name: 'Oracle VSS Writer - PL1'
   Writer Id: {26d02976-b909-43ad-af7e-62a4f625e372}
   Writer Instance Id: {300690b1-4fb3-4339-a05a-153e9a4338a0}
   State: [11] Failed
   Last error: Retryable error


If i restart the oracle vss service, it changes to "no error". But the next backup fails.

event logs comes out with VSS error 8193:

Code: Select all
Description:
Volume Shadow Copy Service error: Unexpected error calling routine XML document is too long.  hr = 0x80070018, The program issued a command but the command length is incorrect.

Operation:
   Writer Modifying Modifying Backup Document

Context:
   Execution Context: Requestor
   Writer Instance ID: {300690B1-4FB3-4339-A05A-153E9A4338A0}


I couldn't find much information about this error on the internet.
Thanks for the help.
rurouni
Member
 
Posts: 21
Liked: 3 times
Joined: Wed Jul 24, 2013 7:21 pm

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby Vitaliy S. » Sun Sep 29, 2013 11:29 am

Hello,

rurouni wrote:If i restart the oracle vss service, it changes to "no error". But the next backup fails.

When you restart Oracle VSS service and run regular Windows system backup, do you also see this issue?

Thank you!
Vitaliy S.
Product Manager
 
Posts: 11865
Liked: 425 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby v.Eremin » Mon Sep 30, 2013 8:02 am

As mentioned, it might be also worth informing VSS (PL1) vendor about this issue. Thanks.
v.Eremin
Veeam Software
 
Posts: 5169
Liked: 358 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby ALBEA » Thu Nov 28, 2013 10:58 am 1 person likes this post

Hi,

I had the same error.
The problem was on Microsoft/Windows side.
Try to install this KB :
http://support.microsoft.com/kb/2807849/en-us
After that the problem was solved for me.

Regards,
ALBEA
Lurker
 
Posts: 1
Liked: 1 time
Joined: Thu Nov 28, 2013 10:55 am

[MERGED] Restart VSS Writer service

Veeam Logoby Piotr » Wed Jan 29, 2014 10:42 am

Sometimes it happens the VSS Writer is in error state - command VSSAdmin List Writes gives "Non-retryable error" for this writer. Am I allowed to restart VSS service associated with this writer without affecting other services?

In my case the writer is "Oracle VSS Writer" and the service is "Oracle VSS Writer Service".
Piotr
Novice
 
Posts: 6
Liked: never
Joined: Wed Oct 09, 2013 2:18 pm
Full Name: Piotr Brzozowski

Re: VSS Writer failures when backing up Oracle database serv

Veeam Logoby foggy » Wed Jan 29, 2014 11:18 am

Yes, restarting the service is pretty common troubleshooting step in such cases.
foggy
Veeam Software
 
Posts: 6325
Liked: 343 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], Google [Bot] and 17 guests