Comprehensive data protection for all workloads
Post Reply
andyman3000
Influencer
Posts: 18
Liked: 1 time
Joined: Nov 30, 2017 5:46 pm
Full Name: Andy Perkins
Contact:

SQL Guest Processing Windows 2016 AG without WFCS on VMWare

Post by andyman3000 »

Referencing Case # 03119599

Hello I am working with our DBA to test a POC for enabling SQL processing on our Veeam Backups so we do not need to use LiteSpeed for SQL database backups.

We have enabled Periodic Backup Log Shipping every 15 minute on the 4 servers we are testing on (2 Virtual and 2 Physical). Backups seem to be going smoothly except for one VMWare/Virtual SQL server.

The Server backups are succesful, but the SQL Server Transaction logs for the one server are warning/failing with this error message:

Failed to call RPC function 'Vss.IsPrefferedSqlReplicaForDb': Error code: 0x80004005. Failed to invoke func [IsPrefferedSqlReplicaForDb]: Unspecified error. Code = 0x80040e14. Code meaning = IDispatch error #3092. Source = Microsoft OLE DB Provider for SQL Server. Description = Could not process the operation. Always On Availability Groups does not have permissions to access the Windows Server Failover Clustering (WSFC) cluster. Disable and re-enable Always On Availability Groups by using the SQL Server C

The support engineer on my case wanted me to have the DBA disable and re-enable Always On Availability Groups by using the SQL Server Configuration Manager as a first step, but he said he cannot do that as There is no Windows cluster services installed on it. This one uses windows OS 2016 AG setup without having to install WFCS.

Support then referred me to this KB http://veeam.com/kb2463 to verify if this is a Veeam supported SQL configuration.

Since I'm not a DBA I'm not sure from the article if I am attempting to backup a non-supported SQL Configuration with Veeam, or if I'm not asking our DBA the right questions :D

Is anyone familiar with Windows 2016 Availability groups compared to Windows Failover Clustering? Is this unsupported with Veeam? DBA seems reluctant to make any changes currently as we are in a POC phase.
Mike Resseler
Product Manager
Posts: 8044
Liked: 1263 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by Mike Resseler »

Hi Andy,

Welcome to our forums!

I might be wrong her but AG requires WFSC. See here: https://docs.microsoft.com/en-us/sql/da ... erver-2017

Also, in that link you will see that you might need indeed to disable and re-enable the AG group.
"Always On availability groups registry keys are subkeys of the WSFC cluster. If you delete and re-create a WSFC cluster, you must disable and re-enable the Always On availability groups feature on each instance of SQL Server that hosted an availability replica on the original WSFC cluster. "

I think it would be best to take this information to your DBA and look together for performing this

My 2 cents
Mike
andyman3000
Influencer
Posts: 18
Liked: 1 time
Joined: Nov 30, 2017 5:46 pm
Full Name: Andy Perkins
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by andyman3000 »

Thanks for the response Mike!

Turns out the SQL Availability Group is spread out on a Windows and a Linux server. The Windows server provided was the passive node, and this behavior was expected according to the DBA as even his LiteSpeed tools would not be able to back it up. So the POC is about to get interesting, as we will be able to dive into Veeam Agent for Linux as well, which is our goal to unify all tools into Veeam.

Thanks,
Andy
Mike Resseler
Product Manager
Posts: 8044
Liked: 1263 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by Mike Resseler »

Now you actually have my interest. Let me know the results!
benmac
Novice
Posts: 4
Liked: 1 time
Joined: Aug 02, 2018 7:44 pm
Full Name: Ben
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by benmac »

Did you ever find the solution?

I am trying to perform SQL processing for SQL Server 2017 set up as an AG on two Ubuntu VMs. Getting Pacemaker failovers when the backup fires off though, and am curious if your topic is related or if maybe I need to open a ticket.
andyman3000
Influencer
Posts: 18
Liked: 1 time
Joined: Nov 30, 2017 5:46 pm
Full Name: Andy Perkins
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by andyman3000 »

I am curious how did you set up SQL Processing on the Ubuntu VMs? We have the active DB on the RHEL server but it is looking like we will have to run pre/post scripts which is what they are doing anyway. Only problem is that their native/scripted backup is going through an NFS mount point to another location. I'm not sure if Veeam Agent backup will grab the database backups saved to another location.

Sounds like it should not failover the database to the other node when the backup starts, but from what it seems speaking with our DBA is that database has to be offline for the SQL backup to happen.

So just am curious are you running pre/post scripts for the DB backup?

The Window Agent AG backs up fine, just with the caveat of the Availability group databases being skipped (which is expected according to the DBA since they are active elsewhere)
Mike Resseler
Product Manager
Posts: 8044
Liked: 1263 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by Mike Resseler »

Ben,

In the UG I can find that SQL server 2017 is only supported on windows!
@andy What version are you using?
benmac
Novice
Posts: 4
Liked: 1 time
Joined: Aug 02, 2018 7:44 pm
Full Name: Ben
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by benmac »

andyman3000 wrote:I am curious how did you set up SQL Processing on the Ubuntu VMs?


I have an AG replicating the primary server data to a secondary as well as a config-only monitoring server. The AG is set up to take backups from the primary for log truncation purposes, etc. and I wanted Veeam to do the full system backups, with 15-min log backups.
andyman3000 wrote:We have the active DB on the RHEL server but it is looking like we will have to run pre/post scripts which is what they are doing anyway. Only problem is that their native/scripted backup is going through an NFS mount point to another location. I'm not sure if Veeam Agent backup will grab the database backups saved to another location.
This is similar. We have a share set up on our Veeam server that I'm connecting to via CIFS mount point. These are for the 15-min transaction logs, full, and diff backups initiated from within SQL. However, I'm still not getting full system backups from Veeam without a pacemaker takeover.
andyman3000 wrote:Sounds like it should not failover the database to the other node when the backup starts, but from what it seems speaking with our DBA is that database has to be offline for the SQL backup to happen.
Hmm... does he/she (the DBA) mean for the database to actually be offline, or that the data needs to be backed up from the secondary replica? I don't have a way for the dB to be offline and maintain business continuity. If they mean from the secondary - that's what I keep reading, but apparently that method isn't supported with how I have the AG set up (SQL Server Enterprise may allow this, but we only have Standard).
andyman3000 wrote:So just am curious are you running pre/post scripts for the DB backup?

The Window Agent AG backs up fine, just with the caveat of the Availability group databases being skipped (which is expected according to the DBA since they are active elsewhere)
Honestly, I don't have any pre/post scripts, yet. I'm still trying to get backups to be successful so I haven't done anything in this realm. Do you have something in mind that might make it work?

Here's an example of the e-mail I get every morning when the Veeam backup fires off:

Code: Select all

Pacemaker Alert Takeover in progress at Fri Aug 10 03:01:03 CDT 2018 on <primary server name>
 
        Command line was:
        /usr/lib/ocf/resource.d/heartbeat/MailTo start
This is sent from root@<machine name> via the MailTo heartbeat within Pacemaker. I don't have much detail on top of the time it occurs, which the daily backups start at 3am every day.
Mike Resseler
Product Manager
Posts: 8044
Liked: 1263 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by Mike Resseler »

Ben,

As said, it seems that SQL server 2017 on linux is not supported (see the user guide) so I doubt we can get it working at this point in time. I don't know what the plans are for the next version to support this to be honest
benmac
Novice
Posts: 4
Liked: 1 time
Joined: Aug 02, 2018 7:44 pm
Full Name: Ben
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by benmac »

Thanks Mike. Does Veeam support Pacemaker on Linux in general? I can handle SQL backups internally using maintenance plans, but I'd like to stop failovers from occurring at backup time. The two resources that lead me to think no are this from Reddit (https://www.reddit.com/r/sysadmin/comme ... ith_veeam/), and this from Veeam forums (https://forums.veeam.com/veeam-agent-fo ... 48306.html).
Mike Resseler
Product Manager
Posts: 8044
Liked: 1263 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by Mike Resseler »

Ben,

Unfortunately I have no idea whether this is supported or not (and I don't have the possibility to test this at the moment). I will sent this thread to our Linux specialist and ask to come back to you. Stay tuned (I believe he is OOO at this moment...)
PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: SQL Guest Processing Windows 2016 AG without WFCS on VMW

Post by PTide »

Hi,
Does Veeam support Pacemaker on Linux in general? I can handle SQL backups internally using maintenance plans, but I'd like to stop failovers from occurring at backup time.
Since you use Pacemaker on VMs, I think the Linux Agent forum thread that you've mentioned might be not very relevant to the subject here. The failover problem you're seeing is likely to be related to the way how the VMs react to VMware snapshot. But I digress...

We have not conducted any Pacemaker-specific tests. The failover might occur due to cluster nodes losing network connectivity for a short period of time (from milliseconds to seconds) during VMWare snapshot creation process. That, depending on your cluster settings, might be enough for the cluster to perform a failover or even declare the other node to be dead although it is clearly not (that can lead to a "brain-split" situation). If my memory serves me well, there is a migration-threshold parameter in Pacemaker which defines how many failures should occur before a service gets migrated to another node. You should be able to rise the parameter right before a snapshot is triggered (so that the first failure won't be considered to be a "real failure") and revert the changes right after the snapshot has been taken. That can be done with the usage of pre-freeze/post-thaw scripts, for example. Another option would be to increase a timeout before failover, or to disable failover completely for the duration of your backup window for that particular cluster. I hope that makes sense.

Thanks
Post Reply

Who is online

Users browsing this forum: a.sim, Google [Bot] and 156 guests