SQL Backups and 9.5U3

Availability for the Always-On Enterprise

SQL Backups and 9.5U3

Veeam Logoby DaveWatkins » Thu Jul 05, 2018 8:24 pm

Is anyone else seeing issues backing up SQL Servers?

Since upgrading to 9.5U3 (from U2) we're seeing either

Failed to retrieve SQL server databases information required to perform transaction logs backup


which then results is log backup failures and uncontrolled log growth.

or

Unable to truncate Microsoft SQL Server transaction logs. Details: Failed to call RPC function 'Vss.TruncateSqlLogs': Error code: 0x80004005. Failed to invoke func [TruncateSqlLogs]: Unspecified error. Failed to process 'TruncateSQLLog' command. Failed to logon user [domain\user]. Win32 error:Logon failure: the user has not been granted the requested logon type at this computer. Code: 1385


This isn't affecting all of our SQL servers, just a small subset that all exist on a separate domain

The user being used by B&R for these servers has sysadmin rights on all the SQL Servers and admin rights on the machines themselves. All these VM's were being successfully backed up with U2

Case # 03087011

Thanks
Dave
DaveWatkins
Expert
 
Posts: 309
Liked: 79 times
Joined: Sun Dec 13, 2015 11:33 pm

Re: SQL Backups and 9.5U3

Veeam Logoby dynaudio » Fri Jul 06, 2018 6:38 am

Hi.

After updating from 9.5U3 to 9.5U3a we got this error on a lot of servers:

Unable to truncate Microsoft SQL Server transaction logs. Details: Failed to call RPC function 'Vss.TruncateSqlLogs': Error code: 0x80004005. Failed to invoke func [TruncateSqlLogs]: Unspecified error. Failed to process 'TruncateSQLLog' command. Failed to logon user [domain\user]. Win32 error:Logon failure: the user has not been granted the requested logon type at this computer. Code: 1385.


Our backup user is domain admin, and everything was working flawless on 9.5U3.
dynaudio
Lurker
 
Posts: 1
Liked: never
Joined: Fri Jul 06, 2018 6:33 am
Full Name: Michael Grohnheit

Re: SQL Backups and 9.5U3

Veeam Logoby tschw_ham » Fri Jul 06, 2018 9:06 am

Hello Dave,

I was just going to open a new thread to the same issue. I updated Veeam B&R at one of our customers from version 9.5u2 to 9.5u3a (Build 1922). After the update Veeam could no longer truncate SQL Logs on one SQL Server. It worked fine until the Update.

Error Message:

02.07.2018 16:25:26 4624 ERR BlobCall() error.
02.07.2018 16:25:26 4624 ERR Failed to process 'TruncateSQLLog' command.
02.07.2018 16:25:26 4624 ERR Failed to logon user [###\###]
02.07.2018 16:25:26 4624 ERR Win32 error:Anmeldung fehlgeschlagen: Der Benutzer besitzt nicht den benötigten Anmeldetyp auf diesem Computer.
02.07.2018 16:25:26 4624 ERR Code: 1385


As mentioned in https://www.veeam.com/kb2447 we already added the db_datawriter role to the Backup User in the msdb database.

SQL Cluster or Availability Groups: No
SQL Version: SQL 2014 12.0.5571.0



I already opened a Case at Veeam Support # 03084266

Regards
Tobias
tschw_ham
Service Provider
 
Posts: 3
Liked: never
Joined: Wed Nov 08, 2017 2:06 pm

Re: SQL Backups and 9.5U3

Veeam Logoby gurneetech » Fri Jul 06, 2018 1:24 pm

I am seeing this as well. I have a several different jobs, some configured with domain admin, some with a domain user user granted SQL sysadmin.
Both ways are failing, both worked without issue before the update.

I am also seeing "Failed to retrieve SQL server databases information required to perform transaction logs backup" for VM's that do not have SQL.

Edit:

Enumerating SQL Server databases
Failed to logon UPN user [user@domain.local] Win32 error:Logon failure: the user has not been granted the requested logon type at this computer. Code: 1385
Transaction logs for the following databases were not backed up: <database list>
Transaction logs from some databases were not backed up for the last 7 intervals


Edit#2: I should clarify the versions. T-log backups were working in 9.5U3, this issue developed after 9.5U3a.
gurneetech
Novice
 
Posts: 9
Liked: 2 times
Joined: Mon Jun 23, 2014 1:51 pm

Re: SQL Backups and 9.5U3

Veeam Logoby foggy » Fri Jul 06, 2018 2:35 pm

Could you all please check that Deny log on as a batch job is turned OFF for the corresponding account? This requirement was changed in U3a and might be the reason of the observed behavior.
foggy
Veeam Software
 
Posts: 16299
Liked: 1302 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: SQL Backups and 9.5U3

Veeam Logoby gurneetech » Fri Jul 06, 2018 8:24 pm

foggy wrote:Could you all please check that Deny log on as a batch job is turned OFF for the corresponding account? This requirement was changed in U3a and might be the reason of the observed behavior.


"Deny log on as a batch job" is not set for any of our users in our domain or local GPOs. "Log on as a batch job" is explicitly set for some required accounts, including the one we were using the the primary SQL backup.

This account was not the Administrator account, in testing I found that UAC and RPC may not play nice unless the account used is 'administrator'

Thinking this may be the issue, I added the Domain admin account to the BuiltIn\Backup Operators group, which is defined in the "Log on as a batch job" GPO. I then changed the SQL jobs from the explicitly defined account for Veeam SQL access to the domain admin account.

Unfortunately, still:
7/6/2018 2:02:49 PM :: Failed to logon UPN user [administrator@domain.local]
Win32 error:Logon failure: the user has not been granted the requested logon type at this computer.
Code: 1385
gurneetech
Novice
 
Posts: 9
Liked: 2 times
Joined: Mon Jun 23, 2014 1:51 pm

Re: SQL Backups and 9.5U3

Veeam Logoby DaveWatkins » Sat Jul 07, 2018 3:53 am

In our case the SQL servers not backing up are all on another domain (inherited network) and while they don't have any accounts set to deny batch logins, they do have a GPO set to allow specific accounts to Log in as a batch job. I've added my backup user to that GPO and am trying a test backup now.

Sadly so far in my ticket I've just had to tell them for the third time that the backup user has sysadmin access on the SQL server, they seem fixated on that and don't seem to go any further than that which is disappointing given I've been having to manually control log growth on all of these while this is going on.

Foggy, this sort of thing is why it would be nice if the release notes were significantly more comprehensive. While I've been typing this the backup has completed successfully so in my case this is the fix. It's not enough for them not to be assigned the Deny login as batch job right. If you have anything set in the "Logon as batch job" then your account needs to be added there as anything not in that list is effectively denied.

I'm disappointed the support agent hasn't gotten this far and just kept asking if the user has sysadmin privileges, also disappointed this sort of this isn't included in the release notes for the update. It was obviously known and the main documentation was updated, but even if I had gone there I can't see any way I would know this had changed just for U3a. Is there realistically any way I could have known this and planned for it?

Thanks
Dave
DaveWatkins
Expert
 
Posts: 309
Liked: 79 times
Joined: Sun Dec 13, 2015 11:33 pm

Re: SQL Backups and 9.5U3

Veeam Logoby Gostev » Sat Jul 07, 2018 8:29 pm

DaveWatkins wrote:Is there realistically any way I could have known this and planned for it?

No - it's totally our mistake, and I apologize.

I personally create the release notes to ensure nothing important is omitted, and I do that by reviewing raw data of all changes and enhancements as provided by the team leaders. This particular item simply was not included in the raw data provided to me, otherwise of course it would have been highlighted. I've already expressed my frustration internally - and we will put some process in place to make sure this does not happen again.
Gostev
Veeam Software
 
Posts: 22400
Liked: 2676 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

[MERGED] SQL Warning after Update 3a

Veeam Logoby DEM » Sun Jul 08, 2018 6:44 pm

After Update 3a we are receiving the following warning message for several SQL database backups:

[TDB]Unable to update SQL backupset for instance X Code = 0x80040e09 Code meaning = IDispatch error #3081 Source = Microsoft OLE DB Provider for SQL Server Description = Die UPDATE-Berechtigung wurde für das backupset-Objekt, msdb-Datenbank, dbo-Schema, verweigert.


What does that mean? New permissions needed?
DEM
Service Provider
 
Posts: 4
Liked: 1 time
Joined: Wed Oct 25, 2017 3:04 pm
Full Name: Demando

Re: SQL Warning after Update 3a

Veeam Logoby mats.jansson » Sun Jul 08, 2018 8:19 pm

Hi
We are also having a lot of new sql backup warnings.
It turned out that the backup account not having sysadmin permission.
I looked at old backup logs before updade3a and the sql warnings was alreade there. I think Veeam have updated the error handling in updare3a.
Mats
mats.jansson
Service Provider
 
Posts: 5
Liked: never
Joined: Tue Mar 18, 2014 9:13 am
Full Name: Mats

Re: [MERGED] SQL Warning after Update 3a

Veeam Logoby foggy » Sun Jul 08, 2018 8:50 pm

Mats, please check if you're seeing messages similar to the ones described in the thread above.

DEM wrote:What does that mean? New permissions needed?

I will check regarding this message though, since it differs (and somehow slipped away during proofreading).
foggy
Veeam Software
 
Posts: 16299
Liked: 1302 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: SQL Backups and 9.5U3

Veeam Logoby DaveWatkins » Sun Jul 08, 2018 11:01 pm

Gostev wrote:No - it's totally our mistake, and I apologize.

I personally create the release notes to ensure nothing important is omitted, and I do that by reviewing raw data of all changes and enhancements as provided by the team leaders. This particular item simply was not included in the raw data provided to me, otherwise of course it would have been highlighted. I've already expressed my frustration internally - and we will put some process in place to make sure this does not happen again.

Thanks for this, I wonder if this is also related to why the support side hasn't found this yet. Worth mentioning perhaps is how the main documentation got updated but you got missed, seems like someone knew about this change to get he main documentation updated.
DaveWatkins
Expert
 
Posts: 309
Liked: 79 times
Joined: Sun Dec 13, 2015 11:33 pm

Re: SQL Backups and 9.5U3

Veeam Logoby Gostev » Sun Jul 08, 2018 11:36 pm

Actually, the main documentation was ninja-updated already as a result of the first posts in this thread :D but indeed, the change was well known internally, particularly to the QC team testing SQL Server processing. They responded to me right away suggesting to check Deny log on as a batch job setting after I sent them your original post.
Gostev
Veeam Software
 
Posts: 22400
Liked: 2676 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: SQL Backups and 9.5U3

Veeam Logoby nathano » Mon Jul 09, 2018 4:01 am

had a similar SQL issue. in my case I uninstalled the SQL instance, was no longer required. Was a trial of Dell Wyse management stuff from a while ago :-)
nathano
Veeam Vanguard
 
Posts: 33
Liked: 1 time
Joined: Mon Sep 05, 2016 5:08 am
Full Name: Nathan Oldfield

Re: [MERGED] SQL Warning after Update 3a

Veeam Logoby foggy » Mon Jul 09, 2018 12:20 pm 2 people like this post

DEM wrote:[TDB]Unable to update SQL backupset for instance X Code = 0x80040e09 Code meaning = IDispatch error #3081 Source = Microsoft OLE DB Provider for SQL Server Description = Die UPDATE-Berechtigung wurde für das backupset-Objekt, msdb-Datenbank, dbo-Schema, verweigert.

Please check whether the account has db_datawriter permission on msdb database. This permission was required in previous releases as well, but now Veeam B&R displays this warning in case the permission is not granted.
foggy
Veeam Software
 
Posts: 16299
Liked: 1302 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], DaveWatkins, Google Feedfetcher and 54 guests