Availability for the Always-On Enterprise
DaveWatkins
Expert
Posts: 322
Liked: 86 times
Joined: Dec 13, 2015 11:33 pm
Contact:

SQL Backups and 9.5U3

Post by DaveWatkins » Jul 05, 2018 8:24 pm

Is anyone else seeing issues backing up SQL Servers?

Since upgrading to 9.5U3 (from U2) we're seeing either
Failed to retrieve SQL server databases information required to perform transaction logs backup
which then results is log backup failures and uncontrolled log growth.

or
Unable to truncate Microsoft SQL Server transaction logs. Details: Failed to call RPC function 'Vss.TruncateSqlLogs': Error code: 0x80004005. Failed to invoke func [TruncateSqlLogs]: Unspecified error. Failed to process 'TruncateSQLLog' command. Failed to logon user [domain\user]. Win32 error:Logon failure: the user has not been granted the requested logon type at this computer. Code: 1385
This isn't affecting all of our SQL servers, just a small subset that all exist on a separate domain

The user being used by B&R for these servers has sysadmin rights on all the SQL Servers and admin rights on the machines themselves. All these VM's were being successfully backed up with U2

Case # 03087011

Thanks
Dave

dynaudio
Lurker
Posts: 1
Liked: never
Joined: Jul 06, 2018 6:33 am
Full Name: Michael Grohnheit
Contact:

Re: SQL Backups and 9.5U3

Post by dynaudio » Jul 06, 2018 6:38 am

Hi.

After updating from 9.5U3 to 9.5U3a we got this error on a lot of servers:
Unable to truncate Microsoft SQL Server transaction logs. Details: Failed to call RPC function 'Vss.TruncateSqlLogs': Error code: 0x80004005. Failed to invoke func [TruncateSqlLogs]: Unspecified error. Failed to process 'TruncateSQLLog' command. Failed to logon user [domain\user]. Win32 error:Logon failure: the user has not been granted the requested logon type at this computer. Code: 1385.
Our backup user is domain admin, and everything was working flawless on 9.5U3.

tschw_ham
Service Provider
Posts: 3
Liked: never
Joined: Nov 08, 2017 2:06 pm
Contact:

Re: SQL Backups and 9.5U3

Post by tschw_ham » Jul 06, 2018 9:06 am

Hello Dave,

I was just going to open a new thread to the same issue. I updated Veeam B&R at one of our customers from version 9.5u2 to 9.5u3a (Build 1922). After the update Veeam could no longer truncate SQL Logs on one SQL Server. It worked fine until the Update.

Error Message:
02.07.2018 16:25:26 4624 ERR BlobCall() error.
02.07.2018 16:25:26 4624 ERR Failed to process 'TruncateSQLLog' command.
02.07.2018 16:25:26 4624 ERR Failed to logon user [###\###]
02.07.2018 16:25:26 4624 ERR Win32 error:Anmeldung fehlgeschlagen: Der Benutzer besitzt nicht den benötigten Anmeldetyp auf diesem Computer.
02.07.2018 16:25:26 4624 ERR Code: 1385
As mentioned in https://www.veeam.com/kb2447 we already added the db_datawriter role to the Backup User in the msdb database.

SQL Cluster or Availability Groups: No
SQL Version: SQL 2014 12.0.5571.0



I already opened a Case at Veeam Support # 03084266

Regards
Tobias

gurneetech
Novice
Posts: 9
Liked: 3 times
Joined: Jun 23, 2014 1:51 pm
Contact:

Re: SQL Backups and 9.5U3

Post by gurneetech » Jul 06, 2018 1:24 pm

I am seeing this as well. I have a several different jobs, some configured with domain admin, some with a domain user user granted SQL sysadmin.
Both ways are failing, both worked without issue before the update.

I am also seeing "Failed to retrieve SQL server databases information required to perform transaction logs backup" for VM's that do not have SQL.

Edit:
Enumerating SQL Server databases
Failed to logon UPN user [user@domain.local] Win32 error:Logon failure: the user has not been granted the requested logon type at this computer. Code: 1385
Transaction logs for the following databases were not backed up: <database list>
Transaction logs from some databases were not backed up for the last 7 intervals
Edit#2: I should clarify the versions. T-log backups were working in 9.5U3, this issue developed after 9.5U3a.

foggy
Veeam Software
Posts: 16932
Liked: 1377 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: SQL Backups and 9.5U3

Post by foggy » Jul 06, 2018 2:35 pm

Could you all please check that Deny log on as a batch job is turned OFF for the corresponding account? This requirement was changed in U3a and might be the reason of the observed behavior.

gurneetech
Novice
Posts: 9
Liked: 3 times
Joined: Jun 23, 2014 1:51 pm
Contact:

Re: SQL Backups and 9.5U3

Post by gurneetech » Jul 06, 2018 8:24 pm

foggy wrote:Could you all please check that Deny log on as a batch job is turned OFF for the corresponding account? This requirement was changed in U3a and might be the reason of the observed behavior.
"Deny log on as a batch job" is not set for any of our users in our domain or local GPOs. "Log on as a batch job" is explicitly set for some required accounts, including the one we were using the the primary SQL backup.

This account was not the Administrator account, in testing I found that UAC and RPC may not play nice unless the account used is 'administrator'

Thinking this may be the issue, I added the Domain admin account to the BuiltIn\Backup Operators group, which is defined in the "Log on as a batch job" GPO. I then changed the SQL jobs from the explicitly defined account for Veeam SQL access to the domain admin account.

Unfortunately, still:
7/6/2018 2:02:49 PM :: Failed to logon UPN user [administrator@domain.local]
Win32 error:Logon failure: the user has not been granted the requested logon type at this computer.
Code: 1385

DaveWatkins
Expert
Posts: 322
Liked: 86 times
Joined: Dec 13, 2015 11:33 pm
Contact:

Re: SQL Backups and 9.5U3

Post by DaveWatkins » Jul 07, 2018 3:53 am 1 person likes this post

In our case the SQL servers not backing up are all on another domain (inherited network) and while they don't have any accounts set to deny batch logins, they do have a GPO set to allow specific accounts to Log in as a batch job. I've added my backup user to that GPO and am trying a test backup now.

Sadly so far in my ticket I've just had to tell them for the third time that the backup user has sysadmin access on the SQL server, they seem fixated on that and don't seem to go any further than that which is disappointing given I've been having to manually control log growth on all of these while this is going on.

Foggy, this sort of thing is why it would be nice if the release notes were significantly more comprehensive. While I've been typing this the backup has completed successfully so in my case this is the fix. It's not enough for them not to be assigned the Deny login as batch job right. If you have anything set in the "Logon as batch job" then your account needs to be added there as anything not in that list is effectively denied.

I'm disappointed the support agent hasn't gotten this far and just kept asking if the user has sysadmin privileges, also disappointed this sort of this isn't included in the release notes for the update. It was obviously known and the main documentation was updated, but even if I had gone there I can't see any way I would know this had changed just for U3a. Is there realistically any way I could have known this and planned for it?

Thanks
Dave

Gostev
Veeam Software
Posts: 23100
Liked: 2913 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: SQL Backups and 9.5U3

Post by Gostev » Jul 07, 2018 8:29 pm

DaveWatkins wrote:Is there realistically any way I could have known this and planned for it?
No - it's totally our mistake, and I apologize.

I personally create the release notes to ensure nothing important is omitted, and I do that by reviewing raw data of all changes and enhancements as provided by the team leaders. This particular item simply was not included in the raw data provided to me, otherwise of course it would have been highlighted. I've already expressed my frustration internally - and we will put some process in place to make sure this does not happen again.

DEM
Service Provider
Posts: 4
Liked: 1 time
Joined: Oct 25, 2017 3:04 pm
Full Name: Demando
Contact:

[MERGED] SQL Warning after Update 3a

Post by DEM » Jul 08, 2018 6:44 pm

After Update 3a we are receiving the following warning message for several SQL database backups:
[TDB]Unable to update SQL backupset for instance X Code = 0x80040e09 Code meaning = IDispatch error #3081 Source = Microsoft OLE DB Provider for SQL Server Description = Die UPDATE-Berechtigung wurde für das backupset-Objekt, msdb-Datenbank, dbo-Schema, verweigert.
What does that mean? New permissions needed?

mats.jansson
Service Provider
Posts: 6
Liked: 1 time
Joined: Mar 18, 2014 9:13 am
Full Name: Mats

Re: SQL Warning after Update 3a

Post by mats.jansson » Jul 08, 2018 8:19 pm

Hi
We are also having a lot of new sql backup warnings.
It turned out that the backup account not having sysadmin permission.
I looked at old backup logs before updade3a and the sql warnings was alreade there. I think Veeam have updated the error handling in updare3a.
Mats

foggy
Veeam Software
Posts: 16932
Liked: 1377 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: [MERGED] SQL Warning after Update 3a

Post by foggy » Jul 08, 2018 8:50 pm

Mats, please check if you're seeing messages similar to the ones described in the thread above.
DEM wrote:What does that mean? New permissions needed?
I will check regarding this message though, since it differs (and somehow slipped away during proofreading).

DaveWatkins
Expert
Posts: 322
Liked: 86 times
Joined: Dec 13, 2015 11:33 pm
Contact:

Re: SQL Backups and 9.5U3

Post by DaveWatkins » Jul 08, 2018 11:01 pm

Gostev wrote:No - it's totally our mistake, and I apologize.

I personally create the release notes to ensure nothing important is omitted, and I do that by reviewing raw data of all changes and enhancements as provided by the team leaders. This particular item simply was not included in the raw data provided to me, otherwise of course it would have been highlighted. I've already expressed my frustration internally - and we will put some process in place to make sure this does not happen again.
Thanks for this, I wonder if this is also related to why the support side hasn't found this yet. Worth mentioning perhaps is how the main documentation got updated but you got missed, seems like someone knew about this change to get he main documentation updated.

Gostev
Veeam Software
Posts: 23100
Liked: 2913 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: SQL Backups and 9.5U3

Post by Gostev » Jul 08, 2018 11:36 pm

Actually, the main documentation was ninja-updated already as a result of the first posts in this thread :D but indeed, the change was well known internally, particularly to the QC team testing SQL Server processing. They responded to me right away suggesting to check Deny log on as a batch job setting after I sent them your original post.

nathano
Veeam Vanguard
Posts: 35
Liked: 1 time
Joined: Sep 05, 2016 5:08 am
Full Name: Nathan Oldfield
Contact:

Re: SQL Backups and 9.5U3

Post by nathano » Jul 09, 2018 4:01 am

had a similar SQL issue. in my case I uninstalled the SQL instance, was no longer required. Was a trial of Dell Wyse management stuff from a while ago :-)

foggy
Veeam Software
Posts: 16932
Liked: 1377 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: [MERGED] SQL Warning after Update 3a

Post by foggy » Jul 09, 2018 12:20 pm 2 people like this post

DEM wrote:[TDB]Unable to update SQL backupset for instance X Code = 0x80040e09 Code meaning = IDispatch error #3081 Source = Microsoft OLE DB Provider for SQL Server Description = Die UPDATE-Berechtigung wurde für das backupset-Objekt, msdb-Datenbank, dbo-Schema, verweigert.
Please check whether the account has db_datawriter permission on msdb database. This permission was required in previous releases as well, but now Veeam B&R displays this warning in case the permission is not granted.

Post Reply

Who is online

Users browsing this forum: gisle_hagen and 57 guests