Veeam 9.5 Update 3 RPC Error with Data Domain Boost

Availability for the Always-On Enterprise

Veeam 9.5 Update 3 RPC Error with Data Domain Boost

Veeam Logoby Wtrippler » Fri Jan 12, 2018 3:07 pm

Since upgrading to 9.5 update 3, we are getting this error when trying to access our data domain devices:
Failed to call RPC function DDBoostSetCreds

Support fixed this once by restarting Veeam services and running the VeeamPluginsHostX64 application from C:\Program Files (x86)\Veeam\Backup Transport\x64

It was fine for 2 days then all of our jobs failed last night with the same error. Any ideas?

Thanks!
Wendy
Wtrippler
Lurker
 
Posts: 2
Liked: never
Joined: Fri Jan 12, 2018 1:58 pm
Full Name: Wendy Trippler

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby v.Eremin » Sat Jan 13, 2018 1:13 pm

Kindly, re-open ticket with our support team and let them investigate it further. Thanks.
v.Eremin
Veeam Software
 
Posts: 14722
Liked: 1102 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby javis » Fri Jan 19, 2018 3:48 pm

We also are experiencing this exact same error with out data domain after installing 9.5 update 3. We have a ticket opened with Veeam support.
javis
Lurker
 
Posts: 2
Liked: never
Joined: Fri Jan 19, 2018 3:43 pm

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby rntguy » Sat Jan 27, 2018 4:48 pm

We have the exact same error. Any luck with this?
rntguy
Service Provider
 
Posts: 82
Liked: 1 time
Joined: Fri Jan 29, 2016 8:31 pm
Full Name: Rnt Guy

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby rntguy » Sat Jan 27, 2018 4:54 pm

Wtrippler wrote:Since upgrading to 9.5 update 3, we are getting this error when trying to access our data domain devices:
Failed to call RPC function DDBoostSetCreds

Support fixed this once by restarting Veeam services and running the VeeamPluginsHostX64 application from C:\Program Files (x86)\Veeam\Backup Transport\x64

How did they 'run' that? I just double clicked it but not sure what to look for.
rntguy
Service Provider
 
Posts: 82
Liked: 1 time
Joined: Fri Jan 29, 2016 8:31 pm
Full Name: Rnt Guy

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby javis » Tue Jan 30, 2018 3:31 pm

This issue had to do with our remote proxy server which is on a different subnet. We've rebooted our Data Domain, proxy server, Veeam server and still didn't solve the issue. I noticed our Veeam server could not establish a connection to our remote proxy on port 6160. I restarted the Veeam Installer Server (our version is 9.0.0.1715) on our remote proxy server and connection was established on port 6160 and this has been working great ever since.
javis
Lurker
 
Posts: 2
Liked: never
Joined: Fri Jan 19, 2018 3:43 pm

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby tkeith » Fri Feb 16, 2018 4:56 pm

We are having similar issues and have missed backups the last two nights!
All our issues started after we updated to Update 3 last tuesday...

Getting different errors:
Error: Failed to call RPC function 'DDBoostFcIsExist': The remote procedure call was cancelled. RPC function call failed. Function name: [DoRpc].
Error: Failed to call RPC function 'DDBoostSetCreds': The remote procedure call was cancelled. RPC function call failed. Function name: [DoRpc].
Error: The RPC server is unavailable. function call failed. Function name: [GetSvcVersion].

These error happens against the data domain, mount servers, and now the backup server itself. We seem to have the installer service crash

We back up thousands of VMs and this can't be happening!

Currently under Veeam support case: 02464083
tkeith
Service Provider
 
Posts: 19
Liked: 9 times
Joined: Fri Jan 09, 2015 4:49 pm
Full Name: Keith Thiessen

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby omegagx » Wed Feb 28, 2018 4:10 pm

Did you ever get this resolved?
omegagx
Enthusiast
 
Posts: 30
Liked: never
Joined: Tue May 09, 2017 6:33 pm
Full Name: Michael Gorn

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby UFE » Mon Mar 05, 2018 7:01 am 1 person likes this post

Hi there,
we had a nearly same problem.
Error: Failed to call RPC function 'TestCompatible': Error code: 0x80070583. Cannot initialize COM runtime.
here is the solution from Veeam support

"It is much pretty common with Update 3 when 3rd party monitoring tools proadcastrsVeeam with PowerShell queries and it affects our backups.
I would recommend the following steps:

1) Disable zabbix service
2) Restart Veeam server
3) Make sure that service is disabled
4) Open Veeam and re-try the job

You can use SNMP instead of Powershell as a workaround or refer to 3rd party software in order to have latest updates

Please keep me updated. I will be happy to help or answer your questions. Have a great day!
Best regards,
Mikhail Zolotov
Veeam Support"

After disabling Zabbix agent, backups works normally. Do you have some monitoring tools there?
UFE
Lurker
 
Posts: 1
Liked: 1 time
Joined: Mon Mar 05, 2018 6:52 am
Full Name: IT team

[MERGED] Failed Backups due to execution of Powershell queri

Veeam Logoby Sindhuja » Wed Apr 04, 2018 10:01 pm

Hello All,

We observed a weird issue at one of our customers, possibly related to a combination of Veeam backup & replication 9.5 Update 3, Data domain and Powershell scripts.
All backups (which were successful so far) failed after the execution of our utility that queries Veeam Server using Powershell Cmdlets (as exposed by VeeamPSSnapIn).
Code: Select all
"Error: Failed to call RPC function 'DDBoostSetCreds': The remote procedure call was cancelled. RPC function call failed. Function name: [DoRpc]."

After some lookout, we came across the below thread,
veeam-backup-replication-f2/veeam-9-5-update-3-rpc-error-t48016.html#p273664

This thread mentions, "With Veeam Backup & Replication 9.5 Update 3, the use of Powershell Cmdlets queries may result in a backup failure".
This is very unfortunate!

We would like to know the following:
  • Is this a known issue and has it been communicated to the customers?
  • Is there a patch available to fix this issue? If not available, any ETA on the patch?
  • Is this related to any specfic Powershell Cmdlet which has an alternative approach and can be avoided?

Regards,
Sindhuja
Sindhuja
Influencer
 
Posts: 21
Liked: never
Joined: Mon Jan 22, 2018 11:01 pm
Full Name: Sindhuja Balasubramanian

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby v.Eremin » Thu Apr 05, 2018 3:10 pm

Few questions to start with:

* Have you already reached our support team?
* Have you tried the workaround mentioned above?

Thanks.
v.Eremin
Veeam Software
 
Posts: 14722
Liked: 1102 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby omegagx » Thu Apr 05, 2018 3:20 pm

This is exactly the type of issue that should have a knowledge base article written up about. It would allow the customer to find a solution (disable monitoring such as zabbix) on the Veeam website instead of wasting time calling support. If this is a known issue that was already experienced by other customers, why not document it instead of forcing everyone to call in?
omegagx
Enthusiast
 
Posts: 30
Liked: never
Joined: Tue May 09, 2017 6:33 pm
Full Name: Michael Gorn

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby foggy » Thu Apr 05, 2018 3:28 pm

Support has a hotfix for this issue, so please contact them to get it.
foggy
Veeam Software
 
Posts: 16226
Liked: 1296 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby Sindhuja » Thu Apr 05, 2018 5:12 pm

Thank you for the response!
We will reach out to Veeam support to help us with the hot fix.
Sindhuja
Influencer
 
Posts: 21
Liked: never
Joined: Mon Jan 22, 2018 11:01 pm
Full Name: Sindhuja Balasubramanian

Re: Veeam 9.5 Update 3 RPC Error

Veeam Logoby Gostev » Mon Apr 09, 2018 7:40 am

omegagx wrote:This is exactly the type of issue that should have a knowledge base article written up about. It would allow the customer to find a solution (disable monitoring such as zabbix) on the Veeam website instead of wasting time calling support. If this is a known issue that was already experienced by other customers, why not document it instead of forcing everyone to call in?

Simply because it did not pass the threshold on the number of support cases opened. With up to 1000 support cases open daily, obviously they have to approach KB article creation selectively. Thanks!
Gostev
Veeam Software
 
Posts: 22208
Liked: 2628 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Next

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot], Google [Bot] and 31 guests