PowerShell script exchange
Post Reply
donaldli
Service Provider
Posts: 19
Liked: never
Joined: Mar 17, 2021 3:22 am
Full Name: Donald Li
Contact:

v11 Disconnect-VBRServer failed on VBR Console

Post by donaldli »

Veeam Support Case #04696791.
We recently upgraded from Veeam v10 to v11.
We are using a VBR Console machine to connect to several VBR servers to execute powershell scripts, which was running fine in v10.
After upgraded to v11, I found the Disconnect-VBRServer cost 1 min 12 seonds to finish. According to the veeam powershell log, I can see it's becuase the disconnect was failed with several time retry. It was trying to connect to the VBR Console machine itself at port 9392, while there is no backup service should be running on this VBR Console machine.

The disconnect runs very well when I was trying to connect from one VBR Server to another VBR Server remotely. I assume it's becuase it has backup service running on its port 9392, which will satify the request to connect to its local backup service on 9392.

I tried to connect to VBR Server by using hostname and IP address. Both case failed for same reason.

The error logs are attached as follows. sao01pscli01 is the VBR Console hostname and 192.168.10.200 is its IP.
There is a line: "Network error in [GetSrvVersion] of [tcp://sao01pscli01:9392/VeeamService] object".

Why Disconnect-VBRServer command leads to request on localhost port 9392? Is this a bug?

Code: Select all

[16.03.2021 22:30:23] <18> Info         Instance of 'DisconnectVBRServer' was created with Id 'fef8eae14fc149ef8b87c14d476210e0'
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] ------- Begin Processing of Veeam PowerShell -------
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] Running cmdlet: Veeam.Backup.PowerShell.Cmdlets.DisconnectVBRServer
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] Running command name: Disconnect-VBRServer
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] Cmdlet script name: C:\VeeamAutomation\dev\testVBRConnection.ps1, line number: 22, offset: 1
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] Cmdlet pipeline length: 1, position: 1
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] --------------- Command session out ---------------
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] ------- Processing of Veeam PowerShell -------
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] Executing license check...
[16.03.2021 22:30:23] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] Preparing parameters...
[16.03.2021 22:30:23] <18> Info         ClientEnvironment  environment has been released.
[16.03.2021 22:30:23] <18> Info         [VeeamBackupSvc]Disconnecting
[16.03.2021 22:30:23] <18> Info         Disposing SVeeamBackupService...
[16.03.2021 22:30:23] <18> Info             Unregistering TCP client channel [bstcp]
[16.03.2021 22:30:23] <18> Info             Channel successfully unregistered
[16.03.2021 22:30:23] <18> Info         [HierarchyLoader] Global loader released
[16.03.2021 22:30:23] <18> Info         [Options] Registry strategy has been reseted.
[16.03.2021 22:30:23] <18> Info           [Options] Server options read strategy was created: failoverEnabled [True]
[16.03.2021 22:30:23] <18> Info         [Options] Using default server options read strategy: failoverEnabled [True].
[16.03.2021 22:30:23] <18> Info         Remoting options: []
[16.03.2021 22:30:23] <18> Info         Registering TCP client channel [bstcp]
[16.03.2021 22:30:23] <18> Info         tokenImpersonationLevel: [Impersonation]
[16.03.2021 22:30:31] <18> Info         Network error in [GetSrvVersion] of [tcp://sao01pscli01:9392/VeeamService] object
[16.03.2021 22:30:31] <18> Warning      Networking error.
[16.03.2021 22:30:31] <18> Warning      No connection could be made because the target machine actively refused it 192.168.10.200:9392 (System.Net.Sockets.SocketException)
[16.03.2021 22:30:31] <18> Warning      Server stack trace: 
[16.03.2021 22:30:31] <18> Warning         at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
[16.03.2021 22:30:31] <18> Warning         at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket(AddressFamily family)
[16.03.2021 22:30:31] <18> Warning         at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
[16.03.2021 22:30:31] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
[16.03.2021 22:30:31] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
[16.03.2021 22:30:31] <18> Warning         at Veeam.Common.Remoting.CBinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
[16.03.2021 22:30:31] <18> Warning      Exception rethrown at [0]: 
[16.03.2021 22:30:31] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
[16.03.2021 22:30:31] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
[16.03.2021 22:30:31] <18> Warning         at Veeam.Backup.Interaction.Management.IVeeamBackupService.GetSrvVersion()
[16.03.2021 22:30:31] <18> Warning         at Veeam.Common.Remoting.CRetryableMethod.DoInvoke[Ret](ActionDelegate`1 dlg)
[16.03.2021 22:30:31] <18> Info           [CRL] Cleanup [Before: 2, After: 1]
[16.03.2021 22:30:31] <18> Warning      [Retry(Elapsed: 00:00:08, Left: 00:00:51)] Failed to perform remoting procedure. Sleeping for 5 seconds.
[16.03.2021 22:30:44] <18> Info         Network error in [GetSrvVersion] of [tcp://sao01pscli01:9392/VeeamService] object
[16.03.2021 22:30:44] <18> Warning      Networking error.
[16.03.2021 22:30:44] <18> Warning      No connection could be made because the target machine actively refused it 192.168.10.200:9392 (System.Net.Sockets.SocketException)
[16.03.2021 22:30:44] <18> Warning      Server stack trace: 
[16.03.2021 22:30:44] <18> Warning         at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
[16.03.2021 22:30:44] <18> Warning         at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket(AddressFamily family)
[16.03.2021 22:30:44] <18> Warning         at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
[16.03.2021 22:30:44] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
[16.03.2021 22:30:44] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
[16.03.2021 22:30:44] <18> Warning         at Veeam.Common.Remoting.CBinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
[16.03.2021 22:30:44] <18> Warning      Exception rethrown at [0]: 
[16.03.2021 22:30:44] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
[16.03.2021 22:30:44] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
[16.03.2021 22:30:44] <18> Warning         at Veeam.Backup.Interaction.Management.IVeeamBackupService.GetSrvVersion()
[16.03.2021 22:30:44] <18> Warning         at Veeam.Common.Remoting.CRetryableMethod.DoInvoke[Ret](ActionDelegate`1 dlg)
[16.03.2021 22:30:44] <18> Info           [CRL] Cleanup [Before: 1, After: 1]
[16.03.2021 22:30:44] <18> Warning      [Retry(Elapsed: 00:00:21, Left: 00:00:38)] Failed to perform remoting procedure. Sleeping for 5 seconds.
[16.03.2021 22:30:58] <18> Info         Network error in [GetSrvVersion] of [tcp://sao01pscli01:9392/VeeamService] object
[16.03.2021 22:30:58] <18> Warning      Networking error.
[16.03.2021 22:30:58] <18> Warning      No connection could be made because the target machine actively refused it 192.168.10.200:9392 (System.Net.Sockets.SocketException)
[16.03.2021 22:30:58] <18> Warning      Server stack trace: 
[16.03.2021 22:30:58] <18> Warning         at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
[16.03.2021 22:30:58] <18> Warning         at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket(AddressFamily family)
[16.03.2021 22:30:58] <18> Warning         at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
[16.03.2021 22:30:58] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
[16.03.2021 22:30:58] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
[16.03.2021 22:30:58] <18> Warning         at Veeam.Common.Remoting.CBinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
[16.03.2021 22:30:58] <18> Warning      Exception rethrown at [0]: 
[16.03.2021 22:30:58] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
[16.03.2021 22:30:58] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
[16.03.2021 22:30:58] <18> Warning         at Veeam.Backup.Interaction.Management.IVeeamBackupService.GetSrvVersion()
[16.03.2021 22:30:58] <18> Warning         at Veeam.Common.Remoting.CRetryableMethod.DoInvoke[Ret](ActionDelegate`1 dlg)
[16.03.2021 22:30:58] <18> Info           [CRL] Cleanup [Before: 1, After: 1]
[16.03.2021 22:30:58] <18> Warning      [Retry(Elapsed: 00:00:35, Left: 00:00:24)] Failed to perform remoting procedure. Sleeping for 5 seconds.
[16.03.2021 22:31:13] <18> Info         Network error in [GetSrvVersion] of [tcp://sao01pscli01:9392/VeeamService] object
[16.03.2021 22:31:13] <18> Warning      Networking error.
[16.03.2021 22:31:13] <18> Warning      No connection could be made because the target machine actively refused it 192.168.10.200:9392 (System.Net.Sockets.SocketException)
[16.03.2021 22:31:13] <18> Warning      Server stack trace: 
[16.03.2021 22:31:13] <18> Warning         at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
[16.03.2021 22:31:13] <18> Warning         at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket(AddressFamily family)
[16.03.2021 22:31:13] <18> Warning         at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
[16.03.2021 22:31:13] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
[16.03.2021 22:31:13] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
[16.03.2021 22:31:13] <18> Warning         at Veeam.Common.Remoting.CBinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
[16.03.2021 22:31:13] <18> Warning      Exception rethrown at [0]: 
[16.03.2021 22:31:13] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
[16.03.2021 22:31:13] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
[16.03.2021 22:31:13] <18> Warning         at Veeam.Backup.Interaction.Management.IVeeamBackupService.GetSrvVersion()
[16.03.2021 22:31:13] <18> Warning         at Veeam.Common.Remoting.CRetryableMethod.DoInvoke[Ret](ActionDelegate`1 dlg)
[16.03.2021 22:31:13] <18> Info           [CRL] Cleanup [Before: 1, After: 1]
[16.03.2021 22:31:13] <18> Warning      [Retry(Elapsed: 00:00:50, Left: 00:00:09)] Failed to perform remoting procedure. Sleeping for 5 seconds.
[16.03.2021 22:31:33] <18> Info         Network error in [GetSrvVersion] of [tcp://sao01pscli01:9392/VeeamService] object
[16.03.2021 22:31:33] <18> Warning      Networking error.
[16.03.2021 22:31:33] <18> Warning      No connection could be made because the target machine actively refused it 192.168.10.200:9392 (System.Net.Sockets.SocketException)
[16.03.2021 22:31:33] <18> Warning      Server stack trace: 
[16.03.2021 22:31:33] <18> Warning         at System.Net.Sockets.Socket.Connect(IPAddress[] addresses, Int32 port)
[16.03.2021 22:31:33] <18> Warning         at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket(AddressFamily family)
[16.03.2021 22:31:33] <18> Warning         at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
[16.03.2021 22:31:33] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
[16.03.2021 22:31:33] <18> Warning         at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
[16.03.2021 22:31:33] <18> Warning         at Veeam.Common.Remoting.CBinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
[16.03.2021 22:31:33] <18> Warning      Exception rethrown at [0]: 
[16.03.2021 22:31:33] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
[16.03.2021 22:31:33] <18> Warning         at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
[16.03.2021 22:31:33] <18> Warning         at Veeam.Backup.Interaction.Management.IVeeamBackupService.GetSrvVersion()
[16.03.2021 22:31:33] <18> Warning         at Veeam.Common.Remoting.CRetryableMethod.DoInvoke[Ret](ActionDelegate`1 dlg)
[16.03.2021 22:31:33] <18> Info           [CRL] Cleanup [Before: 1, After: 1]
[16.03.2021 22:31:33] <18> Error        Failed to get version
[16.03.2021 22:31:33] <126> Info         [LicenseClient] License client stopped. Stopping refresh loop...
[16.03.2021 22:31:33] <126> Info         [LicenseClient] License refresh loop stopped
[16.03.2021 22:31:33] <18> Info         Disposing SVeeamBackupService...
[16.03.2021 22:31:33] <18> Info             Unregistering TCP client channel [bstcp]
[16.03.2021 22:31:33] <18> Info             Channel successfully unregistered
[16.03.2021 22:31:33] <18> Info         [LicenseContainer] Reset license container
[16.03.2021 22:31:33] <18> Info         [HierarchyLoader] Global loader released
[16.03.2021 22:31:33] <18> Info         [Options] Registry strategy has been reseted.
[16.03.2021 22:31:33] <18> Info         [HierarchyLoader] Global loader released
[16.03.2021 22:31:33] <18> Info         [fef8eae14fc149ef8b87c14d476210e0] ------- End Processing of Veeam PowerShell -------
veremin
Product Manager
Posts: 20284
Liked: 2258 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: v11 Disconnect-VBRServer failed on VBR Console

Post by veremin » 1 person likes this post

I've passed the issue to the dev team, will see whether they will find something unexpected. Thanks!
donaldli
Service Provider
Posts: 19
Liked: never
Joined: Mar 17, 2021 3:22 am
Full Name: Donald Li
Contact:

Re: v11 Disconnect-VBRServer failed on VBR Console

Post by donaldli »

Thank you! Hope your dev team can do a quick test to see whether it can be reproduced in your lab!
veremin
Product Manager
Posts: 20284
Liked: 2258 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: v11 Disconnect-VBRServer failed on VBR Console

Post by veremin »

We've reproduced it in one of our tests, but more concrete tests and information are yet to come. Will keep you updated. Thanks!
donaldli
Service Provider
Posts: 19
Liked: never
Joined: Mar 17, 2021 3:22 am
Full Name: Donald Li
Contact:

Re: v11 Disconnect-VBRServer failed on VBR Console

Post by donaldli »

Thanks for letting me know you have reporduced in your lab!
veremin
Product Manager
Posts: 20284
Liked: 2258 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: v11 Disconnect-VBRServer failed on VBR Console

Post by veremin »

Dev team have confirmed the issue. I will let you know, when we have a fix or a workaround. Thanks!
Post Reply

Who is online

Users browsing this forum: No registered users and 13 guests