PowerShell script exchange
Talom
Enthusiast
Posts: 43
Liked: 6 times
Joined: Oct 21, 2014 7:56 am
Contact:

Veeam Satellite Process is not cleaned up

Post by Talom »

Hey Guys,

yesterday i noticed, when i'm cancelling my powershell script with CTRl+C the corresponding Veeam.Backup.Satellite process won't be killed.
My reporting scripts are sometimes cancelled automatically because of timeout or something else and after a few weeks i have a lot of satellite processes that are stuck in the task manager.
After a while my scripts just fail because of too many existing processes

Is this a bug in Veeam or can i write a cleanup script which cleans up unused satellite processes?
BACKUP EAGLE® Developer
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by veremin »

Actually, the said process should have a pre-defined timeout (around 5 minutes, if I'm not mistaken) after which it should be killed. If you see a lot of stuck (not killed) Satellite Process, kindly, reach our support team for further investigation.

Within a ticket you can point out that the problem is not directly related to PowerShell, as support team do not take over tickets regarding non-working scripts, etc.

Thanks.
yurixd
Novice
Posts: 3
Liked: never
Joined: Sep 01, 2017 1:55 pm
Full Name: Yuri Santos
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by yurixd »

Hello friend, I'm having this same problem in version 9.5. When running multiple jobs the Veeam.Backup.Satellite.exe process appears in excess, causing backups to fail.

when I finish these processes in the task manager the backups do again.

Have you come up with any solutions to this problem?
yurixd
Novice
Posts: 3
Liked: never
Joined: Sep 01, 2017 1:55 pm
Full Name: Yuri Santos
Contact:

Job failed

Post by yurixd »

Case # 02197424

Hello friends, the above case was initially referring to a warning message in the SQL and Oracle transaction log.

After a period began to occur in the job of backups where the engineer when analyzing my server found that there is memory leak in veeam, which is causing failures in backup jobs.
I also noticed that in some cases the veeam console is inaccessible on the server, it is necessary to restart the veeam service backup or to restart the server itself.
When I look at the task manager, I see excessive numbers in the Veeam.Backup.Sattelite process. By killing all processes leaving only 1 the backup job returns to normal operation.

Anyone have any suggestions on the problem? I have to daily run the backups by hand due to failure.

**it seems to me that the Veeam.Backup.Satellite process is finished in 5 minutes. something that is not happening.
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by veremin » 1 person likes this post

Hi, Yuri,

Please, let's wait and see what support team says about the issue, once the debug logs are investigated.

Thanks.
JRJenZen
Novice
Posts: 3
Liked: never
Joined: May 02, 2016 7:13 am
Full Name: 7
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by JRJenZen »

Any News On This, i'm an SP and we have hundreds of these causing customers backup to fail.
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by veremin »

We've identified the root cause of this problem. The hotfix is currently being tested.

Since you're an SP, kindly, apply to Veeam Cloud Provider group, using Usergroup settings in the User Control Panel. This's needed to get access to dedicated cloud providers' forum. That is likely to be the first place where we will share news regarding hotfix availability.

Thanks.
rntguy
Enthusiast
Posts: 82
Liked: 1 time
Joined: Jan 29, 2016 8:31 pm
Full Name: Rnt Guy
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by rntguy »

we are getting the same issue. one customer's backups now failing. they don't copy up to the cloud though. where can I get the hotfix?
FCa
Service Provider
Posts: 13
Liked: 2 times
Joined: Dec 20, 2017 1:42 pm
Full Name: Fabien C.
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by FCa »

Hello,
We are also getting the same Issue.

Killing all " Veeam.Backup.Satellite" processes & rescan the Veeam Backup Server temporarly solve the issue...
Could we get a Script that kill all processes except one, so we can schedule it hourly the time for Veeam Dev to fix this bug ?
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by Vitaliy S. »

Fabien, to receive the hotfix for this problem, please contact our technical support team directly using cp.veeam.com
sleti
Veeam Software
Posts: 4
Liked: 1 time
Joined: Apr 27, 2017 12:55 pm
Full Name: Stefan Letinu
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by sleti »

You can proceed in the following way:
Modify PS script: add Connect-VBRServer and Disconnect-VBRServer You must use this commands to close PowerShell session and finish satellite process
Restart Veeam server.
Monitor server and satellite processes.
If you still see multiple satellites – collect fresh logs and PS script for further investigation by the technical team.
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by veremin »

The easiest way to get this issue fixed is to open a support ticket; which I recommend to everyone experiencing the similar problem. Thanks.
seamusobr
Lurker
Posts: 1
Liked: never
Joined: Feb 16, 2018 8:53 am
Full Name: Seamus OBrien
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by seamusobr »

I am also seeing this and having to clear down 50 of these processes daily does anyone know if there is a hotfix for this?
We are a bit reluctant to scale beyond the single client we have at the moment until we get a fix
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by Vitaliy S. »

Seamus, please contact our technical team for assistance with this/fix.
mma
Service Provider
Posts: 111
Liked: 21 times
Joined: Dec 22, 2011 9:12 am
Full Name: Marcel
Location: Lucerne, Switzerland
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by mma » 1 person likes this post

Case # 02620437

Does this fix also help on not powershell triggered jobs?
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by Vitaliy S. »

AFAIK this was related to PowerShell only, but you'd better to double-check with your support engineer.
DMIT
Service Provider
Posts: 6
Liked: 2 times
Joined: Mar 14, 2018 8:31 pm
Full Name: Jeff Ellingham
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by DMIT » 1 person likes this post

I am Veeam Service Provider and noticed the issue when backup agents were unable to connect to our cloud repository - error "Backup Repository is inaccessible". Creating a scheduled task with the the following " Taskkill /im veeam.backup.satellite.exe /f" works perfectly.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by Vitaliy S. »

Thanks for the post, Jeff! This temp workaround indeed should solve the problem until the hotfix for this issue is provided.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by Vitaliy S. »

Quick update: hotfix for this problem is available for download from our support team.
StoneFritz
Service Provider
Posts: 13
Liked: 4 times
Joined: Feb 14, 2017 12:47 pm
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by StoneFritz »

Hello, I have the same problem even with the hotfix installed.
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by Vitaliy S. »

Please let our support team know about this to verify the reason for this issue.
StoneFritz
Service Provider
Posts: 13
Liked: 4 times
Joined: Feb 14, 2017 12:47 pm
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by StoneFritz »

The support is currently looking at the case with me.
KeyInfo
Service Provider
Posts: 8
Liked: 1 time
Joined: Dec 04, 2017 6:42 pm
Full Name: KeyInfo
Contact:

[MERGED] Multiple Satellite Processes

Post by KeyInfo »

We have multiple (63) Veeam.Backup.Satellite processes on our veeam B&R server. Is that normal? If its not, should i periodically stop the processes?
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Multiple Satellite Processes

Post by Vitaliy S. »

There should be a hotfix available to resolve that. Please contact our technical support team.
tpayne
Service Provider
Posts: 61
Liked: 17 times
Joined: Feb 19, 2018 4:50 pm
Full Name: Tim Payne
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by tpayne »

I too have applied the hotfix provided by support and am still having satellite processes not being cleaned up. I have gone back to running the scheduled task that kills them every 6 hours... Just to compare with others applying the hotfix, is it labled "Fix_123620_83ea8ab698"?
StoneFritz
Service Provider
Posts: 13
Liked: 4 times
Joined: Feb 14, 2017 12:47 pm
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by StoneFritz »

I have gone back to running the scheduled task that kills them, too.
KeyInfo
Service Provider
Posts: 8
Liked: 1 time
Joined: Dec 04, 2017 6:42 pm
Full Name: KeyInfo
Contact:

Re: Multiple Satellite Processes

Post by KeyInfo »

We disabled it and now were getting multiple errors that are listed below. Veeam support dont know what the issue is either.
Waiting for backup infrastructure resources availability
Some VMs were not processed during the copy interval
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by Vitaliy S. »

Tim, StoneFritz what are your latest support case IDs?
tpayne
Service Provider
Posts: 61
Liked: 17 times
Joined: Feb 19, 2018 4:50 pm
Full Name: Tim Payne
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by tpayne » 1 person likes this post

02957644
Vitaliy S.
VP, Product Management
Posts: 27055
Liked: 2710 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam Satellite Process is not cleaned up

Post by Vitaliy S. »

Thanks, I will ask our QA team to take a look at your particular situation. It appears that there are different scenarios when this behavior can be observed and our support team would like to review them all.
Post Reply

Who is online

Users browsing this forum: Google [Bot] and 15 guests