Host-based backup of Microsoft Hyper-V VMs.
Post Reply
ibschreiber
Enthusiast
Posts: 25
Liked: 9 times
Joined: Nov 21, 2017 11:51 am
Full Name: Michael Schreiber
Contact:

Wrong registry key kills B&R Application aware processing (#08074972)

Post by ibschreiber » 4 people like this post

Hi everyone,
After upgrading to V13, we ran into issues with Application aware processing through VBR.

No Hyper-V production Snapshots could be generated on multiple machines spread over multiple customers (we're VCSP).

After a long search and trying everything we knew of this issue with previous versions, the solution came in form of a redid post from mazvazzeg (thank you!)

The issue were not missing open firewall ports, user rights, failed vss providers or anything like this.

Veeam changed the service entry for the Hyper V Volumeshadow requestor which prevented it from running at all:

The failed entry for the registry data under

Code: Select all

Computer\HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\vmicvss
contained in the ImagePath key

Code: Select all

 %systemroot%\system32\svchost.exe -k VeeamHvVssGroupstemNetworkRestrictedRedirectionGuard -p
which prevented the service from starting at all.
after changing it back to the value

Code: Select all

%SystemRoot%\System32\svchost.exe -k VeeamHvVssGroup -p
the service is starting again and everything is back to normal.

I'm waiting for Veeam to clarify, if this is a viable solution (at least it's a working one for me) and if there is a different way to fix this.

I'll keep you posted
Michael
Michael Schreiber
CEO Creatronics GmbH - Greding - Germany
Veeam user and VCSP
ibschreiber
Enthusiast
Posts: 25
Liked: 9 times
Joined: Nov 21, 2017 11:51 am
Full Name: Michael Schreiber
Contact:

Re: Wrong registry key kills B&R Application aware processing (#03839416)

Post by ibschreiber » 1 person likes this post

Michael Schreiber
CEO Creatronics GmbH - Greding - Germany
Veeam user and VCSP
david.domask
Product Manager
Posts: 3645
Liked: 885 times
Joined: Jun 28, 2016 12:12 pm
Contact:

Re: Wrong registry key kills B&R Application aware processing (#03839416)

Post by david.domask » 1 person likes this post

Hi Michael,

Thank you for sharing the solution you located, and sorry to hear about the troubles.

Please do continue with Support, I'm not able to quickly find any details on VeeamHvVssGroupstemNetworkRestrictedRedirectionGuard or how it would have been set like that, so while it's good backups are running, as you noted let's see the results of the investigation.

I've notated the case for Support with some additional details, so let's see how the investigation goes.
David Domask | Product Management: Principal Analyst
Samuraj
Veeam Vanguard
Posts: 10
Liked: 3 times
Joined: Feb 12, 2025 12:21 pm
Full Name: Petr Bouška
Location: Prague
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by Samuraj » 1 person likes this post

Hi,
I also encountered this problem on a newly installed SQL server on Hyper-V. Older SQL servers are backed up fine.

Code: Select all

Warning : Failed to create VM recovery checkpoint (mode: Veeam application-aware processing) ... Production checkpoints cannot be created for ...
Unfortunately, I couldn't find this post, so I spent 2 days trying to figure it out. I found that the Hyper-V Volume Shadow Copy Requestor service (vmicvss) is not running and cannot be started.

Finally I found the key mentioned here in the registry, which had a different value than on the other servers. After editing the service started and everything works.

So I was now looking for what the VeeamHvVssGroupstemNetworkRestrictedRedirectionGuard value means and came across this post.
cdubus
Service Provider
Posts: 11
Liked: 10 times
Joined: Jan 28, 2019 12:49 pm
Full Name: CEDRIC DUBUS
Location: FRANCE
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by cdubus »

Hi, Given the format of the value

Code: Select all

"VeeamHvVssGroupstemNetworkRestrictedRedirectionGuard"
I assume that Veeam tried to replace the value

Code: Select all

 "VeeamHvVssGroup"
with

Code: Select all

"VeeamHvVssGroup\ItemNetworkRestricted\RedirectionGuard"
The "s" in "groups" looks like a typo, as the "i" in "item" is missing.
david.domask
Product Manager
Posts: 3645
Liked: 885 times
Joined: Jun 28, 2016 12:12 pm
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by david.domask » 2 people like this post

Thanks for the idea cdubus, may indeed be related.

Currently the issue is being reviewed in one case by our Advanced Support Team & RND; hopefully there should be an update soon on the behavior confirming the issue and validating the workaround.
David Domask | Product Management: Principal Analyst
jasa004
Lurker
Posts: 1
Liked: never
Joined: May 07, 2026 12:28 pm
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by jasa004 »

This issue still exists - also on Community Edition. It took me a full week to find the culprit as to why our Hyper-V production checkpoint creation fails on just 1 healthy VM as well as job fails with little logging. Today i saw the difference in vmicvss service path to executable and then this thread.
How is there still not an update?
BrianBuchanan
Enthusiast
Posts: 76
Liked: 22 times
Joined: Nov 29, 2019 12:56 pm
Full Name: Brian Buchanan
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by BrianBuchanan » 2 people like this post

Thank-you. I just troubleshot my third freshly installed Server 2025 vm with this issue but unlike the other two I didn't give up and just wipe and reinstall.

Credit to Gemini that gave me this:

Code: Select all

Get-WmiObject win32_service | ?{$_.Name -like "*vmicvss*"} | Select PathName
which gave me this output:

Code: Select all

PathName
--------
C:\WINDOWS\system32\svchost.exe -k VeeamHvVssGroupstemNetworkRestrictedRedirectionGuard -p
Which Gemini deemed to be "junk".

I needed to do two things to get checkpoints working again. First was to fix that value with:

Code: Select all

sc.exe config vmicvss binPath= "C:\Windows\system32\svchost.exe -k LocalSystemNetworkRestricted -p"
and second was to add vmicvss to the registry value:
"HKLM:\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Svchost\LocalSystemNetworkRestricted"

Code: Select all

$registryPath = "HKLM:\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Svchost"
$valueName = "LocalSystemNetworkRestricted"

# Check if the group exists and add vmicvss if it's missing
if (Test-Path $registryPath) {
    $currentValues = Get-ItemProperty -Path $registryPath -Name $valueName -ErrorAction SilentlyContinue
    if ($currentValues) {
        if ($currentValues.$valueName -notcontains "vmicvss") {
            $newValues = $currentValues.$valueName + "vmicvss"
            Set-ItemProperty -Path $registryPath -Name $valueName -Value $newValues
            Write-Host "Added vmicvss to Svchost group." -ForegroundColor Green
        }
    } else {
        # Create the value if Veeam deleted it
        New-ItemProperty -Path $registryPath -Name $valueName -Value @("vmicvss") -PropertyType MultiString
    }
}
After that the service would start and I could make production checkpoints.

Some more context, the host output this with "No Contact" for VSS.

Code: Select all

Get-VMIntegrationService -VMName "TESTVM"

VMName  Name                    Enabled PrimaryStatusDescription SecondaryStatusDescription
------  ----                    ------- ------------------------ --------------------------
TESTVM Guest Service Interface False   OK
TESTVM Heartbeat               True    OK
TESTVM Key-Value Pair Exchange True    OK
TESTVM Shutdown                True    OK
TESTVM Time Synchronization    True    OK
TESTVM VSS                     True    No Contact
And trying to start vmicvss on the guest:

Code: Select all

Start-Service -Name vmicvss -Verbose
VERBOSE: Performing the operation "Start-Service" on target "Hyper-V Volume Shadow Copy Requestor (vmicvss)".
Start-Service : Service 'Hyper-V Volume Shadow Copy Requestor (vmicvss)' cannot be started due to the following error:
Cannot start service vmicvss on computer '.'.
At line:1 char:1
+ Start-Service -Name vmicvss -Verbose
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : OpenError: (System.ServiceProcess.ServiceController:ServiceController) [Start-Service],
   ServiceCommandException
    + FullyQualifiedErrorId : CouldNotStartService,Microsoft.PowerShell.Commands.StartServiceCommand
I hope this helps someone else in the future!
eikee
Novice
Posts: 5
Liked: 2 times
Joined: May 12, 2023 2:03 pm
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by eikee »

Same error for two newly installed WS25 VMs. BrianBuchanan, you made my day!
david.domask
Product Manager
Posts: 3645
Liked: 885 times
Joined: Jun 28, 2016 12:12 pm
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by david.domask »

Thank you very much Brian for your helpful post.

For the issue itself, the issue has been confirmed and looks like a fix is being prepared, so please continue with Support cases until the fix is ready.
David Domask | Product Management: Principal Analyst
sc211166
Influencer
Posts: 13
Liked: never
Joined: May 27, 2016 1:11 pm
Contact:

[Merged] Production Checkpoint error

Post by sc211166 »

We have a new installation:
- Hyper-V server 2025 standalone
- VM are windows 2025
- Windows 2025 Domains

After installing the VBR 13 configured Hyper-v Backup jobs and the production checkpoint fails.
We noticed that before running the backup the server vmicvss on the client VM was running after it does not and it fails to start

from inside the VMs
PS C:\WINDOWS\system32> Get-Service -Name vm*

Status Name DisplayName
------ ---- -----------
Running vmicguestinterface Hyper-V Guest Service Interface
Running vmicheartbeat Hyper-V Heartbeat Service
Running vmickvpexchange Hyper-V Data Exchange Service
Running vmicrdv Hyper-V Remote Desktop Virtualizati...
Running vmicshutdown Hyper-V Guest Shutdown Service
Running vmictimesync Hyper-V Time Synchronization Service
Stopped vmicvmsession Hyper-V PowerShell Direct Service
Stopped vmicvss Hyper-V Volume Shadow Copy Requestor

C:\Windows\System32>sc qc vmicvss
[SC] QueryServiceConfig SUCCESS

SERVICE_NAME: vmicvss
TYPE : 20 WIN32_SHARE_PROCESS
START_TYPE : 3 DEMAND_START
ERROR_CONTROL : 1 NORMAL
BINARY_PATH_NAME : C:\WINDOWS\system32\svchost.exe -k VeeamHvVssGroupstemNetworkRestrictedRedirectionGuard -p
LOAD_ORDER_GROUP :
TAG : 0
DISPLAY_NAME : Hyper-V Volume Shadow Copy Requestor
DEPENDENCIES :
SERVICE_START_NAME : LocalSystem

C:\Windows\System32>

C:\Windows\System32>sc start vmicvss
[SC] StartService FAILED 1053:

The service did not respond to the start or control request in a timely fashion.


From the Hyper-v host
PS C:\Users\Administrator> Get-VMIntegrationService -VMname TESTVM

VMName Name Enabled PrimaryStatusDescription SecondaryStatusDescription
------ ---- ------- ------------------------ --------------------------
TESTVM Guest Service Interface True OK
TESTVM Heartbeat True OK
TESTVM Key-Value Pair Exchange True OK
TESTVM Shutdown True OK
TESTVM Time Synchronization True OK
TESTVM VSS True Lost Communication


We opened the ticket 08093928
david.domask
Product Manager
Posts: 3645
Liked: 885 times
Joined: Jun 28, 2016 12:12 pm
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by david.domask » 1 person likes this post

Hi sc211166,

I've merged your post with an existing topic on the same issue.

The workarounds posted above are valid, and a fix is being prepared to address the overall issue.
David Domask | Product Management: Principal Analyst
sc211166
Influencer
Posts: 13
Liked: never
Joined: May 27, 2016 1:11 pm
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by sc211166 »

david.domask
I fixed it with running the following on each VM, does it look good to you or should I modify in other way ?
sc.exe config vmicvss binPath= "%SystemRoot%\System32\svchost.exe -k VeeamHvVssGroup -p"
sc211166
Influencer
Posts: 13
Liked: never
Joined: May 27, 2016 1:11 pm
Contact:

Re: Wrong registry key kills B&R Application aware processing (#08074972)

Post by sc211166 »

david.domask wrote: May 15, 2026 10:33 am Hi sc211166,

I've merged your post with an existing topic on the same issue.

The workarounds posted above are valid, and a fix is being prepared to address the overall issue.

I fixed it with running the following on each VM, does it look good to you or should I modify in other way ?
sc.exe config vmicvss binPath= "%SystemRoot%\System32\svchost.exe -k VeeamHvVssGroup -p"
Post Reply

Who is online

Users browsing this forum: No registered users and 1 guest