Comprehensive data protection for all workloads
alexandre.nakagawa
Influencer
Posts: 21
Liked: 4 times
Joined: Oct 14, 2021 4:57 pm
Full Name: alexandre nakagawa
Contact:

Re: Server 2025 - high CPU and RAM

Post by alexandre.nakagawa » 1 person likes this post

Hello gostev and Johan
I installed a new Veeam server and physical proxies (256GB RAM) with Windows 2025.
I mapped the LUNs from the old servers (Windows 2022 REFS) to the new server.
We migrated on Friday, and early this morning, the server started freezing, with high CPU and memory usage.
I have repositories of 300TB each, with approximately 1PB of data in one of the repositories.
I applied the FileCacheLimitPercent registry keys, but the server remains unstable after 30 minutes of uptime.
Is there any Microsoft fix I can request when opening a support case with Microsoft?
Would you be able to provide this fix if I open a P0 support case with Veeam
karsten123
Service Provider
Posts: 603
Liked: 152 times
Joined: Apr 03, 2019 6:53 am
Full Name: Karsten Meja
Contact:

Re: Server 2025 - high CPU and RAM

Post by karsten123 » 3 people like this post

why do you not just wait for the official fix?
Gostev
Chief Product Officer
Posts: 32345
Liked: 7701 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Server 2025 - high CPU and RAM

Post by Gostev » 2 people like this post

Unfortunately we're never able to provide private fixes we receive from Microsoft for validation, as it's an intellectual property that does not belong to us and therefore we cannot redistribute it.
DaStivi
Veeam Legend
Posts: 379
Liked: 59 times
Joined: Jun 30, 2015 9:13 am
Full Name: Stephan Lang
Location: Austria
Contact:

Re: Server 2025 - high CPU and RAM

Post by DaStivi » 2 people like this post

Can you post some reference number to help with a case at Microsoft to get the private hotfix without any more hassle ?

Waiting another month isn't a option for many if the server just stops responding without being able to create backups... And no none of us is willing to install another Server any maybe loose some weeks or months of backups ..
alexandre.nakagawa
Influencer
Posts: 21
Liked: 4 times
Joined: Oct 14, 2021 4:57 pm
Full Name: alexandre nakagawa
Contact:

Re: Server 2025 - high CPU and RAM

Post by alexandre.nakagawa » 2 people like this post

karsten123 wrote: Jun 16, 2025 10:33 am why do you not just wait for the official fix?
Because my server is unresponsive and I missing almost 1PB of backups... the server run only for about 4 hours and freeze, it has 256GB o ram used.

and the sql databases are becoming unavailable per lack of space on transaction logs directory since the backup logs are not running, (our databases have 200TB each) and we do 30 min log backups.
karsten123
Service Provider
Posts: 603
Liked: 152 times
Joined: Apr 03, 2019 6:53 am
Full Name: Karsten Meja
Contact:

Re: Server 2025 - high CPU and RAM

Post by karsten123 » 1 person likes this post

BEFORE jumping no scope on the 2025 train

… at least, its a valuable lesson
alexandre.nakagawa
Influencer
Posts: 21
Liked: 4 times
Joined: Oct 14, 2021 4:57 pm
Full Name: alexandre nakagawa
Contact:

Re: Server 2025 - high CPU and RAM

Post by alexandre.nakagawa »

I have other 3 veeam repositories that was migrated to 2025 and was running fine for a long time. this is our only server that had this bug, problably because the size of backups and repositories, small repo servers is working fine
johan.h
Veeam Software
Posts: 743
Liked: 205 times
Joined: Jun 05, 2013 9:45 am
Full Name: Johan Huttenga
Contact:

Re: Server 2025 - high CPU and RAM

Post by johan.h »

Understand that this is very frustrating. We were given KB9178699 at the time, private fixes should be requested from Microsoft (its their code after all). If that doesn't work use the private message feature to reach out to me and maybe I can help you push a little.

Separately, Alexandre, I've worked with your Veeam Support engineer on this one and I believe they have a plan in place for you.
alexandre.nakagawa
Influencer
Posts: 21
Liked: 4 times
Joined: Oct 14, 2021 4:57 pm
Full Name: alexandre nakagawa
Contact:

Re: Server 2025 - high CPU and RAM

Post by alexandre.nakagawa »

Ok, thanks johan, i received the update from veeam eng.
BenM2024
Influencer
Posts: 18
Liked: 7 times
Joined: Oct 01, 2024 7:38 am
Full Name: Ben Mottram
Contact:

Re: Server 2025 - high CPU and RAM

Post by BenM2024 »

johan.h wrote: Jun 09, 2025 7:01 pm The ReFS memory exhaustion fix is expected from Microsoft in July for HCI23H2 and Windows Server 2025.
That's good news - if it works :P

FWIW I still can't run a backup (to an NTFS drive) becasue the ReFS bug hangs the server. It seems the 5ish Gb of ram left after ReFS takes it's bit (even when Veeam is disabled)
is not enough memory for a backup to a local NTFS volume.
I might get the opportunity to rob some RAM form another server next week and see if a few more Gb provides enough space for backups to run - it does seem that the ReFS bug maxes out at 90Gbish RAM in my use case. Its worth the downtime on the donor server I feel.
BenM2024
Influencer
Posts: 18
Liked: 7 times
Joined: Oct 01, 2024 7:38 am
Full Name: Ben Mottram
Contact:

Re: Server 2025 - high CPU and RAM

Post by BenM2024 » 1 person likes this post

I might get the opportunity to rob some RAM form another server next week and see if a few more Gb provides enough space for backups to run
Well that went as expected - even with 160Gb RAM in the server it dies whilst doing the backup job. All other jobs disabled. Roll on July Patch Tuesday (8th isn't it?)
johan.h
Veeam Software
Posts: 743
Liked: 205 times
Joined: Jun 05, 2013 9:45 am
Full Name: Johan Huttenga
Contact:

Re: Server 2025 - high CPU and RAM

Post by johan.h »

From what I heard from Microsoft, I would expect a little later in July. But yes, not so far away now.
alexandre.nakagawa
Influencer
Posts: 21
Liked: 4 times
Joined: Oct 14, 2021 4:57 pm
Full Name: alexandre nakagawa
Contact:

Re: Server 2025 - high CPU and RAM

Post by alexandre.nakagawa » 1 person likes this post

My workaround was to mount the iSCSI disk on another machine with 512GB of RAM (a 300TB ReFS volume).
After many hours, I was finally able to access the disk directories.
I then copied the VIB/BKP files to another NTFS disk.
The server crashed multiple times even with 512GB of RAM, but I gradually managed to copy each file.
I lost several backups, but they were weekly backups that would have been deleted soon due to retention, so I only copied the critical ones.
I was able to copy approximately 150TB.
DaStivi
Veeam Legend
Posts: 379
Liked: 59 times
Joined: Jun 30, 2015 9:13 am
Full Name: Stephan Lang
Location: Austria
Contact:

Re: Server 2025 - high CPU and RAM

Post by DaStivi »

i've got a privat fix from microsoft that looks like to fixed the issues... i only had about 10 or 15mintues until the server freezed...
ms-support told me the fix is planned to become publicly available in August ... :(
Gostev
Chief Product Officer
Posts: 32345
Liked: 7701 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Server 2025 - high CPU and RAM

Post by Gostev »

From what I heard, the fix requires changing one registry setting in addition to deploying actual binaries. Did you do both things?
DaStivi
Veeam Legend
Posts: 379
Liked: 59 times
Joined: Jun 30, 2015 9:13 am
Full Name: Stephan Lang
Location: Austria
Contact:

Re: Server 2025 - high CPU and RAM

Post by DaStivi »

No just to install the fix because it's a test-signed file...
But I had refs memory reg keys in place before to try to work around the issue, but none worked...

https://learn.microsoft.com/en-us/troub ... usage-refs
halllowien
Influencer
Posts: 17
Liked: never
Joined: Apr 14, 2020 2:09 pm
Full Name: David Brunner
Contact:

Re: Server 2025 - high CPU and RAM

Post by halllowien »

if you don't "have enough time" for the fix to install or problems with backups on ntfs while refs is mounted, you can maybe remove the refs disk.
for me this solves the hanging problem of Windows to have enough time to do something.
JeremiahDDS
Service Provider
Posts: 33
Liked: 7 times
Joined: Mar 28, 2019 12:52 am
Full Name: Jeremiah Glover
Contact:

Re: Server 2025 - high CPU and RAM

Post by JeremiahDDS »

Having the same issue, does anyone have this private patch?
JTT
Service Provider
Posts: 129
Liked: 8 times
Joined: Jan 02, 2017 7:31 am
Full Name: JTT
Contact:

Re: Server 2025 - high CPU and RAM

Post by JTT » 2 people like this post

Latest response from my MS support case:
I just wanted to give you a quick update on the ongoing ReFS issue. Our Product Group (PG) team is actively working on the fix, and it looks like it might be scheduled for release at the end of July.
I'll be sure to share any further updates as soon as I have it.
JeremiahDDS
Service Provider
Posts: 33
Liked: 7 times
Joined: Mar 28, 2019 12:52 am
Full Name: Jeremiah Glover
Contact:

Re: Server 2025 - high CPU and RAM

Post by JeremiahDDS »

I was on Windows Server 2022 and it was very fast, upgraded to Windows Server 2025 my 7 ReFS volumes are crawling even ones that are SSD. 100% disk activity, lots of RAM usage even when the server isn't doing much. If the final patch isnt going to be out till end of July, what does anyone recommend? I have some very large HDD volumes that I had to disconnect because when they go to 100% it makes the server non respond to, I had to disconnect them. I can't just format the volumes it's too much data. I tried the ReFS tweaks and the private patch.
Post Reply

Who is online

Users browsing this forum: No registered users and 7 guests