Comprehensive data protection for all workloads
Post Reply
sykerzner
Service Provider
Posts: 47
Liked: 2 times
Joined: Jul 27, 2020 1:16 pm
Full Name: SYK
Contact:

Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by sykerzner »

Hi
We have a bunch of small desktops in the field running VBR for our clients. Each has 2 physical disks, for OS, and for storage. The storage disks hold a single VHDX, which is mounted on startup. It contains a volume formatted with REFS. Let's call them C (OS), E (Physical) and F (VHDX with REFS)

Most of our machines are Win10 or server 16/19 which work perfectly.

However, on Win11 machines (22h2 and 23H3), are having the following issues: Every so often the machine freezes up with 100% cpu usage. We were able to track this back to our RMM which runs a defrag when doing a disk inventory. Volumes C and E complete within seconds (in event viewer I can see "The storage optimizer successfully completed analysis on New Volume (E:)" ). SOMETIMES the machine then freezes. Sometimes it eventually completes on it's own with a message "The storage optimizer successfully completed analysis on (F:)", but sometime we have to down it after waiting hours or days.

We get the same result when manually running defrag, SOMETIMES.

I know this is a Windows problem, not a Veeam problem, but I am curious if anyone else encountered this.
Gostev
Chief Product Officer
Posts: 32217
Liked: 7583 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100%

Post by Gostev »

Hi, do you want to include the RMM name as well? I can update the topic name with it.
sykerzner
Service Provider
Posts: 47
Liked: 2 times
Joined: Jul 27, 2020 1:16 pm
Full Name: SYK
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100%

Post by sykerzner »

Sure, ConnectWise Automate (Labtech)
sykerzner
Service Provider
Posts: 47
Liked: 2 times
Joined: Jul 27, 2020 1:16 pm
Full Name: SYK
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by sykerzner »

Here is an update.

We got back a test machine which had been freezing. If no backups where setup, then defrag would not freeze the machine.
Once we added backups, and ran them, the machine would freeze at the next defrag - Consistently. Even after the backups finished.
It seems that rebooting before the defrag prevented the freeze. Stopping Veeam did not prevent the freeze.

I have a ticket with Veeam 07264297

Experimenting more, it seems like this does not happen if the REFS is version 3.10. I am not sure about 3.9, but all the machines I am having trouble with have REFS 3.7. Could be an REFS bug with Veeam backups tripped on and setting up defrag to trigger the freeze? and maybe the bug was fixed in 3.10? I am running some more tests to see.
ReKe
Service Provider
Posts: 36
Liked: 4 times
Joined: Apr 16, 2023 6:16 pm
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by ReKe »

We also see Machines that freeze with W11 22H2 and 23H2 in combination with ReFS. They will be absolutely unresponsive.
ReKe
Service Provider
Posts: 36
Liked: 4 times
Joined: Apr 16, 2023 6:16 pm
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by ReKe »

@sykerzner Do you have any new findings on this one?
M-M-C
Novice
Posts: 9
Liked: 1 time
Joined: Jul 29, 2019 9:12 am
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by M-M-C »

Now I got the same issue with Win11 24h2 and Server 2025 (same version for both, build 26100). Win11 22h2 and 23h2 are 22621/22631, so everything newer than Server 2022 (build 20348) seems to be affected. Server 2025 with ReFS (v3.12) is completely unusable right now. I know those Windows versions are not supported yet, I'm just sharing my experiences from my home lab.
sykerzner
Service Provider
Posts: 47
Liked: 2 times
Joined: Jul 27, 2020 1:16 pm
Full Name: SYK
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by sykerzner »

We had not had this issue on any machine for a while, so it seemed 3.10 solved it. Some of our machines had only 8 GB of RAM, so going to 16 may have helped.
However, it started happening again on one machine. I think it was right after we added some large busy backups...

One workaround: if you reboot before running a defrag, that doesn't happen.
karsten123
Service Provider
Posts: 569
Liked: 140 times
Joined: Apr 03, 2019 6:53 am
Full Name: Karsten Meja
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by karsten123 »

with defrag you mean Windows Disk Defragmenter?
ReKe
Service Provider
Posts: 36
Liked: 4 times
Joined: Apr 16, 2023 6:16 pm
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by ReKe »

How do you upgraded REFS to 3.10?
Daun2shay
Lurker
Posts: 1
Liked: never
Joined: Dec 14, 2023 11:47 pm
Full Name: Cameron Groves
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by Daun2shay »

I have also experienced this we now just use NTFS in our org
tyler.jurgens
Veeam Software
Posts: 425
Liked: 251 times
Joined: Apr 11, 2023 1:18 pm
Full Name: Tyler Jurgens
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by tyler.jurgens »

ReKe wrote: Aug 24, 2024 3:49 pm How do you upgraded REFS to 3.10?
Here is the ReFS version table (according to wikipedia):
https://en.wikipedia.org/wiki/ReFS#Versions

You won't get ReFS above 3.7 on anything other than Windows 11, and looks to only be available on insider preview builds.
Tyler Jurgens
Blog: https://explosive.cloud
Twitter: @Tyler_Jurgens BlueSky: @explosive.cloud
sykerzner
Service Provider
Posts: 47
Liked: 2 times
Joined: Jul 27, 2020 1:16 pm
Full Name: SYK
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by sykerzner »

ReKe wrote: Aug 24, 2024 3:49 pm How do you upgraded REFS to 3.10?
So main workstation is WIn11 enterprise, When I format a volumes with REFS, I get 3.10. To test on machines, I'd frequently create a VHDX and format it with REFS and move it over.

karsten123 wrote: Aug 19, 2024 10:25 pm with defrag you mean Windows Disk Defragmenter?
Yes, or our Labtech's build in Disk Intentory also runs a defrag of sorts, and also MS has a weekly scheduled task. Any of those will trigger the issue
(I don't understand fully the different things MS does when it 'defrags' vhdx's, I know it's not a classic defrag. I am being unspecific)
helpit
Service Provider
Posts: 1
Liked: never
Joined: Dec 09, 2014 9:37 pm
Full Name: helpIT & more GmbH
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by helpit »

Anything new on this topic?
I have the same issue on 2 virtual repositorys running server 2022.

regards,
Thomas
sykerzner
Service Provider
Posts: 47
Liked: 2 times
Joined: Jul 27, 2020 1:16 pm
Full Name: SYK
Contact:

Re: Windows 11 + REFS + Defrag = CPU 100% (ConnectWise Automate)

Post by sykerzner »

Nothing I tried conclusively fixed the issue
It looks like this post may have pick up the issue:


veeam-backup-replication-f2/b-r-on-wind ... 95062.html
Post Reply

Who is online

Users browsing this forum: Amazon [Bot] and 158 guests