-
- Service Provider
- Posts: 96
- Liked: 27 times
- Joined: Feb 09, 2019 5:06 pm
- Contact:
V12 - SureBackups failing since upgrade
Case 05877943, after upgrade the appliance cannot configure IPs on the isolated sides of adapters, after 10 minutes it fails, Hyper-V environment with Windows Server 2019 and latest GA build, is anyone seeing the same? We tried recreating labs, no avail.
15.02.2023 13:49:55 Error Failed to start Hyper-V Virtual Lab 'SureBackup'
Failed to power on virtual lab proxy appliance
Proxy appliance VM network initialization failed. Check proxy appliance IP settings.
15.02.2023 13:49:55 Error Failed to start Hyper-V Virtual Lab 'SureBackup'
Failed to power on virtual lab proxy appliance
Proxy appliance VM network initialization failed. Check proxy appliance IP settings.
-
- Product Manager
- Posts: 14784
- Liked: 1721 times
- Joined: Feb 04, 2013 2:07 pm
- Full Name: Dmitry Popov
- Location: Prague
- Contact:
Re: V12 - SureBackups failing since upgrade
Hello,
Thank you for your post, investigating!
Thank you for your post, investigating!
-
- Service Provider
- Posts: 96
- Liked: 27 times
- Joined: Feb 09, 2019 5:06 pm
- Contact:
Re: V12 - SureBackups failing since upgrade
QA team suggested enabling IPv6 communication in Network rules, dont know why this is required and it may be a bug, however after checking it, we successfully ran the SB tests.
-
- Product Manager
- Posts: 2589
- Liked: 712 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: V12 - SureBackups failing since upgrade
We are trying to get to the root of the problem, and it does seems like a bug.
/Thanks!
/Thanks!
-
- Lurker
- Posts: 1
- Liked: never
- Joined: Feb 15, 2023 6:54 pm
- Full Name: Adam
- Contact:
Re: V12 - SureBackups failing since upgrade
Enabling IPv6 communication work for us as well. Thank you for posting the workaround, SnakeSK.
-
- Enthusiast
- Posts: 42
- Liked: 4 times
- Joined: Nov 14, 2019 7:12 pm
- Full Name: Chris Lukowski
- Contact:
Re: V12 - SureBackups failing since upgrade
What is IPv6 even used for in an all-IPv4 network?
-
- Service Provider
- Posts: 96
- Liked: 27 times
- Joined: Feb 09, 2019 5:06 pm
- Contact:
Re: V12 - SureBackups failing since upgrade
Dont know yet, maybe after adding support they forgot this edge case of IPv4 comms.
-
- Product Manager
- Posts: 14784
- Liked: 1721 times
- Joined: Feb 04, 2013 2:07 pm
- Full Name: Dmitry Popov
- Location: Prague
- Contact:
Re: V12 - SureBackups failing since upgrade
Thank you for the heads up folks! The case is still under investigation, we will update this thread with the results as soon as possible.
-
- Expert
- Posts: 138
- Liked: 43 times
- Joined: Nov 02, 2019 6:19 pm
- Contact:
Re: V12 - SureBackups failing since upgrade
'Network rules', where?!
Can we have a complete answer please? There are network settings on the Hyper-V host, the individual VMs, the Surebackup Lab. What exactly should we be changing and where?
-
- Product Manager
- Posts: 10085
- Liked: 2682 times
- Joined: May 13, 2017 4:51 pm
- Full Name: Fabian K.
- Location: Switzerland
- Contact:
Re: V12 - SureBackups failing since upgrade
I believe it’s the Veeam network traffic rules within the Veeam console. You need to enable the „Enable IPv6 communication“ checkbox.
https://helpcenter.veeam.com/docs/backu ... ml?ver=120
Best,
Fabian
https://helpcenter.veeam.com/docs/backu ... ml?ver=120
Best,
Fabian
Product Management Analyst @ Veeam Software
-
- Expert
- Posts: 138
- Liked: 43 times
- Joined: Nov 02, 2019 6:19 pm
- Contact:
Re: V12 - SureBackups failing since upgrade
Many thanks for the quick response Fabian. I don't think I have looked at Network Rules since I first setup B&R about 5 years ago. I had forgot it existed and would never have found it!
I can confirm that Surebackup is now working after making that change.
I can confirm that Surebackup is now working after making that change.
-
- Service Provider
- Posts: 17
- Liked: 5 times
- Joined: Mar 06, 2017 11:36 am
- Full Name: Tim van Veen
- Contact:
Re: V12 - SureBackups failing since upgrade
Same problem here. Enabling IPv6 communication within the Preferred Networks was not enough. We also had to enable IPv6 in the Proxy appliance settings.
-
- Service Provider
- Posts: 17
- Liked: 5 times
- Joined: Mar 06, 2017 11:36 am
- Full Name: Tim van Veen
- Contact:
Re: V12 - SureBackups failing since upgrade
I've got one SureBackup which is still failing. This job is using Virtual Lab Proxy which has 6 isolated networks. Any updates on this issue?
-
- Product Manager
- Posts: 14784
- Liked: 1721 times
- Joined: Feb 04, 2013 2:07 pm
- Full Name: Dmitry Popov
- Location: Prague
- Contact:
Re: V12 - SureBackups failing since upgrade
Hello Tim,
If the mentioned workaround does not help then likely it's a different issue. Please raise a support case and share the case ID with us. Thank you!
If the mentioned workaround does not help then likely it's a different issue. Please raise a support case and share the case ID with us. Thank you!
-
- Service Provider
- Posts: 17
- Liked: 5 times
- Joined: Mar 06, 2017 11:36 am
- Full Name: Tim van Veen
- Contact:
Re: V12 - SureBackups failing since upgrade
I've raised a support case: #05896536
-
- Product Manager
- Posts: 14784
- Liked: 1721 times
- Joined: Feb 04, 2013 2:07 pm
- Full Name: Dmitry Popov
- Location: Prague
- Contact:
Re: V12 - SureBackups failing since upgrade
Passed to QA, thank you for the case Tim!
-
- Service Provider
- Posts: 17
- Liked: 5 times
- Joined: Mar 06, 2017 11:36 am
- Full Name: Tim van Veen
- Contact:
Re: V12 - SureBackups failing since upgrade
For anyone wondering or having the same problem: I've received a hotfix from the supportteam and this resolved our issue with the vLab in question. After installing the fix we also don't require applying the IPv6 workaround anymore.
-
- Service Provider
- Posts: 96
- Liked: 27 times
- Joined: Feb 09, 2019 5:06 pm
- Contact:
Re: V12 - SureBackups failing since upgrade
Latest patch undid the hotfix, what the hell?
-
- Product Manager
- Posts: 2589
- Liked: 712 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: V12 - SureBackups failing since upgrade
Latest patch code was finished before SureBackup private fix was created, thus the rollback is expected.
Feel free to open the ticket and request updated version of the private fix if enabling-IPv6-workaround is not an option(private fix will be re-compiled soon).
/Thanks!
Feel free to open the ticket and request updated version of the private fix if enabling-IPv6-workaround is not an option(private fix will be re-compiled soon).
/Thanks!
-
- Novice
- Posts: 4
- Liked: never
- Joined: Feb 15, 2023 7:37 am
- Full Name: Rexford Haugen
- Location: Colorado
- Contact:
Re: V12 - SureBackups failing since upgrade
Egor,
Any updates on the private fix being rolled out to a broader update? I'm seeing this error in our environment and we are not yet ready to enable IPv6.
Any updates on the private fix being rolled out to a broader update? I'm seeing this error in our environment and we are not yet ready to enable IPv6.
-
- Product Manager
- Posts: 2589
- Liked: 712 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
-
- Novice
- Posts: 4
- Liked: never
- Joined: Feb 15, 2023 7:37 am
- Full Name: Rexford Haugen
- Location: Colorado
- Contact:
Re: V12 - SureBackups failing since upgrade
That patch resolved the issue.
Thank you!
Thank you!
-
- Lurker
- Posts: 2
- Liked: never
- Joined: May 31, 2023 2:17 am
- Contact:
Re: V12 - SureBackups failing since upgrade
Case 05964441
Hi,
I'm new to Veeam, and am having the same or similar issue as the OP.
We upgraded from V10 to V12 two months ago and since then all SureBackups have failed, as there is a connectivity issue with the virtual lab proxy.
Looking at Hyper-V when running a SureBackup job, it starts the proxy, before shutting it down, saying it failed to start.
We've applied the above patch (running Build: 12.0.0.1420 P20230412), but the problem persists.
From the proxy, I cannot even ping its default gateway.
Opened Case 05964441, but got nowhere with support and it has since been closed by Veeam.
Any assistance would be appreciated.
31/05/2023 3:02:30 PM Job started at 31/05/2023 3:02:28 PM
31/05/2023 3:02:31 PM Getting virtual lab configuration
31/05/2023 3:02:31 PM Using virtual lab Veeam V12 Virtual Lab
31/05/2023 3:02:40 PM Checking virtual lab
31/05/2023 3:02:45 PM Preparing proxy appliance network specification
31/05/2023 3:02:42 PM Network traffic throttling is enabled
31/05/2023 3:08:10 PM Error Failed to start virtual lab proxy appliance VM
31/05/2023 3:08:12 PM Powering off proxy appliance VM
31/05/2023 3:08:15 PM Error Failed to start Hyper-V Virtual Lab 'Veeam V12 Virtual Lab'
Failed to power on virtual lab proxy appliance
Failed to connect to proxy appliance VM using IPv4 address.
31/05/2023 3:08:15 PM Job finished
31/05/2023 3:08:15 PM Sending e-mail report
Hi,
I'm new to Veeam, and am having the same or similar issue as the OP.
We upgraded from V10 to V12 two months ago and since then all SureBackups have failed, as there is a connectivity issue with the virtual lab proxy.
Looking at Hyper-V when running a SureBackup job, it starts the proxy, before shutting it down, saying it failed to start.
We've applied the above patch (running Build: 12.0.0.1420 P20230412), but the problem persists.
From the proxy, I cannot even ping its default gateway.
Opened Case 05964441, but got nowhere with support and it has since been closed by Veeam.
Any assistance would be appreciated.
31/05/2023 3:02:30 PM Job started at 31/05/2023 3:02:28 PM
31/05/2023 3:02:31 PM Getting virtual lab configuration
31/05/2023 3:02:31 PM Using virtual lab Veeam V12 Virtual Lab
31/05/2023 3:02:40 PM Checking virtual lab
31/05/2023 3:02:45 PM Preparing proxy appliance network specification
31/05/2023 3:02:42 PM Network traffic throttling is enabled
31/05/2023 3:08:10 PM Error Failed to start virtual lab proxy appliance VM
31/05/2023 3:08:12 PM Powering off proxy appliance VM
31/05/2023 3:08:15 PM Error Failed to start Hyper-V Virtual Lab 'Veeam V12 Virtual Lab'
Failed to power on virtual lab proxy appliance
Failed to connect to proxy appliance VM using IPv4 address.
31/05/2023 3:08:15 PM Job finished
31/05/2023 3:08:15 PM Sending e-mail report
-
- Product Manager
- Posts: 2589
- Liked: 712 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: V12 - SureBackups failing since upgrade
Hi Sparkie,
As far as I can see the case progress, it surely does seem like a networking issue.
1. Try redeploying the lab from the scratch. Just in case.
2. When it comes to networks, best way is to launch virtual lab appliance manually(HV manager), wait for it to load, and log in locally via KB1447.
At this point you have 2 machines on same network that must communicate with each other. Troubleshoot that part.
/Hope that helps!
As far as I can see the case progress, it surely does seem like a networking issue.
1. Try redeploying the lab from the scratch. Just in case.
2. When it comes to networks, best way is to launch virtual lab appliance manually(HV manager), wait for it to load, and log in locally via KB1447.
At this point you have 2 machines on same network that must communicate with each other. Troubleshoot that part.
/Hope that helps!
-
- Lurker
- Posts: 2
- Liked: never
- Joined: May 31, 2023 2:17 am
- Contact:
Re: V12 - SureBackups failing since upgrade
Hi Egor,
Thanks for your response.
I’ve tried redeploying the lab a couple of times but keep getting the same result. I can log on to the proxy VM but I cannot even ping the default gateway from the VM deployed by Veeam. The settings (all IPs) are the same as those used in V10, but stopped working as soon as I upgraded to V12.
I guess we’ll just have to live without the lab.
Thanks for your response.
I’ve tried redeploying the lab a couple of times but keep getting the same result. I can log on to the proxy VM but I cannot even ping the default gateway from the VM deployed by Veeam. The settings (all IPs) are the same as those used in V10, but stopped working as soon as I upgraded to V12.
I guess we’ll just have to live without the lab.
-
- Product Manager
- Posts: 2589
- Liked: 712 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: V12 - SureBackups failing since upgrade
Based on your description, I take it as virtual lab appliance VM cannot ping default gateway from prod-net side?
Do you have a static IP settings here or retrieve them from DHCP?
- once appliance is up, login and verify it gets correct IP settings (ifconfig)
- double check virtual network to which it has prod-NIC connected to - after all, this is your link to VBR server
P.S. you can always bump your case up with "Escalate" button and request troubleshooting with a support engineer in an online session
Do you have a static IP settings here or retrieve them from DHCP?
- once appliance is up, login and verify it gets correct IP settings (ifconfig)
- double check virtual network to which it has prod-NIC connected to - after all, this is your link to VBR server
P.S. you can always bump your case up with "Escalate" button and request troubleshooting with a support engineer in an online session
-
- Lurker
- Posts: 1
- Liked: 1 time
- Joined: Aug 02, 2021 1:23 pm
- Full Name: Charles Kavazy
- Contact:
Re: V12 - SureBackups failing since upgrade
The workround that fixed it for us was to apply the IPv6 settings and then remove them.
IPv6 was set and then removed in both the Preferred Networks and the Proxy Appliance settings. The Proxy appliance were left as using DHCP rather than assigning a fixed IP. Did this for each of our 3 Virtual Labs and all are now fine.
Circumstances were:
3 July 23 - Upgraded from V11 to V12 build number 12.0.0.1420 P20230412 (which included the hotfix referred to above)
Set IPv6 on Preferred Networks
Set IPv6 on Proxy Appliance of each lab - DHCP and saved the settings
Removed IPv6 from Proxy appliance and saved the settings
Removed IPv6 on Preferred Networks
IPv6 was set and then removed in both the Preferred Networks and the Proxy Appliance settings. The Proxy appliance were left as using DHCP rather than assigning a fixed IP. Did this for each of our 3 Virtual Labs and all are now fine.
Circumstances were:
3 July 23 - Upgraded from V11 to V12 build number 12.0.0.1420 P20230412 (which included the hotfix referred to above)
Set IPv6 on Preferred Networks
Set IPv6 on Proxy Appliance of each lab - DHCP and saved the settings
Removed IPv6 from Proxy appliance and saved the settings
Removed IPv6 on Preferred Networks
-
- Veteran
- Posts: 563
- Liked: 173 times
- Joined: Nov 15, 2019 4:09 pm
- Full Name: Alex Heylin
- Contact:
Re: V12 - SureBackups failing since upgrade
Apparently we just got hit by this too on v12.0.0 P20230718
Workaround from CharlesK fixed it.
Veeam, please address before 12.1 release.
Workaround from CharlesK fixed it.
Veeam, please address before 12.1 release.
-
- Product Manager
- Posts: 2589
- Liked: 712 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: V12 - SureBackups failing since upgrade
QA is positive it was fixed in 12.1 code.
/Cheers!
/Cheers!
-
- Veteran
- Posts: 563
- Liked: 173 times
- Joined: Nov 15, 2019 4:09 pm
- Full Name: Alex Heylin
- Contact:
Re: V12 - SureBackups failing since upgrade
Thanks Egor
Who is online
Users browsing this forum: Fippu, RValensise and 134 guests