-
- Chief Product Officer
- Posts: 31561
- Liked: 6725 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Increase in Hot Add backup time after installing Update
We have also published a knowledge base article with the hotfix > KB2711
-
- Influencer
- Posts: 12
- Liked: 1 time
- Joined: Sep 13, 2018 8:38 am
- Full Name: Matthew Oldham
- Contact:
Re: Increase in Hot Add backup time after installing Update
Is it possible that this increase could cause backup proxies to time out altogether.
In the past couple of weeks we have seen 3 different W2016 backup proxies essentially become invalid/orphaned in VMware whilst having 7 or 8 disks attached. The job logs showed some of the hot add disks were still at 0% upon the job failing. ESXi v6.5.0 9298722
I have had a veeam support call open but all relevant logs requested did not return anything useful on the cause. I have since applied the hotifx today anyway but wondered whether these could be linked ?
In the past couple of weeks we have seen 3 different W2016 backup proxies essentially become invalid/orphaned in VMware whilst having 7 or 8 disks attached. The job logs showed some of the hot add disks were still at 0% upon the job failing. ESXi v6.5.0 9298722
I have had a veeam support call open but all relevant logs requested did not return anything useful on the cause. I have since applied the hotifx today anyway but wondered whether these could be linked ?
-
- Veeam Software
- Posts: 21073
- Liked: 2115 times
- Joined: Jul 11, 2011 10:22 am
- Full Name: Alexander Fogelson
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
Hi Matthew, hard to tell, feel free to escalate the case for further investigation if hotfix doesn't help.
-
- Veeam Legend
- Posts: 1145
- Liked: 388 times
- Joined: Dec 17, 2015 7:17 am
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
One question: We use hotadd only for restores and one with one specific proxy, normally we use direct SAN (which we switched to read only on all LUNs) on other proxys or NBD.
Is it ok to only install the hotfix on this one proxy which does hotadd?
Is it ok to only install the hotfix on this one proxy which does hotadd?
-
- Chief Product Officer
- Posts: 31561
- Liked: 6725 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
Yes, absolutely.
-
- Lurker
- Posts: 2
- Liked: never
- Joined: Sep 26, 2018 9:34 am
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
I've installed this hotfix, and yet i'm still facing the same problem.
The thing is, this seems to have happened overnight, as i've been backing up for a good month or 2 and now this issue has appeared.
It's taking hours for a backup to complete where as before it was literally 10-15 minutes.
I haven't changed anything in my vcenter setup or veeam. Apart from installing the hotfix now which still hasnt resolved it..
Anything else I should try doing?
The thing is, this seems to have happened overnight, as i've been backing up for a good month or 2 and now this issue has appeared.
It's taking hours for a backup to complete where as before it was literally 10-15 minutes.
I haven't changed anything in my vcenter setup or veeam. Apart from installing the hotfix now which still hasnt resolved it..
Anything else I should try doing?
-
- Lurker
- Posts: 2
- Liked: never
- Joined: Sep 26, 2018 9:34 am
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
Actually managed to resolve this.
I noticed I could not access snapshot settings from inside vCenter.
I restarted the service " VMware vSphere Profile-Driven Storage Service" from inside the vcenter appliance management page on port 5480, and ran a backup. Finished in minutes again.
Hope it potentially helps anyone else experiencing this issue!
I noticed I could not access snapshot settings from inside vCenter.
I restarted the service " VMware vSphere Profile-Driven Storage Service" from inside the vcenter appliance management page on port 5480, and ran a backup. Finished in minutes again.
Hope it potentially helps anyone else experiencing this issue!
-
- Novice
- Posts: 3
- Liked: never
- Joined: Mar 03, 2017 12:27 pm
- Full Name: André Winkler
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
Hello all,
in our environment the kb2711 was the solution. As the support explained to me, it is not really a problem of veeam componentens but of vmware componentens, as veeam uses the vmware dlls/exe for hot add. With the exchange of the folders and the veeamagent.exe, they use the older versions.
Our hot add backups also seeam to be a bit faster now, i think. I hope in Update4 the problem will not come back again.
Regards
André
in our environment the kb2711 was the solution. As the support explained to me, it is not really a problem of veeam componentens but of vmware componentens, as veeam uses the vmware dlls/exe for hot add. With the exchange of the folders and the veeamagent.exe, they use the older versions.
Our hot add backups also seeam to be a bit faster now, i think. I hope in Update4 the problem will not come back again.
Regards
André
-
- Novice
- Posts: 4
- Liked: 1 time
- Joined: Oct 25, 2018 6:55 pm
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
I can recommend to switch to NBD Mode, we were struggling with Hot-Add a long time, but while troubleshooting another storage / backup related issue, we switched modes and were super surprised how well it worked.
-
- Chief Product Officer
- Posts: 31561
- Liked: 6725 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
I assume you have 10Gb Ethernet then
-
- Novice
- Posts: 4
- Liked: 1 time
- Joined: Oct 25, 2018 6:55 pm
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
Yes of course, I've taken this as obvious, since it was already mentioned. 10 GB is a clear must.
-
- Lurker
- Posts: 2
- Liked: never
- Joined: Feb 11, 2011 4:32 pm
- Full Name: Solve IT
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
@Fenris
What sort of speeds are you getting using NBD? We have 10Gb and are still only getting 35-45MB/s whereas when hotadd works we get anything from 150-450MB/s depending on size of VM and delta changes.
What sort of speeds are you getting using NBD? We have 10Gb and are still only getting 35-45MB/s whereas when hotadd works we get anything from 150-450MB/s depending on size of VM and delta changes.
-
- Veeam Software
- Posts: 21073
- Liked: 2115 times
- Joined: Jul 11, 2011 10:22 am
- Full Name: Alexander Fogelson
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
The first step in troubleshooting performance issues is always reviewing the bottleneck stats. If you'd like to continue this discussion, please create a separate topic as your question is not related to the original one discussed in this thread. Thanks for understanding!
EDIT: Ok, I see you've already started another discussion regarding your issues, so disregard.
EDIT: Ok, I see you've already started another discussion regarding your issues, so disregard.
-
- Veeam Legend
- Posts: 1145
- Liked: 388 times
- Joined: Dec 17, 2015 7:17 am
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
For us NBD was SOOO much faster than HotAdd or SAN just because with 2500 VMs the start of reading after snapshot took way to long with SAN/hotadd.
We use 4 NBD virtual proxies now and Veeam never was so fast as it is now....
We use 4 NBD virtual proxies now and Veeam never was so fast as it is now....
-
- Chief Product Officer
- Posts: 31561
- Liked: 6725 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
On 10Gb Ethernet, NBD is the real winner especially with async NBD supported we added in Update 3a.
-
- Veeam Legend
- Posts: 1145
- Liked: 388 times
- Joined: Dec 17, 2015 7:17 am
- Contact:
Re: Increase in Hot Add backup time after installing Update 3a
@gostev: Is async NBD active by default? It should work only for 6.7 correct?
Still, with 6.0 and 3a NBD is just excellent and right now i do not really want to go back to direct SAN!
Still, with 6.0 and 3a NBD is just excellent and right now i do not really want to go back to direct SAN!
-
- Chief Product Officer
- Posts: 31561
- Liked: 6725 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Who is online
Users browsing this forum: No registered users and 92 guests