Discussions specific to the VMware vSphere hypervisor
mbiesheuvel
Influencer
Posts: 20
Liked: 1 time
Joined: Dec 13, 2009 7:23 am
Full Name: Michel Biesheuvel
Contact:

Re: Veeam temp snapshots not removed

Post by mbiesheuvel » Sep 18, 2013 7:49 am

You can best say: if veeam is installed on the same server as vcenter ;-).

hansvh
Influencer
Posts: 10
Liked: 1 time
Joined: Feb 26, 2013 11:24 am
Full Name: Hans
Contact:

Re: Veeam temp snapshots not removed

Post by hansvh » Sep 18, 2013 7:54 am

Thanks for your quick reply, but as I stated in my support case vCenter is NOT installed on the Veeam backup server so the article you refer to does not apply...

foggy
Veeam Software
Posts: 18552
Liked: 1606 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam temp snapshots not removed

Post by foggy » Sep 18, 2013 7:58 am

It's not about installing vCenter server on the Veeam backup server (just a subcase). It's about adding vCenter server to the Veeam B&R console as a Windows server.

veremin
Product Manager
Posts: 17141
Liked: 1483 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Veeam temp snapshots not removed

Post by veremin » Sep 18, 2013 7:58 am

Thanks for your quick reply, but as I stated in my support case vCenter is NOT installed on the Veeam backup server so the article you refer to does not apply...
Since you haven’t provided a support ticket ID, I wasn’t aware about that your issue was different and tried to provide you with the information regarding most likeable reason of this issue. :)

Then, let’s wait and see what support team says about this problem.

hansvh
Influencer
Posts: 10
Liked: 1 time
Joined: Feb 26, 2013 11:24 am
Full Name: Hans
Contact:

Re: Veeam temp snapshots not removed

Post by hansvh » Sep 20, 2013 1:09 pm

Well, it looks like my problem was indeed caused by the vCenter Server which was added as a Windows server. The known issue therefore, apart from the fact that in my case this was not visible in the GUI anywhere at all!!!

Veeam support made some changes to the database, I'm confident this solved my issue.

foggy
Veeam Software
Posts: 18552
Liked: 1606 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam temp snapshots not removed

Post by foggy » Sep 20, 2013 1:11 pm

Glad it resolved now, thanks for the update.

monsterlab
Novice
Posts: 5
Liked: never
Joined: Aug 08, 2012 8:44 pm
Contact:

Re: Veeam temp snapshots not removed

Post by monsterlab » Sep 29, 2013 8:31 pm

Does anyone know what needs to be deleted from the Veeam database to clear this up? I do not have the Vcenter server listed under Windows servers, but I know that I had it at one point and I've since deleted it. Perhaps there is something hanging around in the database that needs to be cleaned up. Nevertheless, I'm seeing the same issue where all of my temp snapshots aren't getting cleared out. I woke up this morning to nearly 500 snapshots on my ESX cluster and multiple datastores that were almost completely full.

What a nasty bug to not have a hotfix for yet...

foggy
Veeam Software
Posts: 18552
Liked: 1606 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam temp snapshots not removed

Post by foggy » Sep 30, 2013 8:19 am

monsterlab wrote:Does anyone know what needs to be deleted from the Veeam database to clear this up?
Our support can definitely help you with cleaning up the database. Please contact them directly.

veremin
Product Manager
Posts: 17141
Liked: 1483 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Veeam temp snapshots not removed

Post by veremin » Sep 30, 2013 8:20 am

As to the hotfix, according to the plan, the patch#1 that addresses issue with left snapshots is supposed to be released later this week. Thanks.

zak2011
Expert
Posts: 367
Liked: 41 times
Joined: May 15, 2012 2:21 pm
Full Name: Arun
Contact:

Re: Snapshot removal issues of a large VM

Post by zak2011 » Nov 19, 2013 10:55 am

Do left over snapshots get failed to be removed if there are references of old snapshots in the Veeam snapshot Tracker table in Veeam SQL database?

Thanks

foggy
Veeam Software
Posts: 18552
Liked: 1606 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam temp snapshots not removed

Post by foggy » Nov 19, 2013 11:20 am

There could be several reasons, support should be able to detect the particular one in your case.

zak2011
Expert
Posts: 367
Liked: 41 times
Joined: May 15, 2012 2:21 pm
Full Name: Arun
Contact:

Re: Veeam temp snapshots not removed

Post by zak2011 » Nov 25, 2013 12:17 pm

This is the update from support:-

1. backup job requested vCenter to create a VM snapshot;
2. backup job created db records in [dbo].[VmWareSnapshots] for snapshot tracker, in order to remove them in the end of backup job;
3. backup job requested vCenter to delete the snapshot;
4. backup server lost connection to vCenter and did not receive reply that the snapshot is removed;
5. db record of the snapshot wasn't removed from db table [dbo].[VmWareSnapshots]
6. snapshot tracker tries to delete the snapshot listed in table [dbo].[VmWareSnapshots], but this snapshot doesn't exist on the vCenter, so goes error: "Object reference not set..."

Solution in this case is to clean up the db table [dbo].[VmWareSnapshots] (when no jobs are running).

I did not fully understand though how it applies in my case. The above resolution is right when snapshots are manually deleted from vcenter and not removed from the database.
In my case, I didnt remove the Veeam left over snapshots. The snapshots did not get removed either from vsphere or from the sql database.

Thanks

foggy
Veeam Software
Posts: 18552
Liked: 1606 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam temp snapshots not removed

Post by foggy » Nov 25, 2013 3:27 pm

zak2011 wrote:I did not fully understand though how it applies in my case. The above resolution is right when snapshots are manually deleted from vcenter and not removed from the database.
In my case, I didnt remove the Veeam left over snapshots. The snapshots did not get removed either from vsphere or from the sql database.
Have you discussed this with support engineer?

zak2011
Expert
Posts: 367
Liked: 41 times
Joined: May 15, 2012 2:21 pm
Full Name: Arun
Contact:

Re: Veeam temp snapshots not removed

Post by zak2011 » Nov 25, 2013 8:27 pm

Yes foggy. Have discussed this with the support engineer. They will have a look at this again.

Thanks

cliffm
Enthusiast
Posts: 41
Liked: 4 times
Joined: Jun 03, 2011 12:41 am
Full Name: Cliff Meakin
Contact:

Re: Veeam temp snapshots not removed

Post by cliffm » Apr 23, 2014 4:11 am

Hmmm,

I have just upgraded to V7 today patch 3. Yep, Veeam temp snapshots not being removed but only on 1 Linux machine (so far), they are piling up. All other VMs the snapshots are gone OK at the end of a job. I have logged a support case 00554734. BTW I had noticed this forum topic which was the only reason I had not upgraded to V7 eralier. I was hoping it would be fixed by now. Alas!

cliffm
Enthusiast
Posts: 41
Liked: 4 times
Joined: Jun 03, 2011 12:41 am
Full Name: Cliff Meakin
Contact:

Re: Veeam temp snapshots not removed

Post by cliffm » Apr 27, 2014 12:20 am

Hmmm,

Have not heard from support and got snapshots piling up all over the place.
I bit the bullet and moved the jobs to a B&R server on a network that does not have a vCentre server.
Now the jobs are working OK. The network is not on the Internet so no email messages, but I can live with that if I check in regularly.
Usually I have the vCentre server turned off, because when it is on most of my Microsoft server backups and replicas fail with VSS timeouts.
So kind of sorted, at least I have backups without having to manually delete the snaps every time. Very time consuming process!

I have to add a comment, I dread Veeam upgrades because every time I do something breaks and requires me to completely rearrange my backup strategies. This has been the case with every upgrade over the last 3 years now. But overall I think Veeam is gold and it has saved my bacon a couple of times...

Vitaliy S.
Product Manager
Posts: 23300
Liked: 1630 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Veeam temp snapshots not removed

Post by Vitaliy S. » Apr 27, 2014 2:28 pm

Hi Cliff,

I see that you're on Standard Support contract, so please be aware that Standard Support is provided during business hours only. As to the workaround that you've mentioned, then it seems like the vCenter Server might be one of the reasons why snapshot is not removed after the backup job.
cliffm wrote:Usually I have the vCentre server turned off, because when it is on most of my Microsoft server backups and replicas fail with VSS timeouts.
Hmm...not sure I follow you here. Can you please clarify? Do you have a vCenter Server added to the backup console and you periodically turn it off?

Thanks!

veremin
Product Manager
Posts: 17141
Liked: 1483 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Veeam temp snapshots not removed

Post by veremin » Apr 28, 2014 7:26 am

Just out of curiosity - were you able to reproduce this issue manually without Veeam presence? Or the problem occurred only when Veeam was involved in the process? Thanks.

cliffm
Enthusiast
Posts: 41
Liked: 4 times
Joined: Jun 03, 2011 12:41 am
Full Name: Cliff Meakin
Contact:

Re: Veeam temp snapshots not removed

Post by cliffm » May 04, 2014 11:43 pm

Vitaliy S. wrote:Hi Cliff,

I see that you're on Standard Support contract, so please be aware that Standard Support is provided during business hours only. As to the workaround that you've mentioned, then it seems like the vCenter Server might be one of the reasons why snapshot is not removed after the backup job.
Hmm...not sure I follow you here. Can you please clarify? Do you have a vCenter Server added to the backup console and you periodically turn it off?

Thanks!
Hi Vitaliy,

Yes I usually turn the vCentre server off. I have had a history of problems with Veeam and Vcentre server so my policy is to always set Veeam jobs direct to host. With the vCentre server off I usually have successful snapshots. If I turn it on snaps fail all over the place (only on MS Exchange VMs) but eventaully start to succeed after a few days or more (even though my jobs are direct to host). So it is easier to have it off, I don't need it unless I want to do VMware updates. I have been through this many times, including with support, I am not going to spend any more time on it. Backups are more important than vcentre server so whatever I have to do to get Veeam stable wins the race as far as I am concerned.

Cliff

bsoosay
Enthusiast
Posts: 34
Liked: never
Joined: Oct 02, 2014 7:47 am
Full Name: Benjamin Soosay
Contact:

[MERGED] Snapshot Removals

Post by bsoosay » Oct 12, 2014 11:02 am

I'm using Veeam Backup & Replication version 7.

I observed that after some of the backups had completed successfully, from vCenter, I could see that certain VM's had snapshots that were not removed by Veeam. I found this from Snapshot Manager on vCenter.

1. Any idea why this is happening?

2. Can I remove these snapshots manually by deleting them from Snapshot Manager on vCenter?

3. What am I doing wrong, that's causing this to happen?

I also observed that the hard disks of these VM's (where the snapshots have not been removed), are pointing to the snapshot files and not the parent .vmdk files.

foggy
Veeam Software
Posts: 18552
Liked: 1606 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Veeam temp snapshots not removed

Post by foggy » Oct 12, 2014 6:25 pm

That's not an intended behavior, however can occur occasionally due to various reasons, please review the thread above for details. Are you able to reproduce the same behavior manually, while taking snapshots using vSphere Client? Though you can safely remove those snapshots manually, it might worth contacting support.

veremin
Product Manager
Posts: 17141
Liked: 1483 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Veeam temp snapshots not removed

Post by veremin » Oct 17, 2014 9:20 am 1 person likes this post

Also, don't forget about using Veeam ONE to stay updated about orphaned snapshots' presence. Thanks.

Post Reply

Who is online

Users browsing this forum: DonZoomik and 21 guests