-
- Veteran
- Posts: 270
- Liked: 15 times
- Joined: Jan 03, 2012 2:02 pm
- Full Name: Tristan Floor
- Contact:
VM is doing Full while increment expected
Hi,
Last night we saw our backup (6.1) was doing a job with several linux vm's.
All vm's did an incremental, except 1 vm (same as other vm's).
It did a full!, (both disks on the vm).
How is that possible.
I backup based on vcenter folder structure.
The only important thing that i have done with the vm is storage vmotion to another lun, and the vm is powered off twice that day.
I have not remove it from inventory or something.
What's the trigger that veeam is doing a full in this case?
Thanks.
Last night we saw our backup (6.1) was doing a job with several linux vm's.
All vm's did an incremental, except 1 vm (same as other vm's).
It did a full!, (both disks on the vm).
How is that possible.
I backup based on vcenter folder structure.
The only important thing that i have done with the vm is storage vmotion to another lun, and the vm is powered off twice that day.
I have not remove it from inventory or something.
What's the trigger that veeam is doing a full in this case?
Thanks.
-
- VeeaMVP
- Posts: 6163
- Liked: 1971 times
- Joined: Jul 26, 2009 3:39 pm
- Full Name: Luca Dell'Oca
- Location: Varese, Italy
- Contact:
Re: VM is doing Full while increment expected
Hi Tristan,
have you moved the VM with storage vmotion while it was running, or powering it off? Because in the second scenario,if I'm not wrong vCenter changes the VM moref ID...
have you moved the VM with storage vmotion while it was running, or powering it off? Because in the second scenario,if I'm not wrong vCenter changes the VM moref ID...
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
-
- Veteran
- Posts: 392
- Liked: 33 times
- Joined: Jul 18, 2011 9:30 am
- Full Name: Hussain Al Sayed
- Location: Bahrain
- Contact:
Re: VM is doing Full while increment expected
Hello,
Have you run job on time other that the specified time in the scheduled? You may reach your Retention Period as per how you configured it and deleted the VM as per the Deleted VMs From Disk Retention, then a full backup of the job is expected to run on a day other that the specified Active Full Backup.
Thanks,
Hussain
Have you run job on time other that the specified time in the scheduled? You may reach your Retention Period as per how you configured it and deleted the VM as per the Deleted VMs From Disk Retention, then a full backup of the job is expected to run on a day other that the specified Active Full Backup.
Thanks,
Hussain
-
- Veteran
- Posts: 270
- Liked: 15 times
- Joined: Jan 03, 2012 2:02 pm
- Full Name: Tristan Floor
- Contact:
Re: VM is doing Full while increment expected
I had definitly powered off the vm before moving it with storage vmotion!
-
- Veteran
- Posts: 270
- Liked: 15 times
- Joined: Jan 03, 2012 2:02 pm
- Full Name: Tristan Floor
- Contact:
Re: VM is doing Full while increment expected
I have not run the job on another time!habibalby wrote:Hello,
Have you run job on time other that the specified time in the scheduled? You may reach your Retention Period as per how you configured it and deleted the VM as per the Deleted VMs From Disk Retention, then a full backup of the job is expected to run on a day other that the specified Active Full Backup.
Thanks,
Hussain
-
- Chief Product Officer
- Posts: 31746
- Liked: 7250 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: VM is doing Full while increment expected
How do you know if it's doing full backup for this VM?
-
- Veteran
- Posts: 270
- Liked: 15 times
- Joined: Jan 03, 2012 2:02 pm
- Full Name: Tristan Floor
- Contact:
Re: VM is doing Full while increment expected
My backup tape was full ,.. so that was weird!,
Then looking at the file size of the job, and that was very big,
Normal Full = 1100 GB
Normal Incr= 40 GB
Weird jobsize because of full vm: 757 GB (the vm is one of the biggest in the whole job)
Then looking at the file size of the job, and that was very big,
Normal Full = 1100 GB
Normal Incr= 40 GB
Weird jobsize because of full vm: 757 GB (the vm is one of the biggest in the whole job)
-
- VP, Product Management
- Posts: 27343
- Liked: 2785 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: VM is doing Full while increment expected
If there was a moref ID change then this information would be reflected in the backup job log files, besides if you take a look at VeeamAgent log files you will see how much data VMware CBT has returned as new blocks for this VM. Please contact our support team and let them assist you with the logs review.
-
- VeeaMVP
- Posts: 6163
- Liked: 1971 times
- Joined: Jul 26, 2009 3:39 pm
- Full Name: Luca Dell'Oca
- Location: Varese, Italy
- Contact:
Re: VM is doing Full while increment expected
Another possible cause could have been a defrag operation or sdelete on a VM prior of the backup execution. It would still be an incremental backup, but with a really large amount of changed blocks to save as modified...
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
-
- Veteran
- Posts: 270
- Liked: 15 times
- Joined: Jan 03, 2012 2:02 pm
- Full Name: Tristan Floor
- Contact:
Re: VM is doing Full while increment expected
There is no defrag or sdelete actions done on the linux vm.dellock6 wrote:Another possible cause could have been a defrag operation or sdelete on a VM prior of the backup execution. It would still be an incremental backup, but with a really large amount of changed blocks to save as modified...
It must be something with powering off and storage vmotion that i've done. But I'm wondering if that is normal, and if i can check which ID is used, and if it changed. Can i find that somewhere?
-
- VP, Product Management
- Posts: 27343
- Liked: 2785 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: VM is doing Full while increment expected
Yes, this information can be found in the backup job log files, just compare the VM moref ID between two last job sessions.
-
- VeeaMVP
- Posts: 6163
- Liked: 1971 times
- Joined: Jul 26, 2009 3:39 pm
- Full Name: Luca Dell'Oca
- Location: Varese, Italy
- Contact:
Re: VM is doing Full while increment expected
So you are confirming, as I supposed in a previous post, you first powered off the VM and then you migrated it? This is for sure supposed to change the Moref ID !!!tfloor wrote:It must be something with powering off and storage vmotion that i've done. But I'm wondering if that is normal, and if i can check which ID is used, and if it changed. Can i find that somewhere?
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
-
- Veteran
- Posts: 270
- Liked: 15 times
- Joined: Jan 03, 2012 2:02 pm
- Full Name: Tristan Floor
- Contact:
Re: VM is doing Full while increment expected
Yep,
So why is that :S, if i'm not power it off the moref id stay intact
So why is that :S, if i'm not power it off the moref id stay intact
-
- Veeam Software
- Posts: 21133
- Liked: 2140 times
- Joined: Jul 11, 2011 10:22 am
- Full Name: Alexander Fogelson
- Contact:
Re: VM is doing Full while increment expected
Perhaps some specific conditions should be considered here as I've just migrated the powered off VM and the moref ID did not change.
-
- VeeaMVP
- Posts: 6163
- Liked: 1971 times
- Joined: Jul 26, 2009 3:39 pm
- Full Name: Luca Dell'Oca
- Location: Varese, Italy
- Contact:
Re: VM is doing Full while increment expected
To be sure, we first need to know from the OP if the more was effectively changed, Tristan have you checked the logs?
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
-
- Influencer
- Posts: 11
- Liked: never
- Joined: Dec 07, 2011 4:41 pm
- Contact:
[MERGED] Can storage vmotion increase backup file?
Hello, two days ago i moved all my vm from an iSCSI SAN to another iSCSI SAN for maintenance.
I had also changed the repository of my backup: from a windows server through a NAS (CIFS repository).
I do a full on friday and incremental each week's day. last night backup job was not running, but tonight yes.
The VIB files are about 5/7GB, but the last VIB are 180GB! I see the report and in the past the "data read" is about 20GB, this night about 1014GB, like a full.... but the file is .VIB, not .VBK.
Is it normal? It is cause by storage vmotion or by changing repository's type?
Thanks
I had also changed the repository of my backup: from a windows server through a NAS (CIFS repository).
I do a full on friday and incremental each week's day. last night backup job was not running, but tonight yes.
The VIB files are about 5/7GB, but the last VIB are 180GB! I see the report and in the past the "data read" is about 20GB, this night about 1014GB, like a full.... but the file is .VIB, not .VBK.
Is it normal? It is cause by storage vmotion or by changing repository's type?
Thanks
-
- VP, Product Management
- Posts: 27343
- Liked: 2785 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: VM is doing Full while increment expected
I guess this most likely was caused by the storage vMotion (see this thread discussion for more details).
Can you please tell me how exactly have you migrated your VMs? Be aware that every VM re-registeration in the VI changes the unique VM identifier (moref-id), and if VM ID is changed, then it gets treated as a brand new VM.
Can you please tell me how exactly have you migrated your VMs? Be aware that every VM re-registeration in the VI changes the unique VM identifier (moref-id), and if VM ID is changed, then it gets treated as a brand new VM.
-
- Veteran
- Posts: 392
- Liked: 33 times
- Joined: Jul 18, 2011 9:30 am
- Full Name: Hussain Al Sayed
- Location: Bahrain
- Contact:
Re: VM is doing Full while increment expected
Hello,
if you do a Storage vMotion to a VM, make sure you go to the Veeam Backup Job where the VM that Storage vMotion-ed and you hit Re-Calculate button to get all the storage reclaimed. I have been once in this issue but after doing the recalculation to the other VMs, the CBT SOAP warning / VIB files increased go to normal state.
if you do a Storage vMotion to a VM, make sure you go to the Veeam Backup Job where the VM that Storage vMotion-ed and you hit Re-Calculate button to get all the storage reclaimed. I have been once in this issue but after doing the recalculation to the other VMs, the CBT SOAP warning / VIB files increased go to normal state.
-
- Veteran
- Posts: 392
- Liked: 33 times
- Joined: Jul 18, 2011 9:30 am
- Full Name: Hussain Al Sayed
- Location: Bahrain
- Contact:
Re: [MERGED] Can storage vmotion increase backup file?
Check this out, might help you http://www.interworks.com/blogs/ijahans ... ror-vmwarebabarc wrote:
-
- Influencer
- Posts: 11
- Liked: never
- Joined: Dec 07, 2011 4:41 pm
- Contact:
Re: VM is doing Full while increment expected
Thanks a lot! I'll try!! It seems exactly the same situation!habibalby wrote:Hello,
if you do a Storage vMotion to a VM, make sure you go to the Veeam Backup Job where the VM that Storage vMotion-ed and you hit Re-Calculate button to get all the storage reclaimed. I have been once in this issue but after doing the recalculation to the other VMs, the CBT SOAP warning / VIB files increased go to normal state.
-
- Enthusiast
- Posts: 29
- Liked: 1 time
- Joined: Jan 10, 2012 10:38 am
- Full Name: Paul Winterbourne
- Contact:
[MERGED] Help with data migration and veeam
Hi,
I am looking for some help with the best way to continue my backups with veeam after a rejig of my iscsi storage.
I currently have a starwind san with RAID10 that houses 10TB of vm's on. These vm's are backed up by veeam everynight and it all works nicely however we are running out of space on our iscsi san and I have decided to copy of the .img files from starwind to some other storage, wipe the server (build the volumes in raid 50) and reinstall windows/starwind and configure the luns again (plus copy back the img files).
I will have to reregister the vm's in my virtual center after doing this and dure to the unique id that Veeam uses I am presuming that at that point either my backup jobs will fail or they will perform a full backup of the vm's again.
What is the best method for veeam to cope with this scenario?. i did read that I could remove the vm's from the existing backup jobs and then readd them which would initiate a full read of the disk and only transfer the blocks that have changed? ios this the case?
Of course the problem is that even the reread on 10TB of data is going to take a lonnnggg time.
I do kind of wish that veeam had some sort of UID mapper/changer tool so that you can just update the UID in the veeam db and the backups can continue as normal after virtual infrastrcuture changes. Quite a few times now I have had to initiate a full backup again on my vm;s due to things like removing ESXi hosts from the cluster and then adding them back in (in order to fix an issue with vsphere HA etc).
thanks for any help much appreciated.
Paul
I am looking for some help with the best way to continue my backups with veeam after a rejig of my iscsi storage.
I currently have a starwind san with RAID10 that houses 10TB of vm's on. These vm's are backed up by veeam everynight and it all works nicely however we are running out of space on our iscsi san and I have decided to copy of the .img files from starwind to some other storage, wipe the server (build the volumes in raid 50) and reinstall windows/starwind and configure the luns again (plus copy back the img files).
I will have to reregister the vm's in my virtual center after doing this and dure to the unique id that Veeam uses I am presuming that at that point either my backup jobs will fail or they will perform a full backup of the vm's again.
What is the best method for veeam to cope with this scenario?. i did read that I could remove the vm's from the existing backup jobs and then readd them which would initiate a full read of the disk and only transfer the blocks that have changed? ios this the case?
Of course the problem is that even the reread on 10TB of data is going to take a lonnnggg time.
I do kind of wish that veeam had some sort of UID mapper/changer tool so that you can just update the UID in the veeam db and the backups can continue as normal after virtual infrastrcuture changes. Quite a few times now I have had to initiate a full backup again on my vm;s due to things like removing ESXi hosts from the cluster and then adding them back in (in order to fix an issue with vsphere HA etc).
thanks for any help much appreciated.
Paul
-
- Enthusiast
- Posts: 29
- Liked: 1 time
- Joined: Jan 10, 2012 10:38 am
- Full Name: Paul Winterbourne
- Contact:
Re: Help with data migration and veeam
I know this is probably unsupported but in theory would following this article work?
http://www.interworks.com/blogs/ijahans ... are?page=1
http://www.interworks.com/blogs/ijahans ... are?page=1
-
- VP, Product Management
- Posts: 27343
- Liked: 2785 times
- Joined: Mar 30, 2009 9:13 am
- Full Name: Vitaliy Safarov
- Contact:
Re: VM is doing Full while increment expected
You're correct in your assumption that any manual interaction with our configuration database is not supported, but if you want, you can give it a try.
Who is online
Users browsing this forum: edh and 2 guests