Comprehensive data protection for all workloads
Post Reply
johnlockie
Enthusiast
Posts: 53
Liked: 3 times
Joined: Apr 06, 2012 5:46 pm
Contact:

Feature Request | Test Mode for Backup Jobs

Post by johnlockie »

I think it would be really cool if we can run a backup job in "test" mode.

This would do all the tasks that a normal backup would do, except not process the VM entirely. Maybe only up to 1% and then finish....or not at all. A simple, "yep everything looks good assuming we are able to process the VM".

The reason I ask is that for teir 1 applications I cannot run backups during certain hours (the hours I am at work). Our bottleneck is usually "source" (the VM being backed up). So when a job runs users can be impacted, especially teir 1 apps. And when we are trying to troubleshoot failed backups it could take days before we get it solved (not good). I cannot actually verify the job works until it runs at the appropriate scheduled time.

For example, I am getting "object not found" - a very simple error that I am sure might be fixed now. The "processing" is not failing, but the actual prep work for processing the job is failing. There's no way to test this....without actually running the job.
foggy
Veeam Software
Posts: 21071
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by foggy »

johnlockie wrote:This would do all the tasks that a normal backup would do, except not process the VM entirely. Maybe only up to 1% and then finish....or not at all. A simple, "yep everything looks good assuming we are able to process the VM".
This would be similar to starting the job and stopping it manually immediately, no?
dellock6
VeeaMVP
Posts: 6139
Liked: 1932 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by dellock6 »

I'm also thinking about the fact that some activities of the backup are out of control of Veeam and delegated to vCenter/ESXi, like snapshots management, so there is no complete way of testing a backup without effectively doing it. A "dry-run" in this situation sounds hard to me.

Luca.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
johnlockie
Enthusiast
Posts: 53
Liked: 3 times
Joined: Apr 06, 2012 5:46 pm
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by johnlockie »

foggy wrote: This would be similar to starting the job and stopping it manually immediately, no?
Exactly. Except maybe not putting the job in a FAILED state(?). Because every time you cancel a job, it shows up as failed. Basically leave the job state alone (actually, I don't think I have tried this on 6.1 so maybe you guys changed this). I am also not comfortable enough with stopping a job to trust it won't have a negative impact on the backup files, corruption etc. I have seen these take a long time to cancel, and even a few times had to reboot the Veeam servers to get it to stop. Many times snapshots are left behind too, and that requires manual cleanup of the virtual infrastructure :(

Also @dellock6 these are the exact things I want tested. All of the processes surrounding the actual backup which include creating and mounting the snapshot, permissions to the VM, ability to delete the snapshot, and storage repository requirements, etc. All of this takes <5 minutes and has very little impact on the environment....yet would be a great tool to managing the backups and troubleshooting errors.

Cause when a job fails, and after reviewing logs and making changes, I have no way to really verify it's fixed without running a live backup. Specifically with errors like "object not found", I would like a way to do the dry run.

I am an infrastructure guy, not a programmer....but it seems to me this shouldn't be too difficult to add down the road, and it would only differentiate Veeam further from the competition. :) Not a deal breaker though, just a suggestion/request from a user.
Gostev
Chief Product Officer
Posts: 31559
Liked: 6722 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by Gostev »

This sounds good, thanks for a great suggestion.
rct
Enthusiast
Posts: 35
Liked: 1 time
Joined: Sep 29, 2011 6:07 pm
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by rct »

Launching a job and stopping it manually will only tests vm backup/replica until the manual stop.
A dry run will test them all.
Example : after a vSphere migration some hosts uuid have been changed (?!?) so some vm were backuped successfully and other not.

It will be a good feature !!!
Gostev
Chief Product Officer
Posts: 31559
Liked: 6722 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by Gostev »

One of our QC folks suggests that you create a job with all disks excluded from processing to achieve what you want. Pretty genius I think, thanks for the idea Nikita!
Jamie Pert
Enthusiast
Posts: 68
Liked: 2 times
Joined: Jun 14, 2012 10:56 am
Full Name: Jamie Pert
Location: twitter.com/jam1epert
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by Jamie Pert »

Gostev - will that mean that snapshotting, proxy connectivity and repository connectivity etc are still all tested? If so, that's a genius solution.

I could create a test run for each of the jobs in my Veeam server and run them before a bvackup job and stitch it with a proper job with the new "run after" feature in 6.5.... it's excessive, but could come in handy in some scenarios...

so then when it comes to checking backups in the morning I can see that prior to the backup job the proxy, snapshotting, and repository were all fine
@jam1epert on Twitter
brupnick
Expert
Posts: 196
Liked: 13 times
Joined: Feb 05, 2011 5:09 pm
Full Name: Brian Rupnick
Location: New York, USA
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by brupnick »

I have used this method to test my backup configurations in my development environment and it works very well for what you are looking to do. I will say that it does actually back up the configuration files (.vmx, .vmxf, and .nvram), so it will add a restore point to a job. If you can, it would probably be best to create a true test job (rather than temporarily modifying a production job) when doing this.
Vitaliy S.
VP, Product Management
Posts: 27120
Liked: 2720 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by Vitaliy S. »

Jamie Pert wrote:Gostev - will that mean that snapshotting, proxy connectivity and repository connectivity etc are still all tested?
That's correct - excluding disks doesn't affect VM snapshot creation operation, as snapshot is always created for the whole VM (for all VM disks).
rct
Enthusiast
Posts: 35
Liked: 1 time
Joined: Sep 29, 2011 6:07 pm
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by rct »

It would be better if it was a feature but if we can do that way it's a good news!

Thank you.
damocue
Veeam ProPartner
Posts: 45
Liked: never
Joined: Feb 16, 2011 9:10 am
Full Name: David Molina
Location: Valencia, Spain
Contact:

[MERGED] Feature Request: test/preview at jobs

Post by damocue »

Hello,

After some time using and upgrading Veeam Backup, I miss a test or preview for jobs. Each time after doing a change on backup infrastructure, I'd like to do a test execution and not a execution. With this option, I think over 70% of first failures will be resolved without getting failed backups. Has anyone missed to have this possibility too?

Regards,
dellock6
VeeaMVP
Posts: 6139
Liked: 1932 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Feature Request: test/preview at jobs

Post by dellock6 »

How can you test a snapshot of a VM without doing it? I have no idea if it ca be simulated...

Luca.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
ZachW
Enthusiast
Posts: 68
Liked: 10 times
Joined: Aug 02, 2011 6:09 pm
Full Name: Zach Weed
Contact:

Re: Feature Request: test/preview at jobs

Post by ZachW »

To add in.. There are definitely things that we could "test" successfully in a pre-flight check but it is very unlikely that we would have the availability to completely test all components to check for a failure without actually attempting to perform these actions.
damocue
Veeam ProPartner
Posts: 45
Liked: never
Joined: Feb 16, 2011 9:10 am
Full Name: David Molina
Location: Valencia, Spain
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by damocue »

I was looking for this topic!
As told before, I think there are things that could be tested without doing a snapshot to VM:
  • VM found on virtual platform.
  • Host found on virtual platform.
  • VSS testing.
  • Successful backup mapping.
  • CBT warning (I'm not really sure about this possibility).
  • Time estimation for a backup job. This could be done testing network connectivity, estimation of data readed at VM, etc.
Regards,
gsroute
Novice
Posts: 6
Liked: 1 time
Joined: Dec 05, 2012 12:01 pm
Full Name: Graeme Snee
Contact:

[MERGED] Request for feature - Dry Run / Test mode

Post by gsroute » 1 person likes this post

Recently I put this on twitter

@Veeam I had an idea for you that I wish I had, can we have a "Dry Run" option for backups, i.e. test the process without moving any data?

It got a couple of responses:

by @Veeam: Surebackup?^RV

Should clarify, Surebackup would do a dry run of sorts of the recovery.^RV

by @ChrisDearden: don't forget v8 will also have the ability to do a dry run on the application processing side too.

by @Veeam: It's an interesting thought but many problems are with the target storage. Would still require snapshotting the VMs ^DH

good topic for our forums though... ^DH

So here it is.

Basically, what I was thinking is a way to run a backup that wouldn't really move data or interfere with data already there, such as restore points. Basically a test mode that runs through everything but doesn't upset live backups. Would this be a good idea or would anyone else use it to make it worthwhile?
dellock6
VeeaMVP
Posts: 6139
Liked: 1932 times
Joined: Jul 26, 2009 3:39 pm
Full Name: Luca Dell'Oca
Location: Varese, Italy
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by dellock6 »

The trick of excluding every disk can be effective, as long as you have a fixed selection of VMs and not a dynamic component like a datastore or a resource pool.
But in any case, snapshots of the VM will be created, so you will interfere with production.
with V8 you can now check all the used credentials, and this one was one of the biggest need when people asked for a dry run.

If instead is all about estimating size and performances, size can be estimated using Veeam One reports: total size of VMs for the full and daily change for the increments. Then, applying a conservative 50% reduction, you have an esstimate of the final backup file sizes.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software

@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
gsroute
Novice
Posts: 6
Liked: 1 time
Joined: Dec 05, 2012 12:01 pm
Full Name: Graeme Snee
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by gsroute »

Thanks Luca,

The introduction of credential check will be a big plus, I have seen that as a necessity, similar to Backup exec. but what I am trying to describe is to be able to run a job in test that will check that all elements will actually work, but doesn't involve upsetting the restore points, or copying data over and having to wait etc.

The idea came up when I was troubleshooting a job when one VM started to fail, but I had to create a new job and cancel it when data started moving, this was my only way to test if things were working again. without loosing any restore points from all other VMs.

Thanks.
justind
Enthusiast
Posts: 32
Liked: 4 times
Joined: Nov 09, 2014 4:20 am
Location: Australia
Contact:

Re: Feature Request | Test Mode for Backup Jobs

Post by justind » 2 people like this post

You should check out the new Quick Backup feature in v8. This allows you to re-run a single VM backup within a job and not mess with all the others VMs restore points and CBT etc.

It still moves data but it's pretty handy.
Post Reply

Who is online

Users browsing this forum: fbs@jma.dk and 137 guests