Does restore point count slow down replication jobs?

VMware specific discussions

Does restore point count slow down replication jobs?

Veeam Logoby jbarrow.viracoribt » Thu Sep 03, 2015 3:21 pm

We've been asked to investigate why our replication jobs take so long to process.

After chatting with support, it seems that a great deal of time is spent removing restore points.

Here is an example:
Image

The above job took 36:43 to run in total but a great deal of time looks spent just doing retention work. Right now we're configured to keep 12 restore points for our replicas.

So I'm wondering, does the amount of replica restore points have a direct effect on the time it takes for these jobs to complete? For instance, I was to reduce this job down to say 1, just keeping the DR site as current as possible, would future runs of this job and the time it takes to apply the retention policy on the DR site go down by a large amount or is it mostly storage related so it would stay the same?

Case: 01002324
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Does restore point count slow down replication jobs?

Veeam Logoby jbarrow.viracoribt » Thu Sep 03, 2015 3:27 pm

Also, what determines how many of the "applying retention policy" tasks can be going at once? They don't seem to go through one-by-one and they don't seem to have a direct match up to proxy slots.

Image
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Does restore point count slow down replication jobs?

Veeam Logoby jbarrow.viracoribt » Thu Sep 03, 2015 3:46 pm

But if I'm keeping 12, and the one it's removing is the oldest one in the chain, you're telling me that doesn't take any longer for VMware to handle/process vs if there was only one in the chain?

For instance, if the below VM was just replicated, and it went to remove a restore point, it would be removing the oldest one (8-31-2015 1:16:18PM), at the top of the list keeping all of the other ones. Having all these additional snapshots existing does not effect the speed of that removal at all?

Image
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Does restore point count slow down replication jobs?

Veeam Logoby PTide » Thu Sep 03, 2015 4:25 pm 1 person likes this post

I had double-checked something and had to delete my previous post not to confuse other people who might find this thread in future.

So, my first thought was that deep snapshot tree should not cause significant delays as there is always the only snapshot to be deleted and another one to be relinked. However, on practice it takes longer for VMware to prune snapshots that fall under retention if the tree is deep. Sorry for misguidance.

"what determines how many of the "applying retention policy" tasks can be going at once
If VMs are replicated to a standalone ESXi host then only two of them can be processed simultaneously. If VMs are replicated to cluster then only four can be processed simultaneously, no matter how many hosts are in the cluster.

Thank you.
PTide
Veeam Software
 
Posts: 3022
Liked: 246 times
Joined: Tue May 19, 2015 1:46 pm

Re: Does restore point count slow down replication jobs?

Veeam Logoby Vitaliy S. » Wed Sep 09, 2015 2:19 pm

On a side note, can you take a look at datastore performance when snapshot is being committed (restore point gets removed)? Do you see any high latency, IOPs rate?

P.S. This can be checked with a free version of Veeam ONE.
Vitaliy S.
Veeam Software
 
Posts: 19566
Liked: 1104 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov

Re: Does restore point count slow down replication jobs?

Veeam Logoby jbarrow.viracoribt » Wed Sep 09, 2015 8:37 pm 2 people like this post

Changing from the 12 replication restore points down to 2 seems to have made a pretty big difference in our job completion times. We shaved about 15 minutes (or so) on average off of this one jobs run time by making this change.

Image

Before:
Image

After:
Image
jbarrow.viracoribt
Expert
 
Posts: 184
Liked: 18 times
Joined: Fri Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow

Re: Does restore point count slow down replication jobs?

Veeam Logoby PTide » Thu Sep 10, 2015 10:20 am 1 person likes this post

Thanks for sharing Jonathan, very good illustration!
PTide
Veeam Software
 
Posts: 3022
Liked: 246 times
Joined: Tue May 19, 2015 1:46 pm

Re: Does restore point count slow down replication jobs?

Veeam Logoby Vitaliy S. » Thu Sep 10, 2015 11:02 am 1 person likes this post

Veeam ONE backup report spotted! :)
Vitaliy S.
Veeam Software
 
Posts: 19566
Liked: 1104 times
Joined: Mon Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov


Return to VMware vSphere



Who is online

Users browsing this forum: No registered users and 27 guests