Backup Based Replication overlapping

VMware specific discussions

Backup Based Replication overlapping

Veeam Logoby B.F. » Mon Oct 03, 2016 2:03 pm

We have a very large file server that can take a long time to replicate to our DR. I've been experimenting with backing up the VM to a local disk and then have a replication job run after the backup is completed. So far this has been working very well having the backup job run every 6 hours. In most cases, the jobs do not take very long with this setup.

The file server does have deduplication enabled and once a month, does a thorough Garbage Collection and Scrub as part of the deduplication process. The problem with this is it does cause a lot of data churning on the system which in turn makes for a larger than average backup and replica to transmit. This caused the replication to take longer than normal. The backup started, finished, and then kicked another replication job while the last one was still running.

What happened was the latest replication stopped the running job. From the looks of it, the DR snapshot never got merged and another snapshot was then added to the chain. The 2nd replica didn't have enough time to finish and got killed by yet another replication job. Another unmerged snapshot was then added to the mix. What finally happened was that the DR disk got full of snapshots and it wasn't able to do anything at all after the disk space was all used up.

Is it possible to add some sort of overlap management in case of something like this happens? For example, have an option that sees that the job is already running and not run until after it is completed? Or perhaps if it is running, skip until the job is idle?

Thanks
B.F.
Expert
 
Posts: 107
Liked: 6 times
Joined: Tue Jan 28, 2014 5:41 pm

Re: Backup Based Replication overlapping

Veeam Logoby foggy » Mon Oct 03, 2016 4:30 pm

B.F. wrote:The backup started, finished, and then kicked another replication job while the last one was still running.

Mmm.. are you saying that replication job starts even if its previous cycle has not completed yet? This definitely shouldn't occur. Basically, when backup job starts, it should terminate replication in case it is still underway.
foggy
Veeam Software
 
Posts: 14728
Liked: 1076 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Backup Based Replication overlapping

Veeam Logoby B.F. » Mon Oct 03, 2016 4:34 pm

Sorry, might not have been very clear. The 2nd replication job does stop the replication job that is running before it starts. However, I don't believe that it gives it time to cleanup snapshots which then fills up the target site.

Thanks
B.F.
Expert
 
Posts: 107
Liked: 6 times
Joined: Tue Jan 28, 2014 5:41 pm

Re: Backup Based Replication overlapping

Veeam Logoby foggy » Mon Oct 03, 2016 4:47 pm

Actually it is backup job that should stop replication. Btw, what kind of snapshots are those? Do you mean "Veeam Replica Working snapshots" are not removed?
foggy
Veeam Software
 
Posts: 14728
Liked: 1076 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Backup Based Replication overlapping

Veeam Logoby B.F. » Mon Oct 03, 2016 6:22 pm

I believe that was what there were. I had to delete all remnents of that VM at the DR site and start over since all of the disk space was being consumed. So I can't verify :(

Thanks
B.F.
Expert
 
Posts: 107
Liked: 6 times
Joined: Tue Jan 28, 2014 5:41 pm

Re: Backup Based Replication overlapping

Veeam Logoby foggy » Tue Oct 04, 2016 10:26 am

If you see similar behavior again, please contact technical support for a closer look. This doesn't look expected.
foggy
Veeam Software
 
Posts: 14728
Liked: 1076 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson


Return to VMware vSphere



Who is online

Users browsing this forum: Google [Bot] and 16 guests