Comprehensive data protection for all workloads
Post Reply
aantoniani
Influencer
Posts: 11
Liked: 2 times
Joined: Jan 06, 2012 8:29 am
Full Name: Alessandro Antoniani
Contact:

Backup copy jobs and Fast Clone

Post by aantoniani »

Hi everybody,
I use Backup Copy jobs with GFS to produce long term retention of backups, and I use a single ReFS volume for both the Backup job and the Backup Copy job Repositories.

Doing it on a Backup Repository on the same ReFS volume as the source Backup Repository, I was expecting that the first run of the Backup Copy job would leverage Fast Clone of blocks from the source backup file so that the job would complete quickly and consume very little space.
That does not seem to be the case, and the actual situation is that we have kind of two different branches of block cloning, one for the regular Backup job and a different one for the Backup Copy job and used space is higher that what would actually be needed.

Has anyone suggestions on how to configure the Backup Copy job so that it does not duplicate blocks that are already present in the source Backup Repository?
Alessandro Antoniani
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Backup copy jobs and Fast Clone

Post by Shestakov »

Hi Alessandro,
Out of curiosity, what is the purpose of using same repository for backup and backup copy?
Thanks!
aantoniani
Influencer
Posts: 11
Liked: 2 times
Joined: Jan 06, 2012 8:29 am
Full Name: Alessandro Antoniani
Contact:

Re: Backup copy jobs and Fast Clone

Post by aantoniani »

Long term retention, as a safety measure against wrong modification or deletion of data that is noticed weeks after it actually happened.
Is it so uncommon?
Alessandro Antoniani
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Backup copy jobs and Fast Clone

Post by foggy » 1 person likes this post

Hi Alessandro, this doesn't work as you expect, fastclone works within a backup chain only.
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Backup copy jobs and Fast Clone

Post by Shestakov »

Foggy is correct, Fast Clone helps with increments and merges, but if you create another backup chain, the data will be copied.
As for using same repository for both backup and backup copy. It`s uncommon since the main purpose of creating a copy of backup is to secure it from data loss on primary repository. However it`s supported.
EricJ
Influencer
Posts: 20
Liked: 4 times
Joined: Jan 12, 2017 7:06 pm
Contact:

Re: Backup copy jobs and Fast Clone

Post by EricJ »

Shestakov wrote:As for using same repository for both backup and backup copy. It`s uncommon since the main purpose of creating a copy of backup is to secure it from data loss on primary repository.
This is true, except since you can't specify extended retention (weekly/monthly/quarterly/yearly) on primary backups, we have to resort to making an entirely new second copy on the same repository (very inefficient!), and then using GFS retention on that.

With storage prices dropping, I'd think more people (like myself) would want to have this ability. I mean, if the disk space is there, why wouldn't I want to retain monthly and yearly backups?
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Backup copy jobs and Fast Clone

Post by Shestakov » 1 person likes this post

Eric, initial best practice was to have 2 copies of backup: short chain on the primary repository and longer chain (with GFS or not) on the secondary repository.
However, due to big amount of requests we are considering to add the option for primary jobs as well.
Thanks
aantoniani
Influencer
Posts: 11
Liked: 2 times
Joined: Jan 06, 2012 8:29 am
Full Name: Alessandro Antoniani
Contact:

Re: Backup copy jobs and Fast Clone

Post by aantoniani »

Our situation is similar to that of Eric: we are taking backups offsite on tape, but it is very useful to have them online on disk storage, that makes it much easier and quicker to use in case of need.
So it would be nice to be able to block clone among different backup chains, as Veeam backup knows it is actually replicating existing data.
Alessandro Antoniani
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Backup copy jobs and Fast Clone

Post by Shestakov »

How often do you restore from the old backups?
Usually around 95% of restores are from last week backups, so tape looks like a good place for historical ones, GFS Media Pools are supported for that purposes.
EricJ
Influencer
Posts: 20
Liked: 4 times
Joined: Jan 12, 2017 7:06 pm
Contact:

Re: Backup copy jobs and Fast Clone

Post by EricJ »

Shestakov wrote:Eric, initial best practice was to have 2 copies of backup: short chain on the primary repository and longer chain (with GFS or not) on the secondary repository.
However, due to big amount of requests we are considering to add the option for primary jobs as well.
Thanks
That's great news - thanks!

Yes, I see where you're coming from in trying to ensure users have two separate copies of backups. And, like aantoniani, we do have a second backup location with tapes. Like you said, the majority of backups we do are from the primary repo - but we have the extra disk space, and fast cloning stores GFS copies much more efficiently, so why not make use of it? Also, our monthly and yearly backups are for long-term retention purposes, so having a second copy of those (on disk) would also offer more disaster resiliency.

In essence, the Veeam best practice would be "short chain on primary, long chain on secondary", but I think even better would be "everything on both". :D
aantoniani
Influencer
Posts: 11
Liked: 2 times
Joined: Jan 06, 2012 8:29 am
Full Name: Alessandro Antoniani
Contact:

Re: Backup copy jobs and Fast Clone

Post by aantoniani » 1 person likes this post

Shestakov wrote:How often do you restore from the old backups?
Usually around 95% of restores are from last week backups, so tape looks like a good place for historical ones, GFS Media Pools are supported for that purposes.
In our specific case, somehow often users notice something is missing or wrong weeks or months after it was actually deleted or changed. Adding fun, most of the times they do not know when it was last time that they saw it and it was correct.
So not only you have to restore terabytes of data from tapes to restore a file, but you may be doing the same over and over, going back in time to find the correct version of the file.
That makes a very good case for having historical backups online, also because they cannot wait more than a few minutes to have their file found and restored.
Alessandro Antoniani
Shestakov
Veteran
Posts: 7328
Liked: 781 times
Joined: May 21, 2014 11:03 am
Full Name: Nikita Shestakov
Location: Prague
Contact:

Re: Backup copy jobs and Fast Clone

Post by Shestakov »

Eric, I see your point and it makes sense.
By the way, fast clone works with GFS restore points as well.

Alessandro, got it. The request is taken into account.
Thanks!
mralc
Service Provider
Posts: 5
Liked: never
Joined: Oct 01, 2012 8:20 am
Full Name: Alister Christman
Contact:

Re: Backup copy jobs and Fast Clone

Post by mralc »

Shestakov wrote:Eric, I see your point and it makes sense.
By the way, fast clone works with GFS restore points as well.
Sorry to jump on this thread, just to make sure i understand how fast clone work with GFS and copy jobs, So if you have a four week retention period, every time it create the full backup file it use fast clone?
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Backup copy jobs and Fast Clone

Post by veremin »

Correct, unless you use active full method for GFS restore points. Thanks.
jayscarff
Service Provider
Posts: 114
Liked: 12 times
Joined: Nov 15, 2016 6:56 pm
Location: Cayman Islands
Contact:

Re: Backup copy jobs and Fast Clone

Post by jayscarff »

My question is how can you tell that your cloud connect jobs - pointed to reFS repo are actually doing fast clones?

Thanks
Jason
VMCE
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Backup copy jobs and Fast Clone

Post by veremin »

There must be [Fast Clone] tag in the job session. Do you see it?
Tijz
Service Provider
Posts: 34
Liked: 4 times
Joined: Jan 20, 2012 10:03 am
Full Name: Mattijs Duivenvoorden
Contact:

Re: Backup copy jobs and Fast Clone

Post by Tijz »

So fastclone is available for CSP’s offering their repositories through cloud connect?
And on the tenant side you can actually see if the csp is using it ?
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Backup copy jobs and Fast Clone

Post by veremin » 1 person likes this post

So fastclone is available for CSP’s offering their repositories through cloud connect?

Correct.
And on the tenant side you can actually see if the csp is using it ?
Correct.
jayscarff
Service Provider
Posts: 114
Liked: 12 times
Joined: Nov 15, 2016 6:56 pm
Location: Cayman Islands
Contact:

Re: Backup copy jobs and Fast Clone

Post by jayscarff »

v.Eremin wrote: Oct 08, 2018 5:39 pm There must be [Fast Clone] tag in the job session. Do you see it?
I did, thanks, i was hoping to see it from the Service provider console, but figured it out after i'd typed the question! Sorry!
Jason
VMCE
jayscarff
Service Provider
Posts: 114
Liked: 12 times
Joined: Nov 15, 2016 6:56 pm
Location: Cayman Islands
Contact:

Re: Backup copy jobs and Fast Clone

Post by jayscarff »

Silly question! I should have said can you tell from the provider side if the job is fast cloning easily?
I checked the tenant console and can see Fast Clone!
Jason
VMCE
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Backup copy jobs and Fast Clone

Post by veremin »

This information is not exposed at SP's end. So, you cannot easily get it, unless you parse repository data mover log. Thanks!
Post Reply

Who is online

Users browsing this forum: Bing [Bot], Google [Bot], Paul.Loewenkamp and 271 guests