Backup Copy Job 60 Hour merge HELP

Availability for the Always-On Enterprise

Backup Copy Job 60 Hour merge HELP

Veeam Logoby Kellen.Flood » Sat Aug 13, 2016 12:58 am

Hey All,

I am currently backing up from my repository to AWS S3 via the gateway caching mechanism, but it is currently taking over 60 hours when merging the restore point (creating GFS restore point in s3.

Merging oldest restore point into full backup file (18% done) 59:16:48
Required backup infrastructure resources have been assigned
Creating Synthetic full restore point 7/27/2016 59:15:42

Any advice on why this is taking so long?

We will be opening the support case shortly
Kellen.Flood
Enthusiast
 
Posts: 41
Liked: 3 times
Joined: Fri Apr 19, 2013 8:30 pm
Full Name: Kellen Flood

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby tsightler » Sat Aug 13, 2016 3:23 pm 5 people like this post

Probably because it is having to pull all of the data back from S3 to write to the new full backup. This will be a very slow process, and likely costly as well. Since you say you are doing GFS, I assume that means you are running backup copy jobs to the S3 gateway. If so, you should probably choose the option to read entire restore point from source backup instead of trying to synthesize it. This will copy the new full from the source backup repository, which I assume is on local disk rather than than the S3. This will be much faster than trying to synthesize a backup with data that has to pull blocks back down from S3.
tsightler
Veeam Software
 
Posts: 4768
Liked: 1737 times
Joined: Fri Jun 05, 2009 12:57 pm
Full Name: Tom Sightler

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby Gostev » Sun Aug 14, 2016 7:17 pm 2 people like this post

Yes, what Tom recommends would help big times in this case for sure - but be prepared that either way, we are talking here about periodic fulls that would have to be uploaded to Amazon - and this may take significant time regardless. Should be fine for small backups of course, but is problematic for bigger data sets.

Efficient forever-incremental backup to the cloud was actually the reason why we introduced Veeam Cloud Connect and discontinued our "Cloud Edition", which did support Amazon as a target.
Gostev
Veeam Software
 
Posts: 21390
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby ckent » Mon Aug 15, 2016 6:14 am

i had a very similar issue using cloud connect.
what no one is doing is offering a solution.

How does the OP get all his backup into the cloud without having to perform what is effective a full seed every week ?
ckent
Enthusiast
 
Posts: 43
Liked: never
Joined: Thu Sep 03, 2015 8:00 am

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby Gostev » Mon Aug 15, 2016 11:04 am

With Cloud Connect, GFS fulls are synthesized in the cloud - tenant's components are not involved, so there's no traffic at all.
Gostev
Veeam Software
 
Posts: 21390
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby drichman » Mon Aug 15, 2016 9:17 pm

Gostev wrote:With Cloud Connect, GFS fulls are synthesized in the cloud - tenant's components are not involved, so there's no traffic at all.

I am using Cloud Connect, but still have VERY long times to complete the cloud based sync. When creating a restore point in Azure, it can take 18+ hours to complete the process with an 8-10Tb source disk. I assume this is due to the size of the disk, number of files and available resources in Azure. I have been working with Veeam staff to speed things up, but we have not found a solution yet (other than shrinking the size of the backup data, which we are working on).

Let me know if anyone has an easier option.
drichman
Novice
 
Posts: 3
Liked: never
Joined: Mon Jan 24, 2011 5:22 pm
Full Name: Dean Richman

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby Gostev » Tue Aug 16, 2016 12:23 am

Well, ultimately it comes down to backup storage performance of course, and probably your Azure VM size does not have too many IOPS included.

While we can't really accelerate your backup storage of choice, we will have one new feature in 9.5 that will make synthetic fulls work extremely fast while requiring little to no IOPS from backup storage. It's really game changing - stay tuned for more info soon!
Gostev
Veeam Software
 
Posts: 21390
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby dellock6 » Tue Aug 16, 2016 7:33 am

(such a teaser.... :D)
Luca Dell'Oca
EMEA Cloud Architect @ Veeam Software

@dellock6
http://www.virtualtothecore.com
vExpert 2011-2012-2013-2014-2015-2016
Veeam VMCE #1
dellock6
Veeam Software
 
Posts: 5047
Liked: 1330 times
Joined: Sun Jul 26, 2009 3:39 pm
Location: Varese, Italy
Full Name: Luca Dell'Oca

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby drichman » Wed Sep 07, 2016 10:42 pm

Gostev wrote:Well, ultimately it comes down to backup storage performance of course, and probably your Azure VM size does not have too many IOPS included.

While we can't really accelerate your backup storage of choice, we will have one new feature in 9.5 that will make synthetic fulls work extremely fast while requiring little to no IOPS from backup storage. It's really game changing - stay tuned for more info soon!

We are about to ditch our Azure/CloudConnect environment for the same reason. When can we expect this revolutionary release? Also, will there be anything to address Veeam not being able to natively access Azure cold blob storage?
drichman
Novice
 
Posts: 3
Liked: never
Joined: Mon Jan 24, 2011 5:22 pm
Full Name: Dean Richman

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby Gostev » Wed Sep 07, 2016 11:43 pm

We are planning to release the new version in October.
Gostev
Veeam Software
 
Posts: 21390
Liked: 2349 times
Joined: Sun Jan 01, 2006 1:01 am
Location: Baar, Switzerland

Re: Backup Copy Job 60 Hour merge HELP

Veeam Logoby Kellen.Flood » Mon Sep 12, 2016 5:01 am

Thanks sightler. That worked for us
Kellen.Flood
Enthusiast
 
Posts: 41
Liked: 3 times
Joined: Fri Apr 19, 2013 8:30 pm
Full Name: Kellen Flood


Return to Veeam Backup & Replication



Who is online

Users browsing this forum: Bing [Bot] and 45 guests