Discussions related to using object storage as a backup target.
Post Reply
Encode7
Influencer
Posts: 16
Liked: 11 times
Joined: Jul 13, 2011 10:19 am
Full Name: Ian
Contact:

Progress of offload to object storage

Post by Encode7 »

When looking at running jobs for capacity tier offload to object storage, it shows it is processing a vbk or vib file from start to finish (progress % through the size of the file) which resets to 0% whenever the job is interrupted (e.g. by an overnight backup) - but when offloading to object storage, only changed blocks are uploaded not the entire file.

Is there a way to see true progress of the offload (% or data size of changed blocks remaining to upload)?
sfirmes
Veeam Software
Posts: 276
Liked: 134 times
Joined: Jul 24, 2018 8:38 pm
Full Name: Stephen Firmes
Contact:

Re: Progress of offload to object storage

Post by sfirmes »

@Encode7, as you noted the progress bar indicates how much of the performance tier's source backup has been processed for offloading.

Are you looking for the progress bar to indicate how much data is left to be written to the capacity tier? If so, we don't currently display that information.

Are you having issues with your SOBR offload where knowing how much data remains to be written to the capacity will help troubleshoot the issues?
Steve Firmes | Senior Solutions Architect, Product Management - Alliances @ Veeam Software
Encode7
Influencer
Posts: 16
Liked: 11 times
Joined: Jul 13, 2011 10:19 am
Full Name: Ian
Contact:

Re: Progress of offload to object storage

Post by Encode7 »

Not quite - the progress bar does not indicate how much has been processed unless the offload job starts and completes before the next scheduled backup, as it can process up to say 40%, and then be stopped by an overnight backup job, and then the process for the file will start again at 0% rather than 40%, but still be uploading changed data blocks from the 0% point.
@iannoble
efd121
Enthusiast
Posts: 57
Liked: 3 times
Joined: Aug 07, 2015 8:45 pm
Full Name: David Engler
Contact:

Re: Progress of offload to object storage

Post by efd121 »

I have a question about understanding how much data still needs to be offloaded. We recently switched to an on premise S3 appliance and I would like to get a better picture of the overall progress and when it might get caught up.
According to the S3 appliance Veeam has written over 600TB in the past 7 days. The sealed AWS bucket is just under 800TB. Veeam shows just over 100TB from the SOBR view. I assume the two systems will be closer once Veeam gets fully caught up. I have 20 offloads running with most at 99%.
The number of objects per offload seems to be a moving target. The first job that started last week showed 115 of 1244 objects 47 minutes after it started but 18hrs into that job it was 4202 of 4202 at 46%. The job now shows 4282 of 4292 at 99% and each time an object completes the count goes up.
Most of the active jobs are doing the same thing, they are at 99% and the object count keeps increasing.
is there somewhere I can look to determine either in objects or space how much is left?
We do have VeeamONE.
Dave
Ivan239
Veeam Software
Posts: 16
Liked: 6 times
Joined: Oct 18, 2019 8:55 pm
Full Name: Ivan
Contact:

Re: Progress of offload to object storage

Post by Ivan239 »

New tasks can be added to existing offload sessions, which are generated upon the completion of a backup job for a SOBR with copy mode.
This indeed can make the number of objects to be offloaded in a particular session somewhat undefined. However, with copy mode enabled, all new storages, in any case, must be copied to the capacity tier, so the total number of storages being copied remains unchanged and depends on the number of storages created by backup jobs for that SOBR.
If sessions are unable to complete over an extended period, it might be due to a lack of resources to support the required offload perfomance to the capacity tier, but without log analysis, it's very hard to assert anything.
Post Reply

Who is online

Users browsing this forum: No registered users and 15 guests