When looking at running jobs for capacity tier offload to object storage, it shows it is processing a vbk or vib file from start to finish (progress % through the size of the file) which resets to 0% whenever the job is interrupted (e.g. by an overnight backup) - but when offloading to object storage, only changed blocks are uploaded not the entire file.
Is there a way to see true progress of the offload (% or data size of changed blocks remaining to upload)?
-
- Influencer
- Posts: 16
- Liked: 11 times
- Joined: Jul 13, 2011 10:19 am
- Full Name: Ian
- Contact:
-
- Veeam Software
- Posts: 276
- Liked: 134 times
- Joined: Jul 24, 2018 8:38 pm
- Full Name: Stephen Firmes
- Contact:
Re: Progress of offload to object storage
@Encode7, as you noted the progress bar indicates how much of the performance tier's source backup has been processed for offloading.
Are you looking for the progress bar to indicate how much data is left to be written to the capacity tier? If so, we don't currently display that information.
Are you having issues with your SOBR offload where knowing how much data remains to be written to the capacity will help troubleshoot the issues?
Are you looking for the progress bar to indicate how much data is left to be written to the capacity tier? If so, we don't currently display that information.
Are you having issues with your SOBR offload where knowing how much data remains to be written to the capacity will help troubleshoot the issues?
Steve Firmes | Senior Solutions Architect, Product Management - Alliances @ Veeam Software
-
- Influencer
- Posts: 16
- Liked: 11 times
- Joined: Jul 13, 2011 10:19 am
- Full Name: Ian
- Contact:
Re: Progress of offload to object storage
Not quite - the progress bar does not indicate how much has been processed unless the offload job starts and completes before the next scheduled backup, as it can process up to say 40%, and then be stopped by an overnight backup job, and then the process for the file will start again at 0% rather than 40%, but still be uploading changed data blocks from the 0% point.
@iannoble
-
- Enthusiast
- Posts: 57
- Liked: 3 times
- Joined: Aug 07, 2015 8:45 pm
- Full Name: David Engler
- Contact:
Re: Progress of offload to object storage
I have a question about understanding how much data still needs to be offloaded. We recently switched to an on premise S3 appliance and I would like to get a better picture of the overall progress and when it might get caught up.
According to the S3 appliance Veeam has written over 600TB in the past 7 days. The sealed AWS bucket is just under 800TB. Veeam shows just over 100TB from the SOBR view. I assume the two systems will be closer once Veeam gets fully caught up. I have 20 offloads running with most at 99%.
The number of objects per offload seems to be a moving target. The first job that started last week showed 115 of 1244 objects 47 minutes after it started but 18hrs into that job it was 4202 of 4202 at 46%. The job now shows 4282 of 4292 at 99% and each time an object completes the count goes up.
Most of the active jobs are doing the same thing, they are at 99% and the object count keeps increasing.
is there somewhere I can look to determine either in objects or space how much is left?
We do have VeeamONE.
Dave
According to the S3 appliance Veeam has written over 600TB in the past 7 days. The sealed AWS bucket is just under 800TB. Veeam shows just over 100TB from the SOBR view. I assume the two systems will be closer once Veeam gets fully caught up. I have 20 offloads running with most at 99%.
The number of objects per offload seems to be a moving target. The first job that started last week showed 115 of 1244 objects 47 minutes after it started but 18hrs into that job it was 4202 of 4202 at 46%. The job now shows 4282 of 4292 at 99% and each time an object completes the count goes up.
Most of the active jobs are doing the same thing, they are at 99% and the object count keeps increasing.
is there somewhere I can look to determine either in objects or space how much is left?
We do have VeeamONE.
Dave
-
- Veeam Software
- Posts: 16
- Liked: 6 times
- Joined: Oct 18, 2019 8:55 pm
- Full Name: Ivan
- Contact:
Re: Progress of offload to object storage
New tasks can be added to existing offload sessions, which are generated upon the completion of a backup job for a SOBR with copy mode.
This indeed can make the number of objects to be offloaded in a particular session somewhat undefined. However, with copy mode enabled, all new storages, in any case, must be copied to the capacity tier, so the total number of storages being copied remains unchanged and depends on the number of storages created by backup jobs for that SOBR.
If sessions are unable to complete over an extended period, it might be due to a lack of resources to support the required offload perfomance to the capacity tier, but without log analysis, it's very hard to assert anything.
This indeed can make the number of objects to be offloaded in a particular session somewhat undefined. However, with copy mode enabled, all new storages, in any case, must be copied to the capacity tier, so the total number of storages being copied remains unchanged and depends on the number of storages created by backup jobs for that SOBR.
If sessions are unable to complete over an extended period, it might be due to a lack of resources to support the required offload perfomance to the capacity tier, but without log analysis, it's very hard to assert anything.
Who is online
Users browsing this forum: No registered users and 15 guests