Rotated hard drives support in v8

Availability for the Always-On Enterprise

Re: Rotated hard drives support in v8

Veeam Logoby foggy » Fri May 29, 2015 5:43 pm

Switching the disks itself does not trigger the new copy interval so you either need to right-click the job and select Sync Now manually or schedule the job the way so that the new interval starts after the moment you typically switch disks.
foggy
Veeam Software
 
Posts: 14560
Liked: 1060 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Rotated hard drives support in v8

Veeam Logoby larry » Fri May 29, 2015 7:13 pm

I changed the drive and it just says "waiting new restore points" but there are none on the disk now. I tried switch to hourly from daily but always continuous but sync now just says start new, click yes, stopping, Idle, Waiting backup Repository , rotated Drive letter not change, New Copy interval started Building VM list, Waiting for new restore point points. I go to the disk there is only 93 meg in the folder, the vm's are 800 gig. waits for new restore point until the backup job runs.


I did find if I change the job setting to copy from copy every 1 day to 1 hour save, back to 1 day save I get a yellow warning job canceled by user then job restarts and syncs now. Tried on each jobs and works each time, 4 for 4.
larry
Expert
 
Posts: 371
Liked: 88 times
Joined: Wed Mar 24, 2010 5:47 pm
Full Name: Larry Walker

Re: Rotated hard drives support in v8

Veeam Logoby larry » Mon Jun 01, 2015 3:23 pm

larry wrote:I changed the drive and it just says "waiting new restore points" but there are none on the disk now. I tried switch to hourly from daily but always continuous but sync now just says start new, click yes, stopping, Idle, Waiting backup Repository , rotated Drive letter not change, New Copy interval started Building VM list, Waiting for new restore point points. I go to the disk there is only 93 meg in the folder, the vm's are 800 gig. waits for new restore point until the backup job runs.


I did find if I change the job setting to copy from copy every 1 day to 1 hour save, back to 1 day save I get a yellow warning job canceled by user then job restarts and syncs now. Tried on each jobs and works each time, 4 for 4.


skip this post..or delete, the weird results was from having a copy mounted on a different drive letter which would not be normal. Doing a sync now with Sync-VBRBackupCopyJob works as expected if I dismount the extra copy.
larry
Expert
 
Posts: 371
Liked: 88 times
Joined: Wed Mar 24, 2010 5:47 pm
Full Name: Larry Walker

Re: Rotated hard drives support in v8

Veeam Logoby bernardw » Mon Jul 06, 2015 6:52 pm

Larry,

So you are able to get Veeam to start syncing the backups to your drives in the mornings even when your backups happen in the evening? I would really like the same thing to happen but I have not figured out how to do it from the GUI. I do not get the data to sync even after right clicking on the job and selecting "Sync Now". How did you achieve getting the system to start copying data?



Also for the people that have been working on figuring out how to make Veeam have 1 full backup on the drives even though they are rotated every day I am experimenting with a backup interval of 4 hours. This causes Veeam to copy all the data over and then merge the data. (seeing how we can't setup a repository with only 1 backup). I am having to "force" the merge because my backups are 4 TB and the drives are 6 TB and a single full backup of everything takes 16-18 hours to complete. As Foggy or Gustov mentioned earlier, depending on how the incremental backups are "seen" they can be larger then normal - I have had 1.4 TB incrementals, however I have had fewer issues with these "large" incremental backups when I have a complete full VBK file on the drive.

My biggest frustration with the rotated drives have been:
1) forcing Veeam to have a single good VBK file on the drive
2) to start backing up as soon as a "new" drive is inserted (which Veeam obviously detects since it reports the content has changed).
bernardw
Influencer
 
Posts: 22
Liked: 4 times
Joined: Wed Feb 20, 2013 6:21 pm

Re: Rotated hard drives support in v8

Veeam Logoby larry » Mon Jul 06, 2015 7:39 pm

I created a backup job that backs up a 2 meg vm host at 11am ( just to use the gui) . When job finishes a ps1 script starts the backupcopy job with yesterdays data with time if day restrictions which will stop the job if still running when the nightly job runs. then at night the real job kicks off which is only changes for the day .



Code: Select all
asnp VeeamPSSnapin

$CopyJob = Get-VBRJob -Name "USB-Groton-A-C"
Enable-VBRJob -Job $CopyJob
Sync-VBRBackupCopyJob -Job $CopyJob


If the main ps1 I check for errors and disable jobs if needed.

Code: Select all
$CopyJob = Get-VBRJob -Name "USB-Groton-A-C"
Disable-VBRJob -Job $CopyJob

I found if I disable the jobs and the main job is still running or other errors I have time to fix before everything is automatic.
On error I send an email
larry
Expert
 
Posts: 371
Liked: 88 times
Joined: Wed Mar 24, 2010 5:47 pm
Full Name: Larry Walker

Re: Rotated hard drives support in v8

Veeam Logoby souperstar » Fri Jul 17, 2015 3:01 am

I have to say, I find the Backup Copy Job scheduling confusing. I'm not sure when to schedule it?

I have normal backups writing to a physical Veeam server, with a local repository comprised of DAS. There are multiple COTS disks attached via SAS appliance that I then use a Backup Copy Job to write to. These COTS disks are rotated daily, the five working days of the week. Backups and Backup copies are scheduled during the evening of the five working days of the week.

Breaks down like this:
  • Disks get loaded into the SAS appliance in the morning sometime (no set schedule, but they usually do it before 10AM)
  • Backups kick off about 5:15 PM. Secondary destinations are configured to also write to the COTS disks
  • Currently the Backup Copy Jobs are scheduled to sync daily at 10PM, however I can see a job running right now that in a few minutes is going to "fail" because it isn't finished yet. It's busy "Merging oldest incremental backup into full backup." I only really need the one restore point on the rotated disks, so I don't think I care about this, and it's also taking foreverrrr.

I've tried 4AM, I've tried 4PM... They generate errors because they try to sync and don't have enough time before they're either removed or the Backup Jobs start. I just don't know what "time" to schedule the Copy Job in my case. In fact, I don't really care to schedule the darn thing at all. I just want it to start copying AS SOON AS the Backup Job is done. That one time, one backup on those disks is all I need.

Is this possible, or need to be a feature request, or is there something I'm missing about how to schedule the Backup Copy Jobs?

I don't want to resort to scripting because that'll take me forever and a day to write, but I can if I have to. I tried something similar in V7 and I couldn't pull it off, where I was disabling the Copy jobs until the Backup job was successful and then I would enable the Copy job, and post-script the Copy job to disable itself on success. It just didn't work the way I'd hoped.
souperstar
Enthusiast
 
Posts: 33
Liked: 4 times
Joined: Fri Dec 30, 2011 10:26 pm
Full Name: Chris

Re: Rotated hard drives support in v8

Veeam Logoby foggy » Wed Jul 22, 2015 4:12 pm 1 person likes this post

souperstar wrote:I just don't know what "time" to schedule the Copy Job in my case. In fact, I don't really care to schedule the darn thing at all. I just want it to start copying AS SOON AS the Backup Job is done. That one time, one backup on those disks is all I need.

Just set the copy interval start time to somewhat several minutes after the source backup starts. Backup copy will start new interval and wait until new restore point is available. Enable forward lookup for the backup copy job to avoid copy of previous points, that are already on disk at the time of backup copy job creation.
foggy
Veeam Software
 
Posts: 14560
Liked: 1060 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Rotated hard drives support in v8

Veeam Logoby souperstar » Wed Jul 22, 2015 4:22 pm

This is exactly what I was looking for, and thank you very much foggy. I did both, and look forward to tomorrow's Enterprise Manager report!
souperstar
Enthusiast
 
Posts: 33
Liked: 4 times
Joined: Fri Dec 30, 2011 10:26 pm
Full Name: Chris

Re: Veeam Backup & Removable Media (rotated drives)

Veeam Logoby Stonki » Wed Jul 22, 2015 4:53 pm

Gostev wrote:As of B&R 8.0, rotated drives functionality can now be enabled with a check box in the advanced backup repository settings, as opposed to being controlled by ForceCreateMissingVBK registry settings (which, however, is still supported for upgrade compatibility reasons).

ForceDeleteBackupFiles reg key also works as before, not to change the product behavior after v8 upgrade. However, we strongly recommend deleting this key, because backup files clean up is now integrated, and is done automatically for all Veeam backup files which are no longer under retention policy (see v8 What's New document).

Additionally, v8 backup jobs now track known external hard drives, and "follow" them transparently in case drive letter changes, instead of failing.


sorry jump into this topic, but our backup with three rotating drives stopped working two days ago with the error message: ": Error: Full storage not found "
what makes me wondering, that the Veeam support ask me to add the "forceDeleteBackupfiles" to the registry. Of course it did not change anything... So should I remove it again?
Stonki
Lurker
 
Posts: 2
Liked: never
Joined: Fri Apr 02, 2010 11:28 am
Full Name: Stefan Onken

Re: Rotated hard drives support in v8

Veeam Logoby foggy » Wed Jul 22, 2015 4:57 pm

Judging on the error, there's no full backup (VBK) on the inserted drive, can you confirm that? How rotated drives are configured? Do you have the corresponding option in repository settings enabled or ForceCreateMissingVBK registry key specified?
foggy
Veeam Software
 
Posts: 14560
Liked: 1060 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

Re: Rotated hard drives support in v8

Veeam Logoby Gostev » Wed Jul 22, 2015 11:16 pm

Yes, please remove the key - bad suggestion by our support engineer this...
Gostev
Veeam Software
 
Posts: 21355
Liked: 2334 times
Joined: Sun Jan 01, 2006 1:01 am
Full Name: Anton Gostev

Re: Rotated hard drives support in v8

Veeam Logoby Stonki » Thu Jul 23, 2015 8:21 am

Hello,

after two (three?) days of errors, tonight backup was running fine. Although I tried yesterday evening manually before dinner. Strange. Not sure if this is now permanently solved or will occur on the next change of the hard drive..

1) The backup repository is set as "This repo is backed by rotated hard drives"
2) The backup itself is set to "reverse Incremental"

I added all logs to the support request (00973510). Even the logs from todays succesful backup. Wondering what caused the problem... (might be 20cm in front of the monitor, might not *g*)
Stonki
Lurker
 
Posts: 2
Liked: never
Joined: Fri Apr 02, 2010 11:28 am
Full Name: Stefan Onken

Re: Rotated hard drives support in v8

Veeam Logoby v.Eremin » Thu Jul 23, 2015 9:42 am

It's probably worth observing situation for some time and reaching the support engineer, should the problem re-occur. Thanks.
v.Eremin
Veeam Software
 
Posts: 13075
Liked: 949 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

[MERGED] Configuring a Backup Copy on rotation USB drive

Veeam Logoby vpock » Wed Jul 29, 2015 2:42 pm

Hello all,

So, this is the first time a customer asked for this, so I'm a little puzzled.

The customer use a physical Windows server as a repository. He would like to archive the backups on a set of USB drives using backup copies. I'm not sure how to do this reliably.

Anyone using USB drive for backup copies?
vpock
Influencer
 
Posts: 11
Liked: never
Joined: Wed Jan 29, 2014 9:42 pm
Full Name: Dominic Paquin

Re: Rotated hard drives support in v8

Veeam Logoby foggy » Wed Jul 29, 2015 2:49 pm

Dominic, you need to enable the rotated drives option in the corresponding repository settings. Please review this thread for details. Thanks.
foggy
Veeam Software
 
Posts: 14560
Liked: 1060 times
Joined: Mon Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson

PreviousNext

Return to Veeam Backup & Replication



Who is online

Users browsing this forum: adapterer and 27 guests