-
- Enthusiast
- Posts: 36
- Liked: 2 times
- Joined: Oct 10, 2017 5:46 pm
- Contact:
suggestion needed for particular scenario
Hi,
situation:
15-20GB of data added daily to local VEEAM server storage.
This data is very well compressed when backing on tape.
Goal:
I want to have 2 tapes (LTO6) - one in a library, second one - off site weekly.
Each should contain all the data from the day 1 and add just new files to tape. (Previous days never change)
So, finally I should have an offsite tape with ALL the data that is in LOCAL storage backup folder, of course minus one week that is on the tape in the library
What I did:
Created a media pool and added 2 tapes.
Created a job pointing to the media pool.
Run first FULL backup. It worked fine.
What I think:
I guess that in order to achieve my goal, I have to disable FULL backup and Enable Incremental.
When one of 2 tapes will be removed from the library, first backup will be full on each tape and then when I will switch the tape, only new data will be added to the tape (missing week + daily backups during the week that tape will be in drive).
Is my thinking right? Also, there should be the option to not override the tape.
With a compression that I saw, the tape can contain easily 2 years of given data.
Thanks.
situation:
15-20GB of data added daily to local VEEAM server storage.
This data is very well compressed when backing on tape.
Goal:
I want to have 2 tapes (LTO6) - one in a library, second one - off site weekly.
Each should contain all the data from the day 1 and add just new files to tape. (Previous days never change)
So, finally I should have an offsite tape with ALL the data that is in LOCAL storage backup folder, of course minus one week that is on the tape in the library
What I did:
Created a media pool and added 2 tapes.
Created a job pointing to the media pool.
Run first FULL backup. It worked fine.
What I think:
I guess that in order to achieve my goal, I have to disable FULL backup and Enable Incremental.
When one of 2 tapes will be removed from the library, first backup will be full on each tape and then when I will switch the tape, only new data will be added to the tape (missing week + daily backups during the week that tape will be in drive).
Is my thinking right? Also, there should be the option to not override the tape.
With a compression that I saw, the tape can contain easily 2 years of given data.
Thanks.
-
- Product Manager
- Posts: 2581
- Liked: 708 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: suggestion needed for particular scenario
Hi pob,
Assuming a) you are rotating tapes every week b) you are performing File to Tape; with your current setup you will have the following:
Tape1: Week1_______Week3______so on...
Tape2: ______Week2______Week4...
To have an offiste tape with ALL data at ALL times, you will need additional F2T job with 2 Tapes with following setup:
Tape3: job settings -> Full Backup -> [x] Run the Full Backup automatically - On These Days: Friday 11pm.
Tape4: job settings -> Full Backup -> [x] Run the Full Backup automatically - On These Days: Friday 11pm.
Tape1 and Tape3 will be in the office, Tape2 and Tape4 will be offsite.
What will happen:
Week1: Full backup + daily increments on Tape1. On Friday Tape3 will have a dump of ALL data. During weekend, you bring Tapes1+3 offsite, take Tapes2+4 home.
Week2: daily increments continue on Tape2. On Friday Tape4 will have a dump of ALL data. During weekend, you bring Tapes2+4 offsite, take Tapes1+3 home.
Cycle continues.
Result:
- daily increments on Tape1 or Tape2 (whichever is local today)
- offsite tape with Full backup of all data, no matter what
Hope that helps!
Assuming a) you are rotating tapes every week b) you are performing File to Tape; with your current setup you will have the following:
Tape1: Week1_______Week3______so on...
Tape2: ______Week2______Week4...
To have an offiste tape with ALL data at ALL times, you will need additional F2T job with 2 Tapes with following setup:
Tape3: job settings -> Full Backup -> [x] Run the Full Backup automatically - On These Days: Friday 11pm.
Tape4: job settings -> Full Backup -> [x] Run the Full Backup automatically - On These Days: Friday 11pm.
Tape1 and Tape3 will be in the office, Tape2 and Tape4 will be offsite.
What will happen:
Week1: Full backup + daily increments on Tape1. On Friday Tape3 will have a dump of ALL data. During weekend, you bring Tapes1+3 offsite, take Tapes2+4 home.
Week2: daily increments continue on Tape2. On Friday Tape4 will have a dump of ALL data. During weekend, you bring Tapes2+4 offsite, take Tapes1+3 home.
Cycle continues.
Result:
- daily increments on Tape1 or Tape2 (whichever is local today)
- offsite tape with Full backup of all data, no matter what
Hope that helps!
-
- Enthusiast
- Posts: 36
- Liked: 2 times
- Joined: Oct 10, 2017 5:46 pm
- Contact:
Re: suggestion needed for particular scenario
Egor privet,
thanks for the explanation...
Before I will move to your scenario, I would like to ask again may be for a bit simpler scenario (sorry if it sounds "stupid" ).
What will happen if I will mark the job to pool of 2 tapes, as Incremental for 7 days.
I can create one Full backup manually for the start on each one.
Wouldn't Veeam B&R intelligently append missing/new data to the inserted tape.
It could happen that the tapes will not be rotated every week.
I don't care that one or 2 weeks will be missing on the offsite tape.
The most important thing for me is that missing data will be added on next scheduled time to replaced tape.
From your point of view would it work?
Spasibo.
Misha.
thanks for the explanation...
Before I will move to your scenario, I would like to ask again may be for a bit simpler scenario (sorry if it sounds "stupid" ).
What will happen if I will mark the job to pool of 2 tapes, as Incremental for 7 days.
I can create one Full backup manually for the start on each one.
Wouldn't Veeam B&R intelligently append missing/new data to the inserted tape.
It could happen that the tapes will not be rotated every week.
I don't care that one or 2 weeks will be missing on the offsite tape.
The most important thing for me is that missing data will be added on next scheduled time to replaced tape.
From your point of view would it work?
Spasibo.
Misha.
-
- Product Manager
- Posts: 2581
- Liked: 708 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: suggestion needed for particular scenario
Hi Misha!
Let's make it clear with the requirement first: those files you need to copy on the tapes - are those Veeam Backup files(vbk\vib) or plain files like a file share with documents?
Thing is Veeam has 2 features to copy data on the tape: Backup to Tape(which is meant for Veeam backup files) and File to Tape(which is meant to simply copy files on the tape).
Depending on that, we will pick right job type and right settings\schedule!
/Cheers
Let's make it clear with the requirement first: those files you need to copy on the tapes - are those Veeam Backup files(vbk\vib) or plain files like a file share with documents?
Thing is Veeam has 2 features to copy data on the tape: Backup to Tape(which is meant for Veeam backup files) and File to Tape(which is meant to simply copy files on the tape).
Depending on that, we will pick right job type and right settings\schedule!
/Cheers
-
- Enthusiast
- Posts: 36
- Liked: 2 times
- Joined: Oct 10, 2017 5:46 pm
- Contact:
Re: suggestion needed for particular scenario
the files are regular windows files copied from Windows 10 to Veeam server local storage.
-
- Product Manager
- Posts: 2581
- Liked: 708 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: suggestion needed for particular scenario
To simplify and have increments + full backups on the Tape1\2 at all times, you can just set existing media pool to "Full Backup: Monday 11pm", "Increments daily".
With this setting, each week starts with full dump of everything, plus daily changes for a week. During weekend you switch the tapes, and a new week with another tape starts with full again.
Sounds good?
With this setting, each week starts with full dump of everything, plus daily changes for a week. During weekend you switch the tapes, and a new week with another tape starts with full again.
Sounds good?
-
- Enthusiast
- Posts: 36
- Liked: 2 times
- Joined: Oct 10, 2017 5:46 pm
- Contact:
Re: suggestion needed for particular scenario
Absolutely...
I just made full on each tape.
Removed one for offsite.
Set the job for incremental (only) every day.
Ideally, I don't want/need to run full backup, as one does exists from start on each tape.
I think (may be mistaken) that as soon as one tape of 2 with full backup is in the library only new (incremental) data will be added with the job configuration without full backup.
Is it correct thinking?
Of course I can test it. And if it will not do I will have to enable Full once a week. But in 6 month it will be waste of time and unnecessary mechanical use of drives for overriding FULL.
I just made full on each tape.
Removed one for offsite.
Set the job for incremental (only) every day.
Ideally, I don't want/need to run full backup, as one does exists from start on each tape.
I think (may be mistaken) that as soon as one tape of 2 with full backup is in the library only new (incremental) data will be added with the job configuration without full backup.
Is it correct thinking?
Of course I can test it. And if it will not do I will have to enable Full once a week. But in 6 month it will be waste of time and unnecessary mechanical use of drives for overriding FULL.
-
- Product Manager
- Posts: 2581
- Liked: 708 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: suggestion needed for particular scenario
Correct.
You can also setup automatic overwrite policy on tape according to your needs.
You can also setup automatic overwrite policy on tape according to your needs.
-
- Veteran
- Posts: 636
- Liked: 100 times
- Joined: Mar 23, 2018 4:43 pm
- Full Name: EJ
- Location: London
- Contact:
[MERGED] Rotating tape media
Hi guys,
I've got some tape backups configured. I recently bought a second set of LTO tapes with a plan in mind to rotate the tapes periodically so we always have a set of tapes which have been removed and are physically out of the system entirely.
At the moment I've configured two media pools. I have the first set of 24 tapes in the autoloader currently. I have the second set of 24 sitting outside of the autoloader.
I'm trying to think about the correct way to implement my strategy for rotating the tapes. I'm thinking if I want entirely separate standalone backups on two separate sets of tapes this will mean I'll have to create two backup job definitions for each backup task and set each job to write to the other media pool.
But having two jobs for each task seems clunky. Is there a more elegant way to implement this?
I've got some tape backups configured. I recently bought a second set of LTO tapes with a plan in mind to rotate the tapes periodically so we always have a set of tapes which have been removed and are physically out of the system entirely.
At the moment I've configured two media pools. I have the first set of 24 tapes in the autoloader currently. I have the second set of 24 sitting outside of the autoloader.
I'm trying to think about the correct way to implement my strategy for rotating the tapes. I'm thinking if I want entirely separate standalone backups on two separate sets of tapes this will mean I'll have to create two backup job definitions for each backup task and set each job to write to the other media pool.
But having two jobs for each task seems clunky. Is there a more elegant way to implement this?
-
- Product Manager
- Posts: 2581
- Liked: 708 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: suggestion needed for particular scenario
Hi EJ.
Check posts above, it has same scenario with rotated tapes!
/Cheers!
Check posts above, it has same scenario with rotated tapes!
/Cheers!
-
- Veteran
- Posts: 636
- Liked: 100 times
- Joined: Mar 23, 2018 4:43 pm
- Full Name: EJ
- Location: London
- Contact:
Re: suggestion needed for particular scenario
So are we saying one media pool containing all 48 tapes is preferable to two media pools? Even though half the tapes won't be in the pool at any given time? I guess the autoloader is going to load whatever tape is present in the library provided it isn't overwrite protected?
-
- Product Manager
- Posts: 2581
- Liked: 708 times
- Joined: Jun 14, 2013 9:30 am
- Full Name: Egor Yakovlev
- Location: Prague, Czech Republic
- Contact:
Re: suggestion needed for particular scenario
Correct.
Simple and easy - a single pool and correct settings on Full Backup on Day Z(tapes switch day). If you want more control over the pools, you can have 2, but will need some tuning with schedule, like here.
/Cheers!
Simple and easy - a single pool and correct settings on Full Backup on Day Z(tapes switch day). If you want more control over the pools, you can have 2, but will need some tuning with schedule, like here.
/Cheers!
Who is online
Users browsing this forum: No registered users and 10 guests