-
- Expert
- Posts: 124
- Liked: 22 times
- Joined: Jul 30, 2015 7:32 pm
- Contact:
Backup Copy Job - One giant one, or one for each Backup job?
I have 14 backup jobs covering 500 VMs and 76 TB of backup data. I'm doing an initial copy to a separate storage device that will be heading to a DR location as soon as data is seeded.
What do most people do in regards to the copy job? Create one job that includes all backup jobs so there is only one task to manage? I plan to keep the same retention period on all copy jobs, but if I have to do an active full of a set of VMs, I don't necessarily want to do every VM I'm backing up. So I can see it both ways.
Right now I'm leaning towards one copy job for each backup job, but open to comments
What do most people do in regards to the copy job? Create one job that includes all backup jobs so there is only one task to manage? I plan to keep the same retention period on all copy jobs, but if I have to do an active full of a set of VMs, I don't necessarily want to do every VM I'm backing up. So I can see it both ways.
Right now I'm leaning towards one copy job for each backup job, but open to comments
-
- Chief Product Officer
- Posts: 31806
- Liked: 7300 times
- Joined: Jan 01, 2006 1:01 am
- Location: Baar, Switzerland
- Contact:
Re: Backup Copy Job - One giant one, or one for each Backup
Hello!
Multiple jobs give you more control, but also more things to manage. What do you like better?
From the product perspective, for 500 VMs you can certainly go with the single one (just make sure you have 9.5 U1 installed).
Multiple jobs give you more control, but also more things to manage. What do you like better?
From the product perspective, for 500 VMs you can certainly go with the single one (just make sure you have 9.5 U1 installed).
-
- Veeam ProPartner
- Posts: 141
- Liked: 26 times
- Joined: Oct 12, 2015 2:55 pm
- Full Name: Dead-Data
- Location: UK
- Contact:
Re: Backup Copy Job - One giant one, or one for each Backup
Hi,
We found that when performing synthetic operations, transforms, etc, the backup storage needs as much free space as the largest backup or backup copy job.
So with a single jobs of 500 VMs and 76TB you might well need 76TB+ of free space on the backup repository.
We started off with aggregating backup jobs into fewer backup copy jobs but have since reverted to a one-to-one relationship between backup jobs and copy jobs.
(Environment is 600+ VMs and 1PB source data.)
We found that when performing synthetic operations, transforms, etc, the backup storage needs as much free space as the largest backup or backup copy job.
So with a single jobs of 500 VMs and 76TB you might well need 76TB+ of free space on the backup repository.
We started off with aggregating backup jobs into fewer backup copy jobs but have since reverted to a one-to-one relationship between backup jobs and copy jobs.
(Environment is 600+ VMs and 1PB source data.)
-
- Expert
- Posts: 124
- Liked: 22 times
- Joined: Jul 30, 2015 7:32 pm
- Contact:
Re: Backup Copy Job - One giant one, or one for each Backup
Thanks DeadEyeJacks.
I went ahead and set them up with a one-to-one so I could gradually turn them on and give the granular control Gostev mentioned.
I went ahead and set them up with a one-to-one so I could gradually turn them on and give the granular control Gostev mentioned.
-
- VeeaMVP
- Posts: 6166
- Liked: 1971 times
- Joined: Jul 26, 2009 3:39 pm
- Full Name: Luca Dell'Oca
- Location: Varese, Italy
- Contact:
Re: Backup Copy Job - One giant one, or one for each Backup
That's true however only if you don't use per-vm backup chains. With per-vm enabled, the number of VMs in a job doesn't matter in regards to the size of a backup file, as each VM is still stored in its dedicated file.DeadEyedJacks wrote:Hi,
We found that when performing synthetic operations, transforms, etc, the backup storage needs as much free space as the largest backup or backup copy job.
So with a single jobs of 500 VMs and 76TB you might well need 76TB+ of free space on the backup repository.
Luca Dell'Oca
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
Principal EMEA Cloud Architect @ Veeam Software
@dellock6
https://www.virtualtothecore.com/
vExpert 2011 -> 2022
Veeam VMCE #1
-
- Influencer
- Posts: 17
- Liked: never
- Joined: Jul 15, 2015 4:19 pm
- Full Name: Luba
- Contact:
[MERGED] Backup Copy Job for Multiple VMs
Hello,
We are running 70+ backup jobs every two hours form the VMWare Cluster. Each job includes two VMs (client based) so we are backing up this way more then 150 VMs. I’m currently adding Backup Copy job to implement GFS schema for each VM. What would be recommended way to setup Backup Copy job: use one job that aggregates all the VMs or split it in multiple (the backup/retention policy for each VM should be the same)? Would it be any difference from the performance/administration point of view? Running one job looks easier but would it be any drawback when, for example, adding new VMs to the job or restoring from the backup?
We are constantly adding more backup jobs and looks like our current backup schema is about too change so I’m looking for some kind of “Best Practice” recommendation of using Veeam in busy constantly growing environment.
Thank you very much
We are running 70+ backup jobs every two hours form the VMWare Cluster. Each job includes two VMs (client based) so we are backing up this way more then 150 VMs. I’m currently adding Backup Copy job to implement GFS schema for each VM. What would be recommended way to setup Backup Copy job: use one job that aggregates all the VMs or split it in multiple (the backup/retention policy for each VM should be the same)? Would it be any difference from the performance/administration point of view? Running one job looks easier but would it be any drawback when, for example, adding new VMs to the job or restoring from the backup?
We are constantly adding more backup jobs and looks like our current backup schema is about too change so I’m looking for some kind of “Best Practice” recommendation of using Veeam in busy constantly growing environment.
Thank you very much
-
- Veeam Software
- Posts: 21139
- Liked: 2141 times
- Joined: Jul 11, 2011 10:22 am
- Full Name: Alexander Fogelson
- Contact:
Re: Backup Copy Job - One giant one, or one for each Backup
Hi Luba, seems you're perfectly getting all pros and cons of each approach. It's totally up to you to decide what fits your environment best or to find some middle ground. Some additional considerations are mentioned above.
-
- Lurker
- Posts: 1
- Liked: never
- Joined: Aug 16, 2018 9:07 am
- Contact:
Re: Backup Copy Job - One giant one, or one for each Backup
Thanks for that advice Luca.
The op’s question was about ‘backup copy job’.
Would your per-vm advice also apply to a ‘backup job’ as well?
So, just one backup job to capture all vm’s in the vsphere cluster and then let per-vm, set on the repository, do the donkey work of splitting up each vm into its own chain?
If I have an existing single backup chain on a repository, containing many vm’s, how would they behave if I now enabled per-vm on the repository?
Cheers.
-
- Veeam Software
- Posts: 148
- Liked: 94 times
- Joined: Jan 16, 2013 5:27 pm
- Full Name: Tyler Payton
- Contact:
Re: Backup Copy Job - One giant one, or one for each Backup job?
One thing to consider when deciding whether to enable Per-VM backup files is repository space usage.
https://helpcenter.veeam.com/docs/backu ... files.html
Per-VM Backup Files Option for Existing Backup Repositories
You can enable or disable the Use per-VM backup files option for existing backup repositories at which backup jobs are already targeted. The new setting will not have any effect on previously created backup files on the backup repository. It will affect new backup files created after the setting is changed.
Veeam Backup & Replication applies the new setting starting from the next active full backup. You can create an active full backup manually or wait for Veeam Backup & Replication to automatically create active full backup (if active full backups are scheduled). Synthetic full backups do not affect the Use per-VM backup files setting.
https://helpcenter.veeam.com/docs/backu ... files.html
- If you enable the Use per-VM backup files option, data deduplication between VMs will not work. For more information, see Data Compression and Deduplication.
Per-VM Backup Files Option for Existing Backup Repositories
You can enable or disable the Use per-VM backup files option for existing backup repositories at which backup jobs are already targeted. The new setting will not have any effect on previously created backup files on the backup repository. It will affect new backup files created after the setting is changed.
Veeam Backup & Replication applies the new setting starting from the next active full backup. You can create an active full backup manually or wait for Veeam Backup & Replication to automatically create active full backup (if active full backups are scheduled). Synthetic full backups do not affect the Use per-VM backup files setting.
Tyler Payton
Customer Experience Manager / KB Manager
Customer Experience Manager / KB Manager
Who is online
Users browsing this forum: anthonyspiteri79, Bing [Bot], Majestic-12 [Bot] and 293 guests