Discussions related to exporting backups to tape and backing up directly to tape.
Post Reply
mikeely
Expert
Posts: 224
Liked: 69 times
Joined: Nov 07, 2016 7:39 pm
Full Name: Mike Ely
Contact:

How to break job-to-tape backup into chunks?

Post by mikeely »

I've got a pretty large (slightly over 2TB) batch of weekly .vbk I want to copy off to tape (actually to S3 Glacier but I am trying to approach this from the backup-to-tape perspective). The problem is that the size of the backup consistently overwhelms the maximum cache size of the tape gateway which then slows the backup to an absolute crawl, at least until it get stepped on by or steps on a regular backup job.

What I'd like to do is break the -to-tape portion up into chunks. I can do a backup files to tape but that does no good as the VBKs are all going to have different names each time. What approaches can I take? Ideally I'd write something in bash or perl or such to trigger Veeam to send a list of files to the tape gateway... something tells me I'm about to learn all about the AWS APIs.
'If you truly love Veeam, then you should not let us do this :D' --Gostev, in a particularly Blazing Saddles moment
csydas
Expert
Posts: 193
Liked: 47 times
Joined: Jan 16, 2018 5:14 pm
Full Name: Harvey Carel
Contact:

Re: How to break job-to-tape backup into chunks?

Post by csydas »

Hey Mike,

Maybe I'm just out of the loop technically since we still use good ole' fashioned magnetic tapes for our archives, but how big is the cache on your gateway? Are you talking about this here: https://docs.aws.amazon.com/storagegate ... cepts.html

The numbers seem pretty simple - 20% of the total workload, right? As I see it, you just have two options -- split the job up smaller or increase your cache. I'm not sure there's even a need for API work.

Else, you can do masks within File to Tape jobs and just include .VBK files (I'm assuming you're doing Forever Forward Incremental/Reverse Incremental backups).
mikeely
Expert
Posts: 224
Liked: 69 times
Joined: Nov 07, 2016 7:39 pm
Full Name: Mike Ely
Contact:

Re: How to break job-to-tape backup into chunks?

Post by mikeely »

I've built the cache as big as 2TB, which is the maximum size for the AWS gateway. Still no joy.
'If you truly love Veeam, then you should not let us do this :D' --Gostev, in a particularly Blazing Saddles moment
Dima P.
Product Manager
Posts: 14396
Liked: 1568 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: How to break job-to-tape backup into chunks?

Post by Dima P. »

Hi Mike,

Can you split your big backup file into several smaller ones by using separate vm backup jobs? Thanks!
mikeely
Expert
Posts: 224
Liked: 69 times
Joined: Nov 07, 2016 7:39 pm
Full Name: Mike Ely
Contact:

Re: How to break job-to-tape backup into chunks?

Post by mikeely »

I'd love to, but that big backup is basically "backup this big datastore excepting the following VMs. That way when we add a VM it gets backed up right away.
'If you truly love Veeam, then you should not let us do this :D' --Gostev, in a particularly Blazing Saddles moment
Dima P.
Product Manager
Posts: 14396
Liked: 1568 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: How to break job-to-tape backup into chunks?

Post by Dima P. »

Mike,

The only suggestion that comes to my mind is to use StartWind VTL instead of Amazon Gateway VTL as it does not have any limit on the storage for emulated media.
Post Reply

Who is online

Users browsing this forum: DataDefender and 17 guests