v9 Question about parallel tape processing

Everything about backing up to tape

v9 Question about parallel tape processing

Veeam Logoby ekisner » Fri Oct 16, 2015 5:24 pm

Question... I see you're implementing GFS rotations. This makes me VERY happy.

Since I see that the Veeam devs have given some love to the tape aspects of Veeam, I thought I might inquire as to multiple drive processing - a single library with multiple drives in it.

At present we have a library with a single drive, and the disk to tape job takes about 5 and a half days to run. This is not ideal! Through browsing the forums I see that as of V8, multiple drives must be implemented with multiple media pools and multiple jobs. Which is also not ideal. It can be Frankensteined together but it would require maintenance to make sure that the workaround maintained a balance.

So... is there any support for tape parallelism coming in v9? 2 drives should cut my window to 2 1/2 days, 3 drives even less.

There would likely be FC connectivity.
ekisner
Expert
 
Posts: 131
Liked: 31 times
Joined: Thu Jul 26, 2012 8:04 pm
Full Name: Erik Kisner

Re: v9 Question about parallel tape processing

Veeam Logoby Shestakov » Sat Oct 17, 2015 9:56 pm 2 people like this post

Hello Erik,
Parallel processing between multiple tape drives becomes available in v9. Previously you needed to set up multiple media pools and tape backup jobs, what increased complexity, in v9 it is available out of the box.
Read more about new tape features in v9.
Shestakov
Veeam Software
 
Posts: 4863
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: v9 Question about parallel tape processing

Veeam Logoby Dima P. » Sun Oct 18, 2015 12:45 pm 2 people like this post

Thanks – glad to hear and moreover glad to share your feedback with the team.

In v9 we will have two “levels” of parallel processing available. One is parallel processing between simultaneously running gobs pointed to the same media pool, another is parallel processing between source backup chains. That should bring your performance to the new level – stay tuned for then BETA, and check the blog post Nikita has shared. Cheers!
Dima P.
Veeam Software
 
Posts: 6261
Liked: 441 times
Joined: Mon Feb 04, 2013 2:07 pm
Location: SPb
Full Name: Dmitry Popov

Re: v9 Question about parallel tape processing

Veeam Logoby ekisner » Mon Oct 19, 2015 4:53 pm 2 people like this post

That makes me very happy!

Lots of tape love this patch, very excited for v9 release! Thank you both for your followup.
ekisner
Expert
 
Posts: 131
Liked: 31 times
Joined: Thu Jul 26, 2012 8:04 pm
Full Name: Erik Kisner

Re: v9 Question about parallel tape processing

Veeam Logoby Shestakov » Mon Oct 19, 2015 9:07 pm

Thanks for the kind words, Erik!
I`ll forward them to the developers working on tape features. :D
Shestakov
Veeam Software
 
Posts: 4863
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: v9 Question about parallel tape processing

Veeam Logoby rreed » Thu Nov 12, 2015 7:19 pm

Would you mind expanding a little upon the parallel processing of backup chains please? Bear w/ me please as I have just started diving into Veeam's tape capabilities the last couple of days. We have two drives in our library and having them both going at the same time sure would be great. I know some parallelism I would like to see would be a single one-to-many backup where my backup writes to disk while simultaneously writing to tape rather than traditional B2D2T.

Our reason being is that right now we write directly to deduplicating device (EMC DD's and Dell DR's). The tape job has to pull that data from the dedupe device, which we all know to be slow, rehydrating, etc. Yes I know we need to have JBOD as our staging area before archival storage, and it's in the works, we just don't know when, and it won't be the same 84+ TB of production storage we have on tap. Being able to point at least some of our backup jobs straight to tape that won't fit on our staging LZ would really help out.
VMware 6
Veeam B&R v9
Dell DR4100's
EMC DD2200's
EMC DD620's
Dell TL2000 via PE430 (SAS)
rreed
Expert
 
Posts: 354
Liked: 72 times
Joined: Tue Jun 30, 2015 6:06 pm

Re: v9 Question about parallel tape processing

Veeam Logoby Shestakov » Fri Nov 13, 2015 9:38 am

Hello rreed,
Backup-to-tape job is supposed to be a secondary job to make a copy of the VMs backups and store it on tapes. I see your point but it can only copy existing restore points to the tape media.
In a case of copy process skipping the dedupe device, you would need to make an additional backup of the VMs, what would take even more time and resources.
Thanks!
Shestakov
Veeam Software
 
Posts: 4863
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov

Re: v9 Question about parallel tape processing

Veeam Logoby v.Eremin » Fri Nov 13, 2015 10:53 am

Would you mind expanding a little upon the parallel processing of backup chains please?

In version 9 we will introduce new feature called per-virtual machine (VM) backup file chains, meaning that each VM selected as a source for backup job will have its own set of full and incremental files.

If you select such job (containing multiple chains) as a source for backup to tape job, tape job will be able to process those chains in parallel, distributing the workload among available drives.

Thanks.
v.Eremin
Veeam Software
 
Posts: 13296
Liked: 973 times
Joined: Fri Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin

Re: v9 Question about parallel tape processing

Veeam Logoby rreed » Mon Nov 16, 2015 4:07 pm

This is so very incredibly full of win, guys. Excellent, excellent job, looking VERY forward to this and other new features!! Many thanks!

Question on the per-virtual machine backup file chains, right now if we need to move backup files (say, a given job) to another repository and point the job to the new location (works great); will we be able to move only some of the VMs' backup files of the per-VM chain? In short, split the VM's out of a given job, if that makes sense? Or will it still be the same way were we have to move everything; it's just in many mulitple files vs. just the chains only. If that also makes sense. :? For cases where a given repository needs just a bit of space freed up but I don't have time/landing zone to move it all.
VMware 6
Veeam B&R v9
Dell DR4100's
EMC DD2200's
EMC DD620's
Dell TL2000 via PE430 (SAS)
rreed
Expert
 
Posts: 354
Liked: 72 times
Joined: Tue Jun 30, 2015 6:06 pm

Re: v9 Question about parallel tape processing

Veeam Logoby Shestakov » Mon Nov 16, 2015 5:36 pm

Here is another top-feature, Scale-Out Backup Repository. With the feature, you can use several repositories, logically combined to a single one, as a target for your job.
Shestakov
Veeam Software
 
Posts: 4863
Liked: 396 times
Joined: Wed May 21, 2014 11:03 am
Location: Saint Petersburg
Full Name: Nikita Shestakov


Return to Tape



Who is online

Users browsing this forum: jaherr and 6 guests