Discussions related to exporting backups to tape and backing up directly to tape.
Post Reply
ccone@vascorltd.com
Influencer
Posts: 19
Liked: 2 times
Joined: Sep 08, 2017 1:47 pm
Full Name: Clint Cone
Contact:

Writing VEEAM Agent backups to tape is slow

Post by ccone@vascorltd.com »

System software/versions: Windows Server 2012 R2, VEEAM 9.5 Update 2

Server hardware:
HP DL380 G7, 2 X Xeon E5-2960 v2 (20 total cores @ 3.0GHz), 192 GB RAM

Storage:
Repository: Promise VESS R2600xid, 220 TB (formatted), 10 GB/s iSCSI network
Tape drive/media: HP 1x8 G2 Autoloader (SAS), LTO-7, with HP LTO-7 tapes

We have set it all up and are getting good performance out of the backups of our VMs to tape (about 270 MB/s), but the backups produced by VEEAM Agents on a couple of physical servers is really slow (about 40 MB/s). The bottleneck for those tasks is reported as: Source 91% > Proxy 0% > Network 14% > Target 25%. There is nothing else accessing that source at the time the tape job is running. In fact, there isn't anything happening on the server either (it is after business hours, and the other backup prep/job starts 2 hours later).

All the other tasks in the tape job report something like this: Source 12% > Proxy 6% > Network 24% > Target 99%. This is what I wold expect.

I don't understand why the two VEEAM Agent generated files are so much slower. I can't find any way to change anything about how the tape job processes those VEEAM Agent related backups either. What options do I have to speed those tasks up?

Thanks!
Clint
PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by PTide »

Hi,

Is that Agent for Linux of for Windows that you use? Also what filesystem is being used on the repository?

Thanks
ccone@vascorltd.com
Influencer
Posts: 19
Liked: 2 times
Joined: Sep 08, 2017 1:47 pm
Full Name: Clint Cone
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by ccone@vascorltd.com »

It is all Windows. The host being backed up is Windows Server 2008 R2. The Repository is formatted NTFS, mounted over iSCSI (physical network connection on the VEEAM server is an Emulex 10 GB/s OCe14102-U). What gets me is that all my VM backup jobs get the expected throughput. The same job just went last night, but skipped the agent backups from physical servers as they had full backups going and no updates for tapes. It reported writing at 289 MB/s. But when it has to write the agent output to tape, it crawls through them. then it zooms through the VM backups.
Dima P.
Product Manager
Posts: 14396
Liked: 1568 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by Dima P. »

Hello Clint,

Are you using encryption both in agent backup jobs and in tape jobs?
ccone@vascorltd.com
Influencer
Posts: 19
Liked: 2 times
Joined: Sep 08, 2017 1:47 pm
Full Name: Clint Cone
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by ccone@vascorltd.com »

We are not using encryption in any jobs.
ccone@vascorltd.com
Influencer
Posts: 19
Liked: 2 times
Joined: Sep 08, 2017 1:47 pm
Full Name: Clint Cone
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by ccone@vascorltd.com »

Just noticed one more detail... after an active full backup from the agent, the tape write speed for that file is as fast as expected. So the performance impact is only when it is processing our weekday incremental backups. Looking closely at the job results in the UI, it saw a VBK to write to tape. This is different than what is usually there. The job sees usually indicates it is processing a "VBK map" instead of a VBK.
PTide
Product Manager
Posts: 6408
Liked: 724 times
Joined: May 19, 2015 1:46 pm
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by PTide »

So the performance impact is only when it is processing our weekday incremental backups. Looking closely at the job results in the UI, it saw a VBK to write to tape. This is different than what is usually there. The job sees usually indicates it is processing a "VBK map" instead of a VBK.
So, you say that you get daily VBK to tape, is that correct? If so then may I ask you what are the days that you've specified for Full backup?

Thank you
ccone@vascorltd.com
Influencer
Posts: 19
Liked: 2 times
Joined: Sep 08, 2017 1:47 pm
Full Name: Clint Cone
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by ccone@vascorltd.com »

Full backups happen on the weekends... Tape jobs run monday through friday, so on Mondays we get the previous weekend's active full backup onto tape.
einhirn
Enthusiast
Posts: 53
Liked: 18 times
Joined: Feb 02, 2015 1:51 pm
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by einhirn »

I'm seeing this problem, too, can't say that it happens every time a VBK-Map has to be written, can't say that it only occurs with VBK-Maps... Anyway, I've just opened a case to have the issue investigated: #02339506
ccone@vascorltd.com
Influencer
Posts: 19
Liked: 2 times
Joined: Sep 08, 2017 1:47 pm
Full Name: Clint Cone
Contact:

Re: Writing VEEAM Agent backups to tape is slow

Post by ccone@vascorltd.com »

I think upgrading the Veeam agent on the remote servers seems to have resolved this for us. But I'm not sure why.
Post Reply

Who is online

Users browsing this forum: No registered users and 29 guests