Since upgrade to B&R V11, backup from disk to tape is very slow

[danc]

Since upgrading to Veeam B&R v11 this week, the disk to tape backup is very slow.
I am getting speeds of 3 -5 mb/s whereas when I was on v10 last week, the speed is around 80mb/s
Backup to disk is still fine, but it is the backup from disk to tape (LTO5) that the speed is greatly reduced.
Is there a fix to this or something I need to check?

[Egor Yakovlev]

Hi Dan.

Double check if you are on latest build 11.0.0.837 P20210525 and if it is so, feel free to troubleshoot performance drop with support.

/Thanks!

[danc]

I've checked and can confirm that I'm on the latest build of 11.00.837 P20210525 which I upgraded this week from v10a.
I'll log a support case with Veeam Support!
Thanks!

Has anyone else had this issue since upgrading from v10 to v11 and see a very significant drop in speed when backing up from disk to tape media?

[Gostev]

Safe to say that in this case, there would have been a multi-page topic about this here now that we're well over 200K downloads for V11
And since it's highly doubtful no one else noticed a 25x tape performance drop, most likely you have some environment-specific issue there.

[danc]

I have the same issues similar to this post:
veeam-backup-replication-f2/storeonce-b ... 37d6fd1fe0

I have also noticed my backups to my HP StoreOnce was slow after the V11 upgrade

I have added now added the Registry Fix:
HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication\
UseUnbufferedAccess
• Type: REG_DWORD
• Set it to 0

This looks to have resolved the slow backup speed to my HP StoreOnce.

However, the backup from disk to Tape is still very slow.
And nothing has been changed from my end, only thing that was changed was upgrading from v10a to v11... so problem points to something with v11!

I have now logged a case with Veeam Support... still waiting on a reply.

[Dima P.]

Please share the case ID, we will review the details with QA team. Thank you in advance!

[danc]

Veeam Support - Case # 04883400

Veeam Support have got back to me to add the following registry fix which looks to have resolved the backup speed issue now:

Key: DisableHtAsyncIo
Path: HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication\
Type: DWORD
Value: 1
This key must be added on the Gateway server for the source repository.

Key: UseUnbufferedAccess
Path: HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication\
Type: REG_DWORD
Value: 0
This key must be added on the Veeam Backup & Replication server.

However, I am now having errors when backing up to tape, where the tapes will not eject so backups to tape are still failing as it cannot eject the tape to add the next tape to continue with the backup

Error
Failed to eject tape DUN624L4 Error: Failed to call RPC function 'UnloadMediumByScsi': [MT]SCSI PASS THROUGH DIRECT ended with Scsi Error Fixed format, current; Sense key: Illegal Request. Additional sense: Medium removal prevented by data transfer element.

[Dima P.]

Thanks for the case, passed to the team!

[danc]

Thanks Dima P!

I have spoken with Veeam support. Was advised to add the following registry changes:

This has helped to resolve the backup speed to disk (HP StoreOnce):
Key: UseUnbufferedAccess
Path: HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication\
Type: REG_DWORD
Value: 0
This key must be added on the Veeam Backup & Replication server.

This registry entry fix has resolved the speeds from the HP StoreOnce (Disk) to Tape:
Key: UseUnbufferedAccess
Path: HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication\
Type: REG_DWORD
Value: 0
This key must be added on the Veeam Backup & Replication server.

I had to reboot both the Veeam Backup Server and also the Veeam Proxy Server
I then needed to restart/reboot the Tape Library

Once this is done, the Veeam backup speed are now running at a speed similar to when I was on V10a.

Spoke with Veeam Support and they said that they have been getting support calls in regards to v11 upgrade issue with users running HP StoreOnce devices.

Will there be a update/patch coming up for V11 soon?

Thanks!

[karsten123]

we had the same slow backups to disk after upgrade from 10 to v11. But with a Netapp via CIFS.
UseUnbufferedAccess did the trick for us too.
Hopefully it is some sort of fix in v11a.

[danc]

*Correction from my post above:
This is the registry entry fix I used to resolve the slow backup speeds from the HP StoreOnce (Disk) to Tape:
Key: DisableHtAsyncIo
Path: HKEY_LOCAL_MACHINE\SOFTWARE\Veeam\Veeam Backup and Replication\
Type: DWORD
Value: 1

[Dima P.]

karsten123,
I'd still recommend to raise a case and investigate the issue with the support team prior adding the registry key.

danc,
The slot issue is likely related to the drivers (QA suspects that somehow the library slot got locked by the library). Please keep working with our team.

[karsten123]

Hi Dima,
i did. Case numbers are #04814523 and #04873056