-
- Novice
- Posts: 3
- Liked: never
- Joined: Feb 14, 2023 12:15 pm
- Contact:
Is software encryption fast enough for writing to tape?
I'm thinking of using Veeam Backup & Replication CE 11.0 with an IBM TS-3200 library and LTO-8 drive. I'd need it encrypted and would like to use software encryption.
However, I've read here that there were significant speed issues with software encryption in the past: tape-f29/ibm-ts3200-and-hardware-encryption-t29322.html
This would be a concern for me as I believe that if the encryption speed is slower than the tape writing speed this would cause shoe-shining on the tape. But this thread is from 2015, and I read in one place that modern CPUs with AES-NI don't have this problem anymore. Is this true?
I have no way to easily test this, so I would appreciate if anyone could shine some light on the issue.
However, I've read here that there were significant speed issues with software encryption in the past: tape-f29/ibm-ts3200-and-hardware-encryption-t29322.html
This would be a concern for me as I believe that if the encryption speed is slower than the tape writing speed this would cause shoe-shining on the tape. But this thread is from 2015, and I read in one place that modern CPUs with AES-NI don't have this problem anymore. Is this true?
I have no way to easily test this, so I would appreciate if anyone could shine some light on the issue.
-
- Product Manager
- Posts: 14759
- Liked: 3044 times
- Joined: Sep 01, 2014 11:46 am
- Full Name: Hannes Kasparick
- Location: Austria
- Contact:
Re: Is software encryption fast enough for writing to tape?
Hello,
and welcome to the forums.
What is "fast enough"? What do you think about trying it out and posting your results and helping others with that?
If it's too slow, you could also use encryption in the backup job. Then the data is encrypted before writing to tape. It also takes CPU cycles, but it seems to be irrelevant today.
Best regards,
Hannes
and welcome to the forums.
What is "fast enough"? What do you think about trying it out and posting your results and helping others with that?
If it's too slow, you could also use encryption in the backup job. Then the data is encrypted before writing to tape. It also takes CPU cycles, but it seems to be irrelevant today.
Best regards,
Hannes
-
- Novice
- Posts: 3
- Liked: never
- Joined: Feb 14, 2023 12:15 pm
- Contact:
Re: Is software encryption fast enough for writing to tape?
Hi, and thanks for the welcome
As you may have guessed from my question I'm new to Veeam and tape backups in general.
So by "fast enough" I'm trying to ask a blanket question on whether software encryption speed is still a concern in some cases, or whether CPUs with AES-NI are so fast that these days that it's generally no longer a bottleneck. Due to my inexperience, trying to set everything up for various tests and running them is a big project for me. I was hoping to save myself this trial and error time if the question has an answer that is clear to experienced users.
To be a bit more specific, I believe the maximum write speed to LTO-8 is 360 MB/s, so I need to hit at least that. The data pool I'd like to back up from will have a theoretical maximum output of around 500 MB/s, which I imagine is fine, unless the CPU throttles the speed by half or more as reported in 2015. The CPU I'm going to use is a Xeon E3-1230 v3, which has AES-NI.
Thanks for the tip with the backup job encryption, I'll have to look into that.
As you may have guessed from my question I'm new to Veeam and tape backups in general.
So by "fast enough" I'm trying to ask a blanket question on whether software encryption speed is still a concern in some cases, or whether CPUs with AES-NI are so fast that these days that it's generally no longer a bottleneck. Due to my inexperience, trying to set everything up for various tests and running them is a big project for me. I was hoping to save myself this trial and error time if the question has an answer that is clear to experienced users.
To be a bit more specific, I believe the maximum write speed to LTO-8 is 360 MB/s, so I need to hit at least that. The data pool I'd like to back up from will have a theoretical maximum output of around 500 MB/s, which I imagine is fine, unless the CPU throttles the speed by half or more as reported in 2015. The CPU I'm going to use is a Xeon E3-1230 v3, which has AES-NI.
Thanks for the tip with the backup job encryption, I'll have to look into that.
-
- Veeam Legend
- Posts: 246
- Liked: 136 times
- Joined: Mar 28, 2019 2:01 pm
- Full Name: SP
- Contact:
Re: Is software encryption fast enough for writing to tape?
You want to hit AT LEAST the Max speed? I am confused, as the max speed is the absolute top in perfect conditions and not always the case.
While there is a performance hit, it really depends on your requirements for encryption, backup window, etc. Get a second drive if you need more throughput. Extend your backup window, Encrypt the jobs. There are a few options.
While running 6 LTO tapes in my TS4500 I noticed about a 20% performance hit turning on software encryption. added a few hours to my window, but I'm backing up 100's of TB's so it's minor. I may get another drive to account for that.
While there is a performance hit, it really depends on your requirements for encryption, backup window, etc. Get a second drive if you need more throughput. Extend your backup window, Encrypt the jobs. There are a few options.
While running 6 LTO tapes in my TS4500 I noticed about a 20% performance hit turning on software encryption. added a few hours to my window, but I'm backing up 100's of TB's so it's minor. I may get another drive to account for that.
-
- Product Manager
- Posts: 14652
- Liked: 1678 times
- Joined: Feb 04, 2013 2:07 pm
- Full Name: Dmitry Popov
- Location: Prague
- Contact:
Re: Is software encryption fast enough for writing to tape?
Hardware encryption has literary zero impact on the performance as data blocks are encrypted by the drive itself while landing the tape. Software encryption is slower compared to hardware encryption as it requires data pre-processing on the host (block should be encrypted by Veeam before it lands the tape). If you have to pick what to use - I'd recommend going with hardware encryption.
-
- Veeam Software
- Posts: 272
- Liked: 68 times
- Joined: Aug 07, 2019 10:05 am
- Full Name: Rob Turk
- Contact:
Re: Is software encryption fast enough for writing to tape?
Perhaps good to know is that modern LTO tape drives include speed matching technology (aka Data rate matching).
They can dynamically slow down to match the incoming data stream without negative impact.
-
- Veeam Legend
- Posts: 246
- Liked: 136 times
- Joined: Mar 28, 2019 2:01 pm
- Full Name: SP
- Contact:
Re: Is software encryption fast enough for writing to tape?
I have tape drives that support hardware encryption. LTO8 drives on my TS4500's.
Dumb me, Edit, because I just found in the TS4500, i had to tell it that my Virtual Library encryption was "application managed"
I had Veeam set up correctly.
Hopefully I get that speed back
Dumb me, Edit, because I just found in the TS4500, i had to tell it that my Virtual Library encryption was "application managed"
I had Veeam set up correctly.
Hopefully I get that speed back
-
- Novice
- Posts: 3
- Liked: never
- Joined: Feb 14, 2023 12:15 pm
- Contact:
Re: Is software encryption fast enough for writing to tape?
Very helpful, thank you!
I thought I had to hit at least the max speed of the drive in order to not have problems, but it appears that the minimum speed allowed with data rate matching for LTO-8 is actually only 112MB/s, so I have a lot less concern about that.
Who is online
Users browsing this forum: No registered users and 7 guests