Discussions specific to tape backups
Post Reply
Didi7
Expert
Posts: 337
Liked: 32 times
Joined: Oct 17, 2014 8:09 am
Contact:

Veeam B&R v9.5 U4b (Confirmations) ...

Post by Didi7 » Aug 09, 2019 10:46 am 5 people like this post

Hello everybody,

I would like to inform you, that we had no issues with tape media and the tape library upgrading from Veeam B&R v9.5 U4 to U4b (2 weeks ago) so far. In this environment we have ...

* HPE DL180 G6 Server (QuadCore-CPU and 8GB RAM) with Windows Server 2008R2 SP1 with all Windows Updates
* HPE MSL2024 LTO-6 tape library

In the upcoming weeks we will continue to upgrade the remaining Veeam B&R 9.5 U4 servers to U4b (dissimilar HW-configurations).

All Veeam servers without tape infrastructure components are already running with Veeam B&R 9.5 U4b successfully.

Will post further results as time goes by.

Regards,
Didi7
Using the most recent Veeam B&R in 18 different environments now and counting!

Dima P.
Product Manager
Posts: 10421
Liked: 843 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Dima P. » Aug 09, 2019 3:37 pm

Hello Didi7,

Thank you for sharing! Side note - I'd strongly recommended to install the following patch after deploying Update 4b - KB 2983 just to be safe (based on users reports standalone devices below LTO6 are affected, but I'd install this hotfix anyway). Cheers!

CPCS
Influencer
Posts: 17
Liked: 4 times
Joined: Mar 01, 2016 1:49 pm
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by CPCS » Aug 12, 2019 7:21 am 1 person likes this post

I just stumbled over this thread, thanks to the Newsletter!

I am struggling with "this" issues for nearly two weeks now and on Friday I finally ordered spare HBA and cabling due to Windows throwing LSI_SAS Controller Errors, HP Support kind of confirmed LTO-drive Problems and cross-checking of ports and cabling also didn’t changed anything. Due to the error didn’t Pop up right away after the upgrade and also was not constant, i could bight me in the ass not opening a Veeam ticket also....

Especially because i already spotted that Veeam was only doing Software encryption anymore, but i could really tell if it was Hardware before, because there was also the HPE HW Encryption kit for a few k€ when i set this up.

After installing the patch Hardware encryption works again and backup is running at this moment

I would like to add that we are using a library and not a standalone drive!

HP DL380p gen8 with HBA H221
HP MSL4048 SAS 2x LTO-5 (3000)

timlongbotham
Novice
Posts: 7
Liked: never
Joined: May 09, 2011 7:45 am
Full Name: Tim Longbotham
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by timlongbotham » Aug 12, 2019 8:44 am

Lucky you Didi7! My pain continues...

Dima P.
Product Manager
Posts: 10421
Liked: 843 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Dima P. » Aug 12, 2019 11:05 am

Hello Tim,

Any chance you have a case ID to shared? I'd love to help you to get it resolved. Cheers!

kmbelt
Influencer
Posts: 12
Liked: never
Joined: Sep 08, 2014 4:08 pm
Full Name: Kevin Belt
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by kmbelt » Aug 12, 2019 5:38 pm

CPCS wrote:
Aug 12, 2019 7:21 am
I just stumbled over this thread, thanks to the Newsletter!

I am struggling with "this" issues for nearly two weeks now and on Friday I finally ordered spare HBA and cabling due to Windows throwing LSI_SAS Controller Errors, HP Support kind of confirmed LTO-drive Problems and cross-checking of ports and cabling also didn’t changed anything. Due to the error didn’t Pop up right away after the upgrade and also was not constant, i could bight me in the ass not opening a Veeam ticket also....

Especially because i already spotted that Veeam was only doing Software encryption anymore, but i could really tell if it was Hardware before, because there was also the HPE HW Encryption kit for a few k€ when i set this up.

After installing the patch Hardware encryption works again and backup is running at this moment

I would like to add that we are using a library and not a standalone drive!

HP DL380p gen8 with HBA H221
HP MSL4048 SAS 2x LTO-5 (3000)
I'm having some issues with mine also. I have DL servers at least Gen8 and a gen 9 or two hosting hp libraries.

MSL4048 with 2 x LTO6 - Can see library but drives are offline and cannot be changed
MSL2024 with 2 x LTO5 - I/O error
1/8 Autoloader with LTO4 - I/O error

All 3 quit working. Opened a ticket, but support takes a couple days to get back to me. I have done the upgrade twice now because i cannot go a week without writing to my tape. I have tried a couple different fixes they sent, but none rectified the issue for me. I'll hold out for now i guess.

Regnor
Service Provider
Posts: 316
Liked: 62 times
Joined: Jan 31, 2011 11:17 am
Full Name: Max
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Regnor » Aug 13, 2019 7:01 am

We've also had I/O errors with different tape devices at a customer after upgrading and received a hotfix which solved the problem/errors.
I'm not sure if you're affected by the same problem, but please ask support if there's a hotfix available.

Hauke
Influencer
Posts: 15
Liked: 1 time
Joined: Apr 16, 2015 11:25 am
Full Name: Hauke Ihnen
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Hauke » Aug 15, 2019 8:18 am

We had the same issues, tape backups not working after 4b installation.

HPE MSL4048 tape library with 2*LTO6 drives. Latest firmware's.

Looks like KB2983 fixed the issues, currently testing tape inventory. Looking good. Will test a backup job later.

[01.08.2019 12:35:40] < 2572> mt | WARN|The semaphore timeout period has expired.
[01.08.2019 12:35:40] < 2572> mt | >> |DeviceIoControl fails or is pending.
[01.08.2019 12:35:40] < 2572> mt | >> |--tr:Error code: 0x00000079
[01.08.2019 12:35:40] < 2572> mt | >> |--tr:Failed to disable hardware encryption.
[01.08.2019 12:35:40] < 2572> mt | ERR |Checksum error was detected in CommonBlockHeader, startOffset: 0, endOffset: 52.
[01.08.2019 12:35:40] < 2572> mt | >> |--tr:TapeReader failed to read media header.
[01.08.2019 12:35:40] < 2572> mt | >> |An exception was thrown from thread [2572].

Didi7
Expert
Posts: 337
Liked: 32 times
Joined: Oct 17, 2014 8:09 am
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Didi7 » Aug 29, 2019 3:47 pm 1 person likes this post

Guys, I am currently in the process to upgrade 5 VBR-servers from VBR 9.5 U4 to 9.5 U4b. These are the specs of the servers ...

1) HPE DL380 Gen10 server (16-Cores-CPU and 32GB RAM) with Windows Server 2016 fully patched with MSL2024 SAS tape library, 1x LTO7-drive
2) HPE DL380 Gen9 server (32-Cores-CPU and 128GB RAM) with Windows Server 2012R2 fully patched with MSL2024 SAS tape library, 1x LTO7-drive
3) HPE DL380 G6 server (16-Cores-CPU and 48GB RAM) with Windows Server 2012R2 fully patched with MSL4048 FC tape library, 2x LTO6-drive
4) HPE DL380p G8 server (4-Cores-CPU and 64GB RAM) with Windows Server 2012R2 fully patched with MSL2024 SAS tape library, 1x LTO6-drive
5) HPE DL380 Gen9 server (48-Cores-CPU and 64GB RAM) with Windows Server 2012R2 fully patched with MSL2024 SAS tape library, 1x LTO5-drive

Pretty nice mix, if you ask me.

Will post the results next week, as soon as I have time. Last Friday of the month (tomorrow) is Active full backup time ;)

Best regards,
Didi7
Using the most recent Veeam B&R in 18 different environments now and counting!

Didi7
Expert
Posts: 337
Liked: 32 times
Joined: Oct 17, 2014 8:09 am
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Didi7 » Sep 02, 2019 4:16 pm 1 person likes this post

Hi everybody,

monthly fulls on all 5 upper mentioned VBR-servers went flawlessly, tape-infrastructure worked as it should!

I can successfully confirm, that the upgrade from VBR 9.5 U4 to VBR 9.5 U4b worked like a charm, all tape media is correctly located in their defined media pools!

With this last upgrade of those 5 VBR-servers, we now have 13 of 18 VBR-servers on VBR 9.5 U4b, 6 of them working flawlessly with tape libraries, 5 of them working flawlessly without any tape infrastructure.

Next step is the upgrade of the last 5 VBR-servers running VBR 9.5 U4 to VBR 9.5 U4b. Those VBR-servers have just a single tape drive (HPE LTO7) with forward forever incremental B2D-jobs and synthetic fulls with B2T-jobs.

Regards,
Didi7
Using the most recent Veeam B&R in 18 different environments now and counting!

Dima P.
Product Manager
Posts: 10421
Liked: 843 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Dima P. » Sep 02, 2019 4:48 pm

Hello Didi7,

Thank you for updating this thread and glad to hear that all works without any issues! Cheers!

ccouchman
Novice
Posts: 3
Liked: 1 time
Joined: Sep 03, 2019 4:27 am
Full Name: Russ Couch
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by ccouchman » Sep 03, 2019 4:40 am

Hi Folks

I upgraded our production server (Windows Server 2012R2 + MSL4048 LTO6 x 2) and both drives were disabled afterwards, tried KB 2983 but this didn't work. Logged a case and once I finally got to L2/L3 support they put in a non-public fix which worked instantly. Now on Monday after the weekend backups have completed and some tapes swapped out I have a new issue which I believe is related, the inventory of the library/drives won't update (say library state is inconsistent and repeats this until I stop the job) and no jobs will run due to various mismatch of where tapes are. Has anybody struck this? Our DR server seems fine (Windows Server 2016 + MSL4048) and is currently pulling some flat file backups to tape.

Thanks
Russ..

wishr
Veeam Software
Posts: 1067
Liked: 108 times
Joined: Aug 07, 2018 3:11 pm
Full Name: Fedor Maslov
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by wishr » Sep 03, 2019 8:27 am

Hi Russ,

Sad to hear you got into such a situation. I'd suggest you to continue the conversations with our support engineers to get it fully resolved. Could you please let us know your case ID?

Thanks

ccouchman
Novice
Posts: 3
Liked: 1 time
Joined: Sep 03, 2019 4:27 am
Full Name: Russ Couch
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by ccouchman » Sep 03, 2019 10:37 am

Hi

Case # 03741776. We did some more troubleshooting tonight after struggling to get past level 1 all day and being told that the case can't be a sev1 as its for tape....we have a few jobs that go straight to tape on a daily basis that are critical to us, not happy! We tried a new database to clear out any corruptions, re-installed all tape/library drivers plus a load of other steps. Seems we need older code to enable the drive but this isn't compatible with the 4b code, some talk about developing some custom patch for this situation...but nothing back in writing.

Thanks
Russ

Dima P.
Product Manager
Posts: 10421
Liked: 843 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Dima P. » Sep 03, 2019 4:34 pm

Hello Russ,

I've asked our T3 support team to review the case details. Stay tuned.

ccouchman
Novice
Posts: 3
Liked: 1 time
Joined: Sep 03, 2019 4:27 am
Full Name: Russ Couch
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by ccouchman » Sep 04, 2019 12:39 am 1 person likes this post

Hi

We have a custom patch applied and everything looks back to normal. However, I did have to ring this morning to recieve this rather than receiving a case update when it was avaialble. I would have happily applied the update last night so tape jobs could run. Also, seems that their is no real urgency on tape related cases as it is seen as non-critical.

Russ

Dima P.
Product Manager
Posts: 10421
Liked: 843 times
Joined: Feb 04, 2013 2:07 pm
Full Name: Dmitry Popov
Location: Prague
Contact:

Re: Veeam B&R v9.5 U4b (Confirmations) ...

Post by Dima P. » Sep 04, 2019 5:18 pm

Hello Russ,

This is the first time we faced such problem and investigation took longer than expected, sorry for that. I am glad to hear that your tape jobs are up and running. Please let us know if any additional help is required. Cheers!

Post Reply

Who is online

Users browsing this forum: No registered users and 2 guests