Comprehensive data protection for all workloads
Post Reply
AlainRussell
Enthusiast
Posts: 49
Liked: 1 time
Joined: Aug 27, 2011 12:04 am
Full Name: Alain Russell
Contact:

Offsite Backup failing since 9.5 U3 - Support Case #02433569

Post by AlainRussell »

Hi, wondering if anyone else has seen an issue with offsite backups failing to a linux target (Synology NAS) since 9.5 U3.

We're getting the error below on all VMs

Code: Select all

Error: Channel errorOffset and length were out of bounds for the array or count is greater than the number of elements from index to the end of the source collection. Maximum retry count reached (5 out of 5)
The configuration backup job is failing with the error below (also since the upgrade to U3)

Code: Select all

21/12/2017 10:01:19 a.m. Error during request file item '/volume1/VeeamBackup/VeeamConfigBackup/VEEAM-BACKUP'
21/12/2017 10:01:19 a.m. Error Moving configuration backup to repository Office Repository
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by foggy »

Hi Alain, we haven't seen this issue reported before, please continue investigating with your support engineer. I can see that your case is already moving on.
dennism82
Novice
Posts: 4
Liked: never
Joined: Dec 19, 2017 2:59 pm
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by dennism82 »

I had the same issue after migrating from CIFS to Linux on my synology's. Reverted back to CIFS for now for the BCJ's, normal backups are still going on the linux repository as they seem to have no issue.

Should you get a solution i'm very interested.
AlainRussell
Enthusiast
Posts: 49
Liked: 1 time
Joined: Aug 27, 2011 12:04 am
Full Name: Alain Russell
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by AlainRussell »

I've switched to CIFS for the Christmas break, the re-mapped backups were picked up ok and are processing without error now.
Robvil
Expert
Posts: 172
Liked: 20 times
Joined: Oct 03, 2016 12:41 pm
Full Name: Robert
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by Robvil »

I am seeing the same issue and i am also backup up to a linux over ssh.
I am not able to switch to smb/cifs as this would require the load to be moved to my veeam VBR server which is on another site. Too much traffic going over the wan.
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by veremin »

Just to clarify - you started seeing this issue immediately after update (before that everything had worked smoothly)? What type of job are you using? Backup or backup copy one? Have you switched repositories recently?

Also, do you mind opening a support ticket and providing support team with corresponding logs?

Thanks.
Robvil
Expert
Posts: 172
Liked: 20 times
Joined: Oct 03, 2016 12:41 pm
Full Name: Robert
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by Robvil »

started hust after updating to U3 and everything worked smoothly until then.
It is a backup copy job.

I have opened a case and provided my logs. Case number 02454477
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by veremin »

Passed the information to our QA team; will update the topic, once more information is available. Thanks.
Robvil
Expert
Posts: 172
Liked: 20 times
Joined: Oct 03, 2016 12:41 pm
Full Name: Robert
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by Robvil »

Tried to re-create the backup copy job, and remap, but same error. Now data is transfered to the repository.
Now some of my backups of VM suddenly starts to not use CBT several days after upgrading to update3.

This update seems very buggy.
Gostev
Chief Product Officer
Posts: 31457
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by Gostev »

Hi all, the issue is believed to be caused by non-standard transmit window size used by some SSH servers, and the hot fix is currently in testing. Thanks!
Robvil
Expert
Posts: 172
Liked: 20 times
Joined: Oct 03, 2016 12:41 pm
Full Name: Robert
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by Robvil »

Got a hotfix today from support which seems to fix the issue
Martin Damgaard
Influencer
Posts: 19
Liked: 8 times
Joined: Aug 31, 2015 6:31 am
Full Name: Martin Damgaard
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by Martin Damgaard »

Gostev wrote:Hi all, the issue is believed to be caused by non-standard transmit window size used by some SSH servers, and the hot fix is currently in testing. Thanks!
What is the easiest way to get this hotfix?

I am currently seeing the excact same problem on our Synology Linux repository, after upgrading to 9.5 U3.
Backup copies seems to be transferred OK. But it gets stuck around 85% on merging.

Stragely enough our QNAP Linux repository at another remote location (same Veeam B&R server) have not showed any issues.
veremin
Product Manager
Posts: 20270
Liked: 2252 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by veremin »

The easiest way is to open a support ticket, let support engineer check whether the root cause for the problem experienced is the same and apply the hot fix, if necessary. Thanks.
omegagx
Enthusiast
Posts: 68
Liked: 4 times
Joined: May 09, 2017 6:33 pm
Full Name: Mike G
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by omegagx »

What's the link to the KB article describing this issue? I assume since the issue was serious enough to require a hotfix, it warrants a KB article.
It would be much easier and faster to read that and check if the issue I am encountering is the same as the one above than opening a support incident and waiting for support.

Thank you.
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp »

Hi folks,

I got exactly the same issue. It does work fine on our local Synology NAS, but it failed on our remote NAS (connected through a Watchguard VPN).
How shall I process to get the hotfix?

BR,
Seb
foggy
Veeam Software
Posts: 21069
Liked: 2115 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by foggy »

Hi Seb, please contact technical support.
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp »

OK, I will do.
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp » 1 person likes this post

OK. It is done.
Case number is 03006859.

BR,
Seb
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp » 1 person likes this post

Veeam support send me the hotfix yesterday (less than 1h after opening the case).
Since I installed the hotfix, all backup jobs ran 2 times on our offsite Synology NAS (DS1817+).
We got 6 backup jobs (2 Linux Agent Backup + 17 VMs).
It worked flawless. So, it seems the issue is gone after applying the hotfix.
BTW, the backups are much much faster with the "Linux" server repo type, than in CIFS mode!
I will wait few days more before closing my case (just to be sure). I'm a happy customer. :mrgreen:

Seb
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp »

Hi folk,

Do you know if this issue has been fixed in the latest Veeam Backup & Replication 9.5 Update 3a?
Can I safely updated to the version 9.5.0.1922?

BR,
Seb
Gostev
Chief Product Officer
Posts: 31457
Liked: 6648 times
Joined: Jan 01, 2006 1:01 am
Location: Baar, Switzerland
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by Gostev »

All Update 3 hotfixes that were issued before beginning of June should be automatically included in Update 3a.
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp » 1 person likes this post

Perfect!
I will do the upgrade now.
I will post the results.
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp » 1 person likes this post

Backups have been launched 3x without a glitch.
So, the hot-fix mentioned in this topic is definitely included in the update 9.5U3a.
jerardchilton
Lurker
Posts: 2
Liked: never
Joined: Jul 12, 2018 4:30 pm
Full Name: jerard chilton
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by jerardchilton »

Hey Seb, my company has just bought a load of Synology's DS1817+ that they want to use as cheap back up devices and they have VEEAM so I wondered if you could help me understand back up options. From what I researched it looks like I can't use the DS1817+ as a back up repository cos it doesn't really have a Wins/Linux OS so options include setting it up as a iscsi target for a Wins Server2016 or Linux server.

Do you have a view on which flavour of OS to use - notwithstanding the licences costs etc? Do I consider iscsi block or file set up on the NAS? Or consider setting it up as CIFS. Do I set it up to consist of one big LUN and 1 target or several LUNS/iscsi targets?

Sorry for the bunch of questions but am keen to learn and you seem to know what do do?

Kind regards
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp »

Hi Jerard,

Sorry for the late answer. I was out of the office for a couple of weeks.
The best way to use Synology NAS, is to set it up as a Linux server through Perl package.
This is working very well.
Here are the steps:
From the Synology NAS web interface:
- Control Panel/Terminal & SNMP: Enable SSH
- Click on "Advanced Settings" and change the cipher strength to "Low" (Veeam doesn't support even the medium strength ciphers).
- Control Panel/File Services/FTP: Enable sFTP.
- Control Panel/User/Advanced: Enable the user home service.
- Control Panel/Shared Folder. Create a shared folder and grant "admin" access to it.
- Package Centre: Search for Perl. It will be listed under "Third Party". Click install.

Then in Veeam:
- Backup infrastructure (bottom left of the Veeam console).
- Click on "Managed Servers".
- Click on "Add Server" (top left).
- Select LINUX
- Specify the IP address of the NAS.
- Tell it to login with the "admin" account. DO NOT select to use an elevated account, otherwise you will get a "failed to start PerlSoap protocol" error message. The "admin" account has access to everything it needs without any extra permissions.
- Click on "Backup Repositories".
- Click on "Add Repository" (top left).
- Select "Linux server" as type of repo.
- On the next step, when you click on the "Populate" button, you should see all NAS folders. If not, something is not setup properly (SSH, Perl package, login setup, etc...).
- Select the path.

You are done.
:)

Since the NAS (through Perl command) does lot of handshake work (probably some hash process), the backups are very fast. This is good for offsite backup, cos most of the traffic is from Veeam to the NAS. There is nearly no traffic from the NAS to VEEAM (probably all writing checks are done on the CPU of the NAS).

I hope this help.

Seb
jerardchilton
Lurker
Posts: 2
Liked: never
Joined: Jul 12, 2018 4:30 pm
Full Name: jerard chilton
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by jerardchilton »

Seb, thanks for the guidance. I get as far as adding the Linux server as a back up repository but then it throws an error during a rescan of agent back up "unable to install back up agent, cannot connect to <ip address> Error : /tmp/******.

Its weird when using the Add server wizard in the server the mount points to the Linux file system in the back up repository view e.g /volume1/ but not any shared folders I created. On the tab Repositry I can browse to the shared folder I created and it can populate the details but when I reach the end of the wizard it fails as mentioned above.

I've followed your instructions above. Currently running VEEAM 9.5.3U3a (latest) and DSM6.2.

Any ideas about this error????
Many thanks
SebCharp
Enthusiast
Posts: 29
Liked: 6 times
Joined: May 15, 2018 4:03 pm
Full Name: S. Charpentier
Contact:

Re: Offsite Backup failing since 9.5 U3 - Support Case #0243

Post by SebCharp »

Hi Jerard,

I didn't get this error.... So I don't have any idea about where your problem comes from.
I also used the latest VEEAM and the latest DSM on our Synologys.

Are you using the IP address or a "DNS" address?
I my case, Synology NAS got a fixed IP address. Then I'm using those IP.
Are you using the "admin" credentials for the NAS connection?
Did you create the destination folder in the NAS and correctly setup the permissions?

I don't know if this can help you, but here is a documentation which I wrote (in French) → VEEAM - Synology NAS.pdf

Seb
Post Reply

Who is online

Users browsing this forum: ante_704, ds_nl, Google [Bot], Helge.T and 267 guests