Discussions specific to the VMware vSphere hypervisor
Post Reply
0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

ChannelError:ConnectionReset

Post by 0zzY » Jul 23, 2015 7:21 am 1 person likes this post

Hi, i have open case 00973559.

The backup log report this: Hot add is not supported for source disk, failing over to network mode. After that i receive the error: ChannelError:ConnectionReset.
On second or third retry the job finish succesfully (using hot add).
This happen for 3-4 vm in different jobs.
We are working on vmware 5.5 and veeam 8.0.0.2030

How can i fix it?

Vitaliy S.
Product Manager
Posts: 22999
Liked: 1557 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: ChannelError:ConnectionReset

Post by Vitaliy S. » Jul 23, 2015 10:05 am

What type of disks do you use for VMs you're backing up with hotadd backup mode?

0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

Re: ChannelError:ConnectionReset

Post by 0zzY » Jul 23, 2015 10:39 am

Hi Vitaliy, disks are all scsi

Vitaliy S.
Product Manager
Posts: 22999
Liked: 1557 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: ChannelError:ConnectionReset

Post by Vitaliy S. » Jul 23, 2015 11:58 am

If all requirements are met for virtual disks, then let's wait till our support team looks through the log files.

0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

Re: ChannelError:ConnectionReset

Post by 0zzY » Jul 23, 2015 5:43 pm

Hi Vitaliy, all requirements are ok, also becouse backup successfully finish on second or third attempt using hotadd

Vitaliy S.
Product Manager
Posts: 22999
Liked: 1557 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: ChannelError:ConnectionReset

Post by Vitaliy S. » Jul 26, 2015 7:58 pm

Is there anything in common for the VMs that fail to be processed in hotadd mode?

0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

Re: ChannelError:ConnectionReset

Post by 0zzY » Jul 27, 2015 9:00 am

I think they are build from the same template.
Another problem (i don't know if it's related to the previous) sometimes one job hang on 99% and all next jobs that are in queue are waiting

Vitaliy S.
Product Manager
Posts: 22999
Liked: 1557 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: ChannelError:ConnectionReset

Post by Vitaliy S. » Jul 27, 2015 11:03 am

Do you have any other VMs to try the hotadd backup mode? Also let's wait for our support team to investigate this problem via log files.

emachabert
Veeam Vanguard
Posts: 373
Liked: 165 times
Joined: Nov 17, 2010 11:42 am
Full Name: Eric Machabert
Location: France
Contact:

Re: ChannelError:ConnectionReset

Post by emachabert » Jul 27, 2015 9:42 pm

last time I saw this type of error it was caused by the vcenter reaching it's conncetion limits.
Veeamizing your IT since 2009/ Vanguard 2015,2016,2017,2018,2019

0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

Re: ChannelError:ConnectionReset

Post by 0zzY » Jul 28, 2015 4:01 pm

Vitaliy S. wrote:Do you have any other VMs to try the hotadd backup mode? Also let's wait for our support team to investigate this problem via log files.
hi vitaliy, yes we have other vm and hot add works fine.

0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

Re: ChannelError:ConnectionReset

Post by 0zzY » Jul 28, 2015 4:04 pm

emachabert wrote:last time I saw this type of error it was caused by the vcenter reaching it's conncetion limits.
what connection limits are you talking about? is it possible to see something about this limit? network graph?

Vitaliy S.
Product Manager
Posts: 22999
Liked: 1557 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: ChannelError:ConnectionReset

Post by Vitaliy S. » Jul 28, 2015 9:01 pm

Since other VMs are backed up without issues then connection limits shouldn't be the case here. What did our support engineer say after reviewing the debug logs?

jbarrow.viracoribt
Expert
Posts: 184
Liked: 18 times
Joined: Feb 15, 2013 9:31 pm
Full Name: Jonathan Barrow
Contact:

Re: ChannelError:ConnectionReset

Post by jbarrow.viracoribt » Aug 13, 2015 7:14 pm

I'm having this same issue and really getting no good solutions from tech support. It only happens when parallel processing is turned on. Case number 00968559 .

veremin
Product Manager
Posts: 16901
Liked: 1438 times
Joined: Oct 26, 2012 3:28 pm
Full Name: Vladimir Eremin
Contact:

Re: ChannelError:ConnectionReset

Post by veremin » Aug 14, 2015 8:34 am

If you're not satisfied with the level of support provided, you can always escalate your case in order for it to be handled by higher tier support engineer. Thanks.

0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

Re: ChannelError:ConnectionReset

Post by 0zzY » Aug 15, 2015 8:03 am

Vitaliy S. wrote:Since other VMs are backed up without issues then connection limits shouldn't be the case here. What did our support engineer say after reviewing the debug logs?

Hi Vitaliy, some days ago i closed the case becouse thought it was solved but i was wrong, so i have opened a new case id 00987387

To be honest not all other vms are backed up successfully and what really happen is the following:

My customer has 2 errors during every backup:
1 - ChannelError:ConnectionReset (we have this error for some backup job but often the backup job end successfully on next retry, but i'd like to know why this happen)
2 - Every night one backup job hang on 99% or 47% (the same vm is always involved, only this night for another one) -> if i look at backup server with vsphere client i can see one disk is "hot-addedd" more than one time, other times the job can't work in hot-add and it switch to newtork mode.
In any event it hangs and i can't stop it, i have to kill all veeamagent process from task manager, so disc consolidation can start automatically and after that rebot backup server.

How can i escalate my case to be handled by higher tier support? It's going on from many days and we need a solution faster

Vitaliy S.
Product Manager
Posts: 22999
Liked: 1557 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: ChannelError:ConnectionReset

Post by Vitaliy S. » Aug 16, 2015 7:23 pm

You can ask your support engineer to escalate the case. BTW, does this issue happen if you switch to network backup mode only?

0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

Re: ChannelError:ConnectionReset

Post by 0zzY » Aug 17, 2015 7:08 am

Vitaliy S. wrote:You can ask your support engineer to escalate the case. BTW, does this issue happen if you switch to network backup mode only?
Hi Vitaliy, this night i have setup my secondary backup proxy to work ONLY on network mode. Now backup goes successfully.
If i set backup proxy on auto, backup job switch from hot-add to newtork mode and backup fails.

Vitaliy S.
Product Manager
Posts: 22999
Liked: 1557 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: ChannelError:ConnectionReset

Post by Vitaliy S. » Aug 17, 2015 10:14 am

Ok, seems like it is indeed an issue with hotadd mode. Let's see what your support engineers say after escalation.

0zzY
Enthusiast
Posts: 58
Liked: 6 times
Joined: Jul 09, 2012 8:01 am
Full Name: 0zzy
Contact:

Re: ChannelError:ConnectionReset

Post by 0zzY » Sep 04, 2015 1:28 pm 1 person likes this post

After disable automount on bacakup proxy http://www.veeam.com/kb1882 , backup jobs are working fine from last week.

bbricker
Enthusiast
Posts: 49
Liked: 23 times
Joined: Feb 10, 2012 8:43 pm
Contact:

Re: ChannelError:ConnectionReset

Post by bbricker » Oct 07, 2015 2:17 pm

I get the "Error: ChannelError: ConnectionReset" message randomly on a failed job on random vm's about once a week. When the job retries with that one vm, it always completes fine. I already had automount disabled.

What is also interesting is that doing a search of that error brings up a Veeam article about Patch 3 for 6.5 where it says it was fixed
http://www.veeam.com/kb1751

Resolved Issues
VMware
• Backup jobs may fail with the error "ChannelError: ConnectionReset"

foggy
Veeam Software
Posts: 18278
Liked: 1564 times
Joined: Jul 11, 2011 10:22 am
Full Name: Alexander Fogelson
Contact:

Re: ChannelError:ConnectionReset

Post by foggy » Oct 07, 2015 3:51 pm

Such issues can have different nature, though report similar error message. That's why it is always recommended to investigate more closely through support.

rikH
Service Provider
Posts: 16
Liked: 1 time
Joined: May 22, 2015 1:44 pm
Full Name: RickH
Contact:

[MERGED] ChannelError: ConnectionReset

Post by rikH » Jun 30, 2016 12:20 pm

I had a couple of backup jobs fail with the following error message. Processing VMXXX Error: ChannelError: ConnectionReset
They did however succeed on the retry.

Can anybody explain what channel error is. For example does it mean I have had a network or SAN disturbance or is it a general message that makes it unclear to whatever the cause is? I don't have a history of these messages and the backups completed ok in the retry but I wondered if I can glean any clues here for things to proactively to check.
I have searched on this but can't say I found a real clear indication of what it is.
Regards Richard

Vitaliy S.
Product Manager
Posts: 22999
Liked: 1557 times
Joined: Mar 30, 2009 9:13 am
Full Name: Vitaliy Safarov
Contact:

Re: ChannelError: ConnectionReset

Post by Vitaliy S. » Jun 30, 2016 12:30 pm

It's hard to say what this error refers to without seeing additional debug logs. Please open a support case and let our team assist you with the required logs review. Once you do this, please post your case ID for future reference.

Post Reply

Who is online

Users browsing this forum: No registered users and 9 guests