Then backup task is run file system go to read-only mode

[lext55]

Hello!

Your support case number is 02400151.

I have some errors with my Asterisk server.

Host: Windows Hyper-V 2012 R2 Core x64 (with all updates)
Veeam Backup & Replication: 9.5.0.823
Name virtual machine: Server-Elastix
OS virtual machine: Centos 5.11 x64 (Elastix-2.5.0-Stable-x86_64-bin-21oct2014.iso)
kernel virtual machine: (uname -a) Linux COMP55555.LOCAL 2.6.18-398.el5 #1 SMP Tue Sep 16 20:50:52 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux
Linux Integration Services guest virtual machine: LinuxIC-4.2.3-1.iso


When the backup task is run, the file system in the guest operating system is set to read-only mode. After reboot guest system, I need run fsck mannualy.

For example, I ran the manual backup task 8:49:45 27.11.2017 , job will be ends 9:07:44 27.11.2017. I quote the logs below.

Code: Select all

cat /var/log/messages
Nov 27 08:34:11 COMP55555 ntpd[2205]: synchronized to 192.36.143.130, stratum 1
Nov 27 08:34:22 COMP55555 ntpd[2205]: time reset +11.428313 s
Nov 27 08:34:22 COMP55555 ntpd[2205]: kernel time sync enabled 0001
Nov 27 08:37:52 COMP55555 ntpd[2205]: synchronized to 195.3.254.2, stratum 2
Nov 27 08:41:05 COMP55555 ntpd[2205]: synchronized to 192.36.143.130, stratum 1
Nov 27 08:51:00 COMP55555 Hyper-V VSS: VSS: op=FREEZE: succeeded 
Nov 27 08:51:00 COMP55555 kernel: storvsc: Current: sense key: Unit Attention
Nov 27 08:51:00 COMP55555 kernel:     Add. Sense: Changed operating definition
Nov 27 08:51:00 COMP55555 kernel: 
Nov 27 08:51:00 COMP55555 kernel: sd 0:0:0:0: Warning! Received an indication that the operating parameters on this target have changed. The Linux SCSI layer does not automatically adjust these parameters.
Nov 27 08:51:00 COMP55555 Hyper-V VSS: VSS: op=THAW: succeeded 
Nov 27 08:54:45 COMP55555 ntpd[2205]: time reset +11.454263 s
Nov 27 08:54:53 COMP55555 avahi-daemon[3000]: Invalid query packet.
Nov 27 08:56:05 COMP55555 last message repeated 3 times
Nov 27 08:56:42 COMP55555 last message repeated 10 times
Nov 27 08:57:57 COMP55555 ntpd[2205]: synchronized to 195.3.254.2, stratum 2
Nov 27 09:01:08 COMP55555 avahi-daemon[3000]: Invalid query packet.
Nov 27 09:01:12 COMP55555 last message repeated 2 times
Nov 27 09:02:12 COMP55555 ntpd[2205]: synchronized to 192.36.143.130, stratum 1
Nov 27 09:02:12 COMP55555 avahi-daemon[3000]: Invalid query packet.
Nov 27 09:03:10 COMP55555 last message repeated 4 times
Nov 27 09:06:40 COMP55555 last message repeated 6 times
Nov 27 09:17:31 COMP55555 syslogd 1.4.1: restart.

I think you need to pay attention to this piece of log
Nov 27 08:51:00 COMP55555 kernel: sd 0:0:0:0: Warning! Received an indication that the operating parameters on this target have changed. The Linux SCSI layer does not automatically adjust these parameters.





P.S.: What we need to update to a more recent version of Linux, we know. But we use a regular version of elastix, with a very large number of self-written code. Implement all this functionality on a fresh Linux distribution, it will take a long time and money.
P.P.S.: Sorry for my english.

[Mike Resseler]

Hi Andrey,

First: Welcome to the forums

From the logs it is difficult for us to figure out why it makes the system inconsistent. Since you have a case number (thanks for posting it here!) keep working with our support engineers and let us know what the outcome is.

Thanks
Mike

[lext55]

Hello!

I try to collect logs https://www.veeam.com/kb1832 . But Select Jobs -> Jobs is empty .

I resolve problem by himself .

Steps to resolve:

1. Uninstall LinuxIC-4.2.3-1.iso run

./uninstall.sh

Script says remove hda=noprobe hdb=noprobe. But do not do this, because kernel-2.6.18-398.el5 has inbuild hyper-v modules (version 3.1).

2. Reboot the system.

3. Connect Centos Vault repository. You need to edit file /etc/yum.repos.d/CentOS-Base.repo

Code: Select all

nano /etc/yum.repos.d/CentOS-Base.repo

cat /etc/yum.repos.d/CentOS-Base.repo 
# CentOS-Base.repo
#
# The mirror system uses the connecting IP address of the client and the
# update status of each mirror to pick mirrors that are updated to and
# geographically close to the client.  You should use this for CentOS updates
# unless you are manually picking other mirrors.
#
# If the mirrorlist= does not work for you, as a fall back you can try the 
# remarked out baseurl= line instead.
#
#

[base]
name=CentOS-$releasever - Base
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=os
#baseurl=http://mirror.centos.org/centos/$releasever/os/$basearch/
baseurl=http://vault.centos.org/5.11/os/x86_64/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5

#released updates 
[updates]
name=CentOS-$releasever - Updates
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=updates
#baseurl=http://mirror.centos.org/centos/$releasever/updates/$basearch/
baseurl=http://vault.centos.org/5.11/updates/x86_64/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5

#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=extras
#baseurl=http://mirror.centos.org/centos/$releasever/extras/$basearch/
baseurl=http://vault.centos.org/5.11/extras/x86_64/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5

#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-$releasever - Plus
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=centosplus
#baseurl=http://mirror.centos.org/centos/$releasever/centosplus/$basearch/
baseurl=http://vault.centos.org/5.11/centosplus/x86_64/
gpgcheck=1
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5

#contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=contrib
#baseurl=http://mirror.centos.org/centos/$releasever/contrib/$basearch/
baseurl=http://vault.centos.org/5.11/contrib/x86_64/
gpgcheck=1
enabled=0
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5

4. Check for available package updates using yum

yum check-update

5. Update kernel kernel-2.6.18-398.el5.x86_64.rpm -> kernel-2.6.18-419.el5.x86_64.rpm

old kernel http://vault.centos.org/5.11/os/x86_64/ ... x86_64.rpm
new kernel http://vault.centos.org/5.11/updates/x8 ... x86_64.rpm

yum install kernel.x86_64 kernel-devel.x86_64 kernel-headers.x86_64

During kernel installation, do not enter at once "y" -> first check kernel version .

6. Reboot system.

7. Install hv_vss_daemon , hv_kvp_daemon , hv_fcopy_daemon .

From image LinuxIC-4.2.3-1.iso you need to unpack /usr/src/linux-ic-4.2.3-1/CentOS511_UPDATE/lis-511/x86_64/microsoft-hyper-v-4.2.3.1-20171102.x86_64.rpm

You need copy files from package on his places is system .

Please copy this files:

Code: Select all

/usr/sbin/hv_fcopy_daemon
/usr/sbin/hv_get_dhcp_info
/usr/sbin/hv_get_dns_info
/usr/sbin/hv_kvp_daemon
/usr/sbin/hv_set_ifconfig
/usr/sbin/hv_vss_daemon
/etc/X11/xorg.conf
/etc/init.d/hv_vss_daemon
/etc/init.d/hv_kvp_daemon
/etc/init.d/hv_fcopy_daemon

Do not copy this file

Code: Select all

/opt/files/updategrub.pl

Add hv_vss_daemon , hv_kvp_daemon , hv_fcopy_daemon in autostart

Code: Select all

/sbin/chkconfig hv_vss_daemon on
/sbin/chkconfig hv_kvp_daemon on
/sbin/chkconfig hv_fcopy_daemon on

Do not install kmod-microsoft-hyper-v-4.2.3.1-20171102.x86_64.rpm microsoft-hyper-v-debuginfo-4.2.3.1-20171102.x86_64.rpm

8. Reboot the system
9. Try to start Veeam Backup or Hyper-V VSS snapshot . All must work fine.

Why I not use `rpm -i` command to install microsoft-hyper-v-4.2.3.1-20171102.x86_64.rpm ? Because we must to use inbuild kernel modules (version 3.1). Because we need use default initrd ram disk. Rpm package regenerate initrd with new hyper-v kernel modules, blacklisted inbuild kernel hyperv modules, new modules have problems with VSS based backup.

This in not Veeam problem, this is Microsoft problem.

P.S.:
I find original problem https://lists.debian.org/debian-kernel/ ... 00178.html and https://social.technet.microsoft.com/Fo ... ed-backups
And i find set of patches that need to be superimposed on the kernel https://bugs.launchpad.net/ubuntu/+sour ... comments/1
But my kernel is so old, more than half of the patches are not applied.

P.P.S: Maybe you will add to the description of the system requirements for CentOS 5.11, that guest add-ons work only with kernel modules not higher than version 3.1. That other users do not spend so much time on patching the kernel, and selecting the working combination kernel / initrd / hyper-v modules kernel / guest services.