Problem with Linux ISCSI direct SAN backup hanging. Restarting ISCSID unsticks it

[GarethUK]

Hi,

We're using Redhat 8 non hardened with VMWARE 7 and Datacore San Symphony. We will be moving to hardened.

We've been using direct SAN backup but are finding it to be unreliable.

We see jobs hang. After looking into it we see lots of lines of logging in the .resources log which just cycles for hours.

However, I found that if I restart ISCSID it kicks back into life. But we then see

29.03.2024 03:09:52.863] <139809490196224> dsk | End of output for command 'ls /dev/disk/by-path | grep iscsi'
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Found less ISCSI targets associated with physical devices than are connected
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Rescan path '/sys/class/block//device/rescan' doesn't exist
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Rescan path '/sys/class/block//device/rescan' doesn't exist
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Rescan path '/sys/class/block//device/rescan' doesn't exist
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Rescan path '/sys/class/block//device/rescan' doesn't exist
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Rescan path '/sys/class/block//device/rescan' doesn't exist
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Rescan path '/sys/class/block//device/rescan' doesn't exist
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Rescan path '/sys/class/block//device/rescan' doesn't exist
[29.03.2024 03:09:53.864] <139809490196224> dsk | WARN|Rescan path '/sys/class/block//device/rescan' doesn't exist
[29.03.2024 03:09:53.864] <139809490196224> cli | Method [VMFSSAN.RefreshISCSISessionList] completed. Elapsed time: [00:00:04.964]
[29.03.2024 03:09:53.865] <139809490196224> cli | - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
[29.03.2024 03:09:53.865] <139809490196224> cli | Result
[29.03.2024 03:09:53.865] <139809490196224> cli | (EStringArray) IQN[] =
[29.03.2024 03:09:53.865] <139809490196224> cli | {
[29.03.2024 03:09:53.865] <139809490196224> cli | iqn.2000-08.com.datacore:san-

The path '/sys/class/block//device/rescan' is obviously incorrect. Has anyone seen anything like this or can suggest next steps for debugging? We have been talking to support for an extended period now and not seeing any resolution.

Any help very much appreciated.

Gareth

[Sturniolo]

Hey @GarethUK

Do you have a case open with our support?

If not, that is the best course of action.