OFED bug. SRP_DAEMON don't generate scsi device

Infrastructure & Networking Software And Drivers Mellanox OFED
1

OS CentOS 7.7

OFED MLNX_OFED_LINUX-4.7-1.0.0.1-rhel7.7

Base OS ofed work fine. srp scsi devices present, multipath work.

Install fresh MLNX_OFED_LINUX-4.7-1.0.0.1-rhel7.7

srp get srp devices but not generate scsi devices.

More info:

[root@s003 ~]# lsscsi

[0:0:0:0] disk ATA WDC WD6000BLHX-6 5G04 /dev/sda

[1:0:0:0] disk ATA WDC WD6000BLHX-6 5G04 /dev/sdb

[root@s003 ~]# ibsrpdm -c

id_ext=248a0703006dd800,ioc_guid=248a0703006dd800,dgid=fe80000000000000248a0703006dd801,pkey=ffff,service_id=248a0703006dd800

id_ext=248a0703006f2510,ioc_guid=248a0703006f2510,dgid=fe80000000000000248a0703006f2511,pkey=ffff,service_id=248a0703006f2510

id_ext=e0247f8888a68c24,ioc_guid=e0247f8888a68c24,dgid=fe80000000000000e0247f8888a68c25,pkey=ffff,service_id=e0247f8888a68c24

id_ext=e0247f8888a68c24,ioc_guid=e0247f8888a68c24,dgid=fe80000000000000e0247f8888a68c26,pkey=ffff,service_id=e0247f8888a68c24

id_ext=e41d2d0300e09840,ioc_guid=e41d2d0300e09840,dgid=fe80000000000000e41d2d0300e09841,pkey=ffff,service_id=e41d2d0300e09840

id_ext=248a0703006dbf40,ioc_guid=248a0703006dbf40,dgid=fe80000000000000248a0703006dbf41,pkey=ffff,service_id=248a0703006dbf40

id_ext=248a0703006ddb50,ioc_guid=248a0703006ddb50,dgid=fe80000000000000248a0703006ddb51,pkey=ffff,service_id=248a0703006ddb50

id_ext=248a0703006f2560,ioc_guid=248a0703006f2560,dgid=fe80000000000000248a0703006f2561,pkey=ffff,service_id=248a0703006f2560

id_ext=248a0703006ddd60,ioc_guid=248a0703006ddd60,dgid=fe80000000000000248a0703006ddd61,pkey=ffff,service_id=248a0703006ddd60

id_ext=248a0703006f2570,ioc_guid=248a0703006f2570,dgid=fe80000000000000248a0703006f2571,pkey=ffff,service_id=248a0703006f2570

id_ext=e0247f8888a68c74,ioc_guid=e0247f8888a68c74,dgid=fe80000000000000e0247f8888a68c75,pkey=ffff,service_id=e0247f8888a68c74

id_ext=e0247f8888a68c74,ioc_guid=e0247f8888a68c74,dgid=fe80000000000000e0247f8888a68c76,pkey=ffff,service_id=e0247f8888a68c74

id_ext=248a0703006ddd80,ioc_guid=248a0703006ddd80,dgid=fe80000000000000248a0703006ddd81,pkey=ffff,service_id=248a0703006ddd80

id_ext=248a0703006f2590,ioc_guid=248a0703006f2590,dgid=fe80000000000000248a0703006f2591,pkey=ffff,service_id=248a0703006f2590

id_ext=248a0703006bdb90,ioc_guid=248a0703006bdb90,dgid=fe80000000000000248a0703006bdb91,pkey=ffff,service_id=248a0703006bdb90

id_ext=248a0703006ddc90,ioc_guid=248a0703006ddc90,dgid=fe80000000000000248a0703006ddc91,pkey=ffff,service_id=248a0703006ddc90

id_ext=248a0703006de290,ioc_guid=248a0703006de290,dgid=fe80000000000000248a0703006de291,pkey=ffff,service_id=248a0703006de290

id_ext=248a0703006dbfa0,ioc_guid=248a0703006dbfa0,dgid=fe80000000000000248a0703006dbfa1,pkey=ffff,service_id=248a0703006dbfa0

id_ext=248a0703006dd7c0,ioc_guid=248a0703006dd7c0,dgid=fe80000000000000248a0703006dd7c1,pkey=ffff,service_id=248a0703006dd7c0

id_ext=e41d2d0300e093e0,ioc_guid=e41d2d0300e093e0,dgid=fe80000000000000e41d2d0300e093e2,pkey=ffff,service_id=e41d2d0300e093e0

id_ext=248a0703006dd7f0,ioc_guid=248a0703006dd7f0,dgid=fe80000000000000248a0703006dd7f1,pkey=ffff,service_id=248a0703006dd7f0

[root@s003 ~]# ibsrpdm

IO Unit Info:

port LID: 0017

port GID: fe80000000000000248a0703006dd801

change ID: 0001

max controllers: 0x10

controller[ 1]

GUID: 248a0703006dd800

vendor ID: 000002

device ID: 001003

IO class : 0100

ID: Linux SRP target

service entries: 1

service[ 0]: 248a0703006dd800 / SRP.T10:248a0703006dd800

…

…

[root@s003 ~]# lsscsi

[0:0:0:0] disk ATA WDC WD6000BLHX-6 5G04 /dev/sda

[1:0:0:0] disk ATA WDC WD6000BLHX-6 5G04 /dev/sdb

[root@s003 ~]# multipath -ll

2

Hello Shabarchin,

Many thanks for posting your issue on the Mellanox Community.

Based on the information provided, we were able to successfully connect to our SRP target.

SRP target (as we do not provide an ‘ib_srpt’ module with our Mellanox OFED driver, only the initiator module ‘ib_srp’)

SRP Initiator:

  • OS: CentOS Linux release 7.7.1908 (Core)
  • Kernel: 3.10.0-1062.el7.x86_64
  • Drivers: MLNX_OFED_LINUX-4.7-1.0.0.1

If you still experiencing an issue after you validated if the above works for you as well, we need to debug further based on your setup. For this, please open a Mellanox Support ticket through support@mellanox.com (Valid Support contract required).

Many thanks,

~Mellanox Technical Support