I am trying NVMeOF with RoCE on SLES 12 SP3 using the document
HowTo Configure NVMe over Fabrics https://community.mellanox.com/s/article/howto-configure-nvme-over-fabrics
I am noticing that whenever the initiator is having > 32 cores, the initiator is unable to discover/connect to the target. The same procedure works fine if the number of cores <= 32.
kernel: [ 373.418811] nvme_fabrics: unknown parameter or missing value ‘hostid=a61ecf3f-2925-49a7-9304-cea147f61ae’ in ctrl creation request
for a successful connection:
[51354.292021] nvme nvme0: creating 32 I/O queues.
[51354.879684] nvme nvme0: new ctrl: NQN “mcx”, addr 192.168.0.1:4420
Is there any parameter that can restrict the number of the cores the mlx5_core/nvme_rdma/nvmet_rdma driver can use to restrict the IO queue creation and result in a successful discovery/connection? I won’t be able to disable the cores/hyperthreading from the BIOS/UEFI since there are other applications running on the host.
Appreciate any pointers/help!