Issues while configuring NVMe over Fabrics (NVMe-oF) Target Offload

I am trying to configure NVMe over Fabrics (NVMe-oF) Target Offload. I am running into issues when I try to connect.

I am using Ubuntu 20.04 with IOMMU disabled on both hosts and MLNX_OFED_LINUX-5.6-

I have followed this link for installation.
However, when I try to run
nvme connect -t rdma -n testsubsystem -a -s 4420
I get the below error
Failed to write to /dev/nvme-fabrics: Input/output error

The hose dmesg | tail -50 shows

[ 451.386608] nvmet: adding nsid 1 to subsystem testsubsystem
[ 531.859367] nvmet_rdma: enabling port 1 (
[ 572.842137] nvmet: creating controller 1 for subsystem for NQN
[ 600.639453] nvmet: creating controller 1 for subsystem testsubsystem for NQN
[ 602.408514] nvmet_rdma: using dynamic staging buffer 00000000441388f3
[ 602.445333] nvme 0000:c5:00.0: Failed to get peer resource xrq=000000004d1fc490 be_ctrl=00000000e3fde924
[ 602.454821] nvmet_rdma: failed to get XRQ for queue (1)
[ 602.460047] nvmet: failed to install queue 1 cntlid 1 ret 4006

Please let me know if anything else is required. Any help is appreciated!

1 Like