I am trying to configure NVMe over Fabrics (NVMe-oF) Target Offload. I am running into issues when I try to connect.
I am using Ubuntu 20.04 with IOMMU disabled on both hosts and MLNX_OFED_LINUX-5.6-2.0.9.0-ubuntu20.04-x86_64.iso
I have followed this link https://support.mellanox.com/s/article/howto-configure-nvme-over-fabrics--nvme-of--target-offload for installation.
However, when I try to run
nvme connect -t rdma -n testsubsystem -a 10.10.1.1 -s 4420
I get the below error
Failed to write to /dev/nvme-fabrics: Input/output error
The hose dmesg | tail -50 shows
[ 451.386608] nvmet: adding nsid 1 to subsystem testsubsystem
[ 531.859367] nvmet_rdma: enabling port 1 (10.10.1.1:4420)
[ 572.842137] nvmet: creating controller 1 for subsystem nqn.2014-08.org.nvmexpress.discovery for NQN nqn.2014-08.org.nvmexpress:uuid:b21f00f6-7ca5-44ae-afd6-3968c43eed23.
[ 600.639453] nvmet: creating controller 1 for subsystem testsubsystem for NQN nqn.2014-08.org.nvmexpress:uuid:b21f00f6-7ca5-44ae-afd6-3968c43eed23.
[ 602.408514] nvmet_rdma: using dynamic staging buffer 00000000441388f3
[ 602.445333] nvme 0000:c5:00.0: Failed to get peer resource xrq=000000004d1fc490 be_ctrl=00000000e3fde924
[ 602.454821] nvmet_rdma: failed to get XRQ for queue (1)
[ 602.460047] nvmet: failed to install queue 1 cntlid 1 ret 4006
Please let me know if anything else is required. Any help is appreciated!