I am attempt to build a new NAS that will be dedicated for our HPC. The current NAS uses NFS to share a number of ZFS filesystems over 10G Ethernet. I would like to have the same ZFS filesystems shared via NFS over the Infiniband network that is already in place to hopefully speed things up. During my research I found out about NFS over RDMA. I than found out that as of OFED version 4.0-2.0.0.1 driver support was dropped, see page 14 of the release notes. Since the new NAS is going to use Debian 9 I would have to either build the 3.x OFED drivers myself or use the distro drivers. Since this is all Mellanox hardware I would rather not use the distro drivers nor do I want to use old versions if I can avoid it.
Hence this question. Is there a good replacement for NFS over RDMA? I would like to avoid using an iSCSI solution as that would mean a large amount of work getting something new set up. I can try using NFS with IPoIB only but testing shows there are some odd slowdowns when the fabric is in use for computational runs.
The article HowTo Configure NFS over RDMA (RoCE) was what first had me hopeful but it uses OFED 2.4 which will not work out.
I did find this discussion: How to use NFS over RDMA with MLNX_OFED, but the driver has been removed from the latest 4.x versions.