No any proper documentation on how to configure p_keys for ConnectX-4 MLNX_OFED 5.0-2.1.8.0 on Linux!

There is a lack of information on how to use p_keys on CentOS 8/RHEL 8 with ConnectX-4 adapters and MLNX_OFED 5.0-2.1.8.0 driver. After specifying the keys in /etc/opensm/partitions.conf and restarting the service the keys do not appear as configured under /sys/class/infiniband/mlx5_*/ports/1/pkeys/. All documentation about setting p_keys available is addressing mlx4 driver, not mlx5. For instance, there is no iov subfolder under /sys/class/infiniband/mlx5_0/ (the OFED documentation usually refers to /sys/class/infiniband/mlx4_0/iov). And no, things like echo 0x8001 > /sys/class/net/ib0/create_child create interface but there is no carrier status of the interface.

Is there a proper documentation on how to use p_keys for ConnectX-4 MLNX_OFED 5.0-2.1.8.0 on Linux that actually works?

Hi Veselin,

  1. can you share the file :

/etc/opensm/partitions.conf

  1. How did you start opensm , is there an opensm.conf file ? does it point to /etc/opensm/partitions.conf?

  2. what does the /var/log/opensm.log file show? maybe it complains about the partitions.conf file syntax?

Hello Veselin,

Thank you for posting your inquiry to the Mellanox Community.

Please review the following links for further information on partition configuration:

[MLNX_OFED - OpenSM documentation, section “Partitions”]

https://docs.mellanox.com/display/OFEDv502180/OpenSM

[RHEL 8 - Creating a Partition Configuration]

https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/8/html/configuring_infiniband_and_rdma_networks/configuring-an-infiniband-subnet-manager_configuring-and-managing-networking#creating-a-partition-configuration_configuring-an-infiniband-subnet-manager

Best regards,

Mellanox Technical Support