[Bluefield2 DPU] Unable to set VFs trusted mode

[caleb.chiu]

Hi,

I would like to run the Application Recognition example from host side, but unable to set the VFs to be trusted per the NVIDIA DOCA Virtual Functions User Guide.
The step#3 use the command to set VF trusted mode

mlxreg -d /dev/mst/mt41686_pciconf0 --reg_id 0xc007 --reg_len 0x40 --indexes “0x0.0:32=0x80000000” --yes --set “0x4.0:32=0x1”

But I always got the error ME_ICMD_OPERATIONAL_ERROR.

root@DPU:~# mlxreg -d /dev/mst/mt41686_pciconf0 --reg_id 0xc007 --reg_len 0x40 --indexes "0x0.0:32=0x80000000" --yes --set "0x4.0:32=0x1"
You are about to send access register id: 0xc007 with the following data:
Address    | Data
=======================
0x00000000 | 0x80000000
0x00000004 | 0x00000001
0x00000008 | 0x00000000
0x0000000c | 0x00000000
0x00000010 | 0x00000000
0x00000014 | 0x00000000
0x00000018 | 0x00000000
0x0000001c | 0x00000000
0x00000020 | 0x00000000
0x00000024 | 0x00000000
0x00000028 | 0x00000000
0x0000002c | 0x00000000
0x00000030 | 0x00000000
0x00000034 | 0x00000000
0x00000038 | 0x00000000
0x0000003c | 0x00000000
=======================

 Do you want to continue ? (y/n) [n] : y
 Sending access register...
-E- Failed send access register: ME_ICMD_OPERATIONAL_ERROR
root@DPU:~#

Also, I tried to se the trusted mode from host side after VFs created, per the
Single Root IO Virtualization (SR-IOV)
but also failed:

root@ubuntu204:~# lspci | grep Mellanox
b3:00.0 Ethernet controller: Mellanox Technologies MT42822 BlueField-2 integrated ConnectX-6 Dx network controller (rev 01)
b3:00.1 Ethernet controller: Mellanox Technologies MT42822 BlueField-2 integrated ConnectX-6 Dx network controller (rev 01)
b3:00.2 DMA controller: Mellanox Technologies MT42822 BlueField-2 SoC Management Interface (rev 01)
b3:00.3 Ethernet controller: Mellanox Technologies ConnectX Family mlx5Gen Virtual Function (rev 01)
b3:00.4 Ethernet controller: Mellanox Technologies ConnectX Family mlx5Gen Virtual Function (rev 01)
root@ubuntu204:~# ip a | grep ens23f0
11: ens23f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
13: ens23f0v0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    inet 172.16.2.152/24 brd 172.16.2.255 scope global dynamic noprefixroute ens23f0v0
14: ens23f0v1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
root@ubuntu204:~# ip link set ens23f0 vf 0 trust on
RTNETLINK answers: Operation not permitted
root@ubuntu204:~# ip link set ens23f0 vf 1 trust on
RTNETLINK answers: Operation not permitted
root@ubuntu204:~#

My setup:

Host OS: Ubuntu 20.04
DPU: Bluefield-2
DOCA: v1.2.1

It would be very appreciated if you can have the advice.

Regards,
Caleb

[hilaryn]

Hello,

Based on the output provided, the mlxreg utility is unable to properly change the register value. Unfortunately, it will not be possible to determine the cause of the error returned with the information provided. Further investigation will be required.

We would recommend opening a support case for further investigation of the issue. If you do not have a current support contract, please reach out to our Contracts team at networking-contracts@nvidia.com

Thank you,
-Nvidia Network Support

[caleb.chiu]

Hi Hilaryn,

Thanks a lot for pay attention on this ticket.

Before I posted this issue on this forum, I had my colleague’s help to create the support ticket. But the Nvidia supporter insisted this issue is DOCA relative and I should move to this forum. The support ticket has been closed:
00984115 [DOCA] Unable to enable VF trusted mode

So, I would like close this ticket due to there is no answers.

Regards,
Caleb