Can't access GPU from bluefield2

Infrastructure & Networking BlueField
1

Hi, I follow the guide to access GPU from bluefield2.

$ mst status
MST modules:
------------
    MST PCI module is not loaded
    MST PCI configuration module loaded

MST devices:
------------
/dev/mst/mt4125_pciconf0         - PCI configuration cycles access.
                                   domain:bus:dev.fn=0000:41:00.0 addr.reg=88 data.reg=92 cr_bar.gw_offset=-1
                                   Chip revision is: 00
/dev/mst/mt41686_pciconf0        - PCI configuration cycles access.
                                   domain:bus:dev.fn=0000:81:00.0 addr.reg=88 data.reg=92 cr_bar.gw_offset=-1
                                   Chip revision is: 01

I configured the DPU to BlueField-X mode.

$ sudo mlxconfig -d /dev/mst/mt41686_pciconf0 q PCI_DOWNSTREAM_PORT_OWNER[4]
Device #1:
----------

Device type:    BlueField2
Name:           MBF2H516A-CEEO_Ax_Bx
Description:    BlueField-2 DPU 100GbE Dual-Port QSFP56; PCIe Gen4 x16; Crypto; 16GB on-board DDR; 1GbE OOB management; FHHL
Device:         /dev/mst/mt41686_pciconf0

Configurations:                              Next Boot
         PCI_DOWNSTREAM_PORT_OWNER[4]        EMBEDDED_CPU(15)

But after rebooting, the A30 and A5000 cards are still visible from the host and invisible from the DPU.

root@host:~# lspci | grep -i nv
22:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM173X
25:00.0 3D controller: NVIDIA Corporation Device 20b7 (rev a1)
e2:00.0 VGA compatible controller: NVIDIA Corporation Device 2231 (rev a1)
e2:00.1 Audio device: NVIDIA Corporation Device 1aef (rev a1)

Did I miss any configurations? Or are there any other ways to access GPU from DPU? Thanks.

2

I guess, it seems like only the GPU model with ‘x’ suffix can be configured with bluefield-x mode.

3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.