Hi, I follow the guide to access GPU from bluefield2.
$ mst status
MST modules:
------------
MST PCI module is not loaded
MST PCI configuration module loaded
MST devices:
------------
/dev/mst/mt4125_pciconf0 - PCI configuration cycles access.
domain:bus:dev.fn=0000:41:00.0 addr.reg=88 data.reg=92 cr_bar.gw_offset=-1
Chip revision is: 00
/dev/mst/mt41686_pciconf0 - PCI configuration cycles access.
domain:bus:dev.fn=0000:81:00.0 addr.reg=88 data.reg=92 cr_bar.gw_offset=-1
Chip revision is: 01
I configured the DPU to BlueField-X mode.
$ sudo mlxconfig -d /dev/mst/mt41686_pciconf0 q PCI_DOWNSTREAM_PORT_OWNER[4]
Device #1:
----------
Device type: BlueField2
Name: MBF2H516A-CEEO_Ax_Bx
Description: BlueField-2 DPU 100GbE Dual-Port QSFP56; PCIe Gen4 x16; Crypto; 16GB on-board DDR; 1GbE OOB management; FHHL
Device: /dev/mst/mt41686_pciconf0
Configurations: Next Boot
PCI_DOWNSTREAM_PORT_OWNER[4] EMBEDDED_CPU(15)
But after rebooting, the A30 and A5000 cards are still visible from the host and invisible from the DPU.
root@host:~# lspci | grep -i nv
22:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM173X
25:00.0 3D controller: NVIDIA Corporation Device 20b7 (rev a1)
e2:00.0 VGA compatible controller: NVIDIA Corporation Device 2231 (rev a1)
e2:00.1 Audio device: NVIDIA Corporation Device 1aef (rev a1)
Did I miss any configurations? Or are there any other ways to access GPU from DPU? Thanks.