Installing Ubuntu 22.04 on BlueField 3 end up in hung state

mshaha · September 4, 2025, 8:06am

Hello,

I got a new Bluefield 3 out-of-the-box, this is my first attempt on set up Ubuntu 22.04 on the card.

State of the card:

/dev/rshim0 is discoverable from my host
I have access to dpu-bmc and redfish and UEFI via virtual console /dev/rshim0/console, I turned OFF secure boot on the UEFI because I found a thread saying it is needed to get Ubuntu 22.04 to install seamlessly.
physically, I am connecting the card on a PCIe Gen 5 slot with one network cable connected to the management RJ45 port (dpu-bmc)
I do not have the necessary QSFP to RJ45 converter at the moment (need advise what brand is compatible with Bluefield 3)

I am using the bf bundle package from Nvidia with this command line:

bfb-install --bfb bf-bundle-3.1.0-76_25.07_ubuntu-22.04_prod.bfb --config bf.cfg --rshim rshim0

Everything looks fine, until it just stopped here:

root@localhost:/home/user# bfb-install --bfb bf-bundle-3.1.0-76_25.07_ubuntu-22.04_prod.bfb --config bf.cfg --rshim rshim0
Checking if local host has root access...
/dev/rshim0 (0000:c1:00) is in NIC mode
Checking if rshim driver is running locally...
Warn: 'pv' command not found. Continue without showing BFB progress.
Unbinding pf0 (0000:c1:00.0)
Unbinding pf1 (0000:c1:00.1)
Pushing bfb + cfg
Collecting BlueField booting status. Press Ctrl+C to stop…
 INFO[PSC]: PSC BL1 START
 INFO[BL2]: start
 INFO[BL2]: boot mode (rshim)
 INFO[BL2]: VDD_CPU: 781 mV
 INFO[BL2]: VDDQ: 1118 mV
 INFO[BL2]: DDR POST passed
 INFO[BL2]: UEFI loaded
 INFO[BL31]: start
 INFO[BL31]: lifecycle GA Secured
 INFO[BL31]: runtime
 INFO[UEFI]: Partial NIC
 INFO[BL31]: MB ping success
 INFO[UEFI]: eMMC init
 INFO[UEFI]: eMMC probed
 INFO[UEFI]: UPVS valid
 INFO[UEFI]: PMI: updates started
 INFO[UEFI]: PMI: total updates: 1
 INFO[UEFI]: PMI: updates completed, status 0
 INFO[UEFI]: PCIe enum start
 INFO[UEFI]: PCIe enum end
 INFO[BL31]: Partial NIC
 INFO[BL31]: power capping disabled
 INFO[UEFI]: UEFI Secure Boot (disabled)
 INFO[UEFI]: PK configured
 INFO[UEFI]: Redfish enabled
 INFO[UEFI]: exit Boot Service
 INFO[MISC]: Found bf.cfg
 INFO[MISC]: Erasing eMMC drive: /dev/mmcblk0
 INFO[MISC]: Erasing NVME drive: /dev/nvme0n1
 INFO[MISC]: Ubuntu installation started
 INFO[MISC]: Installing OS image
 INFO[MISC]: Changing the default password for user ubuntu
 INFO[MISC]: Ubuntu installation completed
 INFO[MISC]: Installed NIC Firmware is the same as provided. Skipping NIC Firmware update.
 INFO[MISC]: Installation finished
 INFO[MISC]: Rebooting...
 INFO[PSC]: PSC BL1 START
 INFO[BL2]: start
 INFO[BL2]: boot mode (emmc)
 INFO[BL2]: VDD_CPU: 781 mV
 INFO[BL2]: VDDQ: 1120 mV
 INFO[BL2]: DDR POST passed
 INFO[BL2]: UEFI loaded
 INFO[BL31]: start
 INFO[BL31]: lifecycle GA Secured
 INFO[BL31]: runtime
 INFO[BL31]: MB ping success
 INFO[UEFI]: eMMC init
 INFO[UEFI]: eMMC probed
 INFO[UEFI]: UPVS valid
 INFO[UEFI]: PCIe enum start
 INFO[UEFI]: PCIe enum end
 INFO[UEFI]: PMI: updates started
 INFO[UEFI]: PMI: total updates: 1
 INFO[UEFI]: PMI: updates completed, status 0
 INFO[UEFI]: PMI: updates started
 INFO[UEFI]: PMI: total updates: 8
 INFO[UEFI]: PMI: updates completed, status 0
 INFO[UEFI]: PMI: rebooting
 INFO[PSC]: PSC BL1 START
 INFO[BL2]: start
 INFO[BL2]: boot mode (emmc)
 INFO[BL2]: VDD_CPU: 778 mV
 INFO[BL2]: VDDQ: 1120 mV
 INFO[BL2]: DDR POST passed
 INFO[BL2]: UEFI loaded
 INFO[BL31]: start
 INFO[BL31]: lifecycle GA Secured
 INFO[BL31]: runtime
 INFO[BL31]: MB ping success
 INFO[UEFI]: eMMC init
 INFO[UEFI]: eMMC probed
 INFO[UEFI]: UPVS valid
 INFO[UEFI]: PCIe enum start
 INFO[UEFI]: PCIe enum end
 INFO[BL31]: power capping disabled
 INFO[UEFI]: UEFI Secure Boot (disabled)
 INFO[UEFI]: PK configured
 INFO[UEFI]: Redfish enabled
 INFO[UEFI]: DPU-BMC RF credentials found
 INFO[UEFI]: In Enhanced NIC mode
Binding pf0 (0000:c1:00.0)
Binding pf1 (0000:c1:00.1)

This is what the virtual console print out, at this point there is no other response from the console:

Press ESC/F2/DEL twice    to enter UEFI Menu.
Press ENTER               to skip countdown.

3  seconds remain...
2  seconds remain...
1  seconds remain...
0  seconds remain...
** Redfish GET https://192.168.240.1/redfish/v1/, Success
ProcessVendorIdentification: Vendor: Nvidia
** XAUTH POST https://192.168.240.1/redfish/v1/SessionService/Sessions, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Oem/Nvidia/SystemConfigProfile/Status, Success
[Pcm] Profile pending activation: None.
** Redfish GET https://192.168.240.1/redfish/v1/Registries/BiosAttributeRegistry/BiosAttributeRegistry, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings, Success
** Redfish PATCH https://192.168.240.1/redfish/v1/Systems/Bluefield, Success
** Redfish PATCH https://192.168.240.1/redfish/v1/Systems/Bluefield, Success
** Redfish POST https://192.168.240.1/redfish/v1/Systems/Bluefield/Actions/Oem/NvidiaComputerSystem.PushSmbiosTable, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Bios/Settings, Success
** Redfish PATCH https://192.168.240.1/redfish/v1/Systems/Bluefield/Bios, Success
** Redfish PATCH https://192.168.240.1/redfish/v1/UpdateService/FirmwareInventory, Access Denied
** Redfish GET https://192.168.240.1/redfish/v1/TaskService/Tasks/, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Oem/Nvidia/Truststore/Certificates, Success
** Redfish GET https://192.168.240.1/redfish/v1/TaskService/Tasks/, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/PK/Certificates, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/PK/Certificates/1, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/KEK/Certificates, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/KEK/Certificates/1, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/db/Certificates, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/db/Certificates/1, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/db/Certificates/2, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/db/Certificates/3, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/db/Certificates/4, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/db/Certificates/5, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/db/Certificates/6, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/db/Certificates/7, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Certificates, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/1, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/10, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/11, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/12, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/13, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/14, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/15, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/16, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/17, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/18, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/19, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/2, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/20, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/21, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/22, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/23, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/24, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/25, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/26, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/27, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/28, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/29, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/3, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/30, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/31, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/32, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/33, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/34, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/35, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/36, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/37, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/38, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/39, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/4, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/40, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/41, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/42, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/43, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/44, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/45, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/46, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/47, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/48, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/49, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/5, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/50, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/51, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/52, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/53, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/54, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/55, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/56, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/57, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/58, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/59, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/6, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/60, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/61, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/62, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/63, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/64, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/65, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/66, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/67, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/68, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/69, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/7, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/70, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/71, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/72, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/73, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/74, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/75, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/76, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/77, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/8, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot/SecureBootDatabases/dbx/Signatures/9, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot, Success
** Redfish PATCH https://192.168.240.1/redfish/v1/Systems/Bluefield/SecureBoot, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0000, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0001, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0002, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0003, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0004, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0005, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0006, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0007, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0008, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0009, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot000A, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot000B, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot000C, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot000D, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot000E, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot000F, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0010, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0011, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0012, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0013, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0014, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0015, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0016, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0017, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0018, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0000, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0001, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0002, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0004, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0005, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0006, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0007, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0008, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0009, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot000A, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot000B, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot000C, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot000D, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot000E, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot000F, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0010, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0011, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0012, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0013, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0014, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0015, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0016, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0017, Success
** Redfish GET https://192.168.240.1/redfish/v1/Systems/Bluefield/Settings/BootOptions/Boot0018, Success
** Redfish PATCH https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0003, Aborted
BootOptions: PATCH of whole boot option not supported, fall back to DELETE/POST.
** Redfish DELETE https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions/Boot0003, Success
** Redfish POST https://192.168.240.1/redfish/v1/Systems/Bluefield/BootOptions, Success

I am stuck here, dpu-bmc is still responding, I can perform the bfb-install again but it will be the same result

bf-bundle file sha256:

9ca6907432e203bee623b4bb351ffecc1d1b1516d473f3cc1b0c9769de82e53b  bf-bundle-3.1.0-76_25.07_ubuntu-22.04_prod.bfb

when i echo “SW_RESET 1” > /dev/rshim0/misc, this is the printing, before the bunch of redfish commands sent before hung state

Nvidia BlueField-3 rev1 BL1 V1.0 
NOTICE:  Running as 9009D3D400NNHA0 system 
NOTICE:  BL2: v2.2(release):4.12.0-27-gd9bafc95f 
NOTICE:  BL2: Built : 20:36:13, Jul 30 2025 
NOTICE:  BL2 built for hw (ver 2) 
NOTICE:  # Finished initializing DDR MSS1 
NOTICE:  DDR POST passed. 
NOTICE:  HW watchdog disabled. 
NOTICE:  BL31: v2.2(release):4.12.0-27-gd9bafc95f 
NOTICE:  BL31: Built : 20:36:13, Jul 30 2025 
NOTICE:  BL31 built for hw (ver 2), lifecycle GA Secured 
NOTICE:  OP-TEE non functional as HW Crypto NOT ENABLED UEFI firmware (version BlueField:4.12.0-19-gdd4c9d8a10-BId13720 built at 20:36:55 on Jul 30 2025)

Mellanox BlueField-3 [A1] A78(D42) 8 Cores r0p1

Memory Information:DDR5 Memory Available: 16 GB Operating Frequency: 5200 MT/s

Storage Device Information:NVMe Device Address: 06:00.0 Vendor ID: 1344 Device ID: 6001Current Link Speed: 8.0 GT/s Negotiated Link WidthPTM:11129663568:2:0:6~: x2

[Pcm] Profile Root Key found (type: RSA, size: 4096 bits)[Pcm] Profile CA certificate found (NVIDIA certificate)Current Secure Boot State: disabledSecure Boot Mode         : User ModePK is  configuredRedfish enabledDPU BMC version: BF-25.07-6Getting BMC Credentials…DHCP Session Start

cat /dev/rshim0/misc

DISPLAY_LEVEL   2 (0:basic, 1:advanced, 2:log)
BF_MODE         NIC mode
BOOT_MODE       1 (0:rshim, 1:emmc, 2:emmc-boot-swap)
BOOT_TIMEOUT    300 (seconds)
USB_TIMEOUT     40 (seconds)
DROP_MODE       0 (0:normal, 1:drop)
SW_RESET        0 (1: reset)
DEV_NAME        pcie-0000:c1:00.3
DEV_INFO        BlueField-3(Rev 1)
OPN_STR         N/A
UP_TIME         2589(s)
SECURE_NIC_MODE 0 (0:no, 1:yes)
FORCE_CMD       0 (1: send Force command)

mshaha · September 4, 2025, 8:09am

forgot to add:

bf.cfg contains these attributes, the password has a value (generated with “openssl passwd -1“):

device=/dev/nvme0n1

ubuntu_PASSWORD=''

mst status

MST modules:
------------
    MST PCI module is not loaded
    MST PCI configuration module loaded
PCI devices:
------------
DEVICE_TYPE                         MST                           PCI       RDMA            NET                                     NUMA
BlueField3(rev:1)                   /dev/mst/mt41692_pciconf0.2   c1:00.2                                           1

BlueField3(rev:1)                   /dev/mst/mt41692_pciconf0.1   c1:00.1   mlx5_0          net-enp193s0f1np0                       1

BlueField3(rev:1)                   /dev/mst/mt41692_pciconf0     c1:00.0   mlx5_1          net-enp193s0f0np0                       1

mshaha · September 5, 2025, 7:03am

I just found out I have the same issue reported here: While update BlueField-3 dpu with bf-bundle-3.0.0-135_25.04_ubuntu-22.04_prod.bfb the os can not be run

The only difference is that my secureboot is disabled already. Yet facing the same issue. I have yet to try the suggestion to get 24.04 bfb bundle.

Where can I get 24.04 bfb bundle? I can only find Ubuntu 22.04 here NVIDIA DOCA Downloads | NVIDIA Developer

abirman · September 10, 2025, 12:32pm

Hi,

Thanks for your question.

Is your BF3 card in NIC mode?

If yes, it is expected that after boot you don’t see login prompt in the console, as in NIC mode no operating system is running on BF3, and it’s operating as a regular CX7 network adapter, and it’s managed from the host side only.

For more info about NIC mode:

NIC Mode

Moving Between Operation Modes

Best Regards,

Anatoly

Topic		Replies	Views
It sticked when I tried to install ubuntu 22.04 for Bluefield2 from terminal or sdkmanager BlueField	10	1198	January 13, 2024
Installing ubuntu22.04 on BlueField-2 DPU Mellanox OFED	2	1058	August 2, 2023
While update BlueField-3 dpu with bf-bundle-3.0.0-135_25.04_ubuntu-22.04_prod.bfb the os can not be run BlueField	3	99	September 8, 2025
S870 causes kernel panic Device query of S870 crashes kernel CUDA Programming and Performance	27	25694	May 29, 2008
Some funkiness with my first try at running a linux nvidia driver. Linux	20	4251	September 15, 2015
CUDA working on ubuntu-desktop not on ubuntu-server CUDA Programming and Performance	21	19188	March 13, 2014
CUDA, Linux Ubuntu 10.04 and strange mismatch version CUDA Programming and Performance	26	19202	November 18, 2010
Bfb-install fails on Bluefield 3 BlueField	2	1318	October 10, 2023
331.20 WHQL long-term driver discussion Linux	30	14500	November 24, 2013
Bluefield-2 firmware is dead, cannot access, hang up at boot, cannot reflash BlueField	12	3034	December 27, 2023

Installing Ubuntu 22.04 on BlueField 3 end up in hung state

NIC Mode

Moving Between Operation Modes

Related topics