NCCL bandwidth capped at 3 GB/s, GPU PCIe topology reports Gen1 x1 on DGX Spark FE

  1. They published playbook is designed for one port connected. You can run with both ports with different configuration and you should get similar speed.
  2. Running ethtool -i enp1s0f1np1 should show
driver: mlx5_core
version: 6.17.0-1014-nvidia
firmware-version: 28.45.4028 (NVD0000000087)

Please confirm you have this firmware version to eliminate the FW regression bug.

I will review your logs too