Help with AJA Kona XM and RDMA support on Jetson AGX Orin Developer Kit

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
, ,
1

Hi everyone,

I’m working with a Jetson AGX Orin Developer Kit, and I’m trying to use an AJA Kona XM video card that I specifically acquired for this device. My goal is to make it work using RDMA, since I’ve read that the Jetson platform supports this technology.

However, I’m having trouble enabling RDMA properly. When I compile the AJA driver (libajantv2) with the environment variables AJA_RDMA=1 and AJA_IGPU=1, I get the following warnings:

Warning: Can’t find symbol nvidia_p2p_init_mapping in /lib/modules/5.15.148-tegra/updates/drivers/nv-p2p/nvidia-p2p.ko; assuming CONFIG_MODVERSIONS=n so setting CRC=0
Warning: Can’t find symbol nvidia_p2p_destroy_mapping in /lib/modules/5.15.148-tegra/updates/drivers/nv-p2p/nvidia-p2p.ko; assuming CONFIG_MODVERSIONS=n so setting CRC=0

Additionally, when I try running the rdmawhacker demo and other RDMA-related demos, they fail to run.

Here are the main version details of my system:

JetPack / L4T: 36.4.4
Kernel: 5.15.148-tegra
CUDA: 12.6 (V12.6.68)
NVIDIA Driver (NVRM): 540.4.0
Architecture: aarch64

I’m not very experienced with these types of systems or devices, so I’d really appreciate any guidance on:

  • How to properly enable RDMA on Jetson AGX Orin

  • Whether the missing nvidia_p2p_* symbols could indicate a compatibility issue

  • Any documentation or examples related to RDMA with external PCIe devices on Jetson

Thanks a lot in advance for your help!

Best regards

4

Hello @antoniocano568,

How is everything going?

I believe you are right, those warnings seem to indicate that the AJA driver is expecting those nvidia_p2p functions to be available in the nvidia-p2p.ko kernel module. However, it seems like it the re-adjusts and changes some settings to accommodate for that.

To provide better support, would it be possible for you to answer provide the following:

  1. A link to the repo you are using to get libajantv2 driver sources.
  2. A link to the instructions you are following for compilation.
  3. The error logs you get when you rung rdwawhacker demo or any other demo.

best regards,

Andrew
Embedded Software Engineer at ProventusNova

5

Hi @proventusnova ,

Thanks you for your reply. Mainly I’ve been following this link for the installation: AJA Video Systems - NVIDIA Docs .

When i execute rdmawhacker i get:

ERROR: GPU buffer lock failed.

Also i tried the cudalowlatencydemo and i get:

error: RDMA buffer index 0 size 8294400 lock failed
error: RDMA buffer index 0 size 8294400 lock failed
error: DMAReadSegment failed
error: DMAReadSegment failed

I also checked if nvidia_p2p was loaded, and it was.

I am not sure at this point if RDMA is supported on the jetson AGX orin.

best regards,

Antonio

6

Hey @antoniocano568,

Thanks for getting back with further details.

I was reading the documentation you shared and it says that the AJA driver needs to be loaded manually on every reboot with the following command:

sudo sh ${NTV2}/driver/bin/load_ajantv2

Do you see any output logs when you run that ?

best regards,
Andrew
Embedded Software Engineer at ProventusNova

8

Hi,
The guidance is for IGX Orin, and is not supported on AGX Orin.

On AGX Orin, please check
GitHub - NVIDIA/jetson-rdma-picoevb: Minimal HW-based demo of GPUDirect RDMA on NVIDIA Jetson AGX Xavier running L4T
Issues with nv-p2p.h and nvidia-peermem for Jetpack 6.0 - #10 by AastaLLL

10

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.