AGX Orin TensorRT cross compatibility

Autonomous Machines Jetson & Embedded Systems Jetson AGX Orin
1

Hello,

To what extent are TensorRT models compiled on one AGX Orin hardware compatible with other AGX Orin versions. For example, is a model generated on the 32 GB AGX Orin compatible with the 64 GB AGX Orin or Industrial? Or does the model need to be generated for each specific target hardware (e.g. via dev kit emulation)?

Regards,
Alex.

3

Hi,

We don’t support portability on Jetson.
So it’s more recommended to compile it on the target platform instead.
This will be a one-time job and the generated engine file can be reused on the same platform with the same software.

Thanks.

4

Thanks @AastaLLL . In that case, can you please confirm that this can be achieved via emulation as described here?

Specifically, if we use a standard 64 GB AGX Orin developer kit and flash the jetson-agx-orin-devkit-as-jao-32gb image, would we be able to compile a TensorRT model that is fully compatible with a 32 GB AGX Orin target?

Regards,
Alex.

5

Hi,

It might work but to convert the TensorRT engine on the real target device is more recommended.
We don’t have test items for such use cases.

Thanks.

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.