Convert ONNX to TensorRT and run on another device


Hi, I would like to convert ONNX model (2070 GPU) to TensorRT and run on another device (Jetson AGX Orin). Is it possible?


Please refer to the following docs, which may help you.

By default, TensorRT engines are only compatible with the type of device where they were built. With build-time configuration, engines can be built that are compatible with other types of devices. Currently, hardware compatibility is supported only for Ampere and later device architectures and is not supported on NVIDIA DRIVE OS or JetPack.

Thank you.