How to run Pytorch trained MaskRCNN (detectron2) with TensorRT

[AastaLLL]

Hi,

caffe2 is included in the pyTorch package.
Please find the following topic for the prebuilt pytorch package for the Jetson device:

PyTorch for Jetson

Below are pre-built PyTorch pip wheel installers for Jetson Nano, TX1/TX2, Xavier, and Orin with JetPack 4.2 and newer. Download one of the PyTorch binaries from below for your version of JetPack, and see the installation instructions to run on your Jetson. These pip wheels are built for ARM aarch64 architecture, so run these commands on your Jetson (not on a host PC). You can also use the pre-built l4t-pytorch and l4t-ml container images and Dockerfiles. PyTorch pip wheels JetPack 5

PyTo…

Unsupported ONNX data type: UINT8 (2)

Above error indicates that ONNX model use the non-supported INT8 data format.
However, INT8 is supported on the Xavier platform.

We are going to check this issue.
Will share more information with you later.

Thanks.