Correct way to use triton in jp 5.1.2?

Autonomous Machines Jetson & Embedded Systems Jetson AGX Orin
1

Hey there I couldn’t find the suitable triton server container for 5.1.2? Compatibility matrix suggest 21.07 for cuda 11.4 but there is no arm container available. I used higher version which is 22.11 which runs onnx models in example fine but doesn’t run my own yolov5l.engine model.

| yolov5 | 1 | UNAVAILABLE: Invalid argument: instance group yolov5_0 of model yolov5 specifies invalid or unsupported gpu id 0. GPUs with at least the minimum required CUDA compute compatibility of 6.000000 are: |

4

Hi,

Please check below for the info:

Thanks.

6

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.