Hi,
Have you maximized the device performance first?
$ sudo nvpmodel -m 0
$ sudo jetson_clocks
More, could you try it with INT8 mode?
Orin’s DLA FP16 mode is expected to run slower by design.
More details can be found in the below topic:
Thanks.