The TensorRT inference API consumes 15-20% of CPU resources on a single core. Only the TensorRT AI inference interface was executed in the test, which did not include CPU/GPU data transfer. [image] In theory it shouldn’t take up CPU resources, it shouldn’t take up so much. Is this normal? If not…

The TensorRT inference API consumes more CPU resources（Jetson Xavier NX）

Robotics & Edge Computing Jetson Systems Jetson Xavier NX

AastaLLL February 13, 2025, 4:22am 10

There is no update from you for a period, assuming this is not an issue anymore.
Hence, we are closing this topic. If need further support, please open a new one.
Thanks

Hi,

Could you share the ONNX file that can be deployed with trtexec?
We want to reproduce this locally to check the usage further.

Thanks.

Topic		Replies	Views
Yolov5 slow inference on Jetson Xavier NX16 Jetson Xavier NX ai	10	1783	October 26, 2022
TensorRT Inference Consuming Large Amount of System Resources TensorRT	1	730	July 5, 2022
Python sample yolov3 app on tensorrt Jetson Xavier NX tensorrt , yolo , python	9	1808	October 18, 2021
Uneven allocation of computing resources at AgX runtime Jetson AGX Xavier yolo	5	499	October 18, 2021
Nvidia Jetson NX extremely slow even with TensorRT inference for yolov3 Jetson Xavier NX tensorrt	21	2864	October 18, 2021
Extremely slow TF Lite inference on Jetson Xavier NX Jetson Xavier NX tensorflow	11	236	January 20, 2025
Individual Using of CPU and GPU Jetson Xavier NX jetson-inference	2	454	October 18, 2021
TensorRT uses GPU alone or mix of CPU & GPU Jetson Nano tensorrt	5	617	October 18, 2021
Detection tesnorRT takes seconds to run on TX2 Jetson TX2 tensorrt , jetson-inference	8	784	October 18, 2021
Jetson Xavier NX - Tensorflow 2 container slower on GPU than on CPU Jetson Xavier NX tensorflow	5	2696	October 18, 2021

The TensorRT inference API consumes more CPU resources（Jetson Xavier NX）

Related topics