I have a jetson orin nano 8GB board. JetPack 5.1.4 OpenCV 4.9.0 (cuda enabled) $ yolo version 8.3.28 run model=yolo11n.engin, 1920x1080P @30FPS I found there is only 10~ 12FPS, but the GPU & CPU is NOT that high. Is there anyway to boost performance?

Hi, In your video, it looks like the GPU is not fully occupied so it should have room for further optimization. But this is an Ultralytics app, you will need to check with them to see if they can further improve their implementation. Thanks.

Hi, Have you maximized device performance? $ sudo nvpmodel -m 0 $ sudo jetson_clocks Could you monitor GPU usage with tegrastats at the same time? $ sudo tegrastats Thanks

@AastaLLL I got the same result ~ 10FPS, but the streaming is 30FPS/RTP live Please check jtop/ tegrastats result. PS: yolo was started at the middle of the video about 40s. EDIT: Check engine file but failed I got this file from YOLO11 🚀 NEW - Ultralytics YOLO Docs . And followed NVIDIA…

I got engine format fixed, but performance didn’t improve much, just from 10FPS to 13 FPS. Still got issue. EDIT: And it can’t predict!!! $ /usr/src/tensorrt/bin/trtexec --loadEngine=./model/yolo11n.engine &&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --loadEngine…

Please help to check the system settings: System Environment: Python 3.8.10 GStreamer: YES (1.16.3) NVIDIA CUDA: YES (ver 11.4, CUFFT CUBLAS FAST_MATH) OpenCV version: 4.9.0 , CUDA support: True Torch version: 2.1.0a0+41361538.nv23.06 Torchvision version: 0…

@AastaLLL Currently, we have figured out with yolo 11n demo. We got : stable ~19 FPS@1920x1080 imgz=320x320 stable ~21 FPS@1920x1080 imgz=320x320, 16 selected classes almost ~25 FPS@1280x960 imgz=320x320, 16 selected classes Is that all for the jetson orin nano 8GB?

Hi, The document is written by the Ultralytics. Unfortunately, you will need to reach out to know the exact setting for their profiling data. Thanks.

OK, thanks. Is there any NVIDIA demo about small object detection with NVIDIA hardware speedup?

Hi, Have you checked our Deepstream SDK? [image] DeepStream SDK Develop and deploy AI-powered intelligent video analytics apps and services faster anywhere. Thanks.

Yeah, still on other stuff, right now it’s around 27FPS close to 30FPS with RTP source running at 1920x1080@60FPS, yolo v11n imgz=320 I’ll try but not sure how much will get. Do you have any data or figure on this? [image] Which DS version for Jetson Orin Nano/Jetpack 5.1.4/L4T 35…

Anyway to boost yolo performance on Jetson Orin?

Robotics & Edge Computing Jetson Systems Jetson Orin Nano

daniel2008_12 November 22, 2024, 12:22am 8

Is Jetson Orin Nano 8GB equipped with DLA hardware?

How to configure device param according to Export - Ultralytics YOLO Docs ?

Topic		Replies	Views
Low Performance - Jetson Orin Nano Super TensorRT jetson , jetson-orin	3	472	February 24, 2025
Slow FPS on Orin Nano 8 GB - YoloV8 Jetson Orin Nano yolo	7	2561	January 29, 2024
Speed question of Deepstream on Jetson Orin Nano DeepStream SDK jetson , deepstream	4	153	January 22, 2025
Different behavior (NOT good) of yolov11n on Jetson Orin Nano Super Jetson Orin Nano yolo	16	482	March 5, 2025
YOLOv5S model performance testing benchmark DeepStream SDK jetson , deepstream	3	225	April 25, 2025
YoloV3 Deepstream SDK 4.0 performance on Jetson Nano DeepStream SDK	14	4647	October 12, 2021
YOLOv8 model training on Jetson Orin Nano Jetson Orin Nano yolo	7	1263	August 1, 2024
Need help with slower inference using YOLOv8 on NVIDIA Orin Nano 4GB Jetson Orin Nano jetson-inference	8	2302	July 26, 2023
Yolo11/26 C++ TRT Object Detection on Jetson Orin Nano Jetson Orin Nano yolo , deepstream	8	154	April 22, 2026
Jetson nano Not able to give higher FPS Jetson Nano yolo	8	2388	October 15, 2021

Anyway to boost yolo performance on Jetson Orin?

Related topics