Jetson Orin Nano 8GB, The transformed model has an inference result of [], How to investigate and solve

13543065743 · February 27, 2025, 2:21am

device: Jetson Orin Nano 8GB,
model：Object detection model developed by Ultralytics，yolov8s.pt
Conversion process：pt————> onnx————> engine
Conversion Script：
python3 export-det.py --weights deepstream/yolov8s_bak.pt --iou-thres 0.65 --conf-thres 0.25 --topk 100 --opset 11 --sim --input-shape 1 3 544 960 --device cuda:0

/usr/src/tensorrt/bin/trtexec --onnx=deepstream/yolov8s_bak.onnx --saveEngine=deepstream/yolov8s_bak.engine --buildOnly --minShapes=images:1x3x544x960 --optShapes=images:1x3x544x960 --maxShapes=images:1x3x544x960

junshengy · February 27, 2025, 6:14am

Please refer to this sample for yolov8 model. it provides model, configuration file, pipeline, and post-processing code.

The model export code is not provided by DeepStream. For more questions, please consult the Ultralytics

github.com/NVIDIA-AI-IOT/deepstream_tools

yolo_deepstream/deepstream_yolo/README.md

main

# Deploy YOLO Models With DeepStream #

**This sample shows how to integrate YOLO models with customized output layer parsing for detected objects with DeepStreamSDK.**

## 1. Sample contents: ##
- `deepstream_app_config_yolo.txt`: DeepStream reference app configuration file for using YOLO models as the primary detector.
- `config_infer_primary_yoloV4.txt`: Configuration file for the GStreamer nvinfer plugin for the YoloV4 detector model.
- `config_infer_primary_yoloV7.txt`: Configuration file for the GStreamer nvinfer plugin for the YoloV7 detector model.
- `config_infer_primary_yoloV8.txt`: Configuration file for the GStreamer nvinfer plugin for the YoloV8 detector model.
- `config_infer_primary_yoloV8_dla.txt`: Configuration file for the GStreamer nvinfer plugin for the YoloV8 detector model running with DLA on Jetson.
- `config_infer_primary_yoloV9.txt`: Configuration file for the GStreamer nvinfer plugin for the YoloV9 detector model.
- `nvdsinfer_custom_impl_Yolo/nvdsparsebbox_Yolo.cpp`: Output layer parsing function for detected objects for the Yolo models.
- `nvdsinfer_custom_impl_Yolo/nvdsparsebbox_Yolo_cuda.cu`: Output layer parsing function for detected objects for the Yolo models by CUDA.

## 2. Download and Build ##

```sh
  $ cd ~/
  $ git clone https://github.com/NVIDIA-AI-IOT/deepstream_tools.git
  $ cd ~/deepstream_tools/yolo_deepstream/deepstream_yolo/nvdsinfer_custom_impl_Yolo

This file has been truncated. show original

Y-T-G · February 27, 2025, 11:19pm

Seem like you exported with NMS, in which case you would need to modify the post-processing to not use NMS and use correct parsing.

Topic		Replies	Views
Accuracy issues in object detection models using Jetson AGX Orin DeepStream SDK yolo , deepstream , inception	9	735	December 8, 2023
Deepstream-App not working on Jetson Orin Nanod DeepStream SDK tensorrt , gstreamer , jetson , deepstream	3	38	May 13, 2025
Regarding the use of YOLOV8S model combined with JPS Docker Metropolis Microservices for Jetson jetson , deepstream	15	76	December 31, 2024
Yolo V8 run on deepstream 7 with python binding DeepStream SDK	6	730	July 22, 2024
How to use custom yolov4-tiny in deepstream6 with rtsp output? DeepStream SDK	8	993	November 25, 2022
How Can I use custom yolov9 model on Jetpack 5.1.1(DeepStream 6.2) use Gstreamer detect person? DeepStream SDK deepstream	2	45	November 1, 2024
No detection on Jetson Orin Nano DeepStream SDK jetson , deepstream	1	42	June 13, 2025
Deepstream-YOLO-seg custom yolov8 onnx model not working as expected DeepStream SDK onnx , segmentation	22	2146	November 10, 2023
Running YOLO Over 8 Video Streams Simultaneously on Jetson Orin AGX - Seeking Advice Jetson AGX Orin yolo	4	515	September 16, 2024
YOLO-POSE Demo Accelerated with Deepstream and TensorRT(Pose Estimation with DeepStream Python Binding) DeepStream SDK tensorrt , yolo , demos-and-tutorials , deepstream	2	1487	April 26, 2024

Jetson Orin Nano 8GB, The transformed model has an inference result of [], How to investigate and solve

Related topics