Classification_pyt sgie config for deepstream app

eassunca · December 17, 2024, 4:07pm

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) NVIDIA GeForce RTX 4070 Laptop GPU
• DeepStream Version 7.0
• JetPack Version (valid for Jetson only)
• TensorRT Version 8.6.1.6-1+cuda12.0
• NVIDIA GPU Driver Version (valid for GPU only) 535.216.01
• Issue Type( questions, new requirements, bugs) questions
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

I have trained the “classification_pyt” model (Tao_tutorials) in a two class custom data. For training I used the notebook classification_pyt.ipynb:

github.com

NVIDIA/tao_tutorials/blob/main/notebooks/tao_launcher_starter_kit/classification_pyt/classification.ipynb

{
 "cells": [
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Classification using TAO Classification PyT\n",
    "\n",
    "Transfer learning is the process of transferring learned features from one application to another. It is a commonly used training technique where you use a model trained on one task and re-train to use it on a different task. \n",
    "\n",
    "Train Adapt Optimize (TAO) Toolkit  is a simple and easy-to-use Python based AI toolkit for taking purpose-built AI models and customizing them with users' own data.\n",
    "\n",
    "<img align=\"center\" src=\"https://d29g4g2dyqv443.cloudfront.net/sites/default/files/akamai/TAO/tlt-tao-toolkit-bring-your-own-model-diagram.png\" width=\"1080\">\n"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},

This file has been truncated. show original

In the end, I exported the model as .engine. Now I need to run the model as an sgie in the Deeptream SDK. How can I get (or generate) the config file for the model?

Thank you in advance.

Fiona.Chen · December 18, 2024, 4:57am

classification_pyt does not support generating the DeepStream config file. Please write the nvinfer configuration according to Gst-nvinfer — DeepStream documentation and DeepStream SDK FAQ - Intelligent Video Analytics / DeepStream SDK - NVIDIA Developer Forums

system · January 1, 2025, 4:57am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
DeepStream configuration file (Secondary GIE) for TAO classification training DeepStream SDK	4	500	February 8, 2022
Proper configuration for training and using the Efficientnet image classification model? TAO Toolkit	6	1032	April 13, 2022
Sample for simple classification deepstream6 app DeepStream SDK	8	800	May 3, 2022
Trainning a custom resnet18 classificator and deploy it in deepstream as a secondary model DeepStream SDK	9	851	February 6, 2023
How to use classifier model that trained by ourself not tao to deepstream DeepStream SDK	6	244	February 28, 2024
Correct config for training and deploying Efficientnet classification model in deepstream? TAO Toolkit	2	720	April 12, 2022
Mispredictions with custom trained PoseClassificationNet using deepstream-tao-apps DeepStream SDK	6	420	December 11, 2023
Integrating action recognition custom model into nvinfer as sgie DeepStream SDK deepstream	7	302	June 25, 2024
Integrating Tao Models (detectnet_v2) into Deepstream SDK TAO Toolkit tao , deepstream , jetson-nano	11	974	March 24, 2023
How to use custom-trained image classification model with dstest2_sgie3_config.txt DeepStream SDK	2	363	November 17, 2023

Classification_pyt sgie config for deepstream app

Related topics