How to deploy to Isaac ROS image_segmentation with TAO5?

mat-h · September 19, 2023, 8:29am

Hello,

We can success to deploy to Isaac ROS image_segmentation (GitHub - NVIDIA-ISAAC-ROS/isaac_ros_image_segmentation: Hardware-accelerated, deep learned semantic image segmentation) using below exported “etlt file” with TAO4.
GitHub - NVIDIA-AI-IOT/robot_freespace_seg_Isaac_TAO: In this workflow we demonstrate using SDG + TAO for a freespace segmentation application

But we cannot export “etlt file” latest TAO5 by this script.

Question:
Could you tell us recommended way to deploy to IsaacROS image_segmentation with TAO5 environment such as below notebook example?

github.com

NVIDIA-AI-IOT/robot_freespace_seg_Isaac_TAO/blob/main/freespace_segmentation.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Freespace Segmentation using TAO UNET\n",
    "\n",
    "MIT License\n",
    " SPDX-FileCopyrightText: Copyright (c) 2022 NVIDIA CORPORATION & AFFILIATES. All rights reserved.\n",
    " SPDX-License-Identifier: MIT\n",
    "\n",
    " Permission is hereby granted, free of charge, to any person obtaining a\n",
    " copy of this software and associated documentation files (the \"Software\"),\n",
    " to deal in the Software without restriction, including without limitation\n",
    " the rights to use, copy, modify, merge, publish, distribute, sublicense,\n",
    " and/or sell copies of the Software, and to permit persons to whom the\n",
    " Software is furnished to do so, subject to the following conditions:\n",
    "\n",
    " The above copyright notice and this permission notice shall be included in\n",

This file has been truncated. show original

–
Best regards,

mat-h · October 6, 2023, 5:41am

Hello,

Are there any update on this?

We would appreciate if you tell us how to generate xx.etlt from xx.onnx by exported TAO5?

–
Best regards

Raffaello · October 25, 2023, 10:46am

Hi @mat-h and sorry for the late reply,

Have you tried the latest Isaac ROS 2.0 release? We made significant changes to the packages and documentation.

New documentation: NVIDIA Isaac ROS — isaac_ros_docs documentation
Image segmentation documentation: Isaac ROS Image Segmentation — isaac_ros_docs documentation

Let me know if the new release everything is fixed.

Raffaello

mat-h · November 2, 2023, 8:16am

Hi,

Thank you very much for your kindness.
I really appreciate your help.

I checked new github documentation like below;
https://nvidia-isaac-ros.github.io/repositories_and_packages/isaac_ros_image_segmentation/isaac_ros_unet/index.html#quickstart

But it seems to be same guide like “tao-converter with .etlt”.
Are there any clue to use .onnx from TAO5 export model file?

Best regards,

mat-h · December 20, 2023, 6:43am

Hi,

It seems to be success to generate TensotRT engine from onnx file by “trtexec” command.
Is it proper way on Isaac ROS ?

Best regards,

Topic		Replies	Views
Publish a ROS Image message from Camera and use in Isaac ROS Image Segmentation Jetson Orin Nano camera , ros	6	1576	May 30, 2023
Conversion from .etlt to TensorRT model fail Isaac ROS	2	127	June 25, 2024
How to run robot_freespace_seg_Isaac_TAO sample? Isaac Sim	3	262	January 11, 2023
Error : isaac_ros_image_segmentation Isaac ROS	4	1174	August 1, 2022
Exported model can't move to jetson tx2 TAO Toolkit	8	660	October 29, 2021
ROS2 DeepStream Cpp Jetson Xavier NX ros	10	950	November 9, 2022
Isaac_ros_yolov8 quickstart with v4l2 live input Isaac ROS	7	54	October 15, 2024
Designing Robots with NVIDIA Isaac GEMs for ROS Technical Blog	9	1090	March 13, 2022
Unable to export QAT yolov3 in int8 TAO Toolkit	7	549	April 25, 2023
Isaac ROS Freespace Segmentation test error Isaac ROS jetson-inference	7	132	October 30, 2024

How to deploy to Isaac ROS image_segmentation with TAO5?

Related topics