Jetson Nano error when "INT64. Attempting to cast down to INT32"

106200228 · January 13, 2025, 4:29am

• Hardware Platform (Jetson / GPU): Jetson
• DeepStream Version: 6.0.1
• JetPack Version (valid for Jetson only): 4.6.6

I refer this GitHub - marcoslucianops/DeepStream-Yolo-Seg: NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 implementation for YOLO-Segmentation models for running yolo-seg but meet an issue when converting onnx to tensorRT:

WARNING: [TRT]: onnx2trt_utils.cpp:366: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
ERROR: [TRT]: ModelImporter.cpp:773: While parsing node number 313 [Range -> "/0/model.22/Range_output_0"]:
ERROR: [TRT]: ModelImporter.cpp:774: --- Begin node ---
ERROR: [TRT]: ModelImporter.cpp:775: input: "/0/model.22/Constant_23_output_0"
input: "/0/model.22/Cast_output_0"
input: "/0/model.22/Constant_24_output_0"
output: "/0/model.22/Range_output_0"
name: "/0/model.22/Range"
op_type: "Range"

I tried exporting .pt to .onnx by GoogleColab, Jetson Nano … After that, I used onnx for my app, but it still had errors. However, I tried it on DS7.1 with dGPU, it works correctly when downscasting INT32 and run for my app. Can you help me?

junshengy · January 13, 2025, 9:47am

This error is caused by the Range operator not supporting dynamic batch size, so when exporting the onnx model, specify the batch size

 python3 export_yoloV8_seg.py -w yolov8s-seg.pt --batch 32 --simplify

But there will be another error，This problem is caused by the low version of TensorRT. The RoiAlign operator is not supported by TensorRT-8.0.

[01/13/2025-09:23:07] [E] [TRT] 3: getPluginCreator could not find plugin: RoiAlign version: 1
[01/13/2025-09:23:07] [E] [TRT] ModelImporter.cpp:720: While parsing node number 290 [RoiAlign -> "/1/RoiAlign_output_0"]:
[01/13/2025-09:23:07] [E] [TRT] ModelImporter.cpp:721: --- Begin node ---
[01/13/2025-09:23:07] [E] [TRT] ModelImporter.cpp:722: input: "/0/model.22/proto/cv3/act/Mul_output_0"

You can try to port the operator.

github.com

NVIDIA/TensorRT/blob/release/8.5/plugin/roiAlignPlugin/roiAlignPlugin.h

/*
 * SPDX-FileCopyrightText: Copyright (c) 1993-2023 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
 * SPDX-License-Identifier: Apache-2.0
 *
 * Licensed under the Apache License, Version 2.0 (the "License");
 * you may not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 * http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */
#ifndef TRT_ROIALIGN_PLUGIN_H
#define TRT_ROIALIGN_PLUGIN_H

#include "common/plugin.h"

This file has been truncated. show original

Jetson nano cannot be upgraded to a higher version of JetPack, which would be a complicated migration process

junshengy · January 13, 2025, 9:48am

This repository is not officially supported. You can consult the author on GitHub.

106200228 · January 14, 2025, 3:32am

Thanks for your support!

system · January 28, 2025, 3:33am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
TRT Fails to parse ONNX Model (yolov8 Segmentation) Jetson Xavier NX tensorrt , yolo , onnx	5	715	February 23, 2024
TRT Fails to parse ONNX Model (yolov8 Segmentation) DeepStream SDK tensorrt , yolo , onnx	4	294	June 11, 2024
Fail to import tensorRT on Jetson Nano TensorRT tensorrt	3	1634	October 15, 2021
error while loading model in transfer learning Jetson Nano	6	1167	October 14, 2021
Deepstream-YOLO-seg custom yolov8 onnx model not working as expected DeepStream SDK onnx , segmentation	22	2047	November 10, 2023
Issue with yolov8s-seg conversion from onnx to engine Jetson AGX Orin yolo , onnx	5	44	October 29, 2024
Unet Inference on Jetson nano faces problem of compiling the onnx file to the engine file TensorRT tensorrt , cuda	1	385	August 4, 2023
Is there a way to use TensorRT 8.4.3 on the Jetson Nano Dev Kit? TensorRT tensorrt , nano	4	2533	September 15, 2022
INT8 Calibration with DS 6.3 worse than with DS 6.0 DeepStream SDK tensorrt , jetson , deepstream , tensorrt-model-optimizer	20	73	March 10, 2025
Cannot Deploy PyTorch Model on DeepStream TensorRT	9	990	February 13, 2023

Jetson Nano error when "INT64. Attempting to cast down to INT32"

Related topics