Deepstream-3d-lidar-sensor-fusion model issue

Accelerated Computing Intelligent Video Analytics DeepStream SDK
,
1

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) Orin 32G
• DeepStream Version 7.1
• JetPack Version (valid for Jetson only) 6.1

I try to setup v2xfusion environment based on Deepstream 7.1
I download the model file v2xfusionmodel-int8-sparsity-seq.onnx
And when I run deepstream-3d-lidar-sensor-fusion -c ds3d_lidar_video_sensor_v2x_fusion.yml.

It reports below error:

I1217 02:43:40.486572 5202 tensorrt.cc:274] "TRITONBACKEND_ModelFinalize: delete model state"
E1217 02:43:40.486607 5202 model_lifecycle.cc:642] "failed to load 'v2xfusion' version 1: Unavailable: unable to find '/opt/nvidia/deepstream/deepstream-7.1/samples/triton_model_repo/v2xfusion/1/v2xfusionmodel-int8-sparsity-seq.engine' for model instance 'v2xfusion_0_0'"
I1217 02:43:40.486719 5202 tensorrt.cc:231] "TRITONBACKEND_ModelInitialize: v2xfusion (version 1)"
I1217 02:43:40.487442 5202 tensorrt.cc:297] "TRITONBACKEND_ModelInstanceInitialize: v2xfusion_0_0 (GPU device 0)"
I1217 02:43:40.487532 5202 tensorrt.cc:353] "TRITONBACKEND_ModelInstanceFinalize: delete instance state"
E1217 02:43:40.487553 5202 backend_model.cc:692] "ERROR: Failed to create instance: unable to find '/opt/nvidia/deepstream/deepstream-7.1/samples/triton_model_repo/v2xfusion/1/v2xfusionmodel-int8-sparsity-seq.engine' for model instance 'v2xfusion_0_0'"
I1217 02:43:40.487571 5202 tensorrt.cc:274] "TRITONBACKEND_ModelFinalize: delete model state"
E1217 02:43:40.487605 5202 model_lifecycle.cc:642] "failed to load 'v2xfusion' version 1: Unavailable: unable to find '/opt/nvidia/deepstream/deepstream-7.1/samples/triton_model_repo/v2xfusion/1/v2xfusionmodel-int8-sparsity-seq.engine' for model instance 'v2xfusion_0_0'"
I1217 02:43:40.487736 5202 tensorrt.cc:231] "TRITONBACKEND_ModelInitialize: v2xfusion (version 1)"
I1217 02:43:40.488458 5202 tensorrt.cc:297] "TRITONBACKEND_ModelInstanceInitialize: v2xfusion_0_0 (GPU device 0)"
I1217 02:43:40.488570 5202 tensorrt.cc:353] "TRITONBACKEND_ModelInstanceFinalize: delete instance state"

Shall I manually convert onnx to engine file? How to do this?

3

Please refer to the /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-lidar-sensor-fusion/README.v2xfusion

Seems you missed the steps of 1.1.2 and 1.1.3 in the doc.

4

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks