Issue with deepstream-3d-action-recognition sample app

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU)
Nvidia Orin NX 16GB
• DeepStream Version
DeepstreamSDK 7.0.0
• JetPack Version (valid for Jetson only)
Jetpack Version 6.0
• TensorRT Version
Tensorrt 8.6
• Issue Type( questions, new requirements, bugs)
Followed instructions for the deepstream-3d-action-recognition-sample application, configured Makefiles with cuda version 12.2, compiled source code, obtained executable and modified deepstream_action_recognition_config.txt as well as config_infer_primary_2d_action.txt and config_infer_primary_3d_action.txt to adapt them to the downloaded models resnet18_2d_rgb_hmdb5_32.onnx resnet18_2d_rgb_hmdb5_32.onnx.
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
First export GST_DEBUG=2 and export DISPLAY=:0.0
Run the executable as ./deepstream-3d-action-recognition -c config_infer_primary_2d_action for 2d action recognition or ./deepstream-3d-action-recognition -c config_infer_primary_3d_action for 3d case. In both cases I used the sample_push.mov video for input.
Once runned the application exits and outputs the following error message:

num-sources = 1
Now playing: file:///opt/nvidia/deepstream/deepstream-7.0/samples/streams/sample_push.mov,
Setting min object dimensions as 16x16 instead of 1x1 to support VIC compute mode.
WARNING: Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-7.0/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.onnx_b4_gpu0_fp16.engine open error
0:00:07.427665567  2848 0xaaab0f1d5350 WARN                 nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2083> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-7.0/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.onnx_b4_gpu0_fp16.engine failed
0:00:07.858842075  2848 0xaaab0f1d5350 WARN                 nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2188> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-7.0/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.onnx_b4_gpu0_fp16.engine failed, try rebuild
0:00:07.858918972  2848 0xaaab0f1d5350 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2109> [UID = 1]: Trying to create engine from model files
ERROR: Uff input blob name is empty
ERROR: Failed to create network using custom network creation function
ERROR: Failed to get cuda engine from custom library API
0:00:14.588527248  2848 0xaaab0f1d5350 ERROR                nvinfer gstnvinfer.cpp:676:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2129> [UID = 1]: build engine file failed
free(): double free detected in tcache 2

Added all the config files used for the testing

config_infer_primary_2d_action.txt (2.6 KB)
config_infer_primary_3d_action.txt (2.7 KB)
deepstream_action_recognition_config.txt (2.1 KB)

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

Seems you have changed the models.
Why did you set ONNX model to “tlt-encoded-model” parameter?

Please refer to Gst-nvinfer — DeepStream documentation 6.4 documentation for the meaning of the parameters.

You are absolutely right Fiona, I incorrectly setted up the tlt-encoded-model instead of using the onnx-file parameter. Now I’m correctly generating the engine.

Thanks for the input.

By the way, another question, does the deepstream-3d-action-recognition sample app support video recording/video streaming the same way as the base deepstream-app?

No. The smart recording APIs are not added to this sample.

1 Like

All right, thanks for your assistance Fiona.

I think we can close this issue then.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.