Error deploying Action Recognition Net in Deepstream

Please provide the following information when requesting support.

• Hardware (T4/V100/Xavier/Nano/etc)
v100
• Network Type (Detectnet_v2/Faster_rcnn/Yolo_v4/LPRnet/Mask_rcnn/Classification/etc)
Action Recognition Net
• TLT Version (Please run “tlt info --verbose” and share “docker_tag” here)
• Training spec file(If have, please share here)
• How to reproduce the issue ? (This is for errors. Please share the command line and the detailed log here.)

root@IDC_GPU_Server-1:/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-3d-action-recognition# ./deepstream-3d-action-recognition -c deepstream_action_recognition_config.txt
num-sources = 4
Now playing: file:///opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_walk.mov, file:///opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_ride_bike.mov, file:///opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_run.mov, file:///opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_push.mov,
0:00:02.997766186   605 0x7f31e4002350 INFO                 nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1900> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.etlt_b4_gpu0_fp16.engine
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [FullDims Engine Info]: layers num: 2
0   INPUT  kFLOAT input_rgb       3x32x224x224    min: 1x3x32x224x224  opt: 4x3x32x224x224  Max: 4x3x32x224x224
1   OUTPUT kFLOAT fc_pred         5               min: 0               opt: 0               Max: 0

0:00:02.997883847   605 0x7f31e4002350 INFO                 nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2004> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.etlt_b4_gpu0_fp16.engine
0:00:03.000249151   605 0x7f31e4002350 INFO                 nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<primary-nvinference-engine> [UID 1]: Load new model:config_infer_primary_3d_action.txt sucessfully
sequence_image_process.cpp:496, [INFO: CUSTOM_LIB] 3D custom sequence network info(NCSHW), [N: 4, C: 3, S: 32, H: 224, W:224]
sequence_image_process.cpp:524, [INFO: CUSTOM_LIB] Sequence preprocess buffer manager initialized with stride: 1, subsample: 0
sequence_image_process.cpp:526, [INFO: CUSTOM_LIB] SequenceImagePreprocess initialized successfully
Using user provided processing height = 224 and processing width = 224
Decodebin child added: source
Decodebin child added: decodebin0
Decodebin child added: source
Decodebin child added: decodebin1
Decodebin child added: source
Decodebin child added: decodebin2
Decodebin child added: source
Decodebin child added: decodebin3
Running...
Decodebin child added: qtdemux0
Decodebin child added: qtdemux1
Decodebin child added: multiqueue1
Decodebin child added: multiqueue0
Decodebin child added: qtdemux2
Decodebin child added: qtdemux3
Decodebin child added: multiqueue2
Decodebin child added: h264parse0
Decodebin child added: multiqueue3
Decodebin child added: capsfilter0
Decodebin child added: h264parse1
Decodebin child added: h264parse2
Decodebin child added: capsfilter1
Decodebin child added: capsfilter2
Decodebin child added: h264parse3
Decodebin child added: capsfilter3
Decodebin child added: aacparse0
Decodebin child added: aacparse1
Decodebin child added: aacparse2
Decodebin child added: aacparse3
Decodebin child added: avdec_aac0
Decodebin child added: avdec_aac1
Decodebin child added: avdec_aac2
Decodebin child added: avdec_aac3
Decodebin child added: nvv4l2decoder0
Decodebin child added: nvv4l2decoder1
Decodebin child added: nvv4l2decoder2
Decodebin child added: nvv4l2decoder3
In cb_newpad
In cb_newpad
In cb_newpad
In cb_newpad
In cb_newpad
In cb_newpad
In cb_newpad
In cb_newpad
0:00:03.538095349   605 0x5644ad15d050 WARN                 nvinfer gstnvinfer.cpp:2288:gst_nvinfer_output_loop:<primary-nvinference-engine> error: Internal data stream error.
0:00:03.538156715   605 0x5644ad15d050 WARN                 nvinfer gstnvinfer.cpp:2288:gst_nvinfer_output_loop:<primary-nvinference-engine> error: streaming stopped, reason not-negotiated (-4)
ERROR from element primary-nvinference-engine: Internal data stream error.
Error details: gstnvinfer.cpp(2288): gst_nvinfer_output_loop (): /GstPipeline:preprocess-test-pipeline/GstNvInfer:primary-nvinference-engine:
streaming stopped, reason not-negotiated (-4)
Returned, stopping playback
sequence_image_process.cpp:586, [INFO: CUSTOM_LIB] SequenceImagePreprocess is deinitializing
Deleting pipeline

Could you run below firstly?
$ export DISPLAY=:0

Hi, Morganh. I had the same problem, I tried $ export DISPLAY=:0 then deepstream-app got stuck here for almost an hour.

root@IDC_GPU_Server-1:/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-3d-action-recognition# export DISPLAY=:0
root@IDC_GPU_Server-1:/opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-3d-action-recognition# ./deepstream-3d-act                                                    ion-recognition -c deepstream_action_recognition_config.txt
num-sources = 4
Now playing: file:///opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_walk.mov, file:///opt/nvidia/deepstream/deepstream-6.0/sa                                                    mples/streams/sample_ride_bike.mov, file:///opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_run.mov, file:///opt/nvidia/deepst                                                    ream/deepstream-6.0/samples/streams/sample_push.mov,
No protocol specified
No protocol specified
No protocol specified
No protocol specified
No protocol specified
Running...

Are you running inside a docker?
Could you try outside the docker?

I’m running in a container nvcr.io/nvidia/deepstream:6.0-devel, is this not possible?

Firstly, suggest you to double check the steps in DeepStream 3D Action Recognition App — DeepStream 6.0 Release documentation
Especially the step of “Export DISPLAY environment to correct display”.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.