Please provide complete information as applicable to your setup.
Hardware Platform (Jetson / GPU) : Tesla P40
DeepStream Version : nvcr.io/nvidia/deepstream:6.3-samples
NVIDIA GPU Driver Version (valid for GPU only) : Driver Version: 535.183.01 CUDA Version: 12.2
Issue Type( questions, new requirements, bugs) : question
How to reproduce the issue ? :
when i run sample app of deepstream pipeline of action recognition model in container nvcr.io/nvidia/deepstream:6.3-samples and path “/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-action-recognition”
./deepstream-3d-action-recognition -c deepstream_action_recognition_config.txt
num-sources = 1
Now playing: file:///opt/nvidia/deepstream/deepstream/samples/streams/Sitapur5.stream.mp4,
0:00:00.206184727 10356 0x559aa215e2f0 WARN nvinfer gstnvinfer.cpp:887:gst_nvinfer_start:<primary-nvinference-engine> warning: NvInfer output-tensor-meta is enabled but init_params auto increase memory (auto-inc-mem) is disabled. The bufferpool will not be automatically resized.
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1487 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-6.3/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.etlt_b4_gpu2_fp16.engine open error
0:00:03.217104498 10356 0x559aa215e2f0 WARN nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1976> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-6.3/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.etlt_b4_gpu2_fp16.engine failed
0:00:03.236973964 10356 0x559aa215e2f0 WARN nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2081> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-6.3/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.etlt_b4_gpu2_fp16.engine failed, try rebuild
0:00:03.237031230 10356 0x559aa215e2f0 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2002> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: onnx2trt_utils.cpp:377: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
WARNING: [TRT]: TensorRT encountered issues when converting weights between types and that could affect accuracy.
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
WARNING: [TRT]: Check verbose logs for the list of affected weights.
WARNING: [TRT]: - 21 weights are affected by this issue: Detected subnormal FP16 values.
WARNING: [TRT]: - 20 weights are affected by this issue: Detected values less than smallest positive FP16 subnormal value and converted them to the FP16 minimum subnormalized value.
0:00:52.471989479 10356 0x559aa215e2f0 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2034> [UID = 1]: serialize cuda engine to file: /opt/nvidia/deepstream/deepstream-6.3/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.onnx_b4_gpu2_fp16.engine successfully
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [FullDims Engine Info]: layers num: 2
0 INPUT kFLOAT input_rgb 3x32x224x224 min: 1x3x32x224x224 opt: 4x3x32x224x224 Max: 4x3x32x224x224
1 OUTPUT kFLOAT fc_pred 5 min: 0 opt: 0 Max: 0
0:00:52.532170135 10356 0x559aa215e2f0 INFO nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<primary-nvinference-engine> [UID 1]: Load new model:config_infer_primary_3d_action.txt sucessfully
sequence_image_process.cpp:696, [DEBUG: CUSTOM_LIB] Initializing Custom sequence preprocessing lib
sequence_image_process.cpp:456, [DEBUG: CUSTOM_LIB] considered as 3d sequence input since network_input_shape size is 5
sequence_image_process.cpp:494, [INFO: CUSTOM_LIB] 3D custom sequence network info(NCSHW), [N: 4, C: 3, S: 32, H: 224, W:224]
sequence_image_process.cpp:522, [INFO: CUSTOM_LIB] Sequence preprocess buffer manager initialized with stride: 1, subsample: 0
sequence_image_process.cpp:526, [INFO: CUSTOM_LIB] SequenceImagePreprocess initialized successfully
Using user provided processing height = 224 and processing width = 224
Running...
WARNING from element primary-nvinference-engine: NvInfer output-tensor-meta is enabled but init_params auto increase memory (auto-inc-mem) is disabled. The bufferpool will not be automatically resized.
Warning: NvInfer output-tensor-meta is enabled but init_params auto increase memory (auto-inc-mem) is disabled. The bufferpool will not be automatically resized.
ERROR from element preprocess-plugin: Failed to set tensor buffer pool to active
Error details: gstnvdspreprocess.cpp(723): gst_nvdspreprocess_start (): /GstPipeline:preprocess-test-pipeline/GstNvDsPreProcess:preprocess-plugin
Returned, stopping playback
Deleting pipeline
previously i was running the pipeline on GPU-0 and working fine but as i change to GPU-1 as gpu-0 is full then i do respective changes in config_infer_primary_3d_action.txt then above error is coming .
config_infer_primary_3d_action.txt is given below
config_infer_primary_3d_action.txt
################################################################################
# Copyright (c) 2021, NVIDIA CORPORATION. All rights reserved.
#
# Permission is hereby granted, free of charge, to any person obtaining a
# copy of this software and associated documentation files (the "Software"),
# to deal in the Software without restriction, including without limitation
# the rights to use, copy, modify, merge, publish, distribute, sublicense,
# and/or sell copies of the Software, and to permit persons to whom the
# Software is furnished to do so, subject to the following conditions:
#
# The above copyright notice and this permission notice shall be included in
# all copies or substantial portions of the Software.
#
# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL
# THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
# FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
# DEALINGS IN THE SOFTWARE.
################################################################################
# Following properties are mandatory when engine files are not specified:
# int8-calib-file(Only in INT8)
# Caffemodel mandatory properties: model-file, proto-file, output-blob-names
# UFF: uff-file, input-dims, uff-input-blob-name, output-blob-names
# ONNX: onnx-file
#
# Mandatory properties for detectors:
# num-detected-classes
#
# Optional properties for detectors:
# cluster-mode(Default=Group Rectangles), interval(Primary mode only, Default=0)
# custom-lib-path,
# parse-bbox-func-name
#
# Mandatory properties for classifiers:
# classifier-threshold, is-classifier
#
# Optional properties for classifiers:
# classifier-async-mode(Secondary mode only, Default=false)
#
# Optional properties in secondary mode:
# operate-on-gie-id(Default=0), operate-on-class-ids(Defaults to all classes),
# input-object-min-width, input-object-min-height, input-object-max-width,
# input-object-max-height
#
# Following properties are always recommended:
# batch-size(Default=1)
#
# Other optional properties:
# net-scale-factor(Default=1), network-mode(Default=0 i.e FP32),
# model-color-format(Default=0 i.e. RGB) model-engine-file, labelfile-path,
# mean-file, gie-unique-id(Default=0), offsets, process-mode (Default=1 i.e. primary),
# custom-lib-path, network-mode(Default=0 i.e FP32)
#
# The values in the config file are overridden by values set through GObject
# properties.
[property]
gpu-id=2
#auto-inc-mem=1
#tlt-encoded-model=./resnet18_3d_rgb_hmdb5_32.etlt
#tlt-encoded-model=/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.tlt
#tlt-model-key=nvidia_tao
#model-engine-file=./resnet18_3d_rgb_hmdb5_32.etlt_b4_gpu0_fp16.engine
#model-engine-file=
onnx-file=/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.onnx
#model-engine-file=resnet18_3d_rgb_hmdb5_32.etlt_b4_gpu0_fp16.engine
model-engine-file=/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-3d-action-recognition/resnet18_3d_rgb_hmdb5_32.etlt_b4_gpu2_fp16.engine
uff-input-blob-name=input_1:0
labelfile-path=labels.txt
batch-size=4
process-mode=1
# requries preprocess metadata input
input-tensor-from-meta=1
## 0=FP32, 1=INT8, 2=FP16 mode
network-mode=2
gie-unique-id=1
# 1: classifier, 100: custom
network-type=1
# Let application to parse the inference tensor output
output-tensor-meta=1
tensor-meta-pool-size=8
can anyone help me with this why this error is coming.