Please provide complete information as applicable to your setup.
Hardware Platform (Jetson / GPU) : x86 RTX 4070 super
deepStream Version : 7.1
JetPack Version (valid for Jetson only) none
TensorRT Version :10.5
NVIDIA GPU Driver Version (valid for GPU only) 570
Issue Type( questions, new requirements, bugs) questions
How to reproduce the issue ?
run deepstream-app -c source30_1080p_dec_infer-resnet_tiled_display_int8.txt
Requirement details :
os : ubuntu24.04
cuda : 12.6
cudnn : 9.5.0
i follow install doc to install deepstream.
run deepstream-app -c source30_1080p_dec_infer-resnet_tiled_display_int8.txt
shell show me
deepstream-app -c source30_1080p_dec_infer-resnet_tiled_display_int8.txt
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1152 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app/../../models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b30_gpu0_int8.engine open error
0:00:00.123393251 186927 0x591e9c778560 WARN nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2080> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app/../../models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b30_gpu0_int8.engine failed
0:00:00.123408369 186927 0x591e9c778560 WARN nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2185> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app/../../models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b30_gpu0_int8.engine failed, try rebuild
0:00:00.123413853 186927 0x591e9c778560 INFO nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2106> [UID = 1]: Trying to create engine from model files
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1124 Serialize engine failed because of file path: /opt/nvidia/deepstream/deepstream-7.1/samples/models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b30_gpu0_int8.engine opened error
0:00:52.601057081 186927 0x591e9c778560 WARN nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2133> [UID = 1]: failed to serialize cude engine to file: /opt/nvidia/deepstream/deepstream-7.1/samples/models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b30_gpu0_int8.engine
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:327 [FullDims Engine Info]: layers num: 3
0 INPUT kFLOAT input_1:0 3x544x960 min: 1x3x544x960 opt: 30x3x544x960 Max: 30x3x544x960
1 OUTPUT kFLOAT output_cov/Sigmoid:0 4x34x60 min: 0 opt: 0 Max: 0
2 OUTPUT kFLOAT output_bbox/BiasAdd:0 16x34x60 min: 0 opt: 0 Max: 0
0:00:52.786258402 186927 0x591e9c778560 INFO nvinfer gstnvinfer_impl.cpp:343:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app/config_infer_primary.txt sucessfully
Failed to query video capabilities: Invalid argument
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
Failed to query video capabilities: Invalid argument
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
I have reinstalled the drivers and the system many times, but this did not resolve the issue. I hope you can help me.
update:
i use this docker images nvcr.io/nvidia/tensorrt:23.10-py3 build a container.
run command
docker run -it -v --ipc=host --env DISPLAY=$DISPLAY --volume /tmp/.X11-unix:/tmp/.X11-unix --device /dev/dri -d --gpus=all nvcr.io/nvidia/tensorrt:23.10-py3 /bin/bash
and same install
deepstream can work.
Same installation process, why different results?