I am trying to execute the example here deepstream_python_apps/apps/deepstream-imagedata-multistream at master · NVIDIA-AI-IOT/deepstream_python_apps · GitHub
The example generates the following error:
Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-6.0/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine open error
Full output:
Frames will be saved in frames
Creating Pipeline
Creating streamux
Creating source_bin 0
Creating source bin
source-bin-00
Creating Pgie
Creating nvvidconv1
Creating filter1
Creating tiler
Creating nvvidconv
Creating nvosd
Creating EGLSink
Atleast one of the sources is live
Adding elements to Pipeline
Linking elements in the Pipeline
Now playing...
1 : rtsp://localhost/cbb48b92-f74d-4ad5-b8a9-3affbefcc17e_default/12802797-227b-4066-9f22-09745b012762
Starting pipeline
ERROR: ../nvdsinfer/nvdsinfer_model_builder.cpp:1484 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-6.0/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine open error
0:00:02.436358866 3766 0x3b750d0 WARN nvinfer gstnvinfer.cpp:635:gst_nvinfer_logger:<primary-inference> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1889> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-6.0/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine failed
0:00:02.436436696 3766 0x3b750d0 WARN nvinfer gstnvinfer.cpp:635:gst_nvinfer_logger:<primary-inference> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1996> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-6.0/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine failed, try rebuild
0:00:02.436461928 3766 0x3b750d0 INFO nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<primary-inference> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1914> [UID = 1]: Trying to create engine from model files
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1210 INT8 not supported by platform. Trying FP16 mode.
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1224 FP16 not supported by platform. Using FP32 mode.
WARNING: [TRT]: Detected invalid timing cache, setup a local cache instead
ERROR: ../nvdsinfer/nvdsinfer_model_builder.cpp:1456 Serialize engine failed because of file path: /opt/nvidia/deepstream/deepstream-6.0/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_fp32.engine opened error
0:00:11.521725995 3766 0x3b750d0 WARN nvinfer gstnvinfer.cpp:635:gst_nvinfer_logger:<primary-inference> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1942> [UID = 1]: failed to serialize cude engine to file: /opt/nvidia/deepstream/deepstream-6.0/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_fp32.engine
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x368x640
1 OUTPUT kFLOAT conv2d_bbox 16x23x40
2 OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40
0:00:11.527632843 3766 0x3b750d0 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<primary-inference> [UID 1]: Load new model:dstest_imagedata_config.txt sucessfully
Decodebin child added: source
Decodebin child added: decodebin0
Decodebin child added: rtph264depay0
Decodebin child added: h264parse0
Decodebin child added: capsfilter0
Decodebin child added: nvv4l2decoder0
In cb_newpad
/home/ubuntu/pycharm/projects/fususcore-ai-detector-nvidia/etc/aws/python3: line 56: 3766 Bus error (core dumped) /home/ubuntu/pycharm/venv/bin/python3 "$@"
Process finished with exit code 135 (interrupted by signal 7: SIGEMT)
Setup:
- Ubuntu 18.04
- Deepstream 6.0
- Python 3.6
- Cuda 11.4.100
- Drivers 470.82.00
- Tesla M60
pip3 freeze:
absl-py==1.0.0
aiocontextvars==0.2.2
aiohttp==3.8.1
aiosignal==1.2.0
appdirs==1.4.4
asn1crypto==0.24.0
async-timeout==4.0.1
asynctest==0.13.0
attrs==17.4.0
Automat==0.6.0
av==8.0.3
awscli==1.18.69
backcall==0.2.0
bidict==0.21.4
blinker==1.4
boto3==1.17.4
botocore==1.20.4
cachetools==4.2.4
certifi==2018.1.18
chardet==4.0.0
charset-normalizer==2.0.7
click==7.1.2
cloud-init==21.2
colorama==0.3.7
command-not-found==0.3
configobj==5.0.6
constantly==15.1.0
contextlib2==0.6.0.post1
contextvars==2.4
cronex==0.1.3.1
cryptography==2.1.4
cupy-cuda113==9.6.0
cycler==0.11.0
Cython==0.29.24
dataclasses==0.8
decorator==5.1.0
dill==0.3.4
distro-info===0.18ubuntu0.18.04.1
docutils==0.14
ec2-hibinit-agent==1.0.0
fastrlock==0.8
filterpy==1.4.5
frozenlist==1.2.0
fsspec==2021.11.0
future==0.18.2
google-auth==2.3.3
google-auth-oauthlib==0.4.6
grpcio==1.42.0
hibagent==1.0.1
httplib2==0.9.2
hyperlink==17.3.1
icc-rt==2020.0.133
idna==2.10
idna-ssl==1.1.0
imageio==2.10.5
immutables==0.16
importlib-metadata==4.8.2
incremental==16.10.1
influxdb==5.3.1
intel-openmp==2020.0.133
ipython==7.16.1
ipython-genutils==0.2.0
jedi==0.18.1
Jinja2==2.10
jmespath==0.9.3
jsonpatch==1.16
jsonpointer==1.10
jsonschema==2.6.0
keyring==10.6.0
keyrings.alt==3.0
kiwisolver==1.3.1
language-selector==0.1
llvmlite==0.36.0
loguru==0.5.3
Mako==1.1.6
Markdown==3.3.6
MarkupSafe==1.0
matplotlib==3.3.4
motpy==0.0.8
msgpack==1.0.2
multidict==5.2.0
multiprocess==0.70.12.2
netifaces==0.10.4
numba==0.53.1
numpy==1.19.5
oauthlib==3.1.1
olefile==0.45.1
onnx==1.10.2
openvino==2021.4.2
packaging==21.2
PAM==0.4.2
pandas==1.1.5
parso==0.8.2
pathos==0.2.8
pexpect==4.2.1
pgi==0.0.11.2
pickleshare==0.7.5
Pillow==8.4.0
pkg_resources==0.0.0
pox==0.3.0
ppft==1.6.6.4
prompt-toolkit==3.0.22
protobuf==3.19.1
psutil==5.8.0
pyasn1==0.4.2
pyasn1-modules==0.2.1
pycocotools==2.0.2
pycrypto==2.6.1
pycuda==2020.1
pyDeprecate==0.3.1
pyds @ file:///home/ubuntu/pycharm/libs/deepstream_python_apps/bindings/build/pyds-1.1.0-py3-none-linux_x86_64.whl
Pygments==2.2.0
PyGObject==3.26.1
pyjnius==1.4.1
PyJWT==1.5.3
pyOpenSSL==17.5.0
pyparsing==2.4.7
pyserial==3.4
python-apt==1.6.5+ubuntu0.7
python-dateutil==2.8.1
python-debian==0.1.32
python-engineio==4.2.1
python-socketio==5.4.0
pytools==2021.2.9
pytorch-ignite==0.4.7
pytorch-lightning==1.5.2
pytz==2021.3
pyxdg==0.25
PyYAML==5.3.1
requests==2.25.1
requests-oauthlib==1.3.0
requests-unixsocket==0.1.5
roman==2.0.0
rsa==3.4.2
s3transfer==0.3.3
schedule==1.0.0
schema==0.7.4
scipy==1.5.4
screen-resolution-extra==0.0.0
seaborn==0.11.2
SecretStorage==2.3.1
sentry-sdk==0.19.5
service-identity==16.0.0
six==1.11.0
snowy==0.0.9
sos==4.1
ssh-import-id==5.7
supervisor==4.2.1
systemd-python==234
tabulate==0.8.9
tensorboard==2.7.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorrt==8.0.1.6
thop==0.0.31.post2005241907
toml==0.10.2
torch==1.10.0+cu113
torch-tensorrt==1.0.0
torchmetrics==0.6.0
torchsummary==1.5.1
torchvision==0.11.1+cu113
tqdm==4.56.0
traitlets==4.3.3
Twisted==17.9.0
typed-ast==1.4.2
typing_extensions==4.0.0
ufw==0.36
unattended-upgrades==0.1
urllib3==1.26.7
wcwidth==0.2.5
webcolors==1.11.1
websocket-client==0.57.0
Werkzeug==2.0.2
xkit==0.0.0
yarl==1.7.2
zipp==3.6.0
zope.interface==4.3.2
dpkg -l | grep nvinfer:
ii libnvinfer-bin 8.0.1-1+cuda11.3 amd64 TensorRT binaries
ii libnvinfer-dev 8.0.1-1+cuda11.3 amd64 TensorRT development libraries and headers
ii libnvinfer-doc 8.0.1-1+cuda11.3 all TensorRT documentation
ii libnvinfer-plugin-dev 8.0.1-1+cuda11.3 amd64 TensorRT plugin libraries
ii libnvinfer-plugin8 8.0.1-1+cuda11.3 amd64 TensorRT plugin libraries
ii libnvinfer-samples 8.0.1-1+cuda11.3 all TensorRT samples
ii libnvinfer8 8.0.1-1+cuda11.3 amd64 TensorRT runtime libraries
ii python3-libnvinfer 8.0.1-1+cuda11.3 amd64 Python 3 bindings for TensorRT
ls /opt/nvidia/deepstream/deepstream-6.0/samples/models/Primary_Detector/:
cal_trt.bin labels.txt resnet10.caffemodel resnet10.prototxt
to build the DS python binding, here are steps for reference also