Engine from file :primary.resnet10.caffemodel_b4_gpu0_int8.engine failed

stefan.s_from_G · March 7, 2023, 8:04am

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson)
• DeepStream Version 6.1.1
• JetPack Version 5.02
• TensorRT Version
• Issue Type( question)
• How to reproduce the issue ? (Launching on Jetson with jetpack 5.02 a docker container using a object detector with resnet 10 4 class. In the logs of the jetson docker start an error is shown. )
• Requirement details( I have created the docker container on ubuntu 20.04 with deepstream 6.2 and graph composer 2.5. The deepstream app runs after start, but I cannot verify if that object detector is wrong initiated. Please give valuable help. thanks.)

stefan@xavier:~$ sudo docker run -it --rm --net=host --runtime nvidia -e DISPLAY=:0 -v /tmp/.X11-unix/:/tmp/.X11-unix -v /tmp/argus_socket:/tmp/argus_socket pizzabox.homebase.local:5050/stefan/deepstream_rtsp_x4_rtsp_out_jetson:test
2023-03-07 08:02:22.489 INFO gxf/gxe/gxe.cpp@180: Creating context
2023-03-07 08:02:22.680 INFO gxf/gxe/gxe.cpp@105: Loading app: ‘deepstream_rtsp_x4_rtsp_out.yaml’
2023-03-07 08:02:22.680 INFO gxf/std/yaml_file_loader.cpp@129: Loading GXF entities from YAML file ‘deepstream_rtsp_x4_rtsp_out.yaml’…
2023-03-07 08:02:22.702 INFO gxf/gxe/gxe.cpp@105: Loading app: ‘parameters_rtsp_x4_rtsp_out.yaml’
2023-03-07 08:02:22.702 INFO gxf/std/yaml_file_loader.cpp@129: Loading GXF entities from YAML file ‘parameters_rtsp_x4_rtsp_out.yaml’…
2023-03-07 08:02:22.708 INFO gxf/gxe/gxe.cpp@249: Initializing…

(gst-plugin-scanner:19): GStreamer-WARNING **: 08:02:22.948: Failed to load plugin ‘/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstmpeg2enc.so’: libmpeg2encpp-2.1.so.0: cannot open shared object file: No such file or directory

(gst-plugin-scanner:19): GStreamer-WARNING **: 08:02:22.999: Failed to load plugin ‘/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstmpeg2dec.so’: libmpeg2.so.0: cannot open shared object file: No such file or directory

(gst-plugin-scanner:19): GStreamer-WARNING **: 08:02:23.144: Failed to load plugin ‘/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstchromaprint.so’: libavcodec.so.58: cannot open shared object file: No such file or directory

(gst-plugin-scanner:19): GStreamer-WARNING **: 08:02:23.148: Failed to load plugin ‘/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstopenmpt.so’: libmpg123.so.0: cannot open shared object file: No such file or directory

(gst-plugin-scanner:19): GStreamer-WARNING **: 08:02:23.300: Failed to load plugin ‘/usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstmpg123.so’: libmpg123.so.0: cannot open shared object file: No such file or directory

(gst-plugin-scanner:19): GStreamer-WARNING **: 08:02:23.971: Failed to load plugin ‘/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so’: libtritonserver.so: cannot open shared object file: No such file or directory

(gst-plugin-scanner:19): GStreamer-WARNING **: 08:02:24.175: Failed to load plugin ‘/usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so’: librivermax.so.0: cannot open shared object file: No such file or directory
2023-03-07 08:02:25.167 INFO extensions/nvdsbase/nvds_scheduler.cpp@270: This program is linked against GStreamer 1.16.3

2023-03-07 08:02:25.177 INFO extensions/nvdssource/nvurisrcbin.hpp@24: initialize: nvurisrcbin single_source_input

2023-03-07 08:02:25.177 INFO extensions/nvdsmuxdemux/nvstreammux.hpp@27: initialize: nvstreammux streammux

2023-03-07 08:02:25.178 INFO extensions/nvdsinference/nvinferbin.hpp@24: initialize: nvinferbin object_detector

2023-03-07 08:02:25.178 INFO extensions/nvdsvisualization/nvosdbin.hpp@24: initialize: nvosdbin onscreen_display

2023-03-07 08:02:25.179 INFO extensions/nvdssource/nvurisrcbin.hpp@24: initialize: nvurisrcbin Single Source Input7

2023-03-07 08:02:25.180 INFO extensions/nvdsvisualization/nvtilerbin.hpp@37: initialize: nvtilerbin Video Tiler11

2023-03-07 08:02:25.180 INFO extensions/nvdsoutputsink/nvrtspoutsinkbin.hpp@23: initialize: nvrtspoutsinkbin nv_ds_rtsp_out21

2023-03-07 08:02:25.181 INFO extensions/nvdssource/nvurisrcbin.hpp@24: initialize: nvurisrcbin Single Source Input0

2023-03-07 08:02:25.181 INFO extensions/nvdssource/nvurisrcbin.hpp@24: initialize: nvurisrcbin Single Source Input3

2023-03-07 08:02:25.181 INFO extensions/nvdstracker/nvtrackerbin.hpp@23: initialize: nvtrackerbin Object Tracker6

2023-03-07 08:02:25.182 INFO extensions/nvdsanalytics/nvdsanalytics.hpp@23: initialize: nvdsanalytics Object Analytics11

2023-03-07 08:02:25.182 INFO gxf/gxe/gxe.cpp@256: Running…
2023-03-07 08:02:25.182 INFO extensions/nvdsbase/nvds_scheduler.cpp@121: Scheduling 11 elements and 1 components
2023-03-07 08:02:25.182 INFO extensions/nvdssource/nvurisrcbin.hpp@32: create_element: nvurisrcbin single_source_input

2023-03-07 08:02:25.436 INFO extensions/nvdssource/nvurisrcbin.hpp@56: bin_add: nvurisrcbin single_source_input

2023-03-07 08:02:25.436 INFO extensions/nvdsmuxdemux/nvstreammux.hpp@37: create_element: nvstreammux streammux

2023-03-07 08:02:25.439 INFO extensions/nvdsmuxdemux/nvstreammux.hpp@61: bin_add: nvstreammux streammux

2023-03-07 08:02:25.440 INFO extensions/nvdsinference/nvinferbin.hpp@32: create_element: nvinferbin object_detector

2023-03-07 08:02:25.446 INFO extensions/nvdsinference/nvinferbin.hpp@56: bin_add: nvinferbin object_detector

2023-03-07 08:02:25.450 INFO extensions/nvdsvisualization/nvosdbin.hpp@32: create_element: nvosdbin onscreen_display

2023-03-07 08:02:25.458 INFO extensions/nvdsvisualization/nvosdbin.hpp@56: bin_add: nvosdbin onscreen_display

2023-03-07 08:02:25.459 INFO extensions/nvdssource/nvurisrcbin.hpp@32: create_element: nvurisrcbin Single Source Input7

2023-03-07 08:02:25.459 INFO extensions/nvdssource/nvurisrcbin.hpp@56: bin_add: nvurisrcbin Single Source Input7

2023-03-07 08:02:25.459 INFO extensions/nvdsvisualization/nvtilerbin.hpp@45: create_element: nvtilerbin Video Tiler11

2023-03-07 08:02:25.463 INFO extensions/nvdsvisualization/nvtilerbin.hpp@69: bin_add: nvtilerbin Video Tiler11

2023-03-07 08:02:25.463 INFO extensions/nvdsoutputsink/nvrtspoutsinkbin.hpp@31: create_element: nvrtspoutsinkbin nv_ds_rtsp_out21

2023-03-07 08:02:25.463 INFO extensions/nvdsoutputsink/nvrtspoutsinkbin.hpp@55: bin_add: nvrtspoutsinkbin nv_ds_rtsp_out21

2023-03-07 08:02:25.464 INFO extensions/nvdssource/nvurisrcbin.hpp@32: create_element: nvurisrcbin Single Source Input0

2023-03-07 08:02:25.464 INFO extensions/nvdssource/nvurisrcbin.hpp@56: bin_add: nvurisrcbin Single Source Input0

2023-03-07 08:02:25.464 INFO extensions/nvdssource/nvurisrcbin.hpp@32: create_element: nvurisrcbin Single Source Input3

2023-03-07 08:02:25.464 INFO extensions/nvdssource/nvurisrcbin.hpp@56: bin_add: nvurisrcbin Single Source Input3

2023-03-07 08:02:25.465 INFO extensions/nvdstracker/nvtrackerbin.hpp@31: create_element: nvtrackerbin Object Tracker6

2023-03-07 08:02:25.468 INFO extensions/nvdstracker/nvtrackerbin.hpp@55: bin_add: nvtrackerbin Object Tracker6

2023-03-07 08:02:25.468 INFO extensions/nvdsanalytics/nvdsanalytics.hpp@31: create_element: nvdsanalytics Object Analytics11

2023-03-07 08:02:25.469 INFO extensions/nvdsanalytics/nvdsanalytics.hpp@55: bin_add: nvdsanalytics Object Analytics11

*** NvDsRtspOut/nv_ds_rtsp_out21: Launched RTSP Streaming at rtsp://localhost:8554/ds-test ***

Opening in BLOCKING MODE
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
gstnvtracker: Batch processing is ON
gstnvtracker: Past frame output is OFF
[NvMultiObjectTracker] Initialized
WARNING: Deserialize engine failed because file path: primary.resnet10.caffemodel_b4_gpu0_int8.engine open error
0:00:06.433980717 1 0xffff5c018180 WARN nvinfer gstnvinfer.cpp:677:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 1]: deserialize engine from file :primary.resnet10.caffemodel_b4_gpu0_int8.engine failed
0:00:06.508653180 1 0xffff5c018180 WARN nvinfer gstnvinfer.cpp:677:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 1]: deserialize backend context from engine from file :primary.resnet10.caffemodel_b4_gpu0_int8.engine failed, try rebuild
0:00:06.509348225 1 0xffff5c018180 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: The implicit batch dimension mode has been deprecated. Please create the network with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag whenever possible.

Fiona.Chen · March 7, 2023, 9:12am

Is this the whole log? Can the graph run in host?

stefan.s_from_G · March 7, 2023, 9:31am

Yes, the graph is running successfully on jetson host.
In the log an entry, it seems that the file is being created by the graph.

0:02:13.002073649     1 0xffff40018180 INFO                 nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 1]: serialize cuda engine to file: /workspace/deepstream_rtsp_x4_rtsp_out/gxf/sample_models/primary.resnet10.caffemodel_b4_gpu0_int8.engine successfully

WARNING: Deserialize engine failed because file path: primary.resnet10.caffemodel_b4_gpu0_int8.engine open error
0:00:06.629547451     1 0xffff40018180 WARN                 nvinfer gstnvinfer.cpp:677:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 1]: deserialize engine from file :primary.resnet10.caffemodel_b4_gpu0_int8.engine failed
0:00:06.704717826     1 0xffff40018180 WARN                 nvinfer gstnvinfer.cpp:677:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 1]: deserialize backend context from engine from file :primary.resnet10.caffemodel_b4_gpu0_int8.engine failed, try rebuild
0:00:06.705302470     1 0xffff40018180 INFO                 nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: The implicit batch dimension mode has been deprecated. Please create the network with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag whenever possible.
0:02:13.002073649     1 0xffff40018180 INFO                 nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 1]: serialize cuda engine to file: /workspace/deepstream_rtsp_x4_rtsp_out/gxf/sample_models/primary.resnet10.caffemodel_b4_gpu0_int8.engine successfully
INFO: [Implicit Engine Info]: layers num: 3
0   INPUT  kFLOAT input_1         3x368x640       
1   OUTPUT kFLOAT conv2d_bbox     16x23x40        
2   OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40         

0:02:13.125178970     1 0xffff40018180 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 1]: Load new model:/workspace/deepstream_rtsp_x4_rtsp_out/gxf/sample_models/config_infer_primary.txt sucessfully
Running...
****** NvDsScheduler Runtime Keyboard controls:
p: Pause pipeline
r: Resume pipeline
q: Quit pipeline
WARNING from element NvDsRtspOut/nv_ds_rtsp_out21: H.265 does not support 'Baseline' profile. Overriding to 'Main' profile.
2023-03-07 09:28:20.484 INFO  extensions/nvdsbase/nvds_scheduler.cpp@398: NvDsScheduler Pipeline ready

2023-03-07 09:28:20.489 INFO  extensions/nvdsbase/nvds_scheduler.cpp@383: NvDsScheduler Pipeline running

Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
Opening in BLOCKING MODE 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteOpen : Block : BlockType = 261 
NvMMLiteBlockCreate : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
NvMMLiteOpen : Block : BlockType = 8 
===== NVMEDIA: NVENC =====
NvMMLiteBlockCreate : Block : BlockType = 8 
Source 3: Frame Number = 0 Total objects = 0 [ ]

Fiona.Chen · March 7, 2023, 9:37am

What do you mean? Can you run “xhost +” before you run the docker? Can you run "rm -r /tmp/* " before run the graph?

stefan.s_from_G · March 7, 2023, 9:46am

Yes

Fiona.Chen · March 7, 2023, 9:53am

What is the result?

Can you explain what on earth is the error? I do not find any error in the log you posted.

stefan.s_from_G · March 7, 2023, 10:20am

Excuse me for the question, that much.
The problem has been solved, I thought that is obvious.

Fiona.Chen · March 7, 2023, 10:29am

Glad to hear that!

system · March 21, 2023, 10:29am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.