Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
Nano
• DeepStream Version
5.0
• JetPack Version (valid for Jetson only)
4.4
• TensorRT Version
7.1
• NVIDIA GPU Driver Version (valid for GPU only)
Hi ,
I am trying to run : deepstream-app -c deepstream_app_config_yoloV3_tiny.txt with camera (logitech 930e) i get the following error :
nvidia@nvidia-desktop:/opt/nvidia/deepstream/deepstream-5.0/sources/objectDetectlo$ deepstream-app -c deepstream_app_config_yoloV3_tiny.txt
Warn: ‘threshold’ parameter has been deprecated. Use ‘pre-cluster-threshold’ instead.
Using winsys: x11
0:00:00.610999334 18646 0x7f180022f0 INFO nvinfer gstnvinfer.cpp:602:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1591> [UID = 1]: Trying to create engine from model files
Loading pre-trained weights…
Loading weights of yolov3-tiny complete!
Total Number of weights read : 8858734
Loading pre-trained weights…
Loading weights of yolov3-tiny complete!
Total Number of weights read : 8858734
Building Yolo network…
layer inp_size out_size weightPtr
(0) conv-bn-leaky 3 x 416 x 416 16 x 416 x 416 496
(1) maxpool 16 x 416 x 416 16 x 208 x 208 496
(2) conv-bn-leaky 16 x 208 x 208 32 x 208 x 208 5232
(3) maxpool 32 x 208 x 208 32 x 104 x 104 5232
(4) conv-bn-leaky 32 x 104 x 104 64 x 104 x 104 23920
(5) maxpool 64 x 104 x 104 64 x 52 x 52 23920
(6) conv-bn-leaky 64 x 52 x 52 128 x 52 x 52 98160
(7) maxpool 128 x 52 x 52 128 x 26 x 26 98160
(8) conv-bn-leaky 128 x 26 x 26 256 x 26 x 26 394096
(9) maxpool 256 x 26 x 26 256 x 13 x 13 394096
(10) conv-bn-leaky 256 x 13 x 13 512 x 13 x 13 1575792
(11) maxpool 512 x 13 x 13 512 x 13 x 13 1575792
(12) conv-bn-leaky 512 x 13 x 13 1024 x 13 x 13 6298480
(13) conv-bn-leaky 1024 x 13 x 13 256 x 13 x 13 6561648
(14) conv-bn-leaky 256 x 13 x 13 512 x 13 x 13 7743344
(15) conv-linear 512 x 13 x 13 255 x 13 x 13 7874159
(16) yolo 255 x 13 x 13 255 x 13 x 13 7874159
(17) route - 256 x 13 x 13 7874159
(18) conv-bn-leaky 256 x 13 x 13 128 x 13 x 13 7907439
INFO: [TRT]: mm1_19: broadcasting input0 to make tensors conform, dims(input0)=[1,26,13][NONE] dims(input1)=[128,13,13][NONE].
INFO: [TRT]: mm2_19: broadcasting input1 to make tensors conform, dims(input0)=[128,26,13][NONE] dims(input1)=[1,13,26][NONE].
(19) upsample 128 x 13 x 13 128 x 26 x 26 -
(20) route - 384 x 26 x 26 7907439
(21) conv-bn-leaky 384 x 26 x 26 256 x 26 x 26 8793199
(22) conv-linear 256 x 26 x 26 255 x 26 x 26 8858734
(23) yolo 255 x 26 x 26 255 x 26 x 26 8858734
Output yolo blob names :
yolo_17
yolo_24
Total number of yolo layers: 49
Building yolo network complete!
Building the TensorRT Engine…
INFO: [TRT]: mm1_19: broadcasting input0 to make tensors conform, dims(input0)=[1,26,13][NONE] dims(input1)=[128,13,13][NONE].
INFO: [TRT]: mm2_19: broadcasting input1 to make tensors conform, dims(input0)=[128,26,13][NONE] dims(input1)=[1,13,26][NONE].
INFO: [TRT]: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
INFO: [TRT]: Detected 1 inputs and 2 output network tensors.
Building complete!
0:02:08.924557517 18646 0x7f180022f0 INFO nvinfer gstnvinfer.cpp:602:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1624> [UID = 1]: serialize cuda engine to file: /opt/nvidia/deepstream/deepstream-5.0/sources/objectDetector_Yolo/model_b1_gpu0_fp32.engine successfully
INFO: [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT data 3x416x416
1 OUTPUT kFLOAT yolo_17 255x13x13
2 OUTPUT kFLOAT yolo_24 255x26x26
0:02:09.366464369 18646 0x7f180022f0 INFO nvinfer gstnvinfer_impl.cpp:311:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-5.0/sources/objectDetector_Yolo/config_infer_primary_yoloV3_tiny.txt sucessfully
Runtime commands:
h: Print this help
q: Quit
p: Pause
r: Resume
NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
To go back to the tiled display, right-click anywhere on the window.
**PERF: FPS 0 (Avg)
**PERF: 0.00 (0.00)
** INFO: <bus_callback:181>: Pipeline ready
** INFO: <bus_callback:167>: Pipeline running
ERROR from src_elem: Internal data stream error.
Debug info: gstbasesrc.c(3055): gst_base_src_loop (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstV4l2Src:src_elem:
streaming stopped, reason not-negotiated (-4)
** INFO: <bus_callback:147>: incorrect camera parameters provided, please provide supported resolution and frame rate
Quitting
App run failed
But when i changed the source from camera to file its working good. (deepstream_app_conif_yolov3_tiny.txt (source 0 -type=1 to 2 ))
nvidia@nvidia-desktop:/opt/nvidia/deepstream/deepstream-5.0/sources/objectDetector_Yolo$ deepstream-app -c deepstream_app_config_yoloV3_tiny.txt
Warn: ‘threshold’ parameter has been deprecated. Use ‘pre-cluster-threshold’ instead.
Using winsys: x11
0:00:00.642630938 3513 0x15913d80 INFO nvinfer gstnvinfer.cpp:602:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1591> [UID = 1]: Trying to create engine from model files
Loading pre-trained weights…
Loading weights of yolov3-tiny complete!
Total Number of weights read : 8858734
Loading pre-trained weights…
Loading weights of yolov3-tiny complete!
Total Number of weights read : 8858734
Building Yolo network…
layer inp_size out_size weightPtr
(0) conv-bn-leaky 3 x 416 x 416 16 x 416 x 416 496
(1) maxpool 16 x 416 x 416 16 x 208 x 208 496
(2) conv-bn-leaky 16 x 208 x 208 32 x 208 x 208 5232
(3) maxpool 32 x 208 x 208 32 x 104 x 104 5232
(4) conv-bn-leaky 32 x 104 x 104 64 x 104 x 104 23920
(5) maxpool 64 x 104 x 104 64 x 52 x 52 23920
(6) conv-bn-leaky 64 x 52 x 52 128 x 52 x 52 98160
(7) maxpool 128 x 52 x 52 128 x 26 x 26 98160
(8) conv-bn-leaky 128 x 26 x 26 256 x 26 x 26 394096
(9) maxpool 256 x 26 x 26 256 x 13 x 13 394096
(10) conv-bn-leaky 256 x 13 x 13 512 x 13 x 13 1575792
(11) maxpool 512 x 13 x 13 512 x 13 x 13 1575792
(12) conv-bn-leaky 512 x 13 x 13 1024 x 13 x 13 6298480
(13) conv-bn-leaky 1024 x 13 x 13 256 x 13 x 13 6561648
(14) conv-bn-leaky 256 x 13 x 13 512 x 13 x 13 7743344
(15) conv-linear 512 x 13 x 13 255 x 13 x 13 7874159
(16) yolo 255 x 13 x 13 255 x 13 x 13 7874159
(17) route - 256 x 13 x 13 7874159
(18) conv-bn-leaky 256 x 13 x 13 128 x 13 x 13 7907439
INFO: [TRT]: mm1_19: broadcasting input0 to make tensors conform, dims(input0)=[1,26,13][NONE] dims(input1)=[128,13,13][NONE].
INFO: [TRT]: mm2_19: broadcasting input1 to make tensors conform, dims(input0)=[128,26,13][NONE] dims(input1)=[1,13,26][NONE].
(19) upsample 128 x 13 x 13 128 x 26 x 26 -
(20) route - 384 x 26 x 26 7907439
(21) conv-bn-leaky 384 x 26 x 26 256 x 26 x 26 8793199
(22) conv-linear 256 x 26 x 26 255 x 26 x 26 8858734
(23) yolo 255 x 26 x 26 255 x 26 x 26 8858734
Output yolo blob names :
yolo_17
yolo_24
Total number of yolo layers: 49
Building yolo network complete!
Building the TensorRT Engine…
INFO: [TRT]: mm1_19: broadcasting input0 to make tensors conform, dims(input0)=[1,26,13][NONE] dims(input1)=[128,13,13][NONE].
INFO: [TRT]: mm2_19: broadcasting input1 to make tensors conform, dims(input0)=[128,26,13][NONE] dims(input1)=[1,13,26][NONE].
INFO: [TRT]: Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
INFO: [TRT]: Detected 1 inputs and 2 output network tensors.
Building complete!
0:01:48.364360507 3513 0x15913d80 INFO nvinfer gstnvinfer.cpp:602:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1624> [UID = 1]: serialize cuda engine to file: /opt/nvidia/deepstream/deepstream-5.0/sources/objectDetector_Yolo/model_b1_gpu0_fp32.engine successfully
INFO: [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT data 3x416x416
1 OUTPUT kFLOAT yolo_17 255x13x13
2 OUTPUT kFLOAT yolo_24 255x26x26
0:01:48.655951470 3513 0x15913d80 INFO nvinfer gstnvinfer_impl.cpp:311:notifyLoadModelStatus:<primary_gie> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-5.0/sources/objectDetector_Yolo/config_infer_primary_yoloV3_tiny.txt sucessfully
Runtime commands:
h: Print this help
q: Quit
p: Pause
r: Resume
NOTE: To expand a source in the 2D tiled display and view object details, left-click on the source.
To go back to the tiled display, right-click anywhere on the window.
**PERF: FPS 0 (Avg)
**PERF: 0.00 (0.00)
** INFO: <bus_callback:181>: Pipeline ready
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
** INFO: <bus_callback:167>: Pipeline running
**PERF: 31.60 (23.85)
**PERF: 45.39 (44.31)
**PERF: 45.67 (44.92)
**PERF: 44.61 (44.75)
**PERF: 46.75 (45.25)
Running gstreamer succeeded ,and i get video :
$ gst-launch-1.0 v4l2src device=/dev/video0 ! image/jpeg,width=1920,height=1080,framerate=30/1 ! jpegdec ! video/x-raw ! nvvideoconvert ! ‘video/x-raw(memory:NVMM)’ ! fpsdisplaysink text-overlay=0 video-sink=nvoverlaysink -v
deepstream_app_conif_yolov3_tiny.txt :
[application]
enable-perf-measurement=1
perf-measurement-interval-sec=5
#gie-kitti-output-dir=streamscl
[tiled-display]
enable=1
rows=1
columns=1
width=1920
height=1080
gpu-id=0
#(0): nvbuf-mem-default - Default memory allocated, specific to particular platform
#(1): nvbuf-mem-cuda-pinned - Allocate Pinned/Host cuda memory, applicable for Tesla
#(2): nvbuf-mem-cuda-device - Allocate Device cuda memory, applicable for Tesla
#(3): nvbuf-mem-cuda-unified - Allocate Unified cuda memory, applicable for Tesla
#(4): nvbuf-mem-surface-array - Allocate Surface Array memory, applicable for Jetson
nvbuf-memory-type=0
[source0]
enable=1
#Type - 1=CameraV4L2 2=URI 3=MultiURI
type=2
uri=file://…/…/samples/streams/sample_1080p_h264.mp4
num-sources=1
gpu-id=0
(0): memtype_device - Memory type Device
(1): memtype_pinned - Memory type Host Pinned
(2): memtype_unified - Memory type Unified
cudadec-memtype=0
camera-width=1920
camera-height=1080
camera-fps-n=30
camera-v4l2-dev-node=0
camera-fps-d=1
#num-extra-surfaces=10
[sink0]
enable=1
#Type - 1=FakeSink 2=EglSink 3=File
type=2
sync=0
source-id=0
gpu-id=0
nvbuf-memory-type=0