Deepstream-test1 v4l2 source configuration question

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) AMD64, Ubuntu 20.04 (host), RTX 3080
• DeepStream Version 6.2 deepstream-6.2-devel
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only) CUDA 12, 525
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

environment

AMD64 / RTX3080 GPU
CUDA 12 525 driver

in a deepstream-6.2-devel docker container

v4l2-ctl --list-devices
USB 2.0 Camera: USB Camera (usb-0000:06:00.4-2):
/dev/video0
/dev/video1
/dev/video2
/dev/video3

HD User Facing: HD User Facing (usb-0000:06:00.4-3):
/dev/video4
/dev/video5

v4l2-ctl -d /dev/video2 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Type: Video Capture

[0]: 'H264' (H.264, compressed)
	Size: Discrete 1920x1080
		Interval: Discrete 0.033s (30.000 fps)
		Interval: Discrete 0.033s (30.000 fps)

VLC
v4l2:///dev/video0 -VLC Media Player
works as expected (good video, no problems)

deepstream-test1

config file dstest1_config.yml
with source configured as:

source = v4l2 camera (H264)

source0:
enable: 1
type: 1
camera-width: 1920
camera-height: 1080
camera-v4l2-dev-node: 2
camera-fps-n: 30
camera-fps-d: 1
gpu-id: 0
cudadec-memtype: 0

result

jay@nitro:/opt/nvidia/deepstream/deepstream-6.2/sources/apps/sample_apps/deepstream-test1$ ./deepstream-test1-app v4l2_config.yml
Added elements to bin
Using file: v4l2_config.yml
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in CUDA C++ Programming Guide
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in CUDA C++ Programming Guide
0:00:01.724243462 778 0x560abb8142a0 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1909> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.2/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x368x640
1 OUTPUT kFLOAT conv2d_bbox 16x23x40
2 OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40

0:00:01.789619856 778 0x560abb8142a0 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2012> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.2/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
0:00:01.791633561 778 0x560abb8142a0 INFO nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus: [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-6.2/sources/apps/sample_apps/deepstream-test1/dstest1_pgie_config.yml sucessfully
Running…
ERROR from element h264-parser: No valid frames found before end of stream
Error details: gstbaseparse.c(3657): gst_base_parse_loop (): /GstPipeline:dstest1-pipeline/GstH264Parse:h264-parser
Returned, stopping playback
nvstreammux: Successfully handled EOS for source_id=0
Deleting pipeline

source = rtsp (H264)

stream created with

jay@nitro:/project/deepstream/gst1.16$ ./test-launch “v4l2src device=/dev/video2 ! h264parse ! video/x-h264 ! queue ! rtph264pay name=pay0 pt=96”
stream ready at rtsp://127.0.0.1:8554/test

tested w/ VLC

network stream: rtsp://127.0.0.1:8554/test

works as expected

rtsp_config.yml is dstest1_config.yml with the following source defined

source0:
enable: 1
type: 4
url: rtsp://127.0.0.1:8554/test
gpu-id: 0
cudadec-memtype: 0

result

jay@nitro:/opt/nvidia/deepstream/deepstream-6.2/sources/apps/sample_apps/deepstream-test1$ ./deepstream-test1-app rtsp_config.yml
Added elements to bin
Using file: rtsp_config.yml
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in CUDA C++ Programming Guide
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in CUDA C++ Programming Guide
0:00:01.724513754 863 0x55a004acc6a0 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1909> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.2/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x368x640
1 OUTPUT kFLOAT conv2d_bbox 16x23x40
2 OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40

0:00:01.789101694 863 0x55a004acc6a0 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2012> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.2/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
0:00:01.790887458 863 0x55a004acc6a0 INFO nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus: [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-6.2/sources/apps/sample_apps/deepstream-test1/dstest1_pgie_config.yml sucessfully
Running…
ERROR from element h264-parser: No valid frames found before end of stream
Error details: gstbaseparse.c(3657): gst_base_parse_loop (): /GstPipeline:dstest1-pipeline/GstH264Parse:h264-parser
Returned, stopping playback
nvstreammux: Successfully handled EOS for source_id=0
Deleting pipeline

question

What do I need to change to get:

v4l2 H264 camera to work (USB or RTSP)
will v4l2 MJPEG (image/jpeg) work?

v4l2-ctl -d /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Type: Video Capture

[0]: 'MJPG' (Motion-JPEG, compressed)
	Size: Discrete 1920x1080
		Interval: Discrete 0.033s (30.000 fps)
		Interval: Discrete 0.033s (30.000 fps)

[1]: 'YUYV' (YUYV 4:2:2)
	Size: Discrete 640x480
		Interval: Discrete 0.033s (30.000 fps)
		Interval: Discrete 0.033s (30.000 fps)

rtsp stream:

./test-launch “v4l2src device=/dev/video0 ! videorate max-rate=20 ! image/jpeg,width=1920,height=1080,framerate=20/1 ! rtpjpegpay name=pay0 pt=96”
stream ready at rtsp://127.0.0.1:8554/test

3

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

The deepstream_test1 cannot support the v4l2 source. It just support h264 file. If you want to test your camera, you can try to use the samples\configs\deepstream-app\source1_usb_dec_infer_resnet_int8.txt config file.

deepstream-app -c source1_usb_dec_infer_resnet_int8.txt
5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.