Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU) AMD64, Ubuntu 20.04 (host), RTX 3080
• DeepStream Version 6.2 deepstream-6.2-devel
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only) CUDA 12, 525
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
environment
AMD64 / RTX3080 GPU
CUDA 12 525 driver
in a deepstream-6.2-devel docker container
v4l2-ctl --list-devices
USB 2.0 Camera: USB Camera (usb-0000:06:00.4-2):
/dev/video0
/dev/video1
/dev/video2
/dev/video3
HD User Facing: HD User Facing (usb-0000:06:00.4-3):
/dev/video4
/dev/video5
v4l2-ctl -d /dev/video2 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Type: Video Capture
[0]: 'H264' (H.264, compressed)
Size: Discrete 1920x1080
Interval: Discrete 0.033s (30.000 fps)
Interval: Discrete 0.033s (30.000 fps)
VLC
v4l2:///dev/video0 -VLC Media Player
works as expected (good video, no problems)
deepstream-test1
config file dstest1_config.yml
with source configured as:
source = v4l2 camera (H264)
source0:
enable: 1
type: 1
camera-width: 1920
camera-height: 1080
camera-v4l2-dev-node: 2
camera-fps-n: 30
camera-fps-d: 1
gpu-id: 0
cudadec-memtype: 0
result
jay@nitro:/opt/nvidia/deepstream/deepstream-6.2/sources/apps/sample_apps/deepstream-test1$ ./deepstream-test1-app v4l2_config.yml
Added elements to bin
Using file: v4l2_config.yml
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in CUDA C++ Programming Guide
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in CUDA C++ Programming Guide
0:00:01.724243462 778 0x560abb8142a0 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1909> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.2/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x368x640
1 OUTPUT kFLOAT conv2d_bbox 16x23x40
2 OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40
0:00:01.789619856 778 0x560abb8142a0 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2012> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.2/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
0:00:01.791633561 778 0x560abb8142a0 INFO nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus: [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-6.2/sources/apps/sample_apps/deepstream-test1/dstest1_pgie_config.yml sucessfully
Running…
ERROR from element h264-parser: No valid frames found before end of stream
Error details: gstbaseparse.c(3657): gst_base_parse_loop (): /GstPipeline:dstest1-pipeline/GstH264Parse:h264-parser
Returned, stopping playback
nvstreammux: Successfully handled EOS for source_id=0
Deleting pipeline
source = rtsp (H264)
stream created with
jay@nitro:/project/deepstream/gst1.16$ ./test-launch “v4l2src device=/dev/video2 ! h264parse ! video/x-h264 ! queue ! rtph264pay name=pay0 pt=96”
stream ready at rtsp://127.0.0.1:8554/test
tested w/ VLC
network stream: rtsp://127.0.0.1:8554/test
works as expected
rtsp_config.yml is dstest1_config.yml with the following source defined
source0:
enable: 1
type: 4
url: rtsp://127.0.0.1:8554/test
gpu-id: 0
cudadec-memtype: 0
result
jay@nitro:/opt/nvidia/deepstream/deepstream-6.2/sources/apps/sample_apps/deepstream-test1$ ./deepstream-test1-app rtsp_config.yml
Added elements to bin
Using file: rtsp_config.yml
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in CUDA C++ Programming Guide
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in CUDA C++ Programming Guide
0:00:01.724513754 863 0x55a004acc6a0 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1909> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.2/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x368x640
1 OUTPUT kFLOAT conv2d_bbox 16x23x40
2 OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40
0:00:01.789101694 863 0x55a004acc6a0 INFO nvinfer gstnvinfer.cpp:680:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2012> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.2/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
0:00:01.790887458 863 0x55a004acc6a0 INFO nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus: [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-6.2/sources/apps/sample_apps/deepstream-test1/dstest1_pgie_config.yml sucessfully
Running…
ERROR from element h264-parser: No valid frames found before end of stream
Error details: gstbaseparse.c(3657): gst_base_parse_loop (): /GstPipeline:dstest1-pipeline/GstH264Parse:h264-parser
Returned, stopping playback
nvstreammux: Successfully handled EOS for source_id=0
Deleting pipeline
question
What do I need to change to get:
v4l2 H264 camera to work (USB or RTSP)
will v4l2 MJPEG (image/jpeg) work?
v4l2-ctl -d /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Type: Video Capture
[0]: 'MJPG' (Motion-JPEG, compressed)
Size: Discrete 1920x1080
Interval: Discrete 0.033s (30.000 fps)
Interval: Discrete 0.033s (30.000 fps)
[1]: 'YUYV' (YUYV 4:2:2)
Size: Discrete 640x480
Interval: Discrete 0.033s (30.000 fps)
Interval: Discrete 0.033s (30.000 fps)
rtsp stream:
./test-launch “v4l2src device=/dev/video0 ! videorate max-rate=20 ! image/jpeg,width=1920,height=1080,framerate=20/1 ! rtpjpegpay name=pay0 pt=96”
stream ready at rtsp://127.0.0.1:8554/test