DS6.2 dGPU nvv4l2decoder issue

adityawasnik91 · August 31, 2023, 12:48pm

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) dGPU 3060
**• DeepStream Version :- 6.2
**• TensorRT Version:- 8.6.1.6

I have a basic pipeline that works 0:00:00.137442163 87766 0x555b2ad49230 WARN 0:00:00.137468033 87766 0x555b2ad49230 WARN 0:00:00.137471753 87766 0x555b2ad49230 WARN 0:00:00.137474675 87766 0x555b2ad49230 WARN 0:00:00.137484803 87766 0x555b2ad49230 WARN 0:00:00.137487621 87766 0x555b2ad49230 WARN 0:00:00.137490376 87766 0x555b2ad49230 WARN 0:00:00.137492893 87766 0x555b2ad49230 WARN 0:00:00.137500171 87766 0x555b2ad49230 WARN 0:00:00.137502767 87766 0x555b2ad49230 WARN 0:00:00.137505233 87766 0x555b2ad49230 WARN 0:00:00.137507701 87766 0x555b2ad49230 WARN 0:00:00.137512368 87766 0x555b2ad49230 WARN 0:00:00.137515760 87766 0x555b2ad49230 WARN 0:00:00.137519452 87766 0x555b2ad49230 WARN 0:00:00.137522588 87766 0x555b2ad49230 WARN 0:00:00.137530065 87766 0x555b2ad49230 WARN 0:00:00.137532951 87766 0x555b2ad49230 WARN 0:00:00.137535189 87766 0x555b2ad49230 WARN 0:00:00.137537992 87766 0x555b2ad49230 WARN 0:00:00.137542372 87766 0x555b2ad49230 WARN 0:00:00.137545228 87766 0x555b2ad49230 WARN 0:00:00.137547919 87766 0x555b2ad49230 WARN 0:00:00.137550963 87766 0x555b2ad49230 WARN 0:00:00.137557855 87766 0x555b2ad49230 WARN 0:00:00.137560700 87766 0x555b2ad49230 WARN 0:00:00.137563324 87766 0x555b2ad49230 WARN 0:00:00.137566033 87766 0x555b2ad49230 WARN 0:00:00.137572353 87766 0x555b2ad49230 WARN 0:00:00.137575613 87766 0x555b2ad49230 WARN 0:00:00.137578238 87766 0x555b2ad49230 WARN 0:00:00.137580691 87766 0x555b2ad49230 WARN 0:00:00.137584958 87766 0x555b2ad49230 WARN 0:00:00.137588052 87766 0x555b2ad49230 WARN 0:00:00.137590592 87766 0x555b2ad49230 WARN 0:00:00.137593473 87766 0x555b2ad49230 WARN 0:00:00.137598966 87766 0x555b2ad49230 WARN 0:00:00.137602147 87766 0x555b2ad49230 WARN 0:00:00.137604778 87766 0x555b2ad49230 WARN 0:00:00.137607818 87766 0x555b2ad49230 WARN 0:00:00.137801675 87766 0x555b2ad49230 WARN 0:00:00.137806964 87766 0x555b2ad49230 WARN 0:00:00.137809804 87766 0x555b2ad49230 WARN 0:00:00.137812869 87766 0x555b2ad49230 WARN 0:00:00.137820105 87766 0x555b2ad49230 WARN on Jetson Nano. But when I tried to port it to dGPU setup, Im getting following error with gst debug logs.
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat MJPG
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat MJPG
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat AV10
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat AV10
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat DVX5
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat DVX5
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat DVX4
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat DVX4
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat MPG4
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat MPG4
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat MPG2
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat MPG2
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat H265
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat H265
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat VP90
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat VP90
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat VP80
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat VP80
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe minimum capture size for pixelformat H264
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:sink Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:sink Could not probe maximum capture size for pixelformat H264
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:src Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:src Could not probe minimum capture size for pixelformat NM12
v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:nvv4l2-decoder:src Unable to try format: Unknown error -1
v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:nvv4l2-decoder:src Could not probe maximum capture size for pixelformat NM12
v4l2 gstv4l2object.c:2395:gst_v4l2_object_add_interlace_mode:0x555b2a7f7f90 Failed to determine interlace mode

0:00:07.897873346 83597 0x5570aefdac00 WARN jpegparse gstjpegparse.c:664:gst_jpeg_parse_read_header: unhandled marker bf, leavingnvbufsurface: Invalid color format (0)0:00:07.898271098 83597 0x5570aefdac00 ERROR v4l2allocator gstv4l2allocator.c:784:gst_v4l2_allocator_start:nvv4l2-decoder:pool:sink:allocator error requesting 2 buffers: Unknown error -10:00:07.898277307 83597 0x5570aefdac00 ERROR v4l2bufferpool gstv4l2bufferpool.c:1185:gst_v4l2_buffer_pool_start:nvv4l2-decoder:pool:sink we received 0 buffer from device ‘/dev/nvidia0’, we want at least 20:00:07.898280789 83597 0x5570aefdac00 ERROR bufferpool gstbufferpool.c:559:gst_buffer_pool_set_active:nvv4l2-decoder:pool:sink start failed0:00:07.898284890 83597 0x5570aefdac00 WARN v4l2videodec gstv4l2videodec.c:1783:gst_v4l2_video_dec_handle_frame: error: Failed to allocate required memory.0:00:07.898287722 83597 0x5570aefdac00 WARN v4l2videodec gstv4l2videodec.c:1783:gst_v4l2_video_dec_handle_frame: error: Buffer pool activation failed0:00:07.898323612 83597 0x5570aefdac00 WARN basesrc gstbasesrc.c:3072:gst_base_src_loop:<data.appsrc> error: Internal data stream error.0:00:07.898327024 83597 0x5570aefdac00 WARN basesrc gstbasesrc.c:3072:gst_base_src_loop:<data.appsrc> error: streaming stopped, reason error (-5)ERROR from element nvv4l2-decoder: Failed to allocate required memory.Error details: gstv4l2videodec.c(1783): gst_v4l2_video_dec_handle_frame (): /GstPipeline:nvdsanalytics-test-pipeline/nvv4l2decoder:nvv4l2-decoder:Buffer pool activation failedReturned, stopping playbacknvbufsurface: Invalid color format (0)0:00:07.898538375 83597 0x5570aefdac00 ERROR v4l2allocator gstv4l2allocator.c:784:gst_v4l2_allocator_start:nvv4l2-decoder:pool:sink:allocator error requesting 2 buffers: Unknown error -10:00:07.898542497 83597 0x5570aefdac00 ERROR v4l2bufferpool gstv4l2bufferpool.c:1185:gst_v4l2_buffer_pool_start:nvv4l2-decoder:pool:sink we received 0 buffer from device ‘/dev/nvidia0’, we want at least 20:00:07.898545144 83597 0x5570aefdac00 ERROR bufferpool gstbufferpool.c:559:gst_buffer_pool_set_active:nvv4l2-decoder:pool:sink start failed0:00:07.898549261 83597 0x5570aefdac00 WARN v4l2videodec gstv4l2videodec.c:1783:gst_v4l2_video_dec_handle_frame: error: Failed to allocate required memory.0:00:07.898551869 83597 0x5570aefdac00 WARN v4l2videodec gstv4l2videodec.c:1783:gst_v4l2_video_dec_handle_frame: error: Buffer pool activation failed0:00:07.898560189 83597 0x5570aefdac00 WARN videodecoder gstvideodecoder.c:1140:gst_video_decoder_sink_event_default: error: No valid frames decoded before end of stream0:00:07.898563180 83597 0x5570aefdac00 WARN videodecoder gstvideodecoder.c:1140:gst_video_decoder_sink_event_default: error: no valid frames found[NvMultiObjectTracker] De-initializedDeleting pipeline

I have no idea what all these things are, if you could point to some direction, It’d be helpful. can this be a nvidia-driver mismatch issue ?

yingliu · August 31, 2023, 2:17pm

Can you share the pipeline info?

adityawasnik91 · September 1, 2023, 5:56am

sure.
appsrc, jpegparser, decoder,streammux, queue1, pgie, nvconv_after_pgie, dsexample, queue2, nvtracker, sgie,queue3, nvdsanalytics, queue4, queue5, nvvidconv, queue6,nvosd, tee,

→ queue_msg → nvmsgconv → nvmsgbroker
→ queue_sink → nvvidoconv → sink

this is it.

yuweiw · September 1, 2023, 6:06am

Just from the log, please first confirm that your camera can work properly on the DGPU.
https://forums.developer.nvidia.com/t/deepstream-sdk-faq/80236/36

adityawasnik91 · September 1, 2023, 6:12am

I get this error after pipeline runs for a while. like after processing 5-10 frames.

yuweiw · September 4, 2023, 5:45am

How do you know like after processing 5-10 frames ? Could you attach the format of the stream with the method I attached? Could you try to use the jpegdec as the decoder?

adityawasnik91 · September 4, 2023, 5:32pm

Hello, sorry for the late response. I had a function which was supposed to return a gstBuffer from base64 encoded images. that function, under some cases was returning a nullpointer, this issue got fixed after we fixed that.

system · September 18, 2023, 5:33pm

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.