Help with artefacts needed

madisi98 · February 8, 2023, 1:22pm

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) gpu
• DeepStream Version 6.1.1
• TensorRT Version latest for ngc container
• NVIDIA GPU Driver Version (valid for GPU only) 515
• Issue Type( questions, new requirements, bugs) help

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

I’m having issues with artefacts on my image. In my setup (3080 + ryzen 5900) works better than in a production setup with a virtual xeon and a T4, but I see artefacts on both.

I believe artefacts must be generated in the decoding process because detections from the model appear to be influenced by the artefacts, but I don’t know where to start to debug this issue.

For decoding I am connecting to a server that serves mkv files over rtsp through nvurisrcbin, although this happens with uridecodebin too.

Any help here is welcome, many thanks in advance!!

madisi98 · February 8, 2023, 2:42pm

This is what I see in the GST DEBUG log:

root@42e4e4e39daf:/app/src# tail -f 0:01:05.098993025 265 0x7fe488018cc0 WARN 0:01:05.100112205 265 0x7fe488018cc0 WARN 0:01:05.100211295 265 0x7fe488018cc0 WARN 0:01:05.551954953 265 0x7fe48400a120 WARN 0:01:05.551998274 265 0x7fe48400a120 WARN 0:01:05.552020504 265 0x7fe48400a120 WARN 0:01:07.571951234 265 0x7fe488018cc0 WARN 0:01:07.577668313 265 0x7fe488018cc0 WARN 0:01:07.581789440 265 0x7fe488018cc0 WARN 0:01:09.539921638 265 0x7fe488018cc0 WARN 0:01:14.761891799 265 0x7fe488018cc0 WARN 0:01:14.763257831 265 0x7fe488018cc0 WARN 0:01:14.763341962 265 0x7fe488018cc0 WARN 0:01:15.574838130 265 0x7fe488018cc0 WARN 0:01:15.577139240 265 0x7fe488018cc0 WARN 0:01:15.577209801 265 0x7fe488018cc0 WARN 0:01:16.566664214 265 0x7fe488018cc0 WARN 0:01:16.568913544 265 0x7fe488018cc0 WARN 0:01:16.568966684 265 0x7fe488018cc0 WARN 0:01:16.579291984 265 0x7fe488018cc0 WARN 0:01:16.580250883 265 0x7fe488018cc0 WARN 0:01:16.826354662 265 0x7fe488018cc0 WARN 0:01:17.569866787 265 0x7fe488018cc0 WARN 0:01:17.573941242 265 0x7fe488018cc0 WARN 0:01:17.574358056 265 0x7fe488018cc0 WARN 0:01:17.863768223 265 0x7fe488018cc0 WARN 0:01:17.865118295 265 0x7fe488018cc0 WARN 0:01:18.570748518 265 0x7fe488018cc0 WARN 0:01:18.572202841 265 0x7fe488018cc0 WARN 0:01:18.581130419 265 0x7fe488018cc0 WARN 0:01:18.583797402 265 0x7fe488018cc0 WARN 0:01:18.583858573 265 0x7fe488018cc0 WARN 0:01:19.565539497 265 0x7fe488018cc0 WARN 0:01:19.928355006 265 0x7fe488018cc0 WARN 0:01:20.573369000 265 0x7fe488018cc0 WARN 0:01:20.575566639 265 0x7fe488018cc0 WARN 0:01:20.575644000 265 0x7fe488018cc0 WARN 0:01:21.569125606 265 0x7fe488018cc0 WARN 0:01:21.583691843 265 0x7fe488018cc0 WARN 0:01:21.589100751 265 0x7fe488018cc0 WARN /tmp/GST_DEBUG.log
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:05.471194223 < 0:01:05.537860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:05.504527557 < 0:01:05.537860890)
v4l2videodec gstv4l2videodec.c:1326:gst_v4l2_video_dec_loop: Decoder is producing too many buffers
libav gstavauddec.c:628:gst_ffmpegauddec_drain:<avdec_aac0> send packet failed, could not drain decoder
libav gstavauddec.c:628:gst_ffmpegauddec_drain:<avdec_aac0> send packet failed, could not drain decoder
libav gstavauddec.c:628:gst_ffmpegauddec_drain:<avdec_aac0> send packet failed, could not drain decoder
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:08.004527557 < 0:01:08.104527557)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:08.037860890 < 0:01:08.104527557)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:08.071194223 < 0:01:08.104527557)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:09.137860890 < 0:01:09.171194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.137860890 < 0:01:15.237860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.171194223 < 0:01:15.237860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.204527557 < 0:01:15.237860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.937860890 < 0:01:16.037860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.971194223 < 0:01:16.037860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:16.004527557 < 0:01:16.037860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:16.804527557 < 0:01:16.904527557)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:16.837860890 < 0:01:16.904527557)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:16.871194223 < 0:01:16.904527557)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.071194223 < 0:01:17.171194223)
v4l2videodec gstv4l2videodec.c:1326:gst_v4l2_video_dec_loop: Decoder is producing too many buffers
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.137860890 < 0:01:17.171194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.871194223 < 0:01:17.971194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.904527557 < 0:01:17.971194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.937860890 < 0:01:17.971194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.137860890 < 0:01:18.237860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.171194223 < 0:01:18.237860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.671194223 < 0:01:18.771194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.804527557 < 0:01:18.904527557)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.937860890 < 0:01:19.037860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.971194223 < 0:01:19.037860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:19.004527557 < 0:01:19.037860890)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:19.471194223 < 0:01:19.504527557)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:20.137860890 < 0:01:20.171194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:20.671194223 < 0:01:20.771194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:20.704527557 < 0:01:20.771194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:20.737860890 < 0:01:20.771194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:21.537860890 < 0:01:21.571194223)
videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:22.071194223 < 0:01:22.171194223)
v4l2videodec gstv4l2videodec.c:1326:gst_v4l2_video_dec_loop: Decoder is producing too many buffers

yingliu · February 8, 2023, 11:44pm

Can you elaborate what the “artefacts” that you referred to? please also share it in your pipeline.

madisi98 · February 9, 2023, 8:41am

I attached a short screen recording for you to be able to see what these artifacts look like. On the left you can see the original video, running in an rtsp server that the deepstream connects to. On the right what deepstream is outputting.

Also, here is the pipeline I’m using (single camera):

nvurisrcbin → nvvideoconvert → nvstreammux → nvinferserver → nvdslogger → nvvideoconvert → nvosd → nvvideoconvert → nvv4l2h264enc → rtspclientsink

yingliu · February 9, 2023, 9:10am

Sorry, still not understand what help do you need.
The right side seems to be not as smooth as the left side, is this the issue you are referring to?
I also don’t understand the purpose of the pipeline. The message on the right video seems to be counting vehicle/person/crowd count, but why the input is a video of the earth?

madisi98 · February 9, 2023, 9:20am

Hi there,

Thanks for reaching out for clarification. Yes, the right side video has noticeable visual defects, which is the main issue I am referring to. The video is being used as an example to show the problem I am encountering.

Regarding the purpose of the pipeline, it is a system used to count vehicles, persons, and crowd. The input video in this case is of the earth because I’m trying to debug this problem and found this video showed it very well.

I hope this information helps clarify the situation. If you need any further information, please let me know.

yuweiw · February 9, 2023, 11:04am

Could you try to use nvinfer instead of nvinferserver and check the result? If it’s convenient, you also can provide us with your app, model, config files.

madisi98 · February 10, 2023, 12:21pm

After having done some more investigation, I have seen that the problem does not appear in live rtsp cameras. I’m facing the problem while serving files through rtsp only (based on very few tests).

I have tried removing everything in de pipeline. Just decode and re encode, and I’m still facing the issue. I’m starting to believe the issue is in the source of the images, not in deepstream, but consuming the video through vlc works fine

yuweiw · February 13, 2023, 2:04am

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

It may be that native rtsp plugins of gstreamer has problems. You can verify it by using native plguins of Gstreamer to play it. You can also attach your video and give us the way to reproduce the problem. We can help to debug for it. Thanks

system · March 14, 2023, 5:53am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.