Help with artefacts needed

[madisi98]

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) gpu
• DeepStream Version 6.1.1
• TensorRT Version latest for ngc container
• NVIDIA GPU Driver Version (valid for GPU only) 515
• Issue Type( questions, new requirements, bugs) help

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

I’m having issues with artefacts on my image. In my setup (3080 + ryzen 5900) works better than in a production setup with a virtual xeon and a T4, but I see artefacts on both.

I believe artefacts must be generated in the decoding process because detections from the model appear to be influenced by the artefacts, but I don’t know where to start to debug this issue.

For decoding I am connecting to a server that serves mkv files over rtsp through nvurisrcbin, although this happens with uridecodebin too.

Any help here is welcome, many thanks in advance!!

[madisi98]

This is what I see in the GST DEBUG log:

root@42e4e4e39daf:/app/src# tail -f /tmp/GST_DEBUG.log
0:01:05.098993025 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:05.471194223 < 0:01:05.537860890)
0:01:05.100112205 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:05.504527557 < 0:01:05.537860890)
0:01:05.100211295 265 0x7fe488018cc0 WARN v4l2videodec gstv4l2videodec.c:1326:gst_v4l2_video_dec_loop: Decoder is producing too many buffers
0:01:05.551954953 265 0x7fe48400a120 WARN libav gstavauddec.c:628:gst_ffmpegauddec_drain:<avdec_aac0> send packet failed, could not drain decoder
0:01:05.551998274 265 0x7fe48400a120 WARN libav gstavauddec.c:628:gst_ffmpegauddec_drain:<avdec_aac0> send packet failed, could not drain decoder
0:01:05.552020504 265 0x7fe48400a120 WARN libav gstavauddec.c:628:gst_ffmpegauddec_drain:<avdec_aac0> send packet failed, could not drain decoder
0:01:07.571951234 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:08.004527557 < 0:01:08.104527557)
0:01:07.577668313 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:08.037860890 < 0:01:08.104527557)
0:01:07.581789440 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:08.071194223 < 0:01:08.104527557)
0:01:09.539921638 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:09.137860890 < 0:01:09.171194223)
0:01:14.761891799 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.137860890 < 0:01:15.237860890)
0:01:14.763257831 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.171194223 < 0:01:15.237860890)
0:01:14.763341962 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.204527557 < 0:01:15.237860890)
0:01:15.574838130 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.937860890 < 0:01:16.037860890)
0:01:15.577139240 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:15.971194223 < 0:01:16.037860890)
0:01:15.577209801 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:16.004527557 < 0:01:16.037860890)
0:01:16.566664214 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:16.804527557 < 0:01:16.904527557)
0:01:16.568913544 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:16.837860890 < 0:01:16.904527557)
0:01:16.568966684 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:16.871194223 < 0:01:16.904527557)
0:01:16.579291984 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.071194223 < 0:01:17.171194223)
0:01:16.580250883 265 0x7fe488018cc0 WARN v4l2videodec gstv4l2videodec.c:1326:gst_v4l2_video_dec_loop: Decoder is producing too many buffers
0:01:16.826354662 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.137860890 < 0:01:17.171194223)
0:01:17.569866787 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.871194223 < 0:01:17.971194223)
0:01:17.573941242 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.904527557 < 0:01:17.971194223)
0:01:17.574358056 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:17.937860890 < 0:01:17.971194223)
0:01:17.863768223 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.137860890 < 0:01:18.237860890)
0:01:17.865118295 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.171194223 < 0:01:18.237860890)
0:01:18.570748518 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.671194223 < 0:01:18.771194223)
0:01:18.572202841 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.804527557 < 0:01:18.904527557)
0:01:18.581130419 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.937860890 < 0:01:19.037860890)
0:01:18.583797402 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:18.971194223 < 0:01:19.037860890)
0:01:18.583858573 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:19.004527557 < 0:01:19.037860890)
0:01:19.565539497 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:19.471194223 < 0:01:19.504527557)
0:01:19.928355006 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:20.137860890 < 0:01:20.171194223)
0:01:20.573369000 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:20.671194223 < 0:01:20.771194223)
0:01:20.575566639 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:20.704527557 < 0:01:20.771194223)
0:01:20.575644000 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:20.737860890 < 0:01:20.771194223)
0:01:21.569125606 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:21.537860890 < 0:01:21.571194223)
0:01:21.583691843 265 0x7fe488018cc0 WARN videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame: decreasing timestamp (0:01:22.071194223 < 0:01:22.171194223)
0:01:21.589100751 265 0x7fe488018cc0 WARN v4l2videodec gstv4l2videodec.c:1326:gst_v4l2_video_dec_loop: Decoder is producing too many buffers

[yingliu]

Can you elaborate what the “artefacts” that you referred to? please also share it in your pipeline.

[madisi98]

I attached a short screen recording for you to be able to see what these artifacts look like. On the left you can see the original video, running in an rtsp server that the deepstream connects to. On the right what deepstream is outputting.

Also, here is the pipeline I’m using (single camera):

nvurisrcbin → nvvideoconvert → nvstreammux → nvinferserver → nvdslogger → nvvideoconvert → nvosd → nvvideoconvert → nvv4l2h264enc → rtspclientsink

[yingliu]

Sorry, still not understand what help do you need.
The right side seems to be not as smooth as the left side, is this the issue you are referring to?
I also don’t understand the purpose of the pipeline. The message on the right video seems to be counting vehicle/person/crowd count, but why the input is a video of the earth?

[madisi98]

Hi there,

Thanks for reaching out for clarification. Yes, the right side video has noticeable visual defects, which is the main issue I am referring to. The video is being used as an example to show the problem I am encountering.

Regarding the purpose of the pipeline, it is a system used to count vehicles, persons, and crowd. The input video in this case is of the earth because I’m trying to debug this problem and found this video showed it very well.

I hope this information helps clarify the situation. If you need any further information, please let me know.

[yuweiw]

Could you try to use nvinfer instead of nvinferserver and check the result? If it’s convenient, you also can provide us with your app, model, config files.

[madisi98]

After having done some more investigation, I have seen that the problem does not appear in live rtsp cameras. I’m facing the problem while serving files through rtsp only (based on very few tests).

I have tried removing everything in de pipeline. Just decode and re encode, and I’m still facing the issue. I’m starting to believe the issue is in the source of the images, not in deepstream, but consuming the video through vlc works fine

[yuweiw]

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

It may be that native rtsp plugins of gstreamer has problems. You can verify it by using native plguins of Gstreamer to play it. You can also attach your video and give us the way to reproduce the problem. We can help to debug for it. Thanks