Nvstreammux error releasing cuda memory on odd resolution

bogoslovskii · August 11, 2022, 8:53am

The “Cuda failure: status=700 nvbufsurface: Error(-1) in releasing cuda memory” error occurs for odd picture resolutions (bug_img.jpg). The workaround ( interpolation-method=6) from this thread (link) does not help.

• Hardware Platform (Jetson / GPU): GPU RTX 3070
• DeepStream Version: 6.1
• NVIDIA GPU Driver Version (valid for GPU only): 510.85.02
• Issue Type( questions, new requirements, bugs): bug
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing):

docker run -it --rm --gpus=all -v pwd:/data nvcr.io/nvidia/deepstream:6.1-base
gst-launch-1.0 -v uridecodebin3 name=source uri=file:///data/bug_img.jpg ! nvvideoconvert nvbuf-memory-type=3 ! “video/x-raw(memory:NVMM), format=RGBA” ! muxer.sink_0 nvstreammux name=muxer width=1024 height=1024 batch-size=1 live-source=False interpolation-method=6 ! fakesink

log

Setting pipeline to PAUSED …
Pipeline is PREROLLING …
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstURISourceBin:urisourcebin0: source = “(GstFileSrc)\ source”
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstURISourceBin:urisourcebin0/GstTypeFindElement:typefindelement0.GstPad:src: caps = image/jpeg, width=(int)1920, height=(int)993, sof-marker=(int)2
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstURISourceBin:urisourcebin0/GstTypeFindElement:typefindelement0.GstPad:src: caps = NULL
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0/GstParseBin:parsebin0/GstTypeFindElement:typefind.GstPad:src: caps = image/jpeg, width=(int)1920, height=(int)993, sof-marker=(int)2
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0/GstMultiQueue:multiqueue0.GstMultiQueuePad:sink_0: group-id = 4
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0/GstMultiQueue:multiqueue0.GstMultiQueuePad:sink_0: caps = image/jpeg, width=(int)1920, height=(int)993, sof-marker=(int)2
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0/GstMultiQueue:multiqueue0.GstPad:src_0: caps = image/jpeg, width=(int)1920, height=(int)993, sof-marker=(int)2
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0/GstNvJpegDec:nvjpegdec0.GstPad:sink: caps = image/jpeg, width=(int)1920, height=(int)993, sof-marker=(int)2
Using GPU 0 (NVIDIA GeForce RTX 3070, 46 SMs, 1536 th/SM max, CC 8.6, ECC off)
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0/GstNvJpegDec:nvjpegdec0.GstPad:src: caps = video/x-raw(memory:NVMM), format=(string)RGBA, width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0.GstGhostPad:video_0: caps = video/x-raw(memory:NVMM), format=(string)RGBA, width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstURIDecodeBin3:source.GstGhostPad:video_0: caps = video/x-raw(memory:NVMM), format=(string)RGBA, width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/Gstnvvideoconvert:nvvideoconvert0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)RGBA, block-linear=(boolean)false
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)RGBA, block-linear=(boolean)false
/GstPipeline:pipeline0/GstNvStreamMux:muxer.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1024, height=(int)1024, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, framerate=(fraction)0/1, format=(string)RGBA, block-linear=(boolean)false, batch-size=(int)1, num-surfaces-per-frame=(int)1
/GstPipeline:pipeline0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1024, height=(int)1024, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, framerate=(fraction)0/1, format=(string)RGBA, block-linear=(boolean)false, batch-size=(int)1, num-surfaces-per-frame=(int)1
/GstPipeline:pipeline0/GstNvStreamMux:muxer.GstNvStreamPad:sink_0: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)RGBA, block-linear=(boolean)false
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)RGBA, block-linear=(boolean)false
/GstPipeline:pipeline0/Gstnvvideoconvert:nvvideoconvert0.GstPad:sink: caps = video/x-raw(memory:NVMM), format=(string)RGBA, width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstURIDecodeBin3:source.GstGhostPad:video_0.GstProxyPad:proxypad5: caps = video/x-raw(memory:NVMM), format=(string)RGBA, width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0.GstGhostPad:video_0.GstProxyPad:proxypad4: caps = video/x-raw(memory:NVMM), format=(string)RGBA, width=(int)1920, height=(int)993, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:0:0, framerate=(fraction)0/1
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstSystemClock
Got EOS from element “pipeline0”.
Execution ended after 0:00:00.000296478
Setting pipeline to PAUSED …
Setting pipeline to READY …
Cuda failure: status=700
nvbufsurface: Error(-1) in releasing cuda memory
Cuda failure: status=700
nvbufsurface: Error(-1) in releasing cuda memory
Cuda failure: status=700
nvbufsurface: Error(-1) in releasing cuda memory
Cuda failure: status=700
nvbufsurface: Error(-1) in releasing cuda memory
Setting pipeline to NULL …
Cuda failure: status=700
nvbufsurface: Error(-1) in releasing cuda memory
Cuda Failure to destroy stream
Cuda Failure to destroy stream
Freeing pipeline …

Amycao · August 12, 2022, 4:09am

I tried the pipeline on T4, but i can run success. btw, the resolution of the picture you attached is 1380x712, not 1920x993. can you upload the picture you used to repro the issue?

/GstPipeline:pipeline0/GstURIDecodeBin3:source/GstDecodebin3:decodebin3-0/GstNvJpegDec:nvjpegdec0.GstPad:sink: caps = image/jpeg, width=(int)1380, height=(int)712, sof-marker=(int)0
Using GPU 0 (Tesla T4, 40 SMs, 1024 th/SM max, CC 7.5, ECC on)

bogoslovskii · August 15, 2022, 5:29am

The attached picture has the correct size. The size of the picture on the screenshot

Link to the original picture from the Internet.

Amycao · August 16, 2022, 9:37am

Used the original picture, the issue reproed.
Will check and get back to you later.

Amycao · August 30, 2022, 7:50am

This is a bug, we will fix it in future release.