Question of memory leak(vmsize & vmrss rise) when drawing nvosd

• Hardware Platform (Jetson / GPU)
JETSON
• DeepStream Version
5.0
• JetPack Version (valid for Jetson only)
4.4
• TensorRT Version
7

Hi.

There was no problem when using nvmultistreamtiler plugin
but I need a variety of tile layouts, so i made a new customtiler plugin.

When use my custom plugin, no problem in situations where objects are not detected.
→ it means, no object in the frame & no drawing nvosd objects (bbox rectangle)

But the moment deepstream detect an object, start drawing nvosd objects [bbox rectangle]
at the same time occured memory leak(vmsize, vmrss)

below is full source code my custom tiler plugin

I implemented the function of converting nBatch NvBufSurface to 1Batch NvBufSurface in the same way as the existing nvmultistreamtiler.

gstcustomtiler.cpp (33.8 KB)
gstcustomtiler.h (3.3 KB)

and memory leak log


//Normal [ no object detect & no draw nvosd ]

PID: 10201   03:01:06   Total used hardware memory: 227.1406 MiB        hardware memory: 227.1406 MiB           VmSize: 10931.0820 MiB  VmRSS: 973.9102 MiB     RssFile: 314.9414 MiB   RssAnon: 660.1094 MiB     lsof: 449

PID: 10201   03:01:07   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6055 MiB           VmSize: 12452.1484 MiB  VmRSS: 1111.5781 MiB    RssFile: 343.2891 MiB   RssAnon: 750.3672 MiB     lsof: 747

PID: 10201   03:01:08   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12453.9062 MiB  VmRSS: 1111.8594 MiB    RssFile: 359.6914 MiB   RssAnon: 754.7422 MiB     lsof: 747

PID: 10201   03:01:09   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12434.0234 MiB  VmRSS: 1100.9922 MiB    RssFile: 354.8281 MiB   RssAnon: 754.7930 MiB     lsof: 746

PID: 10201   03:01:11   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12452.1484 MiB  VmRSS: 1111.2031 MiB    RssFile: 360.5664 MiB   RssAnon: 755.6992 MiB     lsof: 745

PID: 10201   03:01:12   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12448.5234 MiB  VmRSS: 1113.9570 MiB    RssFile: 344.0234 MiB   RssAnon: 755.7266 MiB     lsof: 743

PID: 10201   03:01:13   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12452.1484 MiB  VmRSS: 1114.7305 MiB    RssFile: 344.0625 MiB   RssAnon: 756.6055 MiB     lsof: 747

PID: 10201   03:01:14   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12439.2969 MiB  VmRSS: 1100.8164 MiB    RssFile: 344.1992 MiB   RssAnon: 756.6172 MiB     lsof: 743

PID: 10201   03:01:15   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6055 MiB           VmSize: 12455.6641 MiB  VmRSS: 1104.1914 MiB    RssFile: 344.0586 MiB   RssAnon: 756.6172 MiB     lsof: 747

PID: 10201   03:01:17   Total used hardware memory: 416.6016 MiB        hardware memory: 416.6055 MiB           VmSize: 12452.1484 MiB  VmRSS: 1111.5469 MiB    RssFile: 344.6250 MiB   RssAnon: 756.6328 MiB     lsof: 747

PID: 10201   03:01:18   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12452.1484 MiB  VmRSS: 1114.0547 MiB    RssFile: 359.2812 MiB   RssAnon: 756.6367 MiB     lsof: 744

PID: 10201   03:01:19   Total used hardware memory: 416.6016 MiB        hardware memory: 416.6016 MiB           VmSize: 12452.1484 MiB  VmRSS: 1114.0273 MiB    RssFile: 358.9141 MiB   RssAnon: 756.6562 MiB     lsof: 747

PID: 10201   03:01:20   Total used hardware memory: 416.6055 MiB        hardware memory: 416.6055 MiB           VmSize: 12444.8984 MiB  VmRSS: 1101.0977 MiB    RssFile: 344.4375 MiB   RssAnon: 756.6602 MiB     lsof: 747

PID: 10201   03:01:22   Total used hardware memory: 416.6055 MiB        hardware memory: 416.6055 MiB           VmSize: 12452.1484 MiB  VmRSS: 1119.5703 MiB    RssFile: 344.5625 MiB   RssAnon: 757.5391 MiB     lsof: 743


//Detect [ object detect  & draw nvosd]


PID: 10201   03:01:23   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12476.6289 MiB  VmRSS: 1135.7070 MiB    RssFile: 384.2305 MiB   RssAnon: 759.1484 MiB     lsof: 797

PID: 10201   03:01:24   Total used hardware memory: 416.6055 MiB        hardware memory: 416.6055 MiB           VmSize: 12578.2383 MiB  VmRSS: 1240.7617 MiB    RssFile: 483.4453 MiB   RssAnon: 760.8008 MiB     lsof: 799

PID: 10201   03:01:25   Total used hardware memory: 416.6016 MiB        hardware memory: 416.6016 MiB           VmSize: 12650.6289 MiB  VmRSS: 1303.0391 MiB    RssFile: 528.2773 MiB   RssAnon: 760.8672 MiB     lsof: 799

PID: 10201   03:01:26   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12650.7383 MiB  VmRSS: 1303.1836 MiB    RssFile: 528.2539 MiB   RssAnon: 760.8672 MiB     lsof: 799

PID: 10201   03:01:28   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12764.8711 MiB  VmRSS: 1401.4492 MiB    RssFile: 633.5508 MiB   RssAnon: 760.8672 MiB     lsof: 799

PID: 10201   03:01:29   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 12898.9961 MiB  VmRSS: 1534.8906 MiB    RssFile: 777.1133 MiB   RssAnon: 760.8672 MiB     lsof: 796

PID: 10201   03:01:30   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13027.6289 MiB  VmRSS: 1657.9141 MiB    RssFile: 880.0000 MiB   RssAnon: 760.8750 MiB     lsof: 799

PID: 10201   03:01:31   Total used hardware memory: 416.6055 MiB        hardware memory: 416.6055 MiB           VmSize: 13152.7461 MiB  VmRSS: 1767.4531 MiB    RssFile: 1000.9688 MiB  RssAnon: 760.8750 MiB     lsof: 797

PID: 10201   03:01:33   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13266.9883 MiB  VmRSS: 1878.8203 MiB    RssFile: 1123.3594 MiB  RssAnon: 760.8750 MiB     lsof: 797

PID: 10201   03:01:34   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13379.2539 MiB  VmRSS: 1989.0469 MiB    RssFile: 1222.9648 MiB  RssAnon: 760.8750 MiB     lsof: 799

PID: 10201   03:01:35   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13420.9961 MiB  VmRSS: 2014.8320 MiB    RssFile: 1253.8516 MiB  RssAnon: 760.9805 MiB     lsof: 799

PID: 10201   03:01:36   Total used hardware memory: 416.6055 MiB        hardware memory: 416.6055 MiB           VmSize: 13437.3633 MiB  VmRSS: 2050.1797 MiB    RssFile: 1288.5781 MiB  RssAnon: 761.8594 MiB     lsof: 796

PID: 10201   03:01:37   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13442.7461 MiB  VmRSS: 2050.2539 MiB    RssFile: 1290.1953 MiB  RssAnon: 761.8633 MiB     lsof: 797

//End Detect

//Normal [ no object detect & no draw nvosd ]

PID: 10201   03:01:39   Total used hardware memory: 416.6055 MiB        hardware memory: 416.6055 MiB           VmSize: 13462.6289 MiB  VmRSS: 2065.9727 MiB    RssFile: 1309.3320 MiB  RssAnon: 761.8711 MiB     lsof: 794

PID: 10201   03:01:40   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13453.6211 MiB  VmRSS: 2051.9375 MiB    RssFile: 1295.3477 MiB  RssAnon: 761.8711 MiB     lsof: 798

PID: 10201   03:01:41   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13459.0039 MiB  VmRSS: 2060.7695 MiB    RssFile: 1301.2148 MiB  RssAnon: 761.8750 MiB     lsof: 799

PID: 10201   03:01:42   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13460.8711 MiB  VmRSS: 2060.6055 MiB    RssFile: 1297.3047 MiB  RssAnon: 761.8789 MiB     lsof: 798

PID: 10201   03:01:44   Total used hardware memory: 416.6055 MiB        hardware memory: 416.6094 MiB           VmSize: 13459.0039 MiB  VmRSS: 2058.4609 MiB    RssFile: 1302.3711 MiB  RssAnon: 761.8828 MiB     lsof: 799

PID: 10201   03:01:45   Total used hardware memory: 416.6016 MiB        hardware memory: 416.6094 MiB           VmSize: 13457.2461 MiB  VmRSS: 2050.3555 MiB    RssFile: 1288.4727 MiB  RssAnon: 761.8828 MiB     lsof: 795

PID: 10201   03:01:46   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6094 MiB           VmSize: 13460.8711 MiB  VmRSS: 2058.1719 MiB    RssFile: 1304.9297 MiB  RssAnon: 761.8828 MiB     lsof: 797

PID: 10201   03:01:47   Total used hardware memory: 416.6094 MiB        hardware memory: 416.6055 MiB           VmSize: 13442.7461 MiB  VmRSS: 2051.8125 MiB    RssFile: 1290.6992 MiB  RssAnon: 761.8867 MiB     lsof: 797

PID: 10201   03:01:48   Total used hardware memory: 196.2305 MiB        hardware memory: 159.9805 MiB           VmSize: 13203.2383 MiB  VmRSS: 2018.5430 MiB    RssFile: 1263.2422 MiB  RssAnon: 755.3008 MiB     lsof: 435

Please upgrade to DS 6.0. Do you see any leak with default osd?

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.