TensorRT model consuming more amount of RAM

[AastaLLL]

Hi,

You can limit the TensorRT memory usage by setting workspace variable.
Please check this comment for more information:

Faster rcnn memory consumption

Hi, It’s recommended to upgrade your device to our JetPack4.4 product release (GA) software first. The memory comes from the algorithm used by TensorRT when inferencing. XavierNX has tensor core hardware so there are much more algorithm can be chosen in TensorRT. Some algorithm will occupy more memory for a better performance. If memory is critical for you, TensorRT also provide an API that can control the maximal memory usage. https://docs.nvidia.com/deeplearning/tensorrt/api/c_api/classn…

Thanks.