Whether the GPU's memory resources can be set in TensorRT ？

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

In tensroflow, I can do this set the GPU’s memory.

config = tf.ConfigProto() 
config.gpu_options.per_process_gpu_memory_fraction = 0.9
session = tf.Session(config=config)

so,I want to know in tensorrt,which has some options can realize that？

Environment

TensorRT Version: 7.1.3
GPU Type: 2080Ti
Nvidia Driver Version: 440
CUDA Version: 10.2
CUDNN Version: 8.0
Operating System + Version: centos7
Python Version (if applicable): 3.6
TensorFlow Version (if applicable): 2.2
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):

Relevant Files

Please attach or include links to any models, data, files, or scripts necessary to reproduce your issue. (Github repo, Google Drive, Dropbox, etc.)

Steps To Reproduce

Please include:

  • Exact steps/commands to build your repro
  • Exact steps/commands to run your repro
  • Full traceback of errors encountered
2

Hi @1965281904,
Apologies for delayed response.
You may find the answer here.
https://docs.nvidia.com/deeplearning/tensorrt/best-practices/index.html#memory

Thanks!