I get the “[virtualMemoryBuffer.cpp::nvinfer1::stdVirtualMemoryBufferImpl::resizePhysical::161] Erro Code 2: OutOfMemory (no further information)” error during dynamic input tensor shape int8 calibration from time to time. I monitor the GPU and RAM memory consumption and there is always free memory during the process.
The calibration process outputs this message around 40 times just before it finishes but the quantized model works well.
Do you know what the problem could be ?
A clear and concise description of the bug or issue.
TensorRT Version: 188.8.131.52
GPU Type: GeForce RTX 2080 Super
Nvidia Driver Version:
CUDA Version: 11.6.1
CUDNN Version: 184.108.40.206
Operating System + Version: Win 10
Python Version (if applicable):
TensorFlow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):
Please attach or include links to any models, data, files, or scripts necessary to reproduce your issue. (Github repo, Google Drive, Dropbox, etc.)
- Exact steps/commands to build your repro
- Exact steps/commands to run your repro
- Full traceback of errors encountered