I’d like to understand system memory usage of TensorRT running on Xavier. I am using the trtexec utility to profile memory usage.
I am running the following command:
/usr/src/tensorrt/bin/trtexec --uff=./my-graph.uff --useDLACore=0 --fp16 --allowGPUFallback --avgRuns=1000 --iterations=1000
Simultaneously I am running the following to periodically monitor memory usage:
watch sudo smem -rp
I am seeing the following usage:
PID User Command Swap USS PSS RSS 22369 root /usr/src/tensorrt/bin/trtex 0.00% 9.57% 10.76% 12.56%
That is 12.56% or just over 2GB of physical memory. Moreover, it is slowly increasing the longer trtexec is running as if memory is leaking.
Can someone explain if this level of memory usage is necessary/expected, and if I am in fact observing some kind of memory leak when I see the percentage slowly creeping up?