TRTEXEC out of memory error - Xavier NX

Autonomous Machines Jetson & Embedded Systems Jetson Xavier NX
1

Please help, converting 200MB ResNet50-FPN on Jetson Xavier fails with this error.

[TRT] Internal error: plugin node (Unnamed Layer* 341) [PluginV2Ext]requires 383404800 bytes of scratch space, but only 16777216 is available. Try increasing the workspace size with IBuilderConfig::setMaxWorkspaceSize() if using IBuilder::buildEngineWithConfig, or IBuilder::setMaxWorkspaceSize() if using IBuilder::buildCudaEngine.

3

Hi,

Could you enable the --verbose and share the complete output with us?

[TRT] Internal error: plugin node (Unnamed Layer* 341) [PluginV2Ext]

It seems that the error occurs from a plugin layer.
Is this your custom implementation or a layer from our plugin library?

Thanks.

4

Hi @AastaLLL

Thanks, I am not implementing custom plugin.
Please see attached onnx and log file.
Thanks
log_resnet50.txt (3.1 MB)
https://drive.google.com/file/d/1WHe5A48li94h9wVxVeAUO-ZYUgX70iGJ/view?usp=sharing

5

Hi,

requires 383404800 bytes of scratch space, but only 16777216 is available.

Sorry for the missing.

Based on the error message, it seems the model is too large for the embedded environment.
You may need a smaller model since XavierNX only has 8GB memory.

Thanks.