Hello @junshengy,
I am facing an issue while converting an ONNX model to a TensorRT model on JetPack 5.1.4. During the conversion process, I see the following logs in the terminal:
[04/02/2025-17:23:18] [W] [TRT] Tactic Device request: 7151MB Available: 5868MB. Device memory is insufficient to use tactic.
[04/02/2025-17:23:18] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 7151 detected for tactic 0x0000000000000004.
Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
[04/02/2025-17:23:18] [W] [TRT] Tactic Device request: 7151MB Available: 5871MB. Device memory is insufficient to use tactic.
[04/02/2025-17:23:18] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 7151 detected for tactic 0x000000000000003c.
Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
[04/02/2025-17:23:19] [W] [TRT] Tactic Device request: 7151MB Available: 5870MB. Device memory is insufficient to use tactic.
[04/02/2025-17:23:19] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 7151 detected for tactic 0x0000000000000074.
Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit().
The model conversion is successful, but I notice a significant performance degradation.
When I decrease the workspace size, the same logs continue to appear, and the performance degradation persists.
Interestingly, when I perform the same conversion on another device running JetPack version 6.0 (Jetson Orin), the conversion completes successfully without any performance degradation, and I do not see the above logs in the terminal.
Could anyone help me understand why this performance degradation occurs on JetPack 5.1.4 (Jetson Xavier and Jetson Orin), while JetPack version 6.0 (Jetson Orin) does not exhibit the same issue?
Additionally, are there any recommendations for overcoming this memory issue or performance degradation on JetPack 5.1.4?