TensorRT Layer Workspace Size

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

In Appendix A.1 of the TensorRT 7.2.2 Developer Documentation, it says that “layers and packaged plugins are expected to work with zero workspace size.” However, this seems to contradict the statement in Section 2.3 that says “layer algorithms often require temporary workspace.” I was wondering which was the more accurate statement of how things works?

3

Hi @tankevin,

Thank you for letting us know.
Statement in the Appendix A.1 need to be updated.
TensorRT doesn’t guarantee to be able run with zero workspace size.
Please wait for the doc update.

Thank you.

1 Like