We just upgraded to JP 4.6 and TRT 8. We have been running ONNX models on TRT 7 successfully. We were allocating 2g for our engine and noticed on TRT 8 we had insufficient memory for a resources and reducing the memory to 1g resolved the issue and we are able to build our engine and run the inference. We also were encapsulating the i in a unique pointer with a custom deleter calling the class destroy method, which seems to have been deprecated in TRT8 and according to the release notes the class destructors are no longer protected, and are now public, so we just allow the unique pointer to go out of scope without a custom deleter. The problem that we see is when the pointer goes out of scope we see :
pure virtual method called
terminate called without an active exception
Which seem to indicate a joinable thread is going out of scope. We see this behavior only when we switch to TRT 8. I found this thread
Is this now an issue with TRT8 or related to workspace size?