Under what circumstances would nvinfer1::IExecutionContext::enqueue not be
asynchronous?
We have enqueue followed cudaStreamSynchronize.
Almost all the time was taken by enqueue with with very
little taken by cudaStreamSynchronize.
Under what circumstances would nvinfer1::IExecutionContext::enqueue not be
asynchronous?
We have enqueue followed cudaStreamSynchronize.
Almost all the time was taken by enqueue with with very
little taken by cudaStreamSynchronize.
Hi,
Please refer to below link and examples:
https://github.com/NVIDIA/TensorRT/blob/master/samples/opensource/sampleMNIST/sampleMNIST.cpp#L305
Thanks
This is NOT an answer to my question.
I repeat my question here:
Under what circumstances would nvinfer1::IExecutionContext::enqueue not be
asynchronous?
We have enqueue followed cudaStreamSynchronize.
Almost all the time was taken by enqueue with with very
little taken by cudaStreamSynchronize.
The question is why in our case enqueue IS NOT asynchronous?
Is the anything that could make enqueue NOT asynchronous.
It can be due to multiple reason:
Thanks
Many thanks. It appears that we have a plugin that syncs