Hi,
explicit batch is required when using the dynamic shapes for inference.
For other usage, you can create the engine with implicit batch.
Please check this document for more information:
Thanks.
Hi,
explicit batch is required when using the dynamic shapes for inference.
For other usage, you can create the engine with implicit batch.
Please check this document for more information:
Thanks.