Max_Batch_Size Triton Server


I face an issue with the max_batch_size when trying to host pretrained resnet18 model using triton server. Setting max_batch_size larger than 0 causes triton server failed to launch.

For better clarity, kindly refer below for the steps that I took:

  1. Do onnx to trt conversion using
  2. Launch triton from the NGC Triton container (

Snippets below show the error msg