Hi,
You can choose the deployed hardware when converting the model into TensorRT engine.
The API looks like as following:
builder->setFp16Mode(true);
builder->setDefaultDeviceType( nvinfer1::DeviceType::kDLA );
The default device type is set to GPU rather than DLA.
Thanks.