Environment
TensorRT Version : 6.0.0.1
GPU Type : Nvidia A40
Nvidia Driver Version : 510.47.03
CUDA Version : 10.1
CUDNN Version : 8.2.2
Operating System + Version : ubuntu 18.04
Python Version (if applicable) : 3.6.8
TensorFlow Version (if applicable) :2.5.1
PyTorch Version (if applicable) :
Baremetal or Container (if container which image + tag) :nvcr.io/nvidia/tensorflow 19.10-py3
trtexec --onnx=albert_best_model_cluener_efficientglobalpointer_tf32.onnx --saveEngine=albert_best_model_cluener_efficientglobalpointer_tf32.trt --workspace=6000 --verbose=True --fp16
albert_best_model_cluener_efficientglobalpointer_tf32.onnx (38.9 MB)