Bfloat16 quantization in tensorrt

Robotics & Edge Computing Jetson Systems Jetson Nano
1

Does TensorRT currently support quantization to bfloat16? I don’t see such an option. If not will there be that option in the future? Thanks!

3

Hi,

It’s not supported right now.
Based on the below link, it is on our list:

Thanks.