I set tensorrt’s IBuilder->setFp16Mode(true), but the builder still uses kFLOAT DataType (I set a break point at one of my plugin, and find that DataType is still kFLOAT).
My GPU is TITAN X, which do not support fast fp16. But I just want to debug my code. I will finally run my code on Jetson TX2 (jetpack 3.3).
GPU: TITAN X