Switch between cuda core and tensor core


I wonder if we can explicitly assign tasks to be executed on CUDA core or tensor core in TensorRT.
Because I look through TensorRT’s document and find no such API.

Hi @ethanguan5,

The CUDA cores are not different from the tensor cores. Tensor cores are like SSE or AVX - it’s one instruction stream through the SM, it just gets dispatched to different execution units inside the core depending on whether it’s an MMA instruction.

Thank you.