Hi,
I wonder if we can explicitly assign tasks to be executed on CUDA core or tensor core in TensorRT.
Because I look through TensorRT’s document and find no such API.
Hi,
I wonder if we can explicitly assign tasks to be executed on CUDA core or tensor core in TensorRT.
Because I look through TensorRT’s document and find no such API.
Hi @ethanguan5,
The CUDA cores are not different from the tensor cores. Tensor cores are like SSE or AVX - it’s one instruction stream through the SM, it just gets dispatched to different execution units inside the core depending on whether it’s an MMA instruction.
Thank you.