Hi, guys, I want to know if I can get the number of Tensor cores of my GPU with CUDA API. Your answer and guidance will be appreciated!

There isn’t any API to do that.

Thank you sincerely for the response!

Hi, @Robert_Crovella , since I cannot get Tensor cores number with CUDA API, would it be explicitly described in some official documentation?

There are various architecture whitepapers that indicate the number of tensor cores (TC). I won’t be able to give you a laundry list of all of them, and its quite possible that this method doesn’t cover every possible GPU that has TC. You would have to come up with your own calculations based on k…

It should be added to the cudaGetDeviceProperties because that function gets a LOT of information: [image] The properties I am dumping from the call: [image] It would be suggested to step this code might hold the tensor core parameter in the latest toolkit if you stepped it with a card that has…

[image] cnmcdee: It should be added to the cudaGetDeviceProperties because that function gets a LOT of information: You can always file a bug requesting that.

[image] cnmcdee: cudaGetDeviceProperties I have filed this in the request .

My proposal (determine architecture from cudaGetDeviceProperties, determine TC per SM from arch whitepapers, multiply) won’t work for at least some cases. In particular there exist members of the sm_75 family that have no TC units , such as GTX 1660 (and others) as well as other members that certain…

Can I get the number of Tensor cores of my GPU?

Accelerated Computing CUDA CUDA Programming and Performance

Robert_Crovella December 14, 2022, 4:51pm 7

You can always file a bug requesting that.

Topic		Replies	Views
Query the number of tensor cores on the GPU? CUDA Programming and Performance cuda	11	1537	November 5, 2022
GTX 560 Ti number of cores 256 vs 384? CUDA Programming and Performance	1	10896	April 7, 2011
How to Check Detailed GPU Architecture Info (GA104/RTX 3060 Ti): GPC/TPC/SM/CUDA Core Counts? GPU - Hardware	1	300	July 22, 2025
[beginner ]cudaGetDeviceCount CUDA Programming and Performance	8	11443	May 4, 2010
gtx 470 showing 112 cores CUDA Programming and Performance	8	7719	June 29, 2010
Clarification on CUDA Core and Tensor Core counts for Jetson AGX Thor Jetson Thor cuda , gpu	6	1064	January 19, 2026
Calculating CUDA cores CUDA Programming and Performance	3	2960	September 13, 2020
How to count cuda cores with numba? CUDA Programming and Performance	4	1759	August 24, 2021
Add ability to get tensor cores information System Management and Monitoring (NVML)	0	586	October 20, 2023
How to check the number of cuda cores used by my program or app? CUDA Programming and Performance	0	471	September 22, 2021

Can I get the number of Tensor cores of my GPU?

Related topics