How many CUDA core are there on AGX Orin

Hi Nvidia
I’m using AGX Orin dev. kit with Jetpack 5.0.2
When I checking the number of cuda cores, I got some questions…
First, according to Here, it says “AGX Orin dev. Kit get 2048 cuda core”.
Tested with cuda-samples/Samples/1_Utilities/deviceQuery Source - Github to check the number of cuda cores.
The output said:

I also checked:

$ grep MemTotal /proc/meminfo
MemTotal: 31268720 kB


$ df / -h
Filesystem = /dev/mmcblk0p1
Size = 57G

My questions are:

  1. How many CUDA core are there on AGX Orin? 1024 or 2048?
  2. If it’s 2048, is there a way to set it up? HW configuration or device tree?

Thank you very much.


Since Orin has lots of variants, could you also share the board details with us?

$ cat /etc/nv_boot_control.conf


Hi AastaLLL:
Here is the logs:

orin@ubuntu:~$ cat /etc/nv_boot_control.conf
TNSPEC 3701-500-0000-J.0-1-1-jetson-agx-orin-devkit-
COMPATIBLE_SPEC 3701--0000--1--jetson-agx-orin-devkit-
TEGRA_OTA_BOOT_DEVICE /dev/mtdblock0
TEGRA_OTA_GPT_DEVICE /dev/mtdblock0

Thank you.


Please set Orin to MAXN mode and try it again.
We can get 2048 CUDA cores under the MAXN setting:

$ ./deviceQuery 
./deviceQuery Starting...

 CUDA Device Query (Runtime API) version (CUDART static linking)

Detected 1 CUDA Capable device(s)

Device 0: "Orin"
  CUDA Driver Version / Runtime Version          11.4 / 11.4
  CUDA Capability Major/Minor version number:    8.7
  Total amount of global memory:                 30536 MBytes (32019165184 bytes)
  (016) Multiprocessors, (128) CUDA Cores/MP:    2048 CUDA Cores
  GPU Max Clock rate:                            1300 MHz (1.30 GHz)

The default 30W mode only turns on 4 GPU TPC (total is 8) so the number of GPU cores is only 1024.
For more details, please find the document below:


Hi AastaLLL:
After changing power mode, CUDA core is now 2048.

$ sudo /usr/sbin/nvpmodel -m 0

Thank you very much!

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.