How many CUDA core are there on AGX Orin

[DaWuLun]

Hi Nvidia
I’m using AGX Orin dev. kit with Jetpack 5.0.2
When I checking the number of cuda cores, I got some questions…
First, according to Here, it says “AGX Orin dev. Kit get 2048 cuda core”.
Tested with cuda-samples/Samples/1_Utilities/deviceQuery Source - Github to check the number of cuda cores.
The output said:

I also checked:

$ grep MemTotal /proc/meminfo
MemTotal: 31268720 kB

and

$ df / -h
Filesystem = /dev/mmcblk0p1
Size = 57G

My questions are:

1. How many CUDA core are there on AGX Orin? 1024 or 2048?
2. If it’s 2048, is there a way to set it up? HW configuration or device tree?

Thank you very much.

[AastaLLL]

Hi,

Since Orin has lots of variants, could you also share the board details with us?

$ cat /etc/nv_boot_control.conf

Thanks.

[DaWuLun]

Hi AastaLLL:
Here is the logs:

orin@ubuntu:~$ cat /etc/nv_boot_control.conf
TNSPEC 3701-500-0000-J.0-1-1-jetson-agx-orin-devkit-
COMPATIBLE_SPEC 3701--0000--1--jetson-agx-orin-devkit-
TEGRA_CHIPID 0x23
TEGRA_OTA_BOOT_DEVICE /dev/mtdblock0
TEGRA_OTA_GPT_DEVICE /dev/mtdblock0

Thank you.

[AastaLLL]

Hi,

Please set Orin to MAXN mode and try it again.
We can get 2048 CUDA cores under the MAXN setting:

$ ./deviceQuery 
./deviceQuery Starting...

 CUDA Device Query (Runtime API) version (CUDART static linking)

Detected 1 CUDA Capable device(s)

Device 0: "Orin"
  CUDA Driver Version / Runtime Version          11.4 / 11.4
  CUDA Capability Major/Minor version number:    8.7
  Total amount of global memory:                 30536 MBytes (32019165184 bytes)
  (016) Multiprocessors, (128) CUDA Cores/MP:    2048 CUDA Cores
  GPU Max Clock rate:                            1300 MHz (1.30 GHz)
...

The default 30W mode only turns on 4 GPU TPC (total is 8) so the number of GPU cores is only 1024.
For more details, please find the document below:
https://docs.nvidia.com/jetson/archives/r35.1/DeveloperGuide/text/SD/PlatformPowerAndPerformance/JetsonOrinNxSeriesAndJetsonAgxOrinSeries.html#supported-modes-and-power-efficiency

Thanks.

[DaWuLun]

Hi AastaLLL:
After changing power mode, CUDA core is now 2048.

$ sudo /usr/sbin/nvpmodel -m 0

Thank you very much!