• Hardware Platform (Jetson / GPU) Jetson Orin NX 16GB • JetPack Version (valid for Jetson only) 6.2 Hi, I used the gpu stress test in 2 minutes with my custom carrier board. https://elinux.org/Jetson/L4T/TRT_Customized_Example#GPU_Stress_Test The power can achieve 37W (super mode), and the t…

Hi, You will need to use TensorRT to run operations on the DLA. Please check the below link for more information: [image] GitHub - NVIDIA/Deep-Learning-Accelerator-SW: NVIDIA DLA-SW, the recipes and tools for running... NVIDIA DLA-SW, the recipes and tools for running deep lear…

Hi, How do you calculate the GFlop? For TOPS benchmarking, it’s recommended to try our CUTLASS library. [image] GitHub - NVIDIA/cutlass: CUDA Templates for Linear Algebra Subroutines CUDA Templates for Linear Algebra Subroutines Thanks.

Hi AastaLLL, The stress test tool I refer to the topic below. [image] Stress tests for the target Jetson Orin NX We have some gpu stress test here. https://elinux.org/Jetson/L4T/TRT_Customized_Example#GPU_Stress_Test For other kind of stress, you could use any upstream…

Hi AastaLLL, I found the error of the modified code. Now, the GFlop is correct (13-15 TOPS) in float16 case. Could you provide the tool to test GPU stress in int 8? Does the CUTLASS library can test it ?

Hi, Yes, you can find the below topic for some info: [image] Discrepancy Between Claimed and Actual Sparse INT8 Performance of Tensor Cores on Jetson AGX Orin Jetson AGX Orin Hello, everyone. Question: The Jetson AGX Orin Tensor Core is advertised to have a…

Hi AastaLLL, I tried the method you provided, the steps are: Changing the below line from Identity8 to Identity4: cutlass/python/cutlass_library/generator.py at main · NVIDIA/cutlass · GitHub Build cutlass library $ git clone GitHub - NVIDIA/cutlass: CUDA Templates for Linear Algebra Subrou…

Hi, To test TOPS, you will need a test that computation >> memory transfer. So would you mind trying different (k, m, n)? You can test it with an argument like k=8192:16384:128. Thanks.

Hi, I tested k=8192:16384:128, and I got 39 TOPS. I also saw your response and tried: How to verify Orin the TOPS performance - #8 by AastaLLL I got the 46909 GFLOP/s = 46.9TOPS in m=512, n=512, k=16256, Identity2. But, I can’t understand that the SOL is 46.9/60 or 46.9/100 ? BTW, I don’t know …

GPU stress test for Orin NX

Robotics & Edge Computing Jetson Systems Jetson Orin NX

AastaLLL May 28, 2025, 8:36am 6

Hi,

Yes, you can find the below topic for some info:

Thanks.

Topic		Replies	Views
How to verify Orin the TOPS performance Jetson Orin NX cuda	9	2396	September 10, 2024
Verifying TOPS with Jetson Orin Nano Jetson Orin NX cudnn	1	611	December 30, 2024
How to test GPU performance Jetson AGX Orin gpu	1	484	January 10, 2025
The performance of the Jetson Orin Nano module does not match the data provided on the official website Jetson AGX Orin cuda , performance	14	3086	September 28, 2023
Discrepancy Between Claimed and Actual Sparse INT8 Performance of Tensor Cores on Jetson AGX Orin Jetson AGX Orin tensorrt , performance	14	985	September 11, 2024
Jetson AGX Orin TOPs / CUDA Cores Explained Jetson AGX Orin jetson-inference	7	7966	May 11, 2023
Jetson series TOPS mean in FLOPS or INTS? Jetson AGX Orin performance	4	7679	November 20, 2023
Testing Jetson Orin NX Performance Jetson Orin NX board-design	1	185	February 2, 2026
Regarding the issue of the GPU compute power test results being significantly lower than expected Jetson Orin Nano nvbugs , gpu-computing	1	143	August 23, 2024
How to measure 200 TOPS of AI Performance of Orin 32GB? CUDA Programming and Performance jetson	6	3628	July 11, 2023

GPU stress test for Orin NX

Related topics