Testing Jetson Orin NX Performance

Robotics & Edge Computing Jetson Systems Jetson Orin NX
1

Hello!

I’m looking for suggestions on testing the performance of my Jetson Orin NX. I’m practically interested in what tools folks have found useful for stressing the CPU and GPU.

I’ve been using a mixture of stress-ng, and a custom CUDA application to load both CPU and GPU to achieve levels of utilization. My goal is to estimate the sustained FLOP rate, and number of FLOPs before my system thermally throttles.

2

*** Please note that this reply is generated by LLM automatically ***

Testing the performance of your Jetson Orin NX is crucial to understand its capabilities and limitations. I’ll provide you with some suggestions on tools and methods that can help you stress the CPU and GPU, estimate the sustained FLOP rate, and identify thermal throttling.

CPU Stressing Tools:

  1. stress-ng: You’re already using this tool, which is great. stress-ng is a versatile tool that can stress various system resources, including CPU, memory, and I/O.
  2. sysbench: This tool is designed to benchmark and stress various system components, including CPU, memory, and disk I/O.
  3. cpuburn: This tool is specifically designed to stress the CPU and can be used to test the system’s thermal throttling.

GPU Stressing Tools:

  1. CUDA applications: You’re already using a custom CUDA application to load the GPU, which is a great approach.
  2. NVIDIA’s GPU Burn: This tool is designed to stress the GPU and can be used to test the system’s thermal throttling.
  3. oclHashcat: This tool is a GPU-accelerated password cracking tool that can be used to stress the GPU.

FLOP Rate Estimation:

  1. Linpack: This is a widely used benchmarking tool that can estimate the system’s FLOP rate.
  2. HPL-AI: This tool is designed to benchmark the system’s FLOP rate and can be used to estimate the sustained FLOP rate.

Thermal Throttling Detection:

  1. Jetson’s built-in thermal monitoring tools: You can use the tegrastats command to monitor the system’s temperature and detect thermal throttling.
  2. NVIDIA’s GPU monitoring tools: You can use the nvidia-smi command to monitor the GPU’s temperature and detect thermal throttling.

Comparison of Tools:

  • stress-ng and sysbench are more versatile tools that can stress various system resources, while cpuburn is specifically designed to stress the CPU.
  • CUDA applications and NVIDIA’s GPU Burn are more suitable for stressing the GPU, while oclHashcat is a GPU-accelerated password cracking tool that can be used to stress the GPU.
  • Linpack and HPL-AI are widely used benchmarking tools that can estimate the system’s FLOP rate.

Recommendations:

  1. Use a combination of stress-ng and sysbench to stress the CPU and estimate the sustained FLOP rate.
  2. Use a CUDA application or NVIDIA’s GPU Burn to stress the GPU and estimate the sustained FLOP rate.
  3. Use Linpack or HPL-AI to estimate the system’s FLOP rate.
  4. Use Jetson’s built-in thermal monitoring tools or NVIDIA’s GPU monitoring tools to detect thermal throttling.

By using these tools and methods, you should be able to estimate the sustained FLOP rate and detect thermal throttling on your Jetson Orin NX.

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.