Jetson power throttling with deepstream

• Hardware Platform (Jetson / GPU) Jetson Orin NX 16GB
• DeepStream Version Deepstream-6.2
• JetPack Version (valid for Jetson only) Jetpack 5.1
• TensorRT Version 5.1
• OpenCV without CUDA

I’m having trouble dissipating heat in my Nvidia Jetson Orin NX in my environment. If the Jetson starts to overheat I would like to reduce the power. Can I change the NVP model during operation to reduce the performance of the Jetson without rebooting?

I use the deepstream app with a camera as a source. There are long periods in which the deepstream app is running even though it is not needed. Once the Deepstream app is needed, I don’t have time to wait for the application to load (which can take half a minute). That’s why I leave it running permanently so that I can use it quickly.

My idea was to install a delay in the main loop so that the FPS is reduced and the GPU is not used so heavily when idle. As soon as I need the application, I deactivate the delay again. This should reduce the heat generated when idling. However, I don’t like the solution. Is there a way in the deepsteam app to temporarily switch off the inference processing of the neural network? Maybe by temporarily not calling a function so that the GPU is no longer used? The deepstream app would then run at the maximum FPS that the camera can provide. This should drastically reduce the heat output.

Hi,

You can set different nvpmodel based on your use case.
Please find below doc for the details:

https://docs.nvidia.com/jetson/archives/r35.4.1/DeveloperGuide/text/SD/PlatformPowerAndPerformance/JetsonOrinNanoSeriesJetsonOrinNxSeriesAndJetsonAgxOrinSeries.html#supported-modes-and-power-efficiency

Thanks.

Is there a way to change power mode without rebooting?

sudo /usr/sbin/nvpmodel -m 0
NVPM ERROR: Error writing 240 to /sys/devices/gpu.0/tpc_pg_mask: 16
NVPM WARN: Reboot required for changing to this power mode: 0
NVPM WARN: DO YOU WANT TO REBOOT NOW? enter YES/yes to confirm:

I have to reboot in all power modes.

Hi,

You will need to reboot to apply the new configuration.

nvpmodel ID-0 is the performance mode.
So it’s expected to throttle much easier since both CPU/GPU clock rates are highest.

Based on your use case, you might try some lower clock rates instead.
Thanks.