AGX Orin System throttled due to Over-current pytorch

Autonomous Machines Jetson & Embedded Systems Jetson AGX Orin
1

I am currently working with a Pytorch model on my AGX Orin, everything was working fine but suddenly I started to get the message: System throttled due to Over-current.

Before I was even running two Pytorch models concurrently without an issue. The last change I made to the Jetson was the upgrade from DS 6.1 to 6.2 but I am not even using Deepstream for this application. I also upgraded Jetpack from 5.0.2 to 5.1

I have been working on this project for 3 months and this wasn’t happening, it just started after the Deepstream upgrade. I just tried an old piece of code thinking that maybe I am doing something different in the code that triggers the message, that piece of code also reads the same Pytorch model and the message still appears.
How can I troubleshoot this problem? How do I downgrade back to DS 6.1 and jetpack 5.0.2?

3

Hi,

Reflashing the device can downgrade to JetPack 5.0.2.

Could you share the tegrastats output with us when the system throttling occurs?

$ sudo tegrastats

Thanks.

4 
04-19-2023 10:16:35 RAM 12193/30587MB (lfb 1950x4MB) SWAP 0/15294MB (cached 0MB) CPU [33%@2201,31%@2201,50%@2201,43%@2201,63%@2201,52%@2201,57%@2201,43%@2201,58%@2201,47%@2201,100%@2201,13%@2201] EMC_FREQ 9%@2133 GR3D_FREQ 52%@407 GR3D2_FREQ 52%@407 VIC_FREQ 729 APE 174 CV0@-256C CPU@48.406C Tboard@34C SOC2@42.75C Tdiode@35.75C SOC0@42.343C CV1@-256C GPU@41.937C tj@48.406C SOC1@42.125C CV2@-256C VDD_GPU_SOC 4009mW/4009mW VDD_CPU_CV 8019mW/8019mW VIN_SYS_5V0 5124mW/5124mW NC 0mW/0mW VDDQ_VDD2_1V8AO 1805mW/1805mW NC 0mW/0mW

04-19-2023 10:16:36 RAM 12595/30587MB (lfb 1886x4MB) SWAP 0/15294MB (cached 0MB) CPU [50%@2201,66%@2201,45%@2201,50%@2201,34%@2201,62%@2201,16%@2201,51%@2201,67%@2201,38%@2201,100%@2201,52%@2201] EMC_FREQ 12%@3199 GR3D_FREQ 99%@1209 GR3D2_FREQ 99%@1204 VIC_FREQ 729 APE 174 CV0@-256C CPU@49.375C Tboard@34C SOC2@43.218C Tdiode@36C SOC0@42.906C CV1@-256C GPU@44.281C tj@49.375C SOC1@42.031C CV2@-256C VDD_GPU_SOC 12019mW/8014mW VDD_CPU_CV 8814mW/8416mW VIN_SYS_5V0 6832mW/5978mW NC 0mW/0mW VDDQ_VDD2_1V8AO 2808mW/2306mW NC 0mW/0mW

04-19-2023 10:16:37 RAM 12601/30587MB (lfb 1884x4MB) SWAP 0/15294MB (cached 0MB) CPU [61%@2201,68%@2201,81%@2201,59%@2201,62%@2201,76%@2201,70%@2201,39%@2201,63%@2201,73%@2201,87%@2201,72%@2201] EMC_FREQ 26%@3199 GR3D_FREQ 27%@1300 GR3D2_FREQ 27%@1300 VIC_FREQ 729 APE 174 CV0@-256C CPU@50.656C Tboard@34C SOC2@43.718C Tdiode@37.25C SOC0@43.343C CV1@-256C GPU@45.375C tj@50.656C SOC1@42.531C CV2@-256C VDD_GPU_SOC 21250mW/12426mW VDD_CPU_CV 10024mW/8952mW VIN_SYS_5V0 8339mW/6765mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3705mW/2772mW NC 0mW/0mW

04-19-2023 10:16:38 RAM 12590/30587MB (lfb 1884x4MB) SWAP 0/15294MB (cached 0MB) CPU [69%@2201,69%@2201,71%@2201,77%@2201,84%@2201,77%@2201,57%@2201,63%@2201,62%@2201,50%@2201,67%@2201,71%@2201] EMC_FREQ 32%@3199 GR3D_FREQ 98%@1298 GR3D2_FREQ 98%@1299 VIC_FREQ 729 APE 174 CV0@-256C CPU@51.125C Tboard@34C SOC2@44.281C Tdiode@37.5C SOC0@43.781C CV1@-256C GPU@45.687C tj@50.968C SOC1@42.656C CV2@-256C VDD_GPU_SOC 22453mW/14932mW VDD_CPU_CV 10424mW/9320mW VIN_SYS_5V0 8440mW/7183mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3806mW/3031mW NC 0mW/0mW

04-19-2023 10:16:39 RAM 12630/30587MB (lfb 1878x4MB) SWAP 0/15294MB (cached 0MB) CPU [76%@2201,87%@2201,68%@2201,62%@2201,77%@2201,66%@2201,67%@2201,71%@2201,63%@2201,67%@2201,73%@2201,68%@2201] EMC_FREQ 35%@3199 GR3D_FREQ 86%@1292 GR3D2_FREQ 86%@1290 VIC_FREQ 729 APE 174 CV0@-256C CPU@50.375C Tboard@34C SOC2@44.531C Tdiode@37.75C SOC0@43.75C CV1@-256C GPU@46.812C tj@50.375C SOC1@42.843C CV2@-256C VDD_GPU_SOC 22854mW/16517mW VDD_CPU_CV 10420mW/9540mW VIN_SYS_5V0 8540mW/7455mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3806mW/3186mW NC 0mW/0mW

04-19-2023 10:16:40 RAM 12645/30587MB (lfb 1877x4MB) SWAP 0/15294MB (cached 0MB) CPU [67%@2201,62%@2201,100%@2201,61%@2201,60%@2201,70%@2057,78%@2201,58%@2201,58%@2201,59%@2321,76%@2201,67%@2201] EMC_FREQ 36%@3199 GR3D_FREQ 99%@1294 GR3D2_FREQ 99%@1291 VIC_FREQ 729 APE 174 CV0@-256C CPU@50.937C Tboard@34C SOC2@44.812C Tdiode@37.75C SOC0@43.875C CV1@-256C GPU@46.531C tj@50.937C SOC1@42.968C CV2@-256C VDD_GPU_SOC 23246mW/17638mW VDD_CPU_CV 10420mW/9686mW VIN_SYS_5V0 8641mW/7652mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3906mW/3306mW NC 0mW/0mW

04-19-2023 10:16:41 RAM 12630/30587MB (lfb 1877x4MB) SWAP 0/15294MB (cached 0MB) CPU [82%@2201,60%@2201,61%@2201,89%@2201,66%@2201,74%@2201,67%@2201,66%@2201,53%@2201,63%@2201,61%@2201,71%@2072] EMC_FREQ 38%@3199 GR3D_FREQ 33%@1300 GR3D2_FREQ 33%@1300 VIC_FREQ 729 APE 174 CV0@-256C CPU@51.687C Tboard@34C SOC2@44.781C Tdiode@38.25C SOC0@44.125C CV1@-256C GPU@47.093C tj@51.687C SOC1@43.093C CV2@-256C VDD_GPU_SOC 22453mW/18326mW VDD_CPU_CV 10424mW/9792mW VIN_SYS_5V0 8540mW/7779mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3806mW/3377mW NC 0mW/0mW

04-19-2023 10:16:42 RAM 12636/30587MB (lfb 1877x4MB) SWAP 0/15294MB (cached 0MB) CPU [80%@2201,57%@2201,80%@2201,71%@2201,69%@2201,60%@2201,59%@2201,69%@2201,64%@2201,57%@2201,80%@2201,64%@2201] EMC_FREQ 38%@3199 GR3D_FREQ 99%@1300 GR3D2_FREQ 78%@1299 VIC_FREQ 729 APE 174 CV0@-256C CPU@51.75C Tboard@34C SOC2@45.031C Tdiode@38.5C SOC0@44.343C CV1@-256C GPU@46.718C tj@51.75C SOC1@43.468C CV2@-256C VDD_GPU_SOC 23656mW/18992mW VDD_CPU_CV 10424mW/9871mW VIN_SYS_5V0 8641mW/7887mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3906mW/3443mW NC 0mW/0mW

04-19-2023 10:16:43 RAM 12642/30587MB (lfb 1877x4MB) SWAP 0/15294MB (cached 0MB) CPU [62%@2201,57%@2201,90%@2201,60%@2201,68%@2201,75%@2201,66%@2201,69%@2201,70%@2201,64%@2201,61%@2201,56%@2201] EMC_FREQ 37%@3199 GR3D_FREQ 99%@1295 GR3D2_FREQ 99%@1294 VIC_FREQ 729 APE 174 CV0@-256C CPU@51.375C Tboard@34C SOC2@45.25C Tdiode@38.25C SOC0@44.375C CV1@-256C GPU@47C tj@51.375C SOC1@43.406C CV2@-256C VDD_GPU_SOC 22854mW/19421mW VDD_CPU_CV 10424mW/9932mW VIN_SYS_5V0 8540mW/7959mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3806mW/3483mW NC 0mW/0mW

04-19-2023 10:16:44 RAM 12550/30587MB (lfb 1883x4MB) SWAP 0/15294MB (cached 0MB) CPU [56%@2201,50%@2201,66%@2201,44%@2201,55%@2201,69%@2201,68%@2201,60%@2201,50%@2201,83%@2201,45%@2201,41%@2201] EMC_FREQ 27%@3199 GR3D_FREQ 0%@1299 GR3D2_FREQ 0%@1300 VIC_FREQ 729 APE 174 CV0@-256C CPU@50.375C Tboard@34C SOC2@44.375C Tdiode@37.5C SOC0@44C CV1@-256C GPU@44.625C tj@50.375C SOC1@43.656C CV2@-256C VDD_GPU_SOC 10429mW/18522mW VDD_CPU_CV 8824mW/9821mW VIN_SYS_5V0 6330mW/7796mW NC 0mW/0mW VDDQ_VDD2_1V8AO 2307mW/3366mW NC 0mW/0mW

04-19-2023 10:16:45 RAM 12562/30587MB (lfb 1883x4MB) SWAP 0/15294MB (cached 0MB) CPU [34%@2201,60%@2201,71%@2201,37%@2201,63%@2201,100%@2201,65%@2201,53%@2201,36%@2201,48%@2043,64%@2201,52%@2201] EMC_FREQ 16%@3199 GR3D_FREQ 21%@1300 GR3D2_FREQ 21%@1299 VIC_FREQ 729 APE 174 CV0@-256C CPU@51.468C Tboard@34C SOC2@44.281C Tdiode@37.25C SOC0@43.781C CV1@-256C GPU@44.375C tj@51.468C SOC1@43.343C CV2@-256C VDD_GPU_SOC 7618mW/17531mW VDD_CPU_CV 9623mW/9803mW VIN_SYS_5V0 5928mW/7626mW NC 0mW/0mW VDDQ_VDD2_1V8AO 2006mW/3242mW NC 0mW/0mW

04-19-2023 10:16:46 RAM 12547/30587MB (lfb 1883x4MB) SWAP 0/15294MB (cached 0MB) CPU [34%@2201,66%@2201,50%@2201,53%@2201,46%@2201,100%@2201,35%@2201,65%@2201,20%@2201,17%@2201,49%@2201,63%@2201] EMC_FREQ 10%@3199 GR3D_FREQ 23%@1300 GR3D2_FREQ 23%@1298 VIC_FREQ 729 APE 174 CV0@-256C CPU@50.562C Tboard@34C SOC2@43.968C Tdiode@37.25C SOC0@43.718C CV1@-256C GPU@44.343C tj@50.562C SOC1@43.5C CV2@-256C VDD_GPU_SOC 6014mW/16571mW VDD_CPU_CV 8416mW/9688mW VIN_SYS_5V0 5526mW/7451mW NC 0mW/0mW VDDQ_VDD2_1V8AO 1805mW/3122mW NC 0mW/0mW

04-19-2023 10:16:47 RAM 12553/30587MB (lfb 1883x4MB) SWAP 0/15294MB (cached 0MB) CPU [52%@2201,51%@2201,47%@2201,67%@2201,42%@2201,100%@2201,50%@2201,54%@2201,45%@2201,58%@2201,43%@2201,52%@2201] EMC_FREQ 8%@3199 GR3D_FREQ 27%@1299 GR3D2_FREQ 27%@1298 VIC_FREQ 729 APE 174 CV0@-256C CPU@50.75C Tboard@34C SOC2@44C Tdiode@37.25C SOC0@43.718C CV1@-256C GPU@44.062C tj@50.75C SOC1@43.281C CV2@-256C VDD_GPU_SOC 6816mW/15820mW VDD_CPU_CV 8821mW/9621mW VIN_SYS_5V0 5727mW/7319mW NC 0mW/0mW VDDQ_VDD2_1V8AO 1906mW/3029mW NC 0mW/0mW

04-19-2023 10:16:48 RAM 12574/30587MB (lfb 1882x4MB) SWAP 0/15294MB (cached 0MB) CPU [44%@2201,40%@2201,60%@2201,54%@2201,49%@2201,100%@2201,74%@2201,63%@2201,54%@2201,56%@2201,69%@2201,59%@2201] EMC_FREQ 12%@2133 GR3D_FREQ 38%@815 GR3D2_FREQ 38%@815 VIC_FREQ 729 APE 174 CV0@-256C CPU@50.437C Tboard@34C SOC2@43.875C Tdiode@37C SOC0@43.718C CV1@-256C GPU@43.593C tj@50.437C SOC1@43.218C CV2@-256C VDD_GPU_SOC 5212mW/15063mW VDD_CPU_CV 9619mW/9621mW VIN_SYS_5V0 5526mW/7191mW NC 0mW/0mW VDDQ_VDD2_1V8AO 1906mW/2948mW NC 0mW/0mW

Is it possible to downgrade Jetpack without having to reflash and lose all my files?

5

Hi,

... VDD_GPU_SOC 22453mW/14932mW ...
... VDD_GPU_SOC 22854mW/16517mW ...
... VDD_GPU_SOC 23246mW/17638mW ...

Based on the output, the device does over the current limit in “VDD_GPU_SOC”.
So system throttling is expected.

To avoid this issue, you can try to add a custom power mode. (ex. lower the CPU clock)
Edit /etc/nvpmodel.conf

…
< POWER_MODEL ID=5 NAME=Custom >
…
CPU_A78_0 MAX_FREQ 1190400
…

$ sudo nvpmodel -m 5

Reflashing is required to downgrade the JetPack version.
Thanks.

1 Like
6

I reflashed the jetson with an old system image I created before doing the upgrade and the system throttling stopped happening. Why did the DS 6.2 and Jetpack 5.1 upgrade trigger the system throttling?
Now I get:

VDD_GPU_SOC 24839mW/25556mW
VDD_GPU_SOC 24038mW/25202mW

Before it was:

Both were set up to MAXN

Full tegrastats below:

 CPU [37%@2201,46%@2201,42%@2201,34%@2201,28%@729,31%@729,27%@729,38%@729,33%@1267,31%@1190,27%@1190,31%@1190] EMC_FREQ 38%@3199 GR3D_FREQ 70%@1296 GR3D2_FREQ 70%@1294 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@56.625C Tboard@42C SOC2@52.031C Tdiode@45.5C SOC0@51.812C CV1@-256C GPU@54.875C tj@56.656C SOC1@50.593C CV2@-256C VDD_GPU_SOC 26041mW/25710mW VDD_CPU_CV 5208mW/5543mW VIN_SYS_5V0 8540mW/8523mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3611mW/3544mW NC 0mW/0mW
04-21-2023 10:33:56 RAM 13437/30536MB (lfb 127x4MB) SWAP 1/15268MB (cached 0MB) CPU [65%@2201,36%@2070,35%@2201,55%@2201,34%@729,31%@729,34%@729,32%@729,33%@2201,26%@2201,40%@2201,32%@2201] EMC_FREQ 38%@3199 GR3D_FREQ 99%@1294 GR3D2_FREQ 99%@1296 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@57.156C Tboard@42C SOC2@52.343C Tdiode@45.5C SOC0@51.968C CV1@-256C GPU@54.5C tj@57.156C SOC1@50.656C CV2@-256C VDD_GPU_SOC 26041mW/25757mW VDD_CPU_CV 6009mW/5609mW VIN_SYS_5V0 8641mW/8540mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3611mW/3553mW NC 0mW/0mW
04-21-2023 10:33:57 RAM 13433/30536MB (lfb 127x4MB) SWAP 1/15268MB (cached 0MB) CPU [52%@2201,73%@2201,45%@2201,40%@2201,29%@2201,35%@2201,33%@2201,37%@2201,41%@1651,31%@2201,37%@2201,36%@2201] EMC_FREQ 39%@3199 GR3D_FREQ 99%@1298 GR3D2_FREQ 99%@1299 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@57.718C Tboard@42C SOC2@52.281C Tdiode@45.75C SOC0@51.843C CV1@-256C GPU@53.968C tj@57.718C SOC1@50.968C CV2@-256C VDD_GPU_SOC 25640mW/25743mW VDD_CPU_CV 6012mW/5660mW VIN_SYS_5V0 8641mW/8552mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3511mW/3548mW NC 0mW/0mW
04-21-2023 10:33:58 RAM 13434/30536MB (lfb 127x4MB) SWAP 1/15268MB (cached 0MB) CPU [36%@2201,41%@2201,83%@2201,33%@2201,39%@1273,33%@1497,33%@1497,30%@1497,32%@1728,37%@1728,35%@1728,33%@1728] EMC_FREQ 39%@3199 GR3D_FREQ 99%@1295 GR3D2_FREQ 99%@1299 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@57.406C Tboard@42C SOC2@52.375C Tdiode@45.75C SOC0@51.937C CV1@-256C GPU@54C tj@57.406C SOC1@50.906C CV2@-256C VDD_GPU_SOC 25651mW/25732mW VDD_CPU_CV 6012mW/5699mW VIN_SYS_5V0 8540mW/8551mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3511mW/3544mW NC 0mW/0mW
04-21-2023 10:33:59 RAM 13444/30536MB (lfb 127x4MB) SWAP 1/15268MB (cached 0MB) CPU [31%@2201,45%@2201,32%@2201,32%@2201,27%@1804,26%@1804,41%@1804,27%@1804,35%@2201,36%@2201,26%@2201,28%@2201] EMC_FREQ 39%@3199 GR3D_FREQ 59%@1293 GR3D2_FREQ 59%@1296 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@57.906C Tboard@42C SOC2@52.406C Tdiode@46C SOC0@52.312C CV1@-256C GPU@54.875C tj@57.906C SOC1@50.968C CV2@-256C VDD_GPU_SOC 25640mW/25723mW VDD_CPU_CV 5208mW/5650mW VIN_SYS_5V0 8540mW/8550mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3611mW/3550mW NC 0mW/0mW
04-21-2023 10:34:00 RAM 13777/30536MB (lfb 106x4MB) SWAP 1/15268MB (cached 0MB) CPU [43%@2201,54%@2201,45%@2201,34%@2201,29%@729,47%@729,28%@729,33%@729,42%@2201,32%@2201,27%@2201,47%@2201] EMC_FREQ 38%@3199 GR3D_FREQ 34%@1294 GR3D2_FREQ 34%@1293 NVJPG1 729 VIC_FREQ 0%@115 APE 233 CV0@-256C CPU@58.062C Tboard@42C SOC2@52.718C Tdiode@45.75C SOC0@52.375C CV1@-256C GPU@55.312C tj@58.187C SOC1@51.187C CV2@-256C VDD_GPU_SOC 26442mW/25788mW VDD_CPU_CV 6009mW/5682mW VIN_SYS_5V0 8540mW/8549mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3611mW/3556mW NC 0mW/0mW
04-21-2023 10:34:01 RAM 13783/30536MB (lfb 106x4MB) SWAP 1/15268MB (cached 0MB) CPU [38%@2201,99%@2201,38%@2201,41%@2201,40%@1651,43%@1651,39%@1651,48%@1574,81%@2201,55%@2201,44%@2201,56%@2201] EMC_FREQ 38%@3199 GR3D_FREQ 63%@1298 GR3D2_FREQ 63%@1296 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@59.156C Tboard@42C SOC2@53C Tdiode@45.75C SOC0@52.531C CV1@-256C GPU@54.968C tj@59.156C SOC1@51.187C CV2@-256C VDD_GPU_SOC 25240mW/25743mW VDD_CPU_CV 8016mW/5877mW VIN_SYS_5V0 8540mW/8548mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3611mW/3560mW NC 0mW/0mW
04-21-2023 10:34:02 RAM 13893/30536MB (lfb 106x4MB) SWAP 1/15268MB (cached 0MB) CPU [41%@2201,43%@2201,42%@2201,38%@2201,33%@1574,41%@1574,49%@1574,37%@1574,38%@2201,57%@2201,33%@2201,73%@2201] EMC_FREQ 37%@3199 GR3D_FREQ 99%@1294 GR3D2_FREQ 99%@1293 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@58.437C Tboard@42C SOC2@52.812C Tdiode@46C SOC0@52.375C CV1@-256C GPU@55.406C tj@58.437C SOC1@51.5C CV2@-256C VDD_GPU_SOC 24028mW/25611mW VDD_CPU_CV 6813mW/5949mW VIN_SYS_5V0 8440mW/8540mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3410mW/3549mW NC 0mW/0mW
04-21-2023 10:34:03 RAM 14016/30536MB (lfb 106x4MB) SWAP 1/15268MB (cached 0MB) CPU [34%@2188,41%@2188,32%@2188,36%@2188,33%@2201,33%@2201,28%@2201,35%@2201,28%@1881,31%@1881,32%@1420,38%@1420] EMC_FREQ 36%@3199 GR3D_FREQ 99%@1289 GR3D2_FREQ 99%@1294 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@57.906C Tboard@42C SOC2@52.687C Tdiode@46C SOC0@52.343C CV1@-256C GPU@54.5C tj@57.906C SOC1@51.437C CV2@-256C VDD_GPU_SOC 24839mW/25556mW VDD_CPU_CV 5611mW/5924mW VIN_SYS_5V0 8339mW/8525mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3410mW/3539mW NC 0mW/0mW
04-21-2023 10:34:04 RAM 14114/30536MB (lfb 106x4MB) SWAP 1/15268MB (cached 0MB) CPU [26%@1809,29%@1748,28%@1190,25%@1190,30%@2201,36%@2201,28%@2201,33%@2201,27%@2201,32%@2201,32%@2201,32%@1971] EMC_FREQ 36%@3199 GR3D_FREQ 99%@1296 GR3D2_FREQ 99%@1298 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@57.437C Tboard@42C SOC2@52.625C Tdiode@46C SOC0@52.625C CV1@-256C GPU@54.593C tj@57.437C SOC1@51.375C CV2@-256C VDD_GPU_SOC 24439mW/25481mW VDD_CPU_CV 4809mW/5850mW VIN_SYS_5V0 8239mW/8506mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3310mW/3524mW NC 0mW/0mW
04-21-2023 10:34:05 RAM 14552/30536MB (lfb 42x4MB) SWAP 1/15268MB (cached 0MB) CPU [46%@2201,41%@2201,44%@2201,42%@2201,35%@2201,43%@2201,47%@2201,36%@2201,41%@2201,41%@2201,36%@2201,44%@2201] EMC_FREQ 37%@3199 GR3D_FREQ 97%@1292 GR3D2_FREQ 97%@1298 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@58.843C Tboard@43C SOC2@53C Tdiode@46.25C SOC0@52.531C CV1@-256C GPU@55.187C tj@58.937C SOC1@51.562C CV2@-256C VDD_GPU_SOC 24839mW/25441mW VDD_CPU_CV 6810mW/5910mW VIN_SYS_5V0 8540mW/8508mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3611mW/3529mW NC 0mW/0mW
04-21-2023 10:34:06 RAM 14766/30536MB (lfb 72x4MB) SWAP 1/15268MB (cached 0MB) CPU [41%@2329,44%@2201,65%@2201,41%@2201,43%@2201,45%@2201,42%@2201,43%@2201,64%@2201,57%@2201,58%@2201,51%@2201] EMC_FREQ 38%@3199 GR3D_FREQ 99%@1296 GR3D2_FREQ 99%@1298 NVJPG1 729 VIC_FREQ 0%@115 APE 233 CV0@-256C CPU@59.281C Tboard@43C SOC2@53C Tdiode@46.25C SOC0@52.562C CV1@-256C GPU@54.343C tj@59.312C SOC1@51.625C CV2@-256C VDD_GPU_SOC 24439mW/25382mW VDD_CPU_CV 8016mW/6034mW VIN_SYS_5V0 8540mW/8510mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3511mW/3528mW NC 0mW/0mW
04-21-2023 10:34:07 RAM 14769/30536MB (lfb 72x4MB) SWAP 1/15268MB (cached 0MB) CPU [31%@2201,36%@2201,92%@2201,29%@2201,30%@2201,37%@2201,47%@2201,37%@2201,25%@2201,34%@2112,36%@2112,29%@2112] EMC_FREQ 38%@3199 GR3D_FREQ 95%@1298 GR3D2_FREQ 95%@1296 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@59.187C Tboard@43C SOC2@53.156C Tdiode@46.5C SOC0@52.875C CV1@-256C GPU@54.593C tj@59.187C SOC1@51.562C CV2@-256C VDD_GPU_SOC 24448mW/25330mW VDD_CPU_CV 6813mW/6077mW VIN_SYS_5V0 8440mW/8506mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3511mW/3527mW NC 0mW/0mW
04-21-2023 10:34:08 RAM 14769/30536MB (lfb 72x4MB) SWAP 1/15268MB (cached 0MB) CPU [57%@2201,61%@2201,33%@2201,55%@2201,33%@2201,59%@2201,36%@2201,38%@2201,39%@1420,40%@1420,34%@1420,40%@1420] EMC_FREQ 37%@3199 GR3D_FREQ 65%@1294 GR3D2_FREQ 65%@1293 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@59.687C Tboard@43C SOC2@53.187C Tdiode@46.5C SOC0@52.781C CV1@-256C GPU@55.468C tj@59.687C SOC1@51.875C CV2@-256C VDD_GPU_SOC 24057mW/25263mW VDD_CPU_CV 7208mW/6137mW VIN_SYS_5V0 8339mW/8497mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3410mW/3521mW NC 0mW/0mW
04-21-2023 10:34:09 RAM 14771/30536MB (lfb 72x4MB) SWAP 1/15268MB (cached 0MB) CPU [35%@2201,34%@2201,31%@2201,99%@2201,45%@2201,39%@2201,33%@2201,49%@2201,32%@1804,31%@1804,38%@1804,31%@1804] EMC_FREQ 36%@3199 GR3D_FREQ 99%@1298 GR3D2_FREQ 99%@1296 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@58.437C Tboard@43C SOC2@53.187C Tdiode@46.25C SOC0@52.718C CV1@-256C GPU@55.093C tj@58.437C SOC1@51.718C CV2@-256C VDD_GPU_SOC 24038mW/25202mW VDD_CPU_CV 6012mW/6130mW VIN_SYS_5V0 8440mW/8494mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3511mW/3520mW NC 0mW/0mW
04-21-2023 10:34:10 RAM 14807/30536MB (lfb 72x4MB) SWAP 1/15268MB (cached 0MB) CPU [63%@2201,32%@2201,35%@2201,89%@2201,37%@2201,26%@2201,31%@2201,38%@2201,36%@2201,38%@2201,33%@2201,35%@2201] EMC_FREQ 37%@3199 GR3D_FREQ 70%@1292 GR3D2_FREQ 71%@1293 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@59.031C Tboard@43C SOC2@53.562C Tdiode@46.5C SOC0@52.937C CV1@-256C GPU@56.125C tj@59.281C SOC1@51.875C CV2@-256C VDD_GPU_SOC 24439mW/25165mW VDD_CPU_CV 6808mW/6163mW VIN_SYS_5V0 8641mW/8501mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3511mW/3520mW NC 0mW/0mW
04-21-2023 10:34:11 RAM 14813/30536MB (lfb 72x4MB) SWAP 1/15268MB (cached 0MB) CPU [60%@2201,36%@2201,34%@2201,98%@2201,34%@1881,44%@1881,35%@1881,34%@1881,37%@2201,40%@2201,44%@2201,38%@2201] EMC_FREQ 38%@3199 GR3D_FREQ 58%@1291 GR3D2_FREQ 58%@1292 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@58.5C Tboard@43C SOC2@53.562C Tdiode@46.75C SOC0@52.937C CV1@-256C GPU@56.187C tj@58.5C SOC1@51.812C CV2@-256C VDD_GPU_SOC 26052mW/25206mW VDD_CPU_CV 6810mW/6192mW VIN_SYS_5V0 8641mW/8508mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3605mW/3524mW NC 0mW/0mW
04-21-2023 10:34:12 RAM 14814/30536MB (lfb 72x4MB) SWAP 1/15268MB (cached 0MB) CPU [23%@2201,27%@2201,36%@2201,30%@2201,30%@2201,22%@2201,25%@2201,28%@2201,29%@729,25%@729,25%@729,27%@729] EMC_FREQ 37%@3199 GR3D_FREQ 92%@1294 GR3D2_FREQ 92%@1293 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@58.531C Tboard@43C SOC2@53.156C Tdiode@46.5C SOC0@53.187C CV1@-256C GPU@55.531C tj@58.531C SOC1@51.812C CV2@-256C VDD_GPU_SOC 23637mW/25137mW VDD_CPU_CV 4807mW/6132mW VIN_SYS_5V0 8440mW/8505mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3310mW/3514mW NC 0mW/0mW
04-21-2023 10:34:13 RAM 14813/30536MB (lfb 72x4MB) SWAP 1/15268MB (cached 0MB) CPU [22%@2201,30%@2201,29%@2201,27%@2201,34%@1036,24%@1036,29%@1036,33%@960,25%@1113,27%@1113,28%@1113,28%@1190] EMC_FREQ 36%@3199 GR3D_FREQ 86%@1292 GR3D2_FREQ 86%@1290 NVJPG1 729 VIC_FREQ 115 APE 233 CV0@-256C CPU@58.343C Tboard@43C SOC2@53.312C Tdiode@46.75C SOC0@53.062C CV1@-256C GPU@55.531C tj@58.343C SOC1@51.968C CV2@-256C VDD_GPU_SOC 24448mW/25109mW VDD_CPU_CV 4807mW/6077mW VIN_SYS_5V0 8339mW/8498mW NC 0mW/0mW VDDQ_VDD2_1V8AO 3310mW/3506mW NC 0mW/0mW
7

Hi,

There are some library changes between JetPack 5.1 and 5.0.2.
Could you share the steps to reproduce this issue?

Thanks.

8

Can’t share all the code but the issue occurred with the model from this repo:

I ran it with pytorch+cuda and on a video instead of pictures.

9

Hi,

Just want to confirm first.

Is the issue need to be reproduced with two inferences concurrently?
Or one PyTorch inference can cause the over-current?

Thanks.

10

The issue happens with both, two inferences concurrently and one inference. With the downgrade, I can run two inferences concurrently or only one without an issue.

11

Hi,

Thanks for the feedback.
Could you also share how you install the PyTorch on JetPack 5.0.2 and JetPack 5.1?

We found the power consumption of the CPU increases a lot in JetPack 5.1.
Is it possible that there are some changes in PyTorch that cause the CPU becomes much busy in JetPack 5.1? (ex. PyTorch 1.13 → 2.0)

Thanks.

12

I didn’t upgrade pytorch with the DS and jetpcack upgrade. I use Pytorch 1.13
image

Should I also upgrade pytorch along with DS and jetpack?

13

Hi,

Sorry for the late update.

Not sure if this is the overcurrent comes from.
But it’s expected to use the PyTorch that is built with the same JetPack version.
There are some dependencies between CUDA libraries and GPU drivers.
Using different libraries might lead to some unexpected issues.

Would you mind giving it a try?

Thanks.

14

@AastaLLL Right now I can’t make changes to my system, next time I upgrade I will have that in mind and make sure I upgrade Pytorch as well. Which Pytorch version is built with the Jetpack 5.1?

15

Hi,

The package folder will change to …/jp/v51/pytorch/
You can find the supported version below:

https://developer.download.nvidia.cn/compute/redist/jp/v51/pytorch/

Thank.s

17

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.