Please provide complete information as applicable to your setup.
**• Hardware Platform (Jetson / GPU)**Orin 64G Development kit
• DeepStream Version 7.1
**• JetPack Version (valid for Jetson only)**6.1+b123
When I run deepstream_parallel_inference_app
with cctvs, I have message came out as System Throttled Due to Overcurrent
Do I need to do something for the message?
Thanks for the reply.
When we do installation for deepstream_reference_apps , we set power model and clocks as
nvpmodel -m 0 && jetson_clocks
So now when I check power mode, it is MAXN . My question is should I change Power Mode to 2 to reslove this power throttle issue? How can I change to Mode 2?
atic@ubuntu:~$ nvpmodel -q --verbose
NVPM VERB: Config file: /etc/nvpmodel.conf
NVPM VERB: parsing done for /etc/nvpmodel.conf
NVPM VERB: Current mode: NV Power Mode: MAXN
0
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_0: PATH /sys/devices/system/cpu/cpu0/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_1: PATH /sys/devices/system/cpu/cpu1/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_2: PATH /sys/devices/system/cpu/cpu2/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_3: PATH /sys/devices/system/cpu/cpu3/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_4: PATH /sys/devices/system/cpu/cpu4/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_5: PATH /sys/devices/system/cpu/cpu5/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_6: PATH /sys/devices/system/cpu/cpu6/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_7: PATH /sys/devices/system/cpu/cpu7/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_8: PATH /sys/devices/system/cpu/cpu8/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_9: PATH /sys/devices/system/cpu/cpu9/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_10: PATH /sys/devices/system/cpu/cpu10/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM CPU_ONLINE: ARG CORE_11: PATH /sys/devices/system/cpu/cpu11/online: REAL_VAL: 1 CONF_VAL: 1
NVPM VERB: PARAM TPC_POWER_GATING: ARG TPC_PG_MASK: PATH /sys/devices/platform/gpu.0/tpc_pg_mask: REAL_VAL: 0 CONF_VAL: 0
NVPM VERB: PARAM GPU_POWER_CONTROL_ENABLE: ARG GPU_PWR_CNTL_EN: PATH /sys/devices/platform/gpu.0/power/control: REAL_VAL: auto CONF_VAL: on
NVPM VERB: PARAM CPU_A78_0: ARG MIN_FREQ: PATH /sys/devices/system/cpu/cpu0/cpufreq/scaling_min_freq: REAL_VAL: 729600 CONF_VAL: 729600
NVPM VERB: PARAM CPU_A78_0: ARG MAX_FREQ: PATH /sys/devices/system/cpu/cpu0/cpufreq/scaling_max_freq: REAL_VAL: 2201600 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM CPU_A78_1: ARG MIN_FREQ: PATH /sys/devices/system/cpu/cpu4/cpufreq/scaling_min_freq: REAL_VAL: 729600 CONF_VAL: 729600
NVPM VERB: PARAM CPU_A78_1: ARG MAX_FREQ: PATH /sys/devices/system/cpu/cpu4/cpufreq/scaling_max_freq: REAL_VAL: 2201600 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM CPU_A78_2: ARG MIN_FREQ: PATH /sys/devices/system/cpu/cpu8/cpufreq/scaling_min_freq: REAL_VAL: 729600 CONF_VAL: 729600
NVPM VERB: PARAM CPU_A78_2: ARG MAX_FREQ: PATH /sys/devices/system/cpu/cpu8/cpufreq/scaling_max_freq: REAL_VAL: 2201600 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM GPU: ARG MIN_FREQ: PATH /sys/devices/platform/17000000.gpu/devfreq_dev/min_freq: REAL_VAL: 306000000 CONF_VAL: 0
NVPM VERB: PARAM GPU: ARG MAX_FREQ: PATH /sys/devices/platform/17000000.gpu/devfreq_dev/max_freq: REAL_VAL: 1300500000 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM GPU_POWER_CONTROL_DISABLE: ARG GPU_PWR_CNTL_DIS: PATH /sys/devices/platform/gpu.0/power/control: REAL_VAL: auto CONF_VAL: auto
NVPM VERB: PARAM EMC: ARG MAX_FREQ: PATH /sys/kernel/nvpmodel_clk_cap/emc: REAL_VAL: 3199000000 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM DLA0_CORE: ARG MAX_FREQ: PATH /sys/devices/platform/bus@0/13e00000.host1x/15880000.nvdla0/clk_cap/dla0_core: REAL_VAL: 1600000000 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM DLA1_CORE: ARG MAX_FREQ: PATH /sys/devices/platform/bus@0/13e00000.host1x/158c0000.nvdla1/clk_cap/dla1_core: REAL_VAL: 1600000000 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM DLA0_FALCON: ARG MAX_FREQ: PATH /sys/devices/platform/bus@0/13e00000.host1x/15880000.nvdla0/clk_cap/dla0_falcon: REAL_VAL: 844800000 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM DLA1_FALCON: ARG MAX_FREQ: PATH /sys/devices/platform/bus@0/13e00000.host1x/158c0000.nvdla1/clk_cap/dla1_falcon: REAL_VAL: 844800000 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM PVA0_VPS: ARG MAX_FREQ: PATH /sys/devices/platform/bus@0/13e00000.host1x/16000000.pva0/clk_cap/pva0_vps: REAL_VAL: 1369600000 CONF_VAL: 9223372036854775807
NVPM VERB: PARAM PVA0_AXI: ARG MAX_FREQ: PATH /sys/devices/platform/bus@0/13e00000.host1x/16000000.pva0/clk_cap/pva0_cpu_axi: REAL_VAL: 985600000 CONF_VAL: 9223372036854775807
Jetson Orin 64G development kit
edit_or
February 12, 2025, 8:54am
10
I don’t have any OC event in the hwmon folders.
Is there any OC related log in kernel log?
edit_or
February 14, 2025, 2:44am
12
These are all files in /var/log folder
Is there any OC related error log in kernel log?
edit_or
February 14, 2025, 2:53am
14
I tested running deepstream_parallel_inference_app
with 4 cctvs stream and three models (all primary GIEs, without secondary GIE) running on Orin 64G development kit. The application runs with a lot of System Throttled Due to Overcurrent popups. App freezed during running. When freezed, all hardware switches have no responses. Press switch button, the system didn’t shutdown. I need to plugout power to shutdown the device.
Then, reduced to 3 cctvs and 3 models, still have same issue.
Reduced to 3 cctvs, 3 models and tried to reduce fps to 8 fps, then frequency of System Throttled Due to Overcurrent popups reduced a lot. The app can run much longer than before. But system still freezed. Last night, I let the device run overnight, this morning the device is freezed with no response.
How can I solve the issue?
Please check your kernel log to search for the OC related error.
edit_or
February 14, 2025, 3:11am
18
I changed from MAXN to 30W.
GPU loading % is always varying from 0% to 99%.
When changed to 30 W mode, cctv streaming has problem which I never encountered in MAXN mode. The issue is as follows.
**PERF: 8.20 (8.23) 7.43 (8.20) 7.43 (8.21)
Processing frame number = 1587
Processing frame number = 1588
Processing frame number = 1590
Processing frame number = 1595
Processing frame number = 1592
Processing frame number = 1595
Processing frame number = 1598
**PERF: 7.37 (8.22) 8.43 (8.20) 8.43 (8.21)
Processing frame number = 1595
Processing frame number = 1600
Processing frame number = 1598
Processing frame number = 1599
**PERF: 14.03 (8.20) 9.28 (8.18) 7.42 (8.19)
**PERF: 0.00 (8.16) 0.00 (8.14) 0.00 (8.15)
**PERF: 0.00 (8.12) 0.00 (8.10) 0.00 (8.10)
**PERF: 0.00 (8.08) 0.00 (8.06) 0.00 (8.06)
**PERF: 0.00 (8.04) 0.00 (8.02) 0.00 (8.02)
**PERF: 0.00 (8.00) 0.00 (7.98) 0.00 (7.98)
**PERF: 0.00 (7.96) 0.00 (7.94) 0.00 (7.94)
**PERF: 0.00 (7.92) 0.00 (7.90) 0.00 (7.90)
**PERF: 0.00 (7.88) 0.00 (7.86) 0.00 (7.87)
** WARN: <watch_source_status:769>: No data from source 1 since last 10 sec. Trying reconnection
NVMMLITE_NVVIDEODEC, <cbAllocPictureBuffer, 4995> ErrorInfo = VideoErrorInfo_OutputBufferUnavailable cctx = 0x6416ac00
** INFO: <reset_source_pipeline:1741>: Resetting source 1
**PERF: 0.00 (7.84) 0.00 (7.82) 0.00 (7.83)
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NvMMLiteBlockCreate : Block : BlockType = 279
Processing frame number = 1600
**PERF: 0.00 (7.80) 0.20 (7.79) 0.00 (7.79)
**PERF: 0.00 (7.77) 0.00 (7.76) 0.00 (7.75)
**PERF: 0.00 (7.73) 0.00 (7.72) 0.00 (7.71)
**PERF: 0.00 (7.69) 0.00 (7.68) 0.00 (7.68)
**PERF: 0.00 (7.65) 0.00 (7.64) 0.00 (7.64)
**PERF: 0.00 (7.62) 0.00 (7.61) 0.00 (7.60)
**PERF: 0.00 (7.58) 0.00 (7.57) 0.00 (7.57)
**PERF: 0.00 (7.55) 0.00 (7.54) 0.00 (7.53)
**PERF: 0.00 (7.51) 0.00 (7.50) 0.00 (7.50)
** WARN: <watch_source_status:769>: No data from source 0 since last 10 sec. Trying reconnection
NVMMLITE_NVVIDEODEC, <cbAllocPictureBuffer, 4995> ErrorInfo = VideoErrorInfo_OutputBufferUnavailable cctx = 0x7c105f20
** INFO: <reset_source_pipeline:1741>: Resetting source 0
**PERF: 0.00 (7.48) 0.00 (7.47) 0.00 (7.46)
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NvMMLiteBlockCreate : Block : BlockType = 279
**PERF: 0.00 (7.44) 0.00 (7.43) 0.00 (7.43)
**PERF: 0.00 (7.41) 0.00 (7.40) 0.00 (7.39)
** WARN: <watch_source_status:769>: No data from source 1 since last 11 sec. Trying reconnection
NVMMLITE_NVVIDEODEC, <cbAllocPictureBuffer, 4995> ErrorInfo = VideoErrorInfo_OutputBufferUnavailable cctx = 0x580f1420
** INFO: <reset_source_pipeline:1741>: Resetting source 1
**PERF: 0.00 (7.37) 0.00 (7.36) 0.00 (7.36)
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NvMMLiteBlockCreate : Block : BlockType = 279
**PERF: 0.00 (7.34) 0.00 (7.33) 0.00 (7.32)
**PERF: 0.00 (7.31) 0.00 (7.30) 0.00 (7.29)
** WARN: <watch_source_status:769>: No data from source 2 since last 16 sec. Trying reconnection
NVMMLITE_NVVIDEODEC, <cbAllocPictureBuffer, 4995> ErrorInfo = VideoErrorInfo_OutputBufferUnavailable cctx = 0x6010b300
** INFO: <reset_source_pipeline:1741>: Resetting source 2
**PERF: 0.00 (7.27) 0.00 (7.26) 0.00 (7.26)
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NvMMLiteBlockCreate : Block : BlockType = 279
**PERF: 0.00 (7.24) 0.00 (7.23) 0.00 (7.23)
**PERF: 0.00 (7.21) 0.00 (7.20) 0.00 (7.19)
**PERF: 0.00 (7.17) 0.00 (7.17) 0.00 (7.16)
**PERF: 0.00 (7.14) 0.00 (7.13) 0.00 (7.13)
**PERF: 0.00 (7.11) 0.00 (7.10) 0.00 (7.10)
** WARN: <watch_source_status:769>: No data from source 0 since last 10 sec. Trying reconnection
NVMMLITE_NVVIDEODEC, <cbAllocPictureBuffer, 4995> ErrorInfo = VideoErrorInfo_OutputBufferUnavailable cctx = 0x44104060
** INFO: <reset_source_pipeline:1741>: Resetting source 0
**PERF: 0.00 (7.08) 0.00 (7.07) 0.00 (7.07)
Opening in BLOCKING MODE
NvMMLiteOpen : Block : BlockType = 279
NvMMLiteBlockCreate : Block : BlockType = 279
**PERF: 0.00 (7.05) 0.00 (7.04) 0.00 (7.03)
**PERF: 0.00 (7.02) 0.00 (7.01) 0.00 (7.00)
** WARN: <watch_source_status:769>: No data from source 1 since last 11 sec. Trying reconnection
Why do you change From MAXN to 30W?
Why do you change From MAXN to 30W?
edit_or
February 14, 2025, 3:17am
22
That makes System Throttled Due to Overcurrent message disappeared. Thought the system is freezed with no enough current.
Do you mean the 30W mode makes “System Throttled Due to Overcurrent” message disappeared?
edit_or
February 14, 2025, 3:20am
24
yes. Message not appeared in that mode. Just streaming starts slow down.