hi,
i met a strange problem of rtsp out,
after working sometime few hours or one day, rtsp will didn’t sink out and i disabled EGL sink.
but deepstream is still keeping works and i checkd by systemctl and journalctl both, deepstreaming is running, but PERF will be below 20frames, sometimes 7 frames only, my IP camera is 30frames/s. so i can not restart deepstream automatically by systemctl script.
pls help to advice how to keep rtsp to work well?
thank you very much!
Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
• DeepStream Version
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
• The pipeline being used
Can you specify more details about rts did not sink out?
You can follow this trouble shoot to find which caused the perf low issue.
Troubleshooting — DeepStream 6.1 Release documentation The DeepStream application is running slowly
thank you so much amycao, and many solutions inside of troubleshooting, and i will try one by one and look what’s results, then feedback to the topic.
thank you very much!
hi,
i tested the perf down problem all advices which from Troubleshooting,
but found it happens again in two days.
it is difficult to test because happens one or two days one time only, like this:
PERF 0.0 (11.84) or
PERF 0.0 (7.32)…
like that… and no rtsp output.
could you advice me how to add some debug informations in source code of deepstream.c?
thank you very much!
The first fps is realtime fps, it measures the fps during the measurement interval, default is 5s, PERF 0.0 means there no frames arriving during this time interval. you can check the arriving time at decoder when the perf 0 happened if the perf drop to 0 caused by network latency.
export NVDS_ENABLE_LATENCY_MEASUREMENT=1 //To enable frame latency measurement
export NVDS_ENABLE_COMPONENT_LATENCY_MEASUREMENT=1 //To enable latency for all plugins before run your app.
hi,
i checked jtop and no fans to run,
how to open fan? maybe this is problem because temperature up to 49.4 degree already even at night of 4 clock…
and my device is out of door on high way.
thank you very much!
i also catch a error log like this, pls help to analysis that:
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: KAKFA_JSON_PARSE: finding kafka key of sensor.id within json message
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: KAKFA_JSON_PARSE: provided path is not valid
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: no matching json field found based on kafka key config; using default partition
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: g_object_get: assertion ‘G_IS_OBJECT (object)’ failed
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: DSLOG:NVDS_KAFKA_PROTO: Message delivered (393 bytes, partition 0)
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: g_object_get: assertion ‘G_IS_OBJECT (object)’ failed
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: g_object_get: assertion ‘G_IS_OBJECT (object)’ failed
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: 3:25:20.269116847 559 0x5598057a30 WARN nvinfer gstnvinfer.cpp:1376:convert_batch_and_push_to_input_thread:<secondary_gie_1> error: NvBufSurfTransform failed with error -3 while converting buffer
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: ERROR from secondary_gie_1: NvBufSurfTransform failed with error -3 while converting buffer
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: Debug info: gstnvinfer.cpp(1376): convert_batch_and_push_to_input_thread (): /GstPipeline:pipeline/GstBin:secondary_gie_bin/GstNvInfer:secondary_gie_1
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: 3:25:20.269517321 559 0x5598057a30 WARN nvinfer gstnvinfer.cpp:2288:gst_nvinfer_output_loop:<secondary_gie_0> error: Internal data stream error.
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: 3:25:20.269546888 559 0x5598057a30 WARN nvinfer gstnvinfer.cpp:2288:gst_nvinfer_output_loop:<secondary_gie_0> error: streaming stopped, reason error (-5)
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: ERROR from secondary_gie_0: Internal data stream error.
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: Debug info: gstnvinfer.cpp(2288): gst_nvinfer_output_loop (): /GstPipeline:pipeline/GstBin:secondary_gie_bin/GstNvInfer:secondary_gie_0:
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: streaming stopped, reason error (-5)
Jun 17 18:07:32 sgs002-desktop ds-sgs-app[559]: Quitting
hi,
i checked sensors today on that device, temperature is near to 60 degree, 59.5, 59.8 like that.
and today no sun directly. but deepstream is running with rtsp out correctly still.
will the temperature affect performance to less if up to more high??
thank you
Did the log catched when performance drop or the app quit because of the system overheated?
Fan is auto balanced, do not suggest reset it.
You can monitor system stats by tegrastats, which includes system temperature. and 60 degree is not a higher temperature.
when the system temperature up to 90 degrees, the clock will drop, it will affect the app performance. lower than 90 degrees, it will not. up to 103 degrees, the system will shutdown as one protection policy.
that sgie log was catched one time only untill now,
mainly issue is deepstream is running always, but no kafka out and no rtsp out after PERF dropped to 0, no all sink out i think because i used fakesink locally.
it is also possible to caused by sgie codes if not temperature reason, which i add face recognition inside sgie0, i am trying to add some debug code to check my source codes again.
another thing, i found a contradiction place abut NX in troubleshooting:
Solution:
Ensure that Jetson clocks are set high. Run these commands to set Jetson clocks high.
$ sudo nvpmodel -m --for MAX perf and power, mode is 0 and for NX set to 8 $ sudo jetson_clocks
before i remember that NX should be setup nvpmodel -2,
shuld i setup 2 or 8 right now?
thank you very much!
When perfomance drop to 0, that means there no frame flowing in the pipeline that time, no message sending out and no stream send out by rtsp is expected.
before i remember that NX should be setup nvpmodel -2,
shuld i setup 2 or 8 right now?
It depends on bsp version used. please check /etc/nvpmodel.conf
which power model id represents the max power.
hi, i catched tegrastats for both status and pls help to check where is problem?
1/Deepstream is running but no rtsp and kafka sink out:
RAM 5154/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [6%@1420,3%@1420,5%@1420,4%@1420,3%@1420,3%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36C GPU@37.5C PMIC@50C AUX@37.5C CPU@39.5C thermal@37.95C
RAM 5155/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [13%@1420,8%@1420,1%@1420,2%@1420,2%@1420,3%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36.5C GPU@37C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5154/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [11%@1420,7%@1420,3%@1420,2%@1420,1%@1420,2%@1420] EMC_FREQ 0% GR3D_FREQ 4% AO@36.5C GPU@37.5C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5155/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [14%@1420,11%@1420,4%@1420,8%@1420,7%@1420,6%@1420] EMC_FREQ 0% GR3D_FREQ 6% AO@36C GPU@37.5C PMIC@50C AUX@37C CPU@39.5C thermal@38.1C
RAM 5154/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [12%@1420,9%@1420,7%@1420,7%@1420,6%@1420,8%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36.5C GPU@37C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5155/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [9%@1420,5%@1420,4%@1420,5%@1420,5%@1420,5%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36.5C GPU@37.5C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5154/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [11%@1420,7%@1420,3%@1420,4%@1420,3%@1420,2%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36C GPU@37.5C PMIC@50C AUX@37.5C CPU@40C thermal@37.95C
RAM 5155/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [9%@1420,7%@1420,5%@1420,5%@1420,3%@1420,5%@1420] EMC_FREQ 0% GR3D_FREQ 5% AO@36.5C GPU@37C PMIC@50C AUX@37.5C CPU@40C thermal@38.1C
RAM 5155/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [11%@1420,10%@1420,7%@1420,6%@1420,4%@1420,5%@1420] EMC_FREQ 0% GR3D_FREQ 5% AO@36.5C GPU@37.5C PMIC@50C AUX@37.5C CPU@39.5C thermal@37.95C
RAM 5155/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [9%@1420,2%@1420,2%@1420,0%@1420,2%@1420,2%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36C GPU@37.5C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5155/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [9%@1420,4%@1420,4%@1420,5%@1420,1%@1420,2%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36.5C GPU@37.5C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5159/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [14%@1420,10%@1420,8%@1420,7%@1420,7%@1420,4%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36C GPU@37C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5159/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [10%@1420,6%@1420,2%@1420,3%@1420,2%@1420,3%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36.5C GPU@37C PMIC@50C AUX@37.5C CPU@39.5C thermal@37.95C
RAM 5159/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [7%@1420,3%@1420,5%@1420,5%@1420,1%@1420,1%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36.5C GPU@37C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5157/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [6%@1420,3%@1420,3%@1420,5%@1420,8%@1420,3%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36C GPU@37.5C PMIC@50C AUX@37.5C CPU@39.5C thermal@38.1C
RAM 5157/7773MB (lfb 90x4MB) SWAP 13/15360MB (cached 1MB) CPU [9%@1420,7%@1420,3%@1420,3%@1420,7%@1420,4%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@36.5C GPU@37.5C PMIC@50C AUX@37.5C CPU@39.5C thermal@37.95C
^C
2\Deepstream is running with rtsp and kafka sink out:
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [20%@1420,20%@1420,12%@1420,11%@1420,12%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@58.5C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [24%@1420,23%@1420,19%@1420,21%@1420,12%@1420,17%@1420] EMC_FREQ 0% GR3D_FREQ 76% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [32%@1420,25%@1420,20%@1420,30%@1420,21%@1420,23%@1420] EMC_FREQ 0% GR3D_FREQ 7% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60.5C thermal@58.3C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,27%@1420,19%@1420,18%@1420,20%@1420,18%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [24%@1420,22%@1420,21%@1420,22%@1420,23%@1420,23%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [21%@1420,21%@1420,16%@1420,15%@1420,14%@1420,18%@1420] EMC_FREQ 0% GR3D_FREQ 3% AO@57C GPU@58C PMIC@50C AUX@56.5C CPU@60C thermal@58.5C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [20%@1420,23%@1420,15%@1420,16%@1420,8%@1420,14%@1420] EMC_FREQ 0% GR3D_FREQ 98% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.05C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [17%@1420,16%@1420,17%@1420,16%@1420,16%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 8% AO@57C GPU@58.5C PMIC@50C AUX@57C CPU@59.5C thermal@58.3C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [30%@1420,23%@1420,21%@1420,21%@1420,19%@1420,23%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60C thermal@58.65C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [26%@1420,26%@1420,21%@1420,18%@1420,20%@1420,22%@1420] EMC_FREQ 0% GR3D_FREQ 36% AO@57C GPU@60C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [32%@1420,25%@1420,21%@1420,24%@1420,21%@1420,23%@1420] EMC_FREQ 0% GR3D_FREQ 39% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60C thermal@58.8C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [23%@1420,24%@1420,19%@1420,17%@1420,18%@1420,18%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [26%@1420,25%@1420,18%@1420,17%@1420,19%@1420,19%@1420] EMC_FREQ 0% GR3D_FREQ 48% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [25%@1420,21%@1420,20%@1420,13%@1420,14%@1420,18%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@57C GPU@58C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5264/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [26%@1420,15%@1420,14%@1420,13%@1420,15%@1420,15%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.35C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [23%@1420,17%@1420,18%@1420,17%@1420,12%@1420,16%@1420] EMC_FREQ 0% GR3D_FREQ 27% AO@57.5C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5264/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [30%@1420,19%@1420,24%@1420,19%@1420,19%@1420,14%@1420] EMC_FREQ 0% GR3D_FREQ 76% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60.5C thermal@57.9C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,21%@1420,17%@1420,17%@1420,17%@1420,19%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57.5C GPU@59C PMIC@50C AUX@57C CPU@60.5C thermal@58.8C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [30%@1420,16%@1420,10%@1420,14%@1420,17%@1420,11%@1420] EMC_FREQ 0% GR3D_FREQ 8% AO@57C GPU@59C PMIC@50C AUX@57.5C CPU@60C thermal@58.65C
RAM 5264/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [19%@1420,13%@1420,14%@1420,10%@1420,14%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 15% AO@57C GPU@58.5C PMIC@50C AUX@57.5C CPU@60C thermal@58.35C
RAM 5264/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [26%@1420,19%@1420,13%@1420,13%@1420,17%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5264/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [20%@1420,16%@1420,13%@1420,11%@1420,10%@1420,10%@1420] EMC_FREQ 0% GR3D_FREQ 1% AO@57C GPU@58.5C PMIC@50C AUX@57C CPU@59.5C thermal@58.5C
RAM 5264/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,19%@1420,15%@1420,16%@1420,18%@1420,15%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.3C
RAM 5264/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [26%@1420,21%@1420,16%@1420,17%@1420,13%@1420,16%@1420] EMC_FREQ 0% GR3D_FREQ 86% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60C thermal@58.3C
RAM 5260/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [30%@1420,18%@1420,19%@1420,14%@1420,13%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@57C GPU@58.5C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5260/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [19%@1420,14%@1420,15%@1420,12%@1420,12%@1420,12%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5260/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,20%@1420,17%@1420,14%@1420,14%@1420,17%@1420] EMC_FREQ 0% GR3D_FREQ 26% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@57.9C
RAM 5260/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [26%@1420,18%@1420,14%@1420,10%@1420,14%@1420,11%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@57C GPU@58.5C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5260/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,15%@1420,13%@1420,18%@1420,9%@1420,11%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60.5C thermal@58.65C
RAM 5260/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [25%@1420,17%@1420,14%@1420,11%@1420,13%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 23% AO@57C GPU@58.5C PMIC@50C AUX@57C CPU@60C thermal@58.35C
RAM 5260/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [29%@1420,21%@1420,18%@1420,18%@1420,20%@1420,20%@1420] EMC_FREQ 0% GR3D_FREQ 55% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60C thermal@58.8C
RAM 5260/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,25%@1420,21%@1420,21%@1420,19%@1420,15%@1420] EMC_FREQ 0% GR3D_FREQ 98% AO@57C GPU@60C PMIC@50C AUX@57C CPU@60C thermal@58.65C
RAM 5261/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [34%@1420,27%@1420,25%@1420,25%@1420,21%@1420,18%@1420] EMC_FREQ 0% GR3D_FREQ 59% AO@57.5C GPU@59.5C PMIC@50C AUX@57C CPU@60.5C thermal@58.65C
RAM 5261/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [28%@1420,22%@1420,21%@1420,21%@1420,18%@1420,17%@1420] EMC_FREQ 0% GR3D_FREQ 72% AO@57C GPU@59.5C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.8C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,20%@1420,25%@1420,20%@1420,20%@1420,26%@1420] EMC_FREQ 0% GR3D_FREQ 89% AO@57C GPU@60C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.55C
RAM 5261/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [31%@1420,23%@1420,22%@1420,24%@1420,19%@1420,21%@1420] EMC_FREQ 0% GR3D_FREQ 16% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60.5C thermal@58.95C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [30%@1420,19%@1420,21%@1420,18%@1420,18%@1420,20%@1420] EMC_FREQ 0% GR3D_FREQ 69% AO@57.5C GPU@59.5C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.7C
RAM 5261/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [30%@1420,18%@1420,19%@1420,18%@1420,19%@1420,19%@1420] EMC_FREQ 0% GR3D_FREQ 19% AO@57C GPU@59.5C PMIC@50C AUX@57.5C CPU@60C thermal@59C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [30%@1420,21%@1420,20%@1420,18%@1420,15%@1420,15%@1420] EMC_FREQ 0% GR3D_FREQ 3% AO@57.5C GPU@59C PMIC@50C AUX@57.5C CPU@60C thermal@59.15C
RAM 5261/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [24%@1420,19%@1420,18%@1420,15%@1420,15%@1420,9%@1420] EMC_FREQ 0% GR3D_FREQ 90% AO@57C GPU@59.5C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.85C
RAM 5261/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [21%@1420,19%@1420,18%@1420,15%@1420,18%@1420,18%@1420] EMC_FREQ 0% GR3D_FREQ 48% AO@57.5C GPU@59.5C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.95C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [25%@1420,18%@1420,13%@1420,17%@1420,13%@1420,14%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@57C GPU@58.5C PMIC@50C AUX@57.5C CPU@60C thermal@58.65C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [23%@1420,18%@1420,13%@1420,14%@1420,13%@1420,10%@1420] EMC_FREQ 0% GR3D_FREQ 98% AO@57C GPU@59.5C PMIC@50C AUX@57C CPU@60.5C thermal@58.65C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [25%@1420,20%@1420,18%@1420,14%@1420,12%@1420,16%@1420] EMC_FREQ 0% GR3D_FREQ 30% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60C thermal@58.5C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [28%@1420,21%@1420,21%@1420,18%@1420,15%@1420,18%@1420] EMC_FREQ 0% GR3D_FREQ 99% AO@57C GPU@59.5C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.35C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [26%@1420,21%@1420,17%@1420,18%@1420,17%@1420,19%@1420] EMC_FREQ 0% GR3D_FREQ 88% AO@57.5C GPU@60C PMIC@50C AUX@57.5C CPU@60.5C thermal@59C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [25%@1420,19%@1420,16%@1420,19%@1420,13%@1420,19%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@57C GPU@59C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.65C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [21%@1420,20%@1420,12%@1420,11%@1420,11%@1420,10%@1420] EMC_FREQ 0% GR3D_FREQ 81% AO@57C GPU@59C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.85C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [29%@1420,21%@1420,19%@1420,15%@1420,17%@1420,16%@1420] EMC_FREQ 0% GR3D_FREQ 91% AO@57.5C GPU@60C PMIC@50C AUX@57.5C CPU@60.5C thermal@59.3C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,20%@1420,19%@1420,18%@1420,18%@1420,16%@1420] EMC_FREQ 0% GR3D_FREQ 25% AO@57.5C GPU@59C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.85C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,17%@1420,13%@1420,11%@1420,10%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 80% AO@57C GPU@59C PMIC@50C AUX@57C CPU@60.5C thermal@58.65C
RAM 5263/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [27%@1420,20%@1420,11%@1420,12%@1420,13%@1420,10%@1420] EMC_FREQ 0% GR3D_FREQ 52% AO@57C GPU@59.5C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.65C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [24%@1420,14%@1420,16%@1420,18%@1420,15%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 0% AO@57C GPU@58.5C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.7C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [24%@1420,19%@1420,16%@1420,13%@1420,13%@1420,13%@1420] EMC_FREQ 0% GR3D_FREQ 94% AO@57C GPU@59.5C PMIC@50C AUX@57.5C CPU@60C thermal@58.7C
RAM 5262/7773MB (lfb 94x4MB) SWAP 13/15360MB (cached 1MB) CPU [28%@1420,20%@1420,24%@1420,21%@1420,26%@1420,20%@1420] EMC_FREQ 0% GR3D_FREQ 41% AO@57.5C GPU@60C PMIC@50C AUX@57.5C CPU@60.5C thermal@58.4C
^C
and i checked /etc/nvmodel.config,
< PM_CONFIG DEFAULT=5 >
< FAN_CONFIG DEFAULT=quiet >
but this ID should be 2 or 8, should i change it in this file?
thank you very much!
hi,
i caught erro log finally, it is the reason for my problem.
pls help to analysis the log and thank you so much!
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: g_object_get: assertion ‘G_IS_OBJECT (object)’ failed
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: g_object_get: assertion ‘G_IS_OBJECT (object)’ failed
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: DSLOG:NVDS_KAFKA_PROTO: nvds_msgapi_do_work
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: DSLOG:NVDS_KAFKA_PROTO: Message delivered (390 bytes, partition 0)
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: g_object_get: assertion ‘G_IS_OBJECT (object)’ failed
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: 0:33:59.769760898 19209 0x557a0e3f70 WARN nvinfer gstnvinfer.cpp:1376:convert_batch_and_push_to_input_thread:<secondary_gie_1> error: NvBufSurfTransform failed with error -3 while converting buffer
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: 0:33:59.769969841 19209 0x557a0e3f70 WARN nvinfer gstnvinfer.cpp:2288:gst_nvinfer_output_loop:<secondary_gie_0> error: Internal data stream error.
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: 0:33:59.770030326 19209 0x557a0e3f70 WARN nvinfer gstnvinfer.cpp:2288:gst_nvinfer_output_loop:<secondary_gie_0> error: streaming stopped, reason error (-5)
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: ERROR from secondary_gie_1: NvBufSurfTransform failed with error -3 while converting buffer
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: Debug info: gstnvinfer.cpp(1376): convert_batch_and_push_to_input_thread (): /GstPipeline:pipeline/GstBin:secondary_gie_bin/GstNvInfer:secondary_gie_1
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: ERROR from secondary_gie_0: Internal data stream error.
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: Debug info: gstnvinfer.cpp(2288): gst_nvinfer_output_loop (): /GstPipeline:pipeline/GstBin:secondary_gie_bin/GstNvInfer:secondary_gie_0:
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: streaming stopped, reason error (-5)
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: Quitting
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: 0:33:59.858729163 19209 0x557a0e3f70 WARN nvinfer gstnvinfer.cpp:1376:convert_batch_and_push_to_input_thread:<secondary_gie_1> error: NvBufSurfTransform failed with error -3 while converting buffer
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: ERROR from secondary_gie_1: NvBufSurfTransform failed with error -3 while converting buffer
Jun 21 16:11:52 sgs002-desktop ds-sgs-app[19209]: Debug info: gstnvinfer.cpp(1376): convert_batch_and_push_to_input_thread (): /GstPipeline:pipeline/GstBin:secondary_gie_bin/GstNvInfer:secondary_gie_1
The system thermal is not high, most is 60 degrees. the error is not caused by overheated.
You can check after line POWER_MODEL ID=* CPU/EMC/GPU etc. frequency. if you are using Jetpack DP 5.0, max power is 8 for NX.
How long it take to get this error?
hi,
that sgie error happens few hours or one day more, then caused performance to drop to 0 and stream stops.
thank you
but deepstreaming no quit, running still without sink out.
thanks
