Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU): Jetson
• DeepStream Version: 5.0
• JetPack Version (valid for Jetson only): 4.5
• TensorRT Version: 7.1.3
• Issue Type( questions, new requirements, bugs): NvArgus bug
Hello,
I have the exact same issue as those who posted in this thread. I posted my issue there as well, but the original thread was opened in 2019 so I think it would be better to start a new post for exposure. The proposed “solution” in that thread is no solution at all. The device shows up when running v4l2-ctl --list-devices without fail, but I consistently get this error.
Note that I am running the exact same DeepStream pipeline on 4 different nano devices and at least 2 of them have this error (while the others have it, but far less frequently, for some reason)
Please let me know if there is anything you can do to help me.
Here are log files (/var/log/syslog and output from my DeepStream program) from two different devices that have the same error. Notice that Device 2 has a lot more errors in /var/log/syslog than does Device 1. This may be annecdotal, but after this output I restarted both pipelines and Device 1 stayed working after that, while for Device 2 I had to restart nvargus-daemon and restart the pipeline an additional time (2 total restarts) before it stayed working. I have not had issues since then (it has been about 1 hour and 30 minutes since the issue occured, and they are both running properly now).
I currently have CRON setup to restart nvargus-daemon at 10:55 AM and to start my DeepStream pipleine at 11:00 AM.
Device 1: Output from /var/log/syslog
Apr 16 10:55:01 cafepop-nano-1 CRON[14383]: (root) CMD (***this command restarts nvargus-daemon***)
Apr 16 10:55:01 cafepop-nano-1 CRON[14382]: (CRON) info (No MTA installed, discarding output)
Apr 16 10:55:47 cafepop-nano-1 systemd[1]: Stopping Argus daemon...
Apr 16 10:55:47 cafepop-nano-1 nvargus-daemon[5316]: === python3[12753]: Connection cleaned up (7F8915D1D0)
Apr 16 10:55:47 cafepop-nano-1 systemd[1]: Stopped Argus daemon.
Apr 16 10:55:47 cafepop-nano-1 systemd[1]: Started Argus daemon.
Apr 16 10:59:01 cafepop-nano-1 systemd[1]: Started Session 26 of user cafepop.
Apr 16 11:00:01 cafepop-nano-1 CRON[14599]: (cafepop) CMD (***this command starts the deepstream pipeline***)
Apr 16 11:00:01 cafepop-nano-1 CRON[14598]: (CRON) info (No MTA installed, discarding output)
Apr 16 11:00:18 cafepop-nano-1 kernel: [53997.997091] nvmap_alloc_handle: PID 14601: python3: WARNING: All NvMap Allocations must have a tag to identify the subsystem allocating memory.Please pass the tag to the API call NvRmMemHanldeAllocAttr() or relevant.
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: === NVIDIA Libargus Camera Service (0.97.3)=== Listening for connections...=== python3[14601]: Connection established (7F7AFDD1D0)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module1
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: ---- imager: No override file found. ----
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: LSC: LSC surface is not based on full res!
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: ---- imager: No override file found. ----
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: (NvCamV4l2) Error ModuleNotPresent: V4L2Device not available (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function findDevice(), line 256)
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: (NvCamV4l2) Error ModuleNotPresent: (propagating from /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function initialize(), line 60)
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: (NvOdmDevice) Error ModuleNotPresent: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function initialize(), line 107)
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: NvPclDriverInitializeData: Unable to initialize driver v4l2_sensor
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: NvPclInitializeDrivers: error: Failed to init camera sub module v4l2_sensor
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: NvPclStartPlatformDrivers: Failed to start module drivers
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: NvPclStateControllerOpen: Failed ImagerGUID 0. (error 0xA000E)
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: NvPclOpen: PCL Open Failed. Error: 0xf
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error BadParameter: Sensor could not be opened. (in src/services/capture/CaptureServiceDeviceSensor.cpp, function getSourceFromGuid(), line 582)
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error BadParameter: (propagating from src/services/capture/CaptureService.cpp, function addSourceByGuid(), line 437)
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function addSourceByIndex(), line 303)
Apr 16 11:00:18 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function getSource(), line 466)
Apr 16 11:00:19 cafepop-nano-1 nvargus-daemon[14418]: Acquiring SCF Camera device source via index 1 has failed. === python3[14601]: CameraProvider initialized (0x7f74ba1430)LSC: LSC surface is not based on full res!
Apr 16 11:00:19 cafepop-nano-1 nvargus-daemon[14418]: NvIspAfConfigParamsSanityCheck: Error: positionWorkingHigh is not larger than positionWorkingLow positionWorkingHigh = 0, positionWorkingLow = 0
Apr 16 11:00:19 cafepop-nano-1 nvargus-daemon[14418]: message repeated 2 times: [ NvIspAfConfigParamsSanityCheck: Error: positionWorkingHigh is not larger than positionWorkingLow positionWorkingHigh = 0, positionWorkingLow = 0]
Apr 16 11:01:16 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error Timeout: (propagating from src/components/amr/Snapshot.cpp, function waitForNewerSample(), line 92)
Apr 16 11:01:20 cafepop-nano-1 nvargus-daemon[14418]: SCF_AutocontrolACSync failed to wait for an earlier frame to complete.
Apr 16 11:01:20 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error Timeout: (propagating from src/components/ac_stages/ACSynchronizeStage.cpp, function doHandleRequest(), line 126)
Apr 16 11:01:20 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error Timeout: (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 137)
Apr 16 11:01:20 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error Timeout: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
Apr 16 11:01:20 cafepop-nano-1 nvargus-daemon[14418]: PowerServiceCore:handleRequests: timePassed = 1908
Apr 16 11:01:20 cafepop-nano-1 nvargus-daemon[14418]: PowerServiceCore:handleRequests: timePassed = 1479
Apr 16 11:02:09 cafepop-nano-1 nvargus-daemon[14418]: waitForIdleLocked remaining request 1249
Apr 16 11:02:09 cafepop-nano-1 nvargus-daemon[14418]: waitForIdleLocked remaining request 1248
Apr 16 11:02:09 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error Timeout: waitForIdle() timed out (in src/api/Session.cpp, function waitForIdleLocked(), line 922)
Apr 16 11:02:09 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error Timeout: (propagating from src/api/Session.cpp, function abortCaptures(), line 888)
Apr 16 11:04:03 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error InvalidState: 2 buffers still pending during EGLStreamProducer destruction (propagating from src/services/gl/EGLStreamProducer.cpp, function freeBuffers(), line 306)
Apr 16 11:04:04 cafepop-nano-1 nvargus-daemon[14418]: SCF: Error InvalidState: (propagating from src/services/gl/EGLStreamProducer.cpp, function ~EGLStreamProducer(), line 50)
Device 1: Output from DeepStream app
2021-04-16 11:00:03.759422: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.2
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/compat/v2_compat.py:96: disable_resource_variables (from tensorflow.python.ops.variable_scope) is deprecated and will be removed in a future version.
Instructions for updating:
non-resource variables are not supported in the long term
04-16:11:00:08,957 DEBUG [mqtt_client.py:32] thing name set to device-4-thing
04-16:11:00:08,958 DEBUG [mqtt_client.py:38] cert path is: certificate.pem
04-16:11:00:08,959 DEBUG [mqtt_client.py:41] read creds
04-16:11:00:09,329 INFO [mqtt_client.py:63] connection to aws successful
04-16:11:00:09,521 DEBUG [main.py:312] Adding elements to Pipeline
04-16:11:00:09,523 DEBUG [main.py:331] Linking pipeline elements...
2021-04-16 11:00:09.527747: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-04-16 11:00:09.528195: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:09.528343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1742] Found device 0 with properties:
pciBusID: 0000:00:00.0 name: NVIDIA Tegra X1 computeCapability: 5.3
coreClock: 0.9216GHz coreCount: 1 deviceMemorySize: 3.87GiB deviceMemoryBandwidth: 194.55MiB/s
2021-04-16 11:00:09.528459: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.2
2021-04-16 11:00:09.528678: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.10
2021-04-16 11:00:09.531813: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-04-16 11:00:09.532803: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-04-16 11:00:09.537394: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-04-16 11:00:09.541446: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.10
2021-04-16 11:00:09.541803: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-04-16 11:00:09.542151: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:09.542450: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:09.542526: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1884] Adding visible gpu devices: 0
2021-04-16 11:00:09.567496: W tensorflow/core/platform/profile_utils/cpu_utils.cc:108] Failed to find bogomips or clock in /proc/cpuinfo; cannot determine CPU frequency
2021-04-16 11:00:09.568031: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xabaa150 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2021-04-16 11:00:09.568095: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version
2021-04-16 11:00:09.625742: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:09.626112: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xae5a770 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2021-04-16 11:00:09.626167: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA Tegra X1, Compute Capability 5.3
2021-04-16 11:00:09.626654: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:09.626767: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1742] Found device 0 with properties:
pciBusID: 0000:00:00.0 name: NVIDIA Tegra X1 computeCapability: 5.3
coreClock: 0.9216GHz coreCount: 1 deviceMemorySize: 3.87GiB deviceMemoryBandwidth: 194.55MiB/s
2021-04-16 11:00:09.626983: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.2
2021-04-16 11:00:09.627133: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.10
2021-04-16 11:00:09.627242: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-04-16 11:00:09.627414: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-04-16 11:00:09.627530: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-04-16 11:00:09.627623: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.10
2021-04-16 11:00:09.627710: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-04-16 11:00:09.627961: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:09.628218: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:09.628284: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1884] Adding visible gpu devices: 0
2021-04-16 11:00:09.628406: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.2
2021-04-16 11:00:14.267729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1283] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-04-16 11:00:14.267834: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1289] 0
2021-04-16 11:00:14.267866: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1302] 0: N
2021-04-16 11:00:14.268370: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:14.268710: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:14.268859: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1428] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 967 MB memory) -> physical GPU (device: 0, name: NVIDIA Tegra X1, pci bus id: 0000:00:00.0, compute capability: 5.3)
04-16:11:00:15,40 DEBUG [main.py:372] Setting up Main Loop
04-16:11:00:15,41 INFO [main.py:700] CafePop pipeline successfully created. Running...
0:00:08.893739257 14601 0xe032320 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1701> [UID = 1]: deserialized trt engine from :/home/cafepop/deepstream-pipeline/config/resnet34_peoplenet_pruned.etlt_b1_gpu0_fp16.engine
0:00:08.893877228 14601 0xe032320 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1805> [UID = 1]: Use deserialized engine model: /home/cafepop/deepstream-pipeline/config/resnet34_peoplenet_pruned.etlt_b1_gpu0_fp16.engine
0:00:08.954793288 14601 0xe032320 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<nvinfer> [UID 1]: Load new model:/home/cafepop/deepstream-pipeline/config/python-app-config.txt sucessfully
04-16:11:00:22,436 INFO [mqtt_client.py:86] Occupany published to AWS
**... (published message repeated many times)**
04-16:11:01:11,34 INFO [mqtt_client.py:86] Occupany published to AWS
2021-04-16 11:01:22.548573: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.10
2021-04-16 11:01:23.551012: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
04-16:11:01:39,987 INFO [mqtt_client.py:86] Occupany published to AWS
**... (published message repeated many times)**
04-16:11:02:03,742 INFO [mqtt_client.py:86] Occupany published to AWS
04-16:11:02:03,765 INFO [main.py:715] Cleaning up
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 87)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 87)
04-16:11:04:15,225 INFO [main.py:717] quiting loop
04-16:11:04:15,226 INFO [main.py:719] Done cleaning up.
04-16:11:04:15,226 INFO [main.py:720] exiting from cleanup
initialized graph def
parsed graf def from string
graph imported
set input var
set output var
done init image encoder
End-of-stream
INFO: [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x544x960
1 OUTPUT kFLOAT output_bbox/BiasAdd 12x34x60
2 OUTPUT kFLOAT output_cov/Sigmoid 3x34x60
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected...
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3264 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 3264 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 0
Output Stream W = 3264 H = 2464
seconds to Run = 0
Frame Rate = 21.000000
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
CONSUMER: Done Success
GST_ARGUS: Cleaning up
GST_ARGUS: Done Success
(Argus) Error InvalidState: Argus client is exiting with 2 outstanding client threads (in src/rpc/socket/client/ClientSocketManager.cpp, function recvThreadCore(), line 357)
Device 2: Output from /var/log/syslog
Apr 16 10:55:01 cafepop-nano-2 CRON[12070]: (root) CMD (***this command restarts nvargus-daemon***)
Apr 16 10:55:01 cafepop-nano-2 CRON[12069]: (CRON) info (No MTA installed, discarding output)
Apr 16 10:56:20 cafepop-nano-2 systemd[1]: Stopping Argus daemon...
Apr 16 10:56:20 cafepop-nano-2 nvargus-daemon[5379]: === python3[9856]: Connection cleaned up (7FB14CC1D0)
Apr 16 10:56:20 cafepop-nano-2 systemd[1]: Stopped Argus daemon.
Apr 16 10:56:20 cafepop-nano-2 systemd[1]: Started Argus daemon.
Apr 16 10:56:40 cafepop-nano-2 systemd[1]: Stopping Argus daemon...
Apr 16 10:56:40 cafepop-nano-2 nvargus-daemon[12106]: === NVIDIA Libargus Camera Service (0.97.3)=== Listening for connections...
Apr 16 10:56:40 cafepop-nano-2 systemd[1]: Stopped Argus daemon.
Apr 16 10:56:40 cafepop-nano-2 systemd[1]: Started Argus daemon.
Apr 16 10:59:09 cafepop-nano-2 systemd[1]: Started Session 28 of user cafepop.
Apr 16 11:00:01 cafepop-nano-2 CRON[12343]: (cafepop) CMD (***this command starts the deepstream pipeline***)
Apr 16 11:00:01 cafepop-nano-2 CRON[12342]: (CRON) info (No MTA installed, discarding output)
Apr 16 11:00:30 cafepop-nano-2 kernel: [54010.307440] nvmap_alloc_handle: PID 12345: python3: WARNING: All NvMap Allocations must have a tag to identify the subsystem allocating memory.Please pass the tag to the API call NvRmMemHanldeAllocAttr() or relevant.
Apr 16 11:00:30 cafepop-nano-2 nvargus-daemon[12169]: === NVIDIA Libargus Camera Service (0.97.3)=== Listening for connections...=== python3[12345]: Connection established (7F8EC521D0)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
Apr 16 11:00:30 cafepop-nano-2 nvargus-daemon[12169]: OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module1
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: ---- imager: No override file found. ----
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: LSC: LSC surface is not based on full res!
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: ---- imager: No override file found. ----
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: (NvCamV4l2) Error ModuleNotPresent: V4L2Device not available (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function findDevice(), line 256)
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: (NvCamV4l2) Error ModuleNotPresent: (propagating from /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function initialize(), line 60)
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: (NvOdmDevice) Error ModuleNotPresent: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function initialize(), line 107)
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: NvPclDriverInitializeData: Unable to initialize driver v4l2_sensor
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: NvPclInitializeDrivers: error: Failed to init camera sub module v4l2_sensor
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: NvPclStartPlatformDrivers: Failed to start module drivers
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: NvPclStateControllerOpen: Failed ImagerGUID 0. (error 0xA000E)
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: NvPclOpen: PCL Open Failed. Error: 0xf
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadParameter: Sensor could not be opened. (in src/services/capture/CaptureServiceDeviceSensor.cpp, function getSourceFromGuid(), line 582)
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadParameter: (propagating from src/services/capture/CaptureService.cpp, function addSourceByGuid(), line 437)
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function addSourceByIndex(), line 303)
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function getSource(), line 466)
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: Acquiring SCF Camera device source via index 1 has failed. === python3[12345]: CameraProvider initialized (0x7f88ba1420)LSC: LSC surface is not based on full res!
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: NvIspAfConfigParamsSanityCheck: Error: positionWorkingHigh is not larger than positionWorkingLow positionWorkingHigh = 0, positionWorkingLow = 0
Apr 16 11:00:31 cafepop-nano-2 nvargus-daemon[12169]: message repeated 2 times: [ NvIspAfConfigParamsSanityCheck: Error: positionWorkingHigh is not larger than positionWorkingLow positionWorkingHigh = 0, positionWorkingLow = 0]
Apr 16 11:02:19 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon[12169]: message repeated 769 times: [ (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)]
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon: W/ libnvphs:socket: Warning (NvPHSSendThroughputHints): too many throughput hints given: buffer full, hints not sent!
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon[12169]: message repeated 3 times: [ (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)]
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=352785569, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon[12169]: message repeated 2 times: [ SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)]
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=359797968, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=359798016, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=359863600, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:37 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=361960799, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=376968734, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=377624141, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=380638845, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=383784620, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=386864860, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=390010636, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=393221947, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CpuFloorVmin, value=0, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=CameraFrameTimestamp, value=396236651, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs: Error: NvPHSSendThroughputHints[usecase=camera, hint=FramerateTarget, value=30, timeout_ms=1000]: queue_or_send() failed
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: E/ libnvphs:socket: Error[11]: probing PHS socket /var/lib/nvphs/nvphsd.ctl failed: Resource temporarily unavailable
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon: D/ libnvphs:socket: Warning: connecting to Power Hinting Service failed. Is PHS running?
Apr 16 11:02:38 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:42 cafepop-nano-2 nvargus-daemon[12169]: message repeated 42 times: [ (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)]
Apr 16 11:02:43 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error Timeout: (propagating from src/components/amr/Snapshot.cpp, function waitForNewerSample(), line 92)
Apr 16 11:02:50 cafepop-nano-2 nvargus-daemon[12169]: SCF_AutocontrolACSync failed to wait for an earlier frame to complete.
Apr 16 11:02:50 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error Timeout: (propagating from src/components/ac_stages/ACSynchronizeStage.cpp, function doHandleRequest(), line 126)
Apr 16 11:02:50 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error Timeout: (propagating from src/components/stages/OrderedStage.cpp, function doExecute(), line 137)
Apr 16 11:02:50 cafepop-nano-2 nvargus-daemon[12169]: SCF: Error Timeout: Sending critical error event (in src/api/Session.cpp, function sendErrorEvent(), line 992)
Apr 16 11:02:50 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:50 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:50 cafepop-nano-2 nvargus-daemon[12169]: PowerServiceCore:handleRequests: timePassed = 8427
Apr 16 11:02:50 cafepop-nano-2 nvargus-daemon[12169]: (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)
Apr 16 11:02:51 cafepop-nano-2 nvargus-daemon[12169]: message repeated 7 times: [ (Argus) Error OverFlow: Too many pending events, ignoring new events (in src/api/EventProviderImpl.cpp, function addEvent(), line 156)]
Apr 16 11:03:58 cafepop-nano-2 systemd[1]: Started Run anacron jobs.
Apr 16 11:03:59 cafepop-nano-2 anacron[12605]: Anacron 2.3 started on 2021-04-16
Apr 16 11:03:59 cafepop-nano-2 anacron[12605]: Normal exit (0 jobs run)
Device 2: Output from DeepStream app
2021-04-16 11:00:06.280233: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.2
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/compat/v2_compat.py:96: disable_resource_variables (from tensorflow.python.ops.variable_scope) is deprecated and will be removed in a future version.
Instructions for updating:
non-resource variables are not supported in the long term
04-16:11:00:15,777 DEBUG [mqtt_client.py:32] thing name set todevice-5-thing
04-16:11:00:15,779 DEBUG [mqtt_client.py:38] cert path is: certificate.pem
04-16:11:00:15,780 DEBUG [mqtt_client.py:41] read creds
04-16:11:00:16,165 INFO [mqtt_client.py:63] connection to aws successful
04-16:11:00:16,687 DEBUG [main.py:312] Adding elements to Pipeline
04-16:11:00:16,688 DEBUG [main.py:331] Linking pipeline elements...
2021-04-16 11:00:16.708698: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-04-16 11:00:16.709917: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:16.710075: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1742] Found device 0 with properties:
pciBusID: 0000:00:00.0 name: NVIDIA Tegra X1 computeCapability: 5.3
coreClock: 0.9216GHz coreCount: 1 deviceMemorySize: 3.87GiB deviceMemoryBandwidth: 194.55MiB/s
2021-04-16 11:00:16.710210: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.2
2021-04-16 11:00:16.710457: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.10
2021-04-16 11:00:16.741357: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-04-16 11:00:16.748413: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-04-16 11:00:16.774106: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-04-16 11:00:16.789127: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.10
2021-04-16 11:00:16.789500: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-04-16 11:00:16.789872: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:16.790197: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:16.791904: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1884] Adding visible gpu devices: 0
2021-04-16 11:00:16.836882: W tensorflow/core/platform/profile_utils/cpu_utils.cc:108] Failed to find bogomips or clock in /proc/cpuinfo; cannot determine CPU frequency
2021-04-16 11:00:16.848151: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x359f31c0 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2021-04-16 11:00:16.848228: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version
2021-04-16 11:00:16.952098: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:16.952454: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x35ca3080 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2021-04-16 11:00:16.952519: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA Tegra X1, Compute Capability 5.3
2021-04-16 11:00:16.953112: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:16.953247: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1742] Found device 0 with properties:
pciBusID: 0000:00:00.0 name: NVIDIA Tegra X1 computeCapability: 5.3
coreClock: 0.9216GHz coreCount: 1 deviceMemorySize: 3.87GiB deviceMemoryBandwidth: 194.55MiB/s
2021-04-16 11:00:16.953483: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.2
2021-04-16 11:00:16.953649: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.10
2021-04-16 11:00:16.953774: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-04-16 11:00:16.953886: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-04-16 11:00:16.953993: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-04-16 11:00:16.954102: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.10
2021-04-16 11:00:16.954205: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-04-16 11:00:16.954483: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:16.954820: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:16.954916: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1884] Adding visible gpu devices: 0
2021-04-16 11:00:16.957992: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.10.2
2021-04-16 11:00:24.726063: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1283] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-04-16 11:00:24.726165: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1289] 0
2021-04-16 11:00:24.726198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1302] 0: N
2021-04-16 11:00:24.733350: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:24.733749: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:1046] ARM64 does not support NUMA - returning NUMA node zero
2021-04-16 11:00:24.733922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1428] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1396 MB memory) -> physical GPU (device: 0, name: NVIDIA Tegra X1, pci bus id: 0000:00:00.0, compute capability: 5.3)
04-16:11:00:25,644 DEBUG [main.py:372] Setting up Main Loop
04-16:11:00:25,645 INFO [main.py:702] CafePop pipeline successfully created. Running...
0:00:14.446027163 12345 0x38e79720 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1701> [UID = 1]: deserialized trt engine from :/home/cafepop/deepstream-pipeline/config/resnet34_peoplenet_pruned.etlt_b1_gpu0_fp16.engine
0:00:14.446170654 12345 0x38e79720 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1805> [UID = 1]: Use deserialized engine model: /home/cafepop/deepstream-pipeline/config/resnet34_peoplenet_pruned.etlt_b1_gpu0_fp16.engine
0:00:14.499734696 12345 0x38e79720 INFO nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<nvinfer> [UID 1]: Load new model:/home/cafepop/deepstream-pipeline/config/python-app-config.txt sucessfully
04-16:11:00:34,877 INFO [mqtt_client.py:86] Occupany published to AWS
**truncated "published to AWS" messages**
04-16:11:01:51,426 INFO [mqtt_client.py:86] Occupany published to AWS
2021-04-16 11:02:09.739288: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.10
2021-04-16 11:02:17.638515: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
04-16:11:02:51,297 INFO [mqtt_client.py:86] Occupany published to AWS
**truncated "published to AWS" messages**
04-16:11:03:08,108 INFO [mqtt_client.py:86] Occupany published to AWS
04-16:11:03:08,136 INFO [main.py:717] Cleaning up
04-16:11:03:09,775 INFO [main.py:720] quiting loop
04-16:11:03:09,776 INFO [main.py:722] Done cleaning up.
04-16:11:03:09,776 INFO [main.py:723] exiting from cleanup
initialized graph def
parsed graf def from string
graph imported
set input var
set output var
done init image encoder
End-of-stream
INFO: [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x544x960
1 OUTPUT kFLOAT output_bbox/BiasAdd 12x34x60
2 OUTPUT kFLOAT output_cov/Sigmoid 3x34x60
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected...
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3264 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 3264 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;
GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 0
Output Stream W = 3264 H = 2464
seconds to Run = 0
Frame Rate = 21.000000
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
CONSUMER: Done Success
GST_ARGUS: Cleaning up
GST_ARGUS: Done Success
Output from v4l2-ctl --list-devices (same for both Device 1 and Device 2)
vi-output, imx219 7-0010 (platform:54080000.vi:0):
/dev/video0
Output from v4l2-ctl --info --device /dev/video0 (same for both Device 1 and Device 2)
Driver Info (not using libv4l2):
Driver name : tegra-video
Card type : vi-output, imx219 7-0010
Bus info : platform:54080000.vi:0
Driver version: 4.9.201
Capabilities : 0x84200001
Video Capture
Streaming
Extended Pix Format
Device Capabilities
Device Caps : 0x04200001
Video Capture
Streaming
Extended Pix Format
Other things I have tried:
- Setting CPU priority for
nvargus-daemonto highest possible (nice value -20) - Restarting
nvargus-daemonbefore every run (this turns out to be necessary, otherwise it fails immediately rather than later)