120fps with IMX219 and binned modes

Gorgo90 · November 14, 2022, 2:59pm

Hi all!
I’m trying to apply this patch to my NX custom board in order to get 120/200fps (if possible) with my IMX219.

nvidia@nvidia-hyai:/proc/device-tree/cam_i2cmux/i2c@0/rbpcv2_imx219_a@10$ cat /etc/nv_tegra_release
# R35 (release), REVISION: 1.0, GCID: 31346300, BOARD: t186ref, EABI: aarch64, DATE: Thu Aug 25 18:41:45 UTC 2022

First of all, the carrier board provides 2x 2-lanes MIPI-CSI that may be the real problem here.

I successfully edited Linux_for_Tegra/sources/hardware/nvidia/platform/t19x/jakku/kernel-dts/common/tegra194-camera-rbpcv2-imx219.dtsi and Linux_for_Tegra/sources/kernel/nvidia/drivers/media/i2c/imx219_mode_tbls.h restoring mode5 (IMX219_MODE_1280x720_120FPS) and adding mode6 (IMX219_MODE_640x480_180FPS).

I see new modes in my system under /proc/device-tree/cam_i2cmux/i2c@0/rbpcv2_imx219_a@10/mode6/ and I see those in GST_ARGUS info:

nvidia@nvidia-hyai:~$ gst-launch-1.0 nvarguscamerasrc ! fakesink
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3280 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3280 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 640 x 480 FR = 200.000000 fps Duration = 5000000 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

I don’t see them with v4l2-ctl though:

nvidia@nvidia-hyai:~$ v4l2-ctl --device /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Type: Video Capture

  Size: Discrete 3280x2464
  	Interval: Discrete 0.048s (21.000 fps)
  Size: Discrete 3280x1848
  	Interval: Discrete 0.036s (28.000 fps)
  Size: Discrete 1920x1080
  	Interval: Discrete 0.033s (30.000 fps)
  Size: Discrete 1640x1232
  	Interval: Discrete 0.033s (30.000 fps)
  Size: Discrete 1280x720
  	Interval: Discrete 0.017s (60.000 fps)

I tried to run gst-launch to capture some frame at 200fps 640x480 (same error with 120fps 1280x720):

SENSOR_ID=0
NUMBER_OF_SNAPSHOTS=1000
FRAMERATE=200

gst-launch-1.0 -e nvarguscamerasrc num-buffers=$NUMBER_OF_SNAPSHOTS sensor-id=$SENSOR_ID ! “video/x-raw(memory:NVMM),width=640,height=480,framerate=$FRAMERATE/1” ! nvjpegenc ! multifilesink location=%03d_imx219_cam$SENSOR_ID.jpeg

Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3280 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3280 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 640 x 480 FR = 200.000000 fps Duration = 5000000 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 6
Output Stream W = 640 H = 480
seconds to Run = 0
Frame Rate = 200.000000
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
nvbuf_utils: dmabuf_fd -1 mapped entry NOT found
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadExecute:694 NvBufSurfaceFromFd Failed.
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadFunction:247 (propagating)
Got EOS from element “pipeline0”.
Execution ended after 0:01:01.012383098
Setting pipeline to NULL …
GST_ARGUS: Cleaning up

nvargus-daemon log:

nvidia@nvidia-hyai:~$ sudo enableCamInfiniteTimeout=1 nvargus-daemon
=== NVIDIA Libargus Camera Service (0.98.3)=== Listening for connections…=== gst-launch-1.0[4293]: Connection established (FFFF9AA95900)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module1
OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
---- imager: No override file found. ----
(NvCamV4l2) Error ModuleNotPresent: V4L2Device not available (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function findDevice(), line 256)
(NvCamV4l2) Error ModuleNotPresent: (propagating from /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function initialize(), line 60)
(NvOdmDevice) Error ModuleNotPresent: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function initialize(), line 107)
NvPclDriverInitializeData: Unable to initialize driver v4l2_sensor
NvPclInitializeDrivers: error: Failed to init camera sub module v4l2_sensor
NvPclStartPlatformDrivers: Failed to start module drivers
NvPclDriver_V4L2_Focuser_Stub_Close: Invalid NULL input pPclDriver
NvPclStateControllerOpen: Failed ImagerGUID 1. (error 0xA000E)
NvPclOpen: PCL Open Failed. Error: 0xf
SCF: Error BadParameter: Sensor could not be opened. (in src/services/capture/CaptureServiceDeviceSensor.cpp, function getSourceFromGuid(), line 646)
SCF: Error BadParameter: (propagating from src/services/capture/CaptureService.cpp, function addSourceByGuid(), line 437)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function addSourceByIndex(), line 311)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function getSource(), line 477)
Acquiring SCF Camera device source via index 0 has failed. ---- imager: No override file found. ----
=== gst-launch-1.0[4293]: CameraProvider initialized (0xffff946a1190)SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
(NvCamV4l2) Error IoctlFailed: (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function streamControl(), line 1661)
(NvOdmDevice) Error IoctlFailed: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 206)
(NvCamV4l2) Error IoctlFailed: (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function streamControl(), line 1661)
(NvOdmDevice) Error IoctlFailed: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 206)
(NvCamV4l2) Error IoctlFailed: (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function streamControl(), line 1661)
(NvOdmDevice) Error IoctlFailed: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 206)
(NvCamV4l2) Error IoctlFailed: (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function streamControl(), line 1661)
(NvOdmDevice) Error IoctlFailed: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 206)
SCF: Error InvalidState: Timeout waiting on frame start sensor guid 0, capture sequence ID = 0 (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 507)
SCF: Error InvalidState: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error InvalidState: Worker thread ViCsiHw frameStart failed (in src/common/Utils.cpp, function workerThread(), line 133)
SCF: Error Timeout: (propagating from src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 593)
SCF: Error Timeout: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error Timeout: Worker thread ViCsiHw frameComplete failed (in src/common/Utils.cpp, function workerThread(), line 133)

Any ideas? Tnks

JerryChang · November 15, 2022, 2:42am

hello Gorgo90,

v4l2-ctl it’s checking kernel driver to parse available sensor modes,
please check you’ve the frmfmt ordering match to the mode definition in device tree.

you may also check you’re updating kernel/device tree correctly.
please review /boot/extlinux/extlinux.conf, there’s LINUX and FDT entry for loading binaries via file system.

BTW,
may I know which camera connector you’re used?
your nvargus-daemon log show an error related to GUID. you may try switch to other camera connector for a quick checking .

Gorgo90 · November 15, 2022, 6:43am

Hello @JerryChang

please check you’ve the frmfmt ordering match to the mode definition in device tree.

You mean checking if modes in tegra194-camera-rbpcv2-imx219.dtsi correspond to the modes in my dtb?
My FDT is: /boot/dtb/kernel_tegra194-p3668-0001-p3509-0000.dtb and I converted it to dts.
Inside the dts, I have cam_i2cmux > i2c@0 and i2c@1. The former has rbpcv3_imx477_a@1a and rbpcv2_imx219_a@10, while the latter has rbpcv3_imx477_c@1a and rbpcv2_imx219_c@10.

rbpcv3_imx477 has 2 modes and rbpcv2_imx219 has 6 that match ones in tegra194-camera-rbpcv2-imx219.dtsi. Their values also match even though with different syntax (sometimes in dts I have [32 00] while in dtsi it’s “2”, but I guess it’s ok).

kernel_tegra194-p3668-0001-p3509-0000.dts (395.8 KB)
tegra194-camera-rbpcv2-imx219.dtsi (28.5 KB)
tegra194-camera-jakku-rbpcv2-imx219.dtsi (1.6 KB)
imx219_mode_tbls.h (12.1 KB)

you may also check you’re updating kernel/device tree correctly.
please review /boot/extlinux/extlinux.conf , there’s LINUX and FDT entry for loading binaries via file system.

I think no problem on this side, since I see the new modes I added manually in the kernel sources. Standard image doesn’t have them (mode5 and mode6).

may I know which camera connector you’re used?

Camera: Sony IMX219 (Arducam B0183)
Wire: awm 20624 80c 60v vw-1
Connector: MIPI-CSI2 2-lane on the HZHY-AI310UAV carrier board

your nvargus-daemon log show an error related to GUID. you may try switch to other camera connector for a quick checking .

This is the deamon log and app log, using the second connector:

nvidia@nvidia-hyai:~$ sudo enableCamInfiniteTimeout=1 nvargus-daemon
=== NVIDIA Libargus Camera Service (0.98.3)=== Listening for connections…=== gst-launch-1.0[2337]: Connection established (FFFF926B0900)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module1
OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
---- imager: No override file found. ----
---- imager: No override file found. ----
(NvCamV4l2) Error ModuleNotPresent: V4L2Device not available (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function findDevice(), line 256)
(NvCamV4l2) Error ModuleNotPresent: (propagating from /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function initialize(), line 60)
(NvOdmDevice) Error ModuleNotPresent: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function initialize(), line 107)
NvPclDriverInitializeData: Unable to initialize driver v4l2_sensor
NvPclInitializeDrivers: error: Failed to init camera sub module v4l2_sensor
NvPclStartPlatformDrivers: Failed to start module drivers
NvPclDriver_V4L2_Focuser_Stub_Close: Invalid NULL input pPclDriver
NvPclStateControllerOpen: Failed ImagerGUID 0. (error 0xA000E)
NvPclOpen: PCL Open Failed. Error: 0xf
SCF: Error BadParameter: Sensor could not be opened. (in src/services/capture/CaptureServiceDeviceSensor.cpp, function getSourceFromGuid(), line 646)
SCF: Error BadParameter: (propagating from src/services/capture/CaptureService.cpp, function addSourceByGuid(), line 437)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function addSourceByIndex(), line 311)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function getSource(), line 477)
Acquiring SCF Camera device source via index 1 has failed. === gst-launch-1.0[2337]: CameraProvider initialized (0xffff8c67ae30)SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
SCF: Error InvalidState: Timeout waiting on frame start sensor guid 1, capture sequence ID = 0 (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 507)
SCF: Error InvalidState: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error InvalidState: Worker thread ViCsiHw frameStart failed (in src/common/Utils.cpp, function workerThread(), line 133)
SCF: Error Timeout: (propagating from src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 593)
SCF: Error Timeout: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error Timeout: Worker thread ViCsiHw frameComplete failed (in src/common/Utils.cpp, function workerThread(), line 133)

gst-launch-1.0 -e nvarguscamerasrc num-buffers=$NUMBER_OF_SNAPSHOTS sensor-id=0 ! “video/x-raw(memory:NVMM),width=640,height=480,framerate=200/1” ! nvjpegenc ! multifilesink location=%03d_imx219_cam0.jpeg

Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3280 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3280 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 640 x 480 FR = 200.000000 fps Duration = 5000000 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 6
Output Stream W = 640 H = 480
seconds to Run = 0
Frame Rate = 200.000000
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
nvbuf_utils: dmabuf_fd -1 mapped entry NOT found
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadExecute:694 NvBufSurfaceFromFd Failed.
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadFunction:247 (propagating)
Got EOS from element “pipeline0”.
Execution ended after 0:01:01.013748576
Setting pipeline to NULL …
GST_ARGUS: Cleaning up
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
GST_ARGUS: Done Success

BTW,
modes 1-4 work. Here the logs:

nvidia@nvidia-hyai:~$ sudo enableCamInfiniteTimeout=1 nvargus-daemon
=== NVIDIA Libargus Camera Service (0.98.3)=== Listening for connections…=== gst-launch-1.0[2489]: Connection established (FFFFAC950900)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module1
OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
---- imager: No override file found. ----
---- imager: No override file found. ----
(NvCamV4l2) Error ModuleNotPresent: V4L2Device not available (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function findDevice(), line 256)
(NvCamV4l2) Error ModuleNotPresent: (propagating from /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function initialize(), line 60)
(NvOdmDevice) Error ModuleNotPresent: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function initialize(), line 107)
NvPclDriverInitializeData: Unable to initialize driver v4l2_sensor
NvPclInitializeDrivers: error: Failed to init camera sub module v4l2_sensor
NvPclStartPlatformDrivers: Failed to start module drivers
NvPclDriver_V4L2_Focuser_Stub_Close: Invalid NULL input pPclDriver
NvPclStateControllerOpen: Failed ImagerGUID 0. (error 0xA000E)
NvPclOpen: PCL Open Failed. Error: 0xf
SCF: Error BadParameter: Sensor could not be opened. (in src/services/capture/CaptureServiceDeviceSensor.cpp, function getSourceFromGuid(), line 646)
SCF: Error BadParameter: (propagating from src/services/capture/CaptureService.cpp, function addSourceByGuid(), line 437)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function addSourceByIndex(), line 311)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function getSource(), line 477)
Acquiring SCF Camera device source via index 1 has failed. === gst-launch-1.0[2489]: CameraProvider initialized (0xffffa8660920)SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
PowerServiceCore:handleRequests: timePassed = 5031
=== gst-launch-1.0[2489]: CameraProvider destroyed (0xffffa8660920)=== gst-launch-1.0[2489]: Connection closed (FFFFAC950900)=== gst-launch-1.0[2489]: Connection cleaned up (FFFFAC950900)

gst-launch-1.0 -e nvarguscamerasrc num-buffers=$NUMBER_OF_SNAPSHOTS sensor-id=0 ! “video/x-raw(memory:NVMM),width=1640,height=1232,framerate=30/1” ! nvjpegenc ! multifilesink location=%03d_imx219_cam0.jpeg
Setting pipeline to PAUSED …

Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3280 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3280 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 640 x 480 FR = 200.000000 fps Duration = 5000000 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 3
Output Stream W = 1640 H = 1232
seconds to Run = 0
Frame Rate = 29.999999
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
Got EOS from element “pipeline0”.
Execution ended after 0:00:33.763233088
Setting pipeline to NULL …
GST_ARGUS: Cleaning up
CONSUMER: Done Success
GST_ARGUS: Done Success
Freeing pipeline …

It correctly generates NUMBER_OF_SNAPSHOTS jpeg in my folder with my face :)

Gorgo90 · November 15, 2022, 6:58am

I tried to print video4linux debug messages.

Message with 1640x1232/30fps (working mode):

[ 853.040842] videodev: v4l2_open: video0: open (0)
[ 853.040876] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 853.040942] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a0001, type=6, name=Camera Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041027] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2003, type=2, name=Group Hold, min/max=0/1, step=1, default=0, flags=0x00000200, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041097] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2008, type=5, name=Sensor Mode, min/max=0/7, step=1, default=0, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041139] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2009, type=5, name=Gain, min/max=16/170, step=1, default=16, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041206] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200a, type=5, name=Exposure, min/max=13/683709, step=1, default=2495, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041248] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200b, type=5, name=Frame Rate, min/max=2000000/30000000, step=1, default=30000000, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041289] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2032, type=258, name=Sensor configuration, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=22, nr_of_dims=1, dims=22,0,0,0
[ 853.041357] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2033, type=258, name=Sensor mode I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 853.041399] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2034, type=258, name=Sensor control I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 853.041439] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2064, type=9, name=Bypass Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041478] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2065, type=9, name=Override Enable, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041517] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2066, type=1, name=Height Align, min/max=1/16, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041556] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2067, type=9, name=Size Align, min/max=0/2, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041595] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2068, type=1, name=Write ISP format, min/max=1/1, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.041676] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2069, type=258, name=Sensor Signal Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=126, nr_of_dims=2, dims=30,18,0,0
[ 853.041797] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206a, type=258, name=Sensor Image Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 853.041959] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206b, type=258, name=Sensor Control Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=252, nr_of_dims=2, dims=30,36,0,0
[ 853.042010] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206c, type=258, name=Sensor DV Timings, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 853.042043] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206d, type=2, name=Low Latency Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.042075] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206e, type=1, name=Preferred Stride, min/max=0/65535, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.042117] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2082, type=1, name=Sensor Modes, min/max=0/30, step=1, default=30, flags=0x00000004, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.042153] video0: VIDIOC_QUERY_EXT_CTRL: error -22: id=0xc09a2082, type=0, name=, min/max=0/0, step=0, default=0, flags=0x00000000, elem_size=0, elems=0, nr_of_dims=0, dims=0,0,0,0
[ 853.042216] videodev: v4l2_release: video0: release
[ 853.046921] videodev: v4l2_open: video0: open (0)
[ 853.046944] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 853.046985] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a0001, type=6, name=Camera Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047020] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2003, type=2, name=Group Hold, min/max=0/1, step=1, default=0, flags=0x00000200, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047073] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2008, type=5, name=Sensor Mode, min/max=0/7, step=1, default=0, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047106] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2009, type=5, name=Gain, min/max=16/170, step=1, default=16, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047142] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200a, type=5, name=Exposure, min/max=13/683709, step=1, default=2495, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047177] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200b, type=5, name=Frame Rate, min/max=2000000/30000000, step=1, default=30000000, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047211] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2032, type=258, name=Sensor configuration, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=22, nr_of_dims=1, dims=22,0,0,0
[ 853.047244] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2033, type=258, name=Sensor mode I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 853.047305] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2034, type=258, name=Sensor control I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 853.047339] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2064, type=9, name=Bypass Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047378] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2065, type=9, name=Override Enable, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047411] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2066, type=1, name=Height Align, min/max=1/16, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047443] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2067, type=9, name=Size Align, min/max=0/2, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047502] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2068, type=1, name=Write ISP format, min/max=1/1, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047535] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2069, type=258, name=Sensor Signal Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=126, nr_of_dims=2, dims=30,18,0,0
[ 853.047569] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206a, type=258, name=Sensor Image Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 853.047626] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206b, type=258, name=Sensor Control Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=252, nr_of_dims=2, dims=30,36,0,0
[ 853.047660] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206c, type=258, name=Sensor DV Timings, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 853.047693] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206d, type=2, name=Low Latency Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047725] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206e, type=1, name=Preferred Stride, min/max=0/65535, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047757] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2082, type=1, name=Sensor Modes, min/max=0/30, step=1, default=30, flags=0x00000004, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.047789] video0: VIDIOC_QUERY_EXT_CTRL: error -22: id=0xc09a2082, type=0, name=, min/max=0/0, step=0, default=0, flags=0x00000000, elem_size=0, elems=0, nr_of_dims=0, dims=0,0,0,0
[ 853.047830] videodev: v4l2_release: video0: release
[ 853.095302] videodev: v4l2_open: video0: open (0)
[ 853.095334] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 853.095381] videodev: v4l2_release: video0: release
[ 853.095427] videodev: v4l2_open: video0: open (0)
[ 853.095446] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 853.095486] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a0001, type=6, name=Camera Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.095538] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2003, type=2, name=Group Hold, min/max=0/1, step=1, default=0, flags=0x00000200, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.095580] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2008, type=5, name=Sensor Mode, min/max=0/7, step=1, default=0, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.095649] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2009, type=5, name=Gain, min/max=16/170, step=1, default=16, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.095691] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200a, type=5, name=Exposure, min/max=13/683709, step=1, default=2495, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.095759] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200b, type=5, name=Frame Rate, min/max=2000000/30000000, step=1, default=30000000, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.095827] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2032, type=258, name=Sensor configuration, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=22, nr_of_dims=1, dims=22,0,0,0
[ 853.095869] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2033, type=258, name=Sensor mode I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 853.095909] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2034, type=258, name=Sensor control I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 853.095973] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2064, type=9, name=Bypass Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.096013] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2065, type=9, name=Override Enable, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.096050] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2066, type=1, name=Height Align, min/max=1/16, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.096087] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2067, type=9, name=Size Align, min/max=0/2, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.096135] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2068, type=1, name=Write ISP format, min/max=1/1, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.096173] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2069, type=258, name=Sensor Signal Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=126, nr_of_dims=2, dims=30,18,0,0
[ 853.096212] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206a, type=258, name=Sensor Image Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 853.096251] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206b, type=258, name=Sensor Control Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=252, nr_of_dims=2, dims=30,36,0,0
[ 853.096316] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206c, type=258, name=Sensor DV Timings, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 853.096387] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206d, type=2, name=Low Latency Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.096425] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206e, type=1, name=Preferred Stride, min/max=0/65535, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.096463] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2082, type=1, name=Sensor Modes, min/max=0/30, step=1, default=30, flags=0x00000004, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 853.096497] video0: VIDIOC_QUERY_EXT_CTRL: error -22: id=0xc09a2082, type=0, name=, min/max=0/0, step=0, default=0, flags=0x00000000, elem_size=0, elems=0, nr_of_dims=0, dims=0,0,0,0
[ 853.096538] videodev: v4l2_release: video0: release
[ 853.096589] videodev: v4l2_open: video0: open (0)
[ 853.096612] video0: VIDIOC_ENUM_FMT: index=0, type=vid-cap, flags=0x0, pixelformat=RG10, mbus_code=0x0000, description=‘10-bit Bayer RGRG/GBGB’
[ 853.096648] video0: VIDIOC_ENUM_FMT: error -22: index=1, type=vid-cap, flags=0x0, pixelformat=
[ 853.096683] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-out, flags=0x0, pixelformat=
[ 853.096716] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-overlay, flags=0x0, pixelformat=
[ 853.096748] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vbi-cap, flags=0x0, pixelformat=
[ 853.096788] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vbi-out, flags=0x0, pixelformat=
[ 853.096845] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=sliced-vbi-cap, flags=0x0, pixelformat=
[ 853.096878] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=sliced-vbi-out, flags=0x0, pixelformat=
[ 853.096911] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-out-overlay, flags=0x0, pixelformat=
[ 853.096969] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-cap-mplane, flags=0x0, pixelformat=
[ 853.097002] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-out-mplane, flags=0x0, pixelformat=
[ 853.097111] video0: VIDIOC_ENUM_FRAMESIZES: index=0, pixelformat=RG10, type=1, wxh=3280x2464
[ 853.097192] video0: VIDIOC_ENUM_FRAMESIZES: index=1, pixelformat=RG10, type=1, wxh=3280x1848
[ 853.097265] video0: VIDIOC_ENUM_FRAMESIZES: index=2, pixelformat=RG10, type=1, wxh=1920x1080
[ 853.097336] video0: VIDIOC_ENUM_FRAMESIZES: index=3, pixelformat=RG10, type=1, wxh=1640x1232
[ 853.097430] video0: VIDIOC_ENUM_FRAMESIZES: index=4, pixelformat=RG10, type=1, wxh=1280x720
[ 853.097504] video0: VIDIOC_ENUM_FRAMESIZES: error -22: index=5, pixelformat=RG10, type=0
[ 853.097543] video0: VIDIOC_G_FMT: type=vid-cap, width=1640, height=1232, pixelformat=RG10, field=none, bytesperline=3280, sizeimage=4040960, colorspace=8, flags=0x0, ycbcr_enc=0, quantization=0, xfer_func=0
[ 853.097600] video0: VIDIOC_ENUMINPUT: index=0, name=Camera 0, type=2, audioset=0x0, tuner=0, std=0x00000000, status=0x0, capabilities=0x0
[ 853.097655] video0: VIDIOC_ENUMINPUT: error -22: index=1, name=, type=0, audioset=0x0, tuner=0, std=0x00000000, status=0x0, capabilities=0x0
[ 853.097756] videodev: v4l2_release: video0: release
[ 853.176385] videodev: v4l2_open: video0: open (0)
[ 853.176419] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 853.176467] videodev: v4l2_release: video0: release
[ 853.318499] NVRM: No NVIDIA GPU found.
[ 853.510767] videodev: v4l2_open: video0: open (0)
[ 853.510831] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=1, error_idx=0, request_fd=0, id/val=0x9a2008/0x3
[ 853.510889] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=1, error_idx=0, request_fd=0, id/val=0x9a2064/0x1
[ 853.510932] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=1, error_idx=0, request_fd=0, id/val=0x9a2065/0x1
[ 853.511128] video0: VIDIOC_S_FMT: type=vid-cap, width=1640, height=1232, pixelformat=RG10, field=none, bytesperline=3280, sizeimage=4040960, colorspace=8, flags=0x0, ycbcr_enc=0, quantization=0, xfer_func=0
[ 853.511196] video0: VIDIOC_REQBUFS: count=2, type=vid-cap, memory=userptr
[ 853.511320] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a200b/0x1c9c380, id/val=0x9a2009/0x10, id/val=0x9a2003/0x0
[ 853.517337] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a200a/0x8232, id/val=0x9a2003/0x0
[ 853.557194] video0: VIDIOC_STREAMON: type=vid-cap
[ 853.822836] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x13, id/val=0x9a2003/0x0
[ 853.856259] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x16, id/val=0x9a2003/0x0
[ 853.889896] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x19, id/val=0x9a2003/0x0
[ 853.926682] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x1b, id/val=0x9a2003/0x0
[ 854.022842] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x1c, id/val=0x9a2003/0x0
[ 854.057053] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x1e, id/val=0x9a2003/0x0
[ 854.092363] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x1f, id/val=0x9a200a/0x8231, id/val=0x9a2003/0x0
[ 854.123290] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x21, id/val=0x9a200a/0x8232, id/val=0x9a2003/0x0
[ 854.158676] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x23, id/val=0x9a200a/0x8231, id/val=0x9a2003/0x0
[ 854.190860] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x24, id/val=0x9a200a/0x8232, id/val=0x9a2003/0x0
[ 854.227541] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x25, id/val=0x9a200a/0x8231, id/val=0x9a2003/0x0
[ 854.256944] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x26, id/val=0x9a200a/0x8232, id/val=0x9a2003/0x0
[ 854.322821] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x27, id/val=0x9a2003/0x0
[ 854.356435] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x29, id/val=0x9a200a/0x8231, id/val=0x9a2003/0x0
[ 854.392045] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x2a, id/val=0x9a200a/0x8232, id/val=0x9a2003/0x0
[ 854.423314] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x2b, id/val=0x9a200a/0x8231, id/val=0x9a2003/0x0
[ 854.490002] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x2c, id/val=0x9a200a/0x8232, id/val=0x9a2003/0x0
[ 854.522722] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x2d, id/val=0x9a2003/0x0
[ 854.556815] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=3, error_idx=2, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x2e, id/val=0x9a2003/0x0
[ 855.289759] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x33, id/val=0x9a200a/0x752f, id/val=0x9a2003/0x0
[ 887.119219] video0: VIDIOC_STREAMOFF: type=vid-cap
[ 887.206939] video0: VIDIOC_REQBUFS: count=0, type=vid-cap, memory=userptr
[ 887.206992] videodev: v4l2_release: video0: release

Message with 640x480/200fps:

[ 1002.928873] videodev: v4l2_open: video0: open (0)
[ 1002.928908] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 1002.929005] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a0001, type=6, name=Camera Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929047] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2003, type=2, name=Group Hold, min/max=0/1, step=1, default=0, flags=0x00000200, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929105] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2008, type=5, name=Sensor Mode, min/max=0/7, step=1, default=0, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929141] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2009, type=5, name=Gain, min/max=16/170, step=1, default=16, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929176] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200a, type=5, name=Exposure, min/max=13/683709, step=1, default=2495, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929212] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200b, type=5, name=Frame Rate, min/max=2000000/30000000, step=1, default=30000000, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929246] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2032, type=258, name=Sensor configuration, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=22, nr_of_dims=1, dims=22,0,0,0
[ 1002.929281] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2033, type=258, name=Sensor mode I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 1002.929316] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2034, type=258, name=Sensor control I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 1002.929350] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2064, type=9, name=Bypass Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929383] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2065, type=9, name=Override Enable, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929416] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2066, type=1, name=Height Align, min/max=1/16, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929450] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2067, type=9, name=Size Align, min/max=0/2, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929509] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2068, type=1, name=Write ISP format, min/max=1/1, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929543] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2069, type=258, name=Sensor Signal Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=126, nr_of_dims=2, dims=30,18,0,0
[ 1002.929602] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206a, type=258, name=Sensor Image Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 1002.929636] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206b, type=258, name=Sensor Control Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=252, nr_of_dims=2, dims=30,36,0,0
[ 1002.929757] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206c, type=258, name=Sensor DV Timings, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 1002.929876] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206d, type=2, name=Low Latency Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929923] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206e, type=1, name=Preferred Stride, min/max=0/65535, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.929994] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2082, type=1, name=Sensor Modes, min/max=0/30, step=1, default=30, flags=0x00000004, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.930028] video0: VIDIOC_QUERY_EXT_CTRL: error -22: id=0xc09a2082, type=0, name=, min/max=0/0, step=0, default=0, flags=0x00000000, elem_size=0, elems=0, nr_of_dims=0, dims=0,0,0,0
[ 1002.930075] videodev: v4l2_release: video0: release
[ 1002.934775] videodev: v4l2_open: video0: open (0)
[ 1002.934799] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 1002.934842] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a0001, type=6, name=Camera Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.934877] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2003, type=2, name=Group Hold, min/max=0/1, step=1, default=0, flags=0x00000200, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.934930] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2008, type=5, name=Sensor Mode, min/max=0/7, step=1, default=0, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.934993] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2009, type=5, name=Gain, min/max=16/170, step=1, default=16, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935028] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200a, type=5, name=Exposure, min/max=13/683709, step=1, default=2495, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935083] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200b, type=5, name=Frame Rate, min/max=2000000/30000000, step=1, default=30000000, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935118] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2032, type=258, name=Sensor configuration, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=22, nr_of_dims=1, dims=22,0,0,0
[ 1002.935181] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2033, type=258, name=Sensor mode I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 1002.935217] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2034, type=258, name=Sensor control I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 1002.935250] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2064, type=9, name=Bypass Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935284] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2065, type=9, name=Override Enable, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935319] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2066, type=1, name=Height Align, min/max=1/16, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935358] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2067, type=9, name=Size Align, min/max=0/2, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935392] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2068, type=1, name=Write ISP format, min/max=1/1, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935425] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2069, type=258, name=Sensor Signal Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=126, nr_of_dims=2, dims=30,18,0,0
[ 1002.935459] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206a, type=258, name=Sensor Image Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 1002.935493] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206b, type=258, name=Sensor Control Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=252, nr_of_dims=2, dims=30,36,0,0
[ 1002.935527] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206c, type=258, name=Sensor DV Timings, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 1002.935561] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206d, type=2, name=Low Latency Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935594] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206e, type=1, name=Preferred Stride, min/max=0/65535, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935652] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2082, type=1, name=Sensor Modes, min/max=0/30, step=1, default=30, flags=0x00000004, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.935685] video0: VIDIOC_QUERY_EXT_CTRL: error -22: id=0xc09a2082, type=0, name=, min/max=0/0, step=0, default=0, flags=0x00000000, elem_size=0, elems=0, nr_of_dims=0, dims=0,0,0,0
[ 1002.935759] videodev: v4l2_release: video0: release
[ 1002.983465] videodev: v4l2_open: video0: open (0)
[ 1002.983493] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 1002.983546] videodev: v4l2_release: video0: release
[ 1002.983593] videodev: v4l2_open: video0: open (0)
[ 1002.983611] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 1002.983686] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a0001, type=6, name=Camera Controls, min/max=0/0, step=0, default=0, flags=0x00000044, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.983741] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2003, type=2, name=Group Hold, min/max=0/1, step=1, default=0, flags=0x00000200, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.983809] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2008, type=5, name=Sensor Mode, min/max=0/7, step=1, default=0, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.983846] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2009, type=5, name=Gain, min/max=16/170, step=1, default=16, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.983920] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200a, type=5, name=Exposure, min/max=13/683709, step=1, default=2495, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.983985] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a200b, type=5, name=Frame Rate, min/max=2000000/30000000, step=1, default=30000000, flags=0x00000020, elem_size=8, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984023] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2032, type=258, name=Sensor configuration, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=22, nr_of_dims=1, dims=22,0,0,0
[ 1002.984059] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2033, type=258, name=Sensor mode I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 1002.984094] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2034, type=258, name=Sensor control I2C packet, min/max=0/4294967295, step=1, default=0, flags=0x00000184, elem_size=4, elems=1026, nr_of_dims=1, dims=1026,0,0,0
[ 1002.984129] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2064, type=9, name=Bypass Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984163] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2065, type=9, name=Override Enable, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984197] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2066, type=1, name=Height Align, min/max=1/16, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984231] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2067, type=9, name=Size Align, min/max=0/2, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984264] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2068, type=1, name=Write ISP format, min/max=1/1, step=1, default=1, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984298] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2069, type=258, name=Sensor Signal Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=126, nr_of_dims=2, dims=30,18,0,0
[ 1002.984332] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206a, type=258, name=Sensor Image Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 1002.984367] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206b, type=258, name=Sensor Control Properties, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=252, nr_of_dims=2, dims=30,36,0,0
[ 1002.984426] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206c, type=258, name=Sensor DV Timings, min/max=0/4294967295, step=1, default=0, flags=0x00000104, elem_size=4, elems=112, nr_of_dims=2, dims=30,16,0,0
[ 1002.984461] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206d, type=2, name=Low Latency Mode, min/max=0/1, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984520] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a206e, type=1, name=Preferred Stride, min/max=0/65535, step=1, default=0, flags=0x00000000, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984555] video0: VIDIOC_QUERY_EXT_CTRL: id=0x9a2082, type=1, name=Sensor Modes, min/max=0/30, step=1, default=30, flags=0x00000004, elem_size=4, elems=1, nr_of_dims=0, dims=0,0,0,0
[ 1002.984614] video0: VIDIOC_QUERY_EXT_CTRL: error -22: id=0xc09a2082, type=0, name=, min/max=0/0, step=0, default=0, flags=0x00000000, elem_size=0, elems=0, nr_of_dims=0, dims=0,0,0,0
[ 1002.984656] videodev: v4l2_release: video0: release
[ 1002.984707] videodev: v4l2_open: video0: open (0)
[ 1002.984728] video0: VIDIOC_ENUM_FMT: index=0, type=vid-cap, flags=0x0, pixelformat=RG10, mbus_code=0x0000, description=‘10-bit Bayer RGRG/GBGB’
[ 1002.984762] video0: VIDIOC_ENUM_FMT: error -22: index=1, type=vid-cap, flags=0x0, pixelformat=
[ 1002.984807] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-out, flags=0x0, pixelformat=
[ 1002.984840] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-overlay, flags=0x0, pixelformat=
[ 1002.984873] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vbi-cap, flags=0x0, pixelformat=
[ 1002.984906] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vbi-out, flags=0x0, pixelformat=
[ 1002.984938] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=sliced-vbi-cap, flags=0x0, pixelformat=
[ 1002.984971] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=sliced-vbi-out, flags=0x0, pixelformat=
[ 1002.985003] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-out-overlay, flags=0x0, pixelformat=
[ 1002.985035] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-cap-mplane, flags=0x0, pixelformat=
[ 1002.985068] video0: VIDIOC_ENUM_FMT: error -22: index=0, type=vid-out-mplane, flags=0x0, pixelformat=
[ 1002.985168] video0: VIDIOC_ENUM_FRAMESIZES: index=0, pixelformat=RG10, type=1, wxh=3280x2464
[ 1002.985257] video0: VIDIOC_ENUM_FRAMESIZES: index=1, pixelformat=RG10, type=1, wxh=3280x1848
[ 1002.985340] video0: VIDIOC_ENUM_FRAMESIZES: index=2, pixelformat=RG10, type=1, wxh=1920x1080
[ 1002.985401] video0: VIDIOC_ENUM_FRAMESIZES: index=3, pixelformat=RG10, type=1, wxh=1640x1232
[ 1002.985463] video0: VIDIOC_ENUM_FRAMESIZES: index=4, pixelformat=RG10, type=1, wxh=1280x720
[ 1002.985514] video0: VIDIOC_ENUM_FRAMESIZES: error -22: index=5, pixelformat=RG10, type=0
[ 1002.985553] video0: VIDIOC_G_FMT: type=vid-cap, width=1640, height=1232, pixelformat=RG10, field=none, bytesperline=3280, sizeimage=4040960, colorspace=8, flags=0x0, ycbcr_enc=0, quantization=0, xfer_func=0
[ 1002.985611] video0: VIDIOC_ENUMINPUT: index=0, name=Camera 0, type=2, audioset=0x0, tuner=0, std=0x00000000, status=0x0, capabilities=0x0
[ 1002.985642] video0: VIDIOC_ENUMINPUT: error -22: index=1, name=, type=0, audioset=0x0, tuner=0, std=0x00000000, status=0x0, capabilities=0x0
[ 1002.985750] videodev: v4l2_release: video0: release
[ 1003.065293] videodev: v4l2_open: video0: open (0)
[ 1003.065324] video0: VIDIOC_QUERYCAP: driver=tegra-video, card=vi-output, imx219 9-0010, bus=platform:tegra-capture-vi:0, version=0x00050a68, capabilities=0x84200001, device_caps=0x04200001
[ 1003.065381] videodev: v4l2_release: video0: release
[ 1003.217156] NVRM: No NVIDIA GPU found.
[ 1003.414808] videodev: v4l2_open: video0: open (0)
[ 1003.414876] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=1, error_idx=0, request_fd=0, id/val=0x9a2008/0x6
[ 1003.414934] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=1, error_idx=0, request_fd=0, id/val=0x9a2064/0x1
[ 1003.414979] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=1, error_idx=0, request_fd=0, id/val=0x9a2065/0x1
[ 1003.415188] video0: VIDIOC_S_FMT: type=vid-cap, width=3280, height=2464, pixelformat=RG10, field=none, bytesperline=6560, sizeimage=16163840, colorspace=8, flags=0x0, ycbcr_enc=0, quantization=0, xfer_func=0
[ 1003.415253] video0: VIDIOC_REQBUFS: count=2, type=vid-cap, memory=userptr
[ 1003.415403] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a200b/0x1406f40, id/val=0x9a2009/0x10, id/val=0x9a2003/0x0
[ 1003.418044] video0: VIDIOC_S_EXT_CTRLS: which=0x9a0000, count=4, error_idx=3, request_fd=0, id/val=0x9a2003/0x1, id/val=0x9a2009/0x6a, id/val=0x9a200a/0x1387, id/val=0x9a2003/0x0
[ 1003.461062] video0: VIDIOC_STREAMON: type=vid-cap
[ 1249.330172] videodev: v4l2_release: video0: release

JerryChang · November 15, 2022, 8:44am

I’m wondering why imx219_mode_tbls.h it shows 640x480@180-fps, but device tree is configured to 200-fps?
what’s the actual output frame-rate? you cannot configure unsupported sensor modes.

Gorgo90 · November 15, 2022, 12:10pm

Yes, I’ve been asking myself that.
I’m facing the same behavior with 1280x720/120fps though. Do you want me to retry this (doable) configuration and paste the log?

What if I lower 640x480/200fps to 180 in the device tree?

JerryChang · November 16, 2022, 2:55am

hello Gorgo90,

let’s start with 1280x720.
this doesn’t look right,
for example, pixel clock should be higher for your 1280x720@120-fps sensor mode.
please review Sensor Pixel Clock session to review your pix_clk_hz settings.

				mode4 {
					active_w = "1280";
					active_h = "720";
					pix_clk_hz = "182400000";
					default_framerate = "60000000";


				mode5 {
					active_w = "1280";
					active_h = "720";
					pix_clk_hz = "169600000";
					default_framerate = "120000000";

you may also try below commands to boost all the VI/CSI/ISP clocks.
in order to confirm this is not system clocking issue.
for example,

sudo su
echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
echo 1 > /sys/kernel/debug/bpmp/debug/clk/emc/mrq_rate_locked
cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/isp/rate
cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate
cat /sys/kernel/debug/bpmp/debug/clk/emc/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/emc/rate

Gorgo90 · November 16, 2022, 7:19am

Hi @JerryChang , thank you for helping!
So, according to the datasheet, the Sensor data rate is 912Mbps/Lane and we have 2 lanes.
To get ‘Bits per pixel’ shall I divide 8MP/resolution? So 8MP/1270x720= 8847360/914400 = 9,67569
pixel_clk_hz = 912 Mbps * 2 / 9.67569 = 188513687

??

I tried your rate commands but I think they were already at max:

root@nvidia-hyai:/home/nvidia# cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
460800000
root@nvidia-hyai:/home/nvidia# cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/isp/rate
576000000
root@nvidia-hyai:/home/nvidia# cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate
314000000
root@nvidia-hyai:/home/nvidia# cat /sys/kernel/debug/bpmp/debug/clk/emc/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/emc/rate
1866000000

root@nvidia-hyai:/home/nvidia# echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
root@nvidia-hyai:/home/nvidia# echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
root@nvidia-hyai:/home/nvidia# echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
root@nvidia-hyai:/home/nvidia# echo 1 > /sys/kernel/debug/bpmp/debug/clk/emc/mrq_rate_locked

root@nvidia-hyai:/home/nvidia# cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
460800000
root@nvidia-hyai:/home/nvidia# cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/isp/rate
576000000
root@nvidia-hyai:/home/nvidia# cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate
314000000
root@nvidia-hyai:/home/nvidia# cat /sys/kernel/debug/bpmp/debug/clk/emc/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/emc/rate
1866000000

Gorgo90 · November 16, 2022, 7:30am

I tried to get snapshots with 1280x720/120fps WITHOUT editing mode5 yet.

SENSOR_ID=0
NUMBER_OF_SNAPSHOTS=1200
FRAMERATE=120
gst-launch-1.0 -e nvarguscamerasrc num-buffers=$NUMBER_OF_SNAPSHOTS sensor-id=$SENSOR_ID ! “video/x-raw(memory:NVMM),width=1280,height=720,framerate=120/1” ! nvjpegenc ! multifilesink location=%03d_rpi_v3_imx219_cam$SENSOR_ID.jpeg
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3280 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3280 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 640 x 480 FR = 200.000000 fps Duration = 5000000 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 5
Output Stream W = 1280 H = 720
seconds to Run = 0
Frame Rate = 120.000005
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
Got EOS from element “pipeline0”.
Execution ended after 0:00:20.459716384
Setting pipeline to NULL …
GST_ARGUS: Cleaning up
CONSUMER: Done Success
GST_ARGUS: Done Success
Freeing pipeline …

nvidia@nvidia-hyai:~$ sudo enableCamInfiniteTimeout=1 nvargus-daemon
=== NVIDIA Libargus Camera Service (0.98.3)=== Listening for connections…=== gst-launch-1.0[2869]: Connection established (FFFF7E846900)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module1
OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
---- imager: No override file found. ----
(NvCamV4l2) Error ModuleNotPresent: V4L2Device not available (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function findDevice(), line 256)
(NvCamV4l2) Error ModuleNotPresent: (propagating from /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function initialize(), line 60)
(NvOdmDevice) Error ModuleNotPresent: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function initialize(), line 107)
NvPclDriverInitializeData: Unable to initialize driver v4l2_sensor
NvPclInitializeDrivers: error: Failed to init camera sub module v4l2_sensor
NvPclStartPlatformDrivers: Failed to start module drivers
NvPclDriver_V4L2_Focuser_Stub_Close: Invalid NULL input pPclDriver
NvPclStateControllerOpen: Failed ImagerGUID 1. (error 0xA000E)
NvPclOpen: PCL Open Failed. Error: 0xf
SCF: Error BadParameter: Sensor could not be opened. (in src/services/capture/CaptureServiceDeviceSensor.cpp, function getSourceFromGuid(), line 646)
SCF: Error BadParameter: (propagating from src/services/capture/CaptureService.cpp, function addSourceByGuid(), line 437)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function addSourceByIndex(), line 311)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function getSource(), line 477)
Acquiring SCF Camera device source via index 0 has failed. ---- imager: No override file found. ----
=== gst-launch-1.0[2869]: CameraProvider initialized (0xffff785a0d50)SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
PowerServiceCore:handleRequests: timePassed = 5008
=== gst-launch-1.0[2869]: CameraProvider destroyed (0xffff785a0d50)=== gst-launch-1.0[2869]: Connection closed (FFFF7E846900)=== gst-launch-1.0[2869]: Connection cleaned up (FFFF7E846900)

But it takes 20sec exactly that let me think it’s using 60fps instead of 120fps. (I also tried with 2400 images and it takes 40sec…).

Gorgo90 · November 16, 2022, 12:45pm

for example, pixel clock should be higher for your 1280x720@120-fps sensor mode.

About this, I don’t know if it’s a bug, but the lower pix_clk_hz was in the nvidia kernel sources (now commented).

https://nv-tegra.nvidia.com/r/plugins/gitiles/device/hardware/nvidia/platform/t19x/jakku-dts/+/refs/tags/jetson_35.1/common/tegra194-camera-rbpcv2-imx219.dtsi

JerryChang · November 17, 2022, 2:35am

hello Gorgo90,

we disable this 1280x720@120-fps sensor mode due to it failed internal stability test.
back-to your issue,
according to your Argus logs, it looks sensor-mode-5 is enabled for streaming.
it may due to I/O issue that you cannot reach 120-fps.

so, please give it a try with following commands to disable preview and shows frame-rate only.
for example, $ gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! 'video/x-raw(memory:NVMM),width=1280, height=720, framerate=120/1, format=NV12' ! nvvidconv ! 'video/x-raw(memory:NVMM),format=I420' ! fpsdisplaysink text-overlay=0 video-sink=fakesink sync=0 -v

Gorgo90 · November 17, 2022, 2:12pm

nvidia@nvidia-hyai:~$ gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! ‘video/x-raw(memory:NVMM),width=1280, height=720, framerate=120/1, format=NV12’ ! nvvidconv ! ‘video/x-raw(memory:NVMM),format=I420’ ! fpsdisplaysink text-overlay=0 video-sink=fakesink sync=0 -v
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = false
Setting pipeline to PLAYING …
New clock: GstSystemClock
/GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3280 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3280 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 640 x 480 FR = 200.000000 fps Duration = 5000000 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 5
Output Stream W = 1280 H = 720
seconds to Run = 0
Frame Rate = 120.000005
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = false
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 33, dropped: 0, current: 65.18, average: 65.18
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 63, dropped: 0, current: 59.91, average: 62.56
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 93, dropped: 0, current: 59.92, average: 61.68
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 124, dropped: 0, current: 60.22, average: 61.31
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 154, dropped: 0, current: 59.90, average: 61.03
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 184, dropped: 0, current: 59.58, average: 60.79
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 215, dropped: 0, current: 60.66, average: 60.77
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 246, dropped: 0, current: 60.13, average: 60.69
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 276, dropped: 0, current: 59.92, average: 60.60
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 306, dropped: 0, current: 59.99, average: 60.54
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 336, dropped: 0, current: 59.94, average: 60.49
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 367, dropped: 0, current: 60.16, average: 60.46
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 398, dropped: 0, current: 59.53, average: 60.39
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 429, dropped: 0, current: 60.85, average: 60.42
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 459, dropped: 0, current: 59.88, average: 60.38
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 489, dropped: 0, current: 59.72, average: 60.34
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 519, dropped: 0, current: 59.90, average: 60.32
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 550, dropped: 0, current: 60.34, average: 60.32
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 581, dropped: 0, current: 60.24, average: 60.31
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 611, dropped: 0, current: 59.83, average: 60.29
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 642, dropped: 0, current: 60.13, average: 60.28
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 672, dropped: 0, current: 59.97, average: 60.27
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 703, dropped: 0, current: 59.93, average: 60.25
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 734, dropped: 0, current: 60.29, average: 60.26
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 764, dropped: 0, current: 59.99, average: 60.24
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 795, dropped: 0, current: 59.97, average: 60.23
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 825, dropped: 0, current: 59.89, average: 60.22
^Chandling interrupt.
Interrupt: Stopping pipeline …
Execution ended after 0:00:14.466643360
Setting pipeline to NULL …
GST_ARGUS: Cleaning up
CONSUMER: Done Success
GST_ARGUS: Done Success
Freeing pipeline …

nvidia@nvidia-hyai:~$ sudo enableCamInfiniteTimeout=1 nvargus-daemon
=== NVIDIA Libargus Camera Service (0.98.3)=== Listening for connections…=== gst-launch-1.0[3011]: Connection established (FFFFA353E900)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module1
OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
---- imager: No override file found. ----
(NvCamV4l2) Error ModuleNotPresent: V4L2Device not available (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function findDevice(), line 256)
(NvCamV4l2) Error ModuleNotPresent: (propagating from /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function initialize(), line 60)
(NvOdmDevice) Error ModuleNotPresent: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function initialize(), line 107)
NvPclDriverInitializeData: Unable to initialize driver v4l2_sensor
NvPclInitializeDrivers: error: Failed to init camera sub module v4l2_sensor
NvPclStartPlatformDrivers: Failed to start module drivers
NvPclDriver_V4L2_Focuser_Stub_Close: Invalid NULL input pPclDriver
NvPclStateControllerOpen: Failed ImagerGUID 1. (error 0xA000E)
NvPclOpen: PCL Open Failed. Error: 0xf
SCF: Error BadParameter: Sensor could not be opened. (in src/services/capture/CaptureServiceDeviceSensor.cpp, function getSourceFromGuid(), line 646)
SCF: Error BadParameter: (propagating from src/services/capture/CaptureService.cpp, function addSourceByGuid(), line 437)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function addSourceByIndex(), line 311)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function getSource(), line 477)
Acquiring SCF Camera device source via index 0 has failed. ---- imager: No override file found. ----
=== gst-launch-1.0[3011]: CameraProvider initialized (0xffff9c635a80)SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
=== gst-launch-1.0[3011]: CameraProvider destroyed (0xffff9c635a80)=== gst-launch-1.0[3011]: Connection closed (FFFFA353E900)=== gst-launch-1.0[3011]: Connection cleaned up (FFFFA353E900)

JerryChang · November 21, 2022, 2:46am

hello Gorgo90,

according to those debug prints, it’s actually outputting with 60-fps.
please further test by v4l standard controls,
you may use camera controls to enable 120-fps sensor modes to test low-level driver functionality.
for example, $ v4l2-ctl -d /dev/video0 --set-fmt-video=width=1280,height=720,pixelformat=RG10 --set-ctrl bypass_mode=0 --set-ctrl sensor_modes=5 --stream-mmap --stream-count=600

Gorgo90 · November 22, 2022, 7:21am

Hello @JerryChang
I’m checking this problem more deeply.
First, I tried the same camera module with another carrier board (different brand/device tree; MIPI-CSI2 2 lane interface, Jetpack 4.6, Linux DCS 4.9.253-tegra ) and I could get 120fps with 1280x720. In fact I could see the extra mode with v4l2-ctl.

dcs_user@DCS:~$ v4l2-ctl --device /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Index : 0
Type : Video Capture
Pixel Format: ‘RG10’
Name : 10-bit Bayer RGRG/GBGB
Size: Discrete 3264x2464
Interval: Discrete 0.048s (21.000 fps)
Size: Discrete 3264x1848
Interval: Discrete 0.036s (28.000 fps)
Size: Discrete 1920x1080
Interval: Discrete 0.033s (30.000 fps)
Size: Discrete 1640x1232
Interval: Discrete 0.033s (30.000 fps)
Size: Discrete 1280x720
Interval: Discrete 0.017s (60.000 fps)
Size: Discrete 1280x720
> Interval: Discrete 0.017s (60.000 fps)

Then, I tried to flash the same Jetpack on my original HYAI carrier board, and I could get 120fps as well!
So, I kept the same imx219_tables.h, tegra194-camera-rbpcv2-imx219.dtsi (same mode configurations) but with Jetpack 5.0.2 the extra mode doesn’t show with v4l2-ctl.

I also added some printk into sensor_common.c and I found that into sensor_common_init_sensor_properties() num_modes is actually 6 (so the extra 120fps is detected at that point).

About your last command, it correctly shows 60fps since modes==5 is 1280x720-60fps. sensor_modes=6 doesn’t start.

How can I be useful for debugging? Do you need to see the changes into the device tree?
Thank you!

JerryChang · November 22, 2022, 8:14am

hello Gorgo90,

BTW,
here’s known v4l bug of --list-formats-ext, fps info is shown incorrectly once you’ve same image resolution defined.

JerryChang · November 22, 2022, 8:15am

hello Gorgo90,

let’s delete this sensor mode 1280x720@60-fps to debug further.

Gorgo90 · November 22, 2022, 8:19am

Yes I was aware about the bug in list-formats-ext but at least it shows, correctly, 2 modes for 1280x720 (Jetpack 4.6) instead of only one (Jetpack 5). I could record with 60fps selecting mode5 and 120fps selecting mode6.

I will try to delete the 60fps mode on Friday. Do you know if newest Jetpack allows one mode only for resolution?

JerryChang · November 22, 2022, 8:33am

hello Gorgo90,

to be honest, I don’t. we usually don’t use same resolution with different frame-rate.

Gorgo90 · November 25, 2022, 9:54am

Hi @JerryChang
as promised I tried to deleted the 60fps mode references from imx219_mode_tbls.h and tegra194-camera-rbpcv2-imx219.dtsi.
I also called the 120fps mode as mode4.
I compiled the all kernel.

Now, list-formats-ext still shows the 1280x720 mode, but with 60fps. Initially I thought it was correct since It could be the 120fps instead.

nvidia@nvidia-desktop:~$ v4l2-ctl --device /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Type: Video Capture

  Size: Discrete 3280x2464
  	Interval: Discrete 0.048s (21.000 fps)
  Size: Discrete 3280x1848
  	Interval: Discrete 0.036s (28.000 fps)
  Size: Discrete 1920x1080
  	Interval: Discrete 0.033s (30.000 fps)
  Size: Discrete 1640x1232
  	Interval: Discrete 0.033s (30.000 fps)
  Size: Discrete 1280x720
  	Interval: Discrete 0.017s (60.000 fps)

Unfortunately I cannot launch gst-launch-1.0:

gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! ‘video/x-raw(memory:NVMM),width=1280, height=720, framerate=120/1, format=NV12’ ! nvvidconv ! ‘video/x-raw(memory:NVMM),format=I420’ ! fpsdisplaysink text-overlay=0 video-sink=fakesink sync=0 -v
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = false
Setting pipeline to PLAYING …
New clock: GstSystemClock
/GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3280 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3280 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 4
Output Stream W = 1280 H = 720
seconds to Run = 0
Frame Rate = 120.000005
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
nvbuf_utils: dmabuf_fd -1 mapped entry NOT found
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadExecute:694 NvBufSurfaceFromFd Failed.
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadFunction:247 (propagating)
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = false
Got EOS from element “pipeline0”.
Execution ended after 0:01:01.015023278
Setting pipeline to PAUSED …
Setting pipeline to READY …
GST_ARGUS: Cleaning up
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
GST_ARGUS: Done Success
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
Setting pipeline to NULL …
Freeing pipeline …
(Argus) Error Timeout: (propagating from src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 137)
(Argus) Error Timeout: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91)
(Argus) Error InvalidState: Argus client is exiting with 5 outstanding client threads (in src/rpc/socket/client/ClientSocketManager.cpp, function recvThreadCore(), line 355)

nvidia@nvidia-desktop:~$ sudo enableCamInfiniteTimeout=1 nvargus-daemon
=== NVIDIA Libargus Camera Service (0.98.3)=== Listening for connections…=== gst-launch-1.0[2527]: Connection established (FFFF80B02900)OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module0
OFParserListModules: module list: /proc/device-tree/tegra-camera-platform/modules/module1
OFParserGetVirtualDevice: NVIDIA Camera virtual enumerator not found in proc device-tree
---- imager: No override file found. ----
(NvCamV4l2) Error ModuleNotPresent: V4L2Device not available (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function findDevice(), line 256)
(NvCamV4l2) Error ModuleNotPresent: (propagating from /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function initialize(), line 60)
(NvOdmDevice) Error ModuleNotPresent: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function initialize(), line 107)
NvPclDriverInitializeData: Unable to initialize driver v4l2_sensor
NvPclInitializeDrivers: error: Failed to init camera sub module v4l2_sensor
NvPclStartPlatformDrivers: Failed to start module drivers
NvPclDriver_V4L2_Focuser_Stub_Close: Invalid NULL input pPclDriver
NvPclStateControllerOpen: Failed ImagerGUID 1. (error 0xA000E)
NvPclOpen: PCL Open Failed. Error: 0xf
SCF: Error BadParameter: Sensor could not be opened. (in src/services/capture/CaptureServiceDeviceSensor.cpp, function getSourceFromGuid(), line 646)
SCF: Error BadParameter: (propagating from src/services/capture/CaptureService.cpp, function addSourceByGuid(), line 437)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function addSourceByIndex(), line 311)
SCF: Error BadParameter: (propagating from src/api/CameraDriver.cpp, function getSource(), line 477)
Acquiring SCF Camera device source via index 0 has failed. ---- imager: No override file found. ----
=== gst-launch-1.0[2527]: CameraProvider initialized (0xffff7c67c9e0)SCF: Error BadValue: NvPHSSendThroughputHints (in src/common/CameraPowerHint.cpp, function sendCameraPowerHint(), line 56)
(NvCamV4l2) Error IoctlFailed: (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function streamControl(), line 1661)
(NvOdmDevice) Error IoctlFailed: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 206)
(NvCamV4l2) Error IoctlFailed: (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function streamControl(), line 1661)
(NvOdmDevice) Error IoctlFailed: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 206)
(NvCamV4l2) Error IoctlFailed: (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function streamControl(), line 1661)
(NvOdmDevice) Error IoctlFailed: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 206)
(NvCamV4l2) Error IoctlFailed: (in /dvs/git/dirty/git-master_linux/camera/utils/nvcamv4l2/v4l2_device.cpp, function streamControl(), line 1661)
(NvOdmDevice) Error IoctlFailed: (propagating from dvs/git/dirty/git-master_linux/camera-partner/imager/src/devices/V4L2SensorViCsi.cpp, function apply(), line 206)
SCF: Error InvalidState: Timeout waiting on frame start sensor guid 0, capture sequence ID = 0 (in src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameStart(), line 507)
SCF: Error InvalidState: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error InvalidState: Worker thread ViCsiHw frameStart failed (in src/common/Utils.cpp, function workerThread(), line 133)
SCF: Error Timeout: (propagating from src/services/capture/FusaCaptureViCsiHw.cpp, function waitCsiFrameEnd(), line 593)
SCF: Error Timeout: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error Timeout: Worker thread ViCsiHw frameComplete failed (in src/common/Utils.cpp, function workerThread(), line 133)
SCF: Error InvalidState: 2 buffers still pending during EGLStreamProducer destruction (propagating from src/services/gl/EGLStreamProducer.cpp, function freeBuffers(), line 302)
SCF: Error InvalidState: (propagating from src/services/gl/EGLStreamProducer.cpp, function ~EGLStreamProducer(), line 50)

v4l2-ctl test:

nvidia@nvidia-desktop:~$ sudo v4l2-ctl -d /dev/video0 --set-fmt-video=width=1280,height=720,pixelformat=RG10 --set-ctrl bypass_mode=0 --set-ctrl sensor_modes=4 --stream-mmap --stream-count=600
VIDIOC_S_EXT_CTRLS: failed: Permission denied
Error setting controls: Permission denied
VIDIOC_S_FMT: failed: Connection timed out
VIDIOC_STREAMON returned -1 (Connection timed out)

Kernel error into Dmesg:

[نوف25 13:49] tegra-i2c 3180000.i2c: I2C transfer timed out
[ +0.000610] imx219 10-0010: imx219_write_reg: i2c write failed, 0x160 = 6
[ +0.000166] imx219 10-0010: ctrl Frame Rate range update failed
[ +0.000130] imx219 10-0010: Error updating control ranges -110
[ +0.111104] tegra-i2c 3180000.i2c: I2C transfer timed out
[ +0.000534] regmap_util_write_table_8:regmap_util_write_table:-110
[ +0.000011] imx219 10-0010: Error writing mode
[ +0.000315] ------------[ cut here ]------------
[ +0.000019] WARNING: CPU: 0 PID: 28261 at drivers/media/common/videobuf2/videobuf2-core.c:1548 vb2_start_streaming+0xe4/0x160
[ +0.000220] Modules linked in: fuse(E) lzo_rle(E) lzo_compress(E) zram(E) realtek(E) loop(E) snd_soc_tegra186_asrc(E) snd_soc_tegra186_dspk(E) snd_soc_tegra210_ope(E) snd_soc_tegra186_arad(E) snd_soc_tegra210_mvc(E) snd_soc_tegra2>
[ +0.000266] binfmt_misc(E) ina3221(E) pwm_fan(E) nvgpu(E) nvmap(E) ip_tables(E) x_tables(E)
[ +0.000046] CPU: 0 PID: 28261 Comm: v4l2-ctl Tainted: G W OE 5.10.104-tegra #9
[ +0.000006] Hardware name: Unknown NVIDIA Jetson Xavier NX Developer Kit/NVIDIA Jetson Xavier NX Developer Kit, BIOS 1.0-d7fb19b 08/10/2022
[ +0.000010] pstate: 60400009 (nZCv daif +PAN -UAO -TCO BTYPE=–)
[ +0.000009] pc : vb2_start_streaming+0xe4/0x160
[ +0.000009] lr : vb2_start_streaming+0x74/0x160
[ +0.000005] sp : ffff80002f98bb10
[ +0.000005] x29: ffff80002f98bb10 x28: ffff2f447e8b6700
[ +0.000014] x27: 0000000040045612 x26: 0000000000000000
[ +0.000014] x25: ffff80002f98bd08 x24: ffff2f46d603a1f8
[ +0.000013] x23: ffff2f43fed0e580 x22: ffff80002f98bd08
[ +0.000013] x21: ffff2f46d603a850 x20: ffff2f46d603a678
[ +0.000013] x19: 00000000ffffff92 x18: 0000000000000010
[ +0.000013] x17: 0000000000000000 x16: ffffccd103080eac
[ +0.000012] x15: ffff2f43fed0eaf0 x14: ffffffffffffffff
[ +0.000013] x13: ffff8000af98b5a7 x12: ffff80002f98b5af
[ +0.000013] x11: 0000000000000005 x10: 0101010101010101
[ +0.000013] x9 : 00000000fffffffe x8 : 203a303130302d30
[ +0.000013] x7 : 3120393132786d69 x6 : c0000000ffffefff
[ +0.000012] x5 : 0000000000000002 x4 : 0000000000000002
[ +0.000013] x3 : 0000000000000000 x2 : ffffccd10320e090
[ +0.000013] x1 : 0000000000000000 x0 : 0000000000000004
[ +0.000034] Call trace:
[ +0.000009] vb2_start_streaming+0xe4/0x160
[ +0.000009] vb2_core_streamon+0x9c/0x1a0
[ +0.000007] vb2_streamon+0x34/0x80
[ +0.000007] vb2_ioctl_streamon+0x58/0x70
[ +0.000009] v4l_streamon+0x40/0x50
[ +0.000030] __video_do_ioctl+0x188/0x400
[ +0.000009] video_usercopy+0x280/0x790
[ +0.000008] video_ioctl2+0x40/0x180
[ +0.000007] v4l2_ioctl+0x68/0x90
[ +0.000010] __arm64_sys_ioctl+0xac/0xf0
[ +0.000032] el0_svc_common.constprop.0+0x80/0x1d0
[ +0.000008] do_el0_svc+0x38/0xb0
[ +0.000010] el0_svc+0x1c/0x30
[ +0.000008] el0_sync_handler+0xa8/0xb0
[ +0.000008] el0_sync+0x16c/0x180
[ +0.000007] —[ end trace fdc8de7a4c7166ef ]—

dmesg_hyai.log (132.9 KB)
devicetree_hayi.dts (259.8 KB)

Gorgo90 · November 25, 2022, 10:41am

UPDATE.
I installed CUDA (no idea if it’s related) and I run the same command:

gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! ‘video/x-raw(memory:NVMM),width=1280, height=720, framerate=120/1, format=NV12’ ! nvvidconv ! ‘video/x-raw(memory:NVMM),format=I420’ ! fpsdisplaysink text-overlay=0 video-sink=fakesink sync=0 -v
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = false
Setting pipeline to PLAYING …
New clock: GstSystemClock
/GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=(fraction)120/1, format=(string)I420
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)120/1
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3280 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3280 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 4
Output Stream W = 1280 H = 720
seconds to Run = 0
Frame Rate = 120.000005
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = false
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 45, dropped: 0, current: 89.88, average: 89.88
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 91, dropped: 0, current: 91.94, average: 90.91
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 137, dropped: 0, current: 91.88, average: 91.23
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 185, dropped: 0, current: 94.48, average: 92.05
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 233, dropped: 0, current: 94.62, average: 92.57
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 281, dropped: 0, current: 95.80, average: 93.11
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 329, dropped: 0, current: 95.08, average: 93.39
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0: last-message = rendered: 376, dropped: 0, current: 93.25, average: 93.37

No kernels error in the dmesg.