Autoexposure is very slow and coarse time changes randomly

Hi all,

As mentionned in this topic Can't find a suitable value of pixel clk and serdes pixel clk - #3 by ShaneCCC, I ported a GMSL2 MIPI CSI2 Image sensor driver from JetPack 4.x to JetPack 5.x

I am using the setup below

  • Jetson AGX Xavier
  • 4 GMSL2 Cameras AR0820 Image sensor with MAX9295 Serializer
  • MAX9296 Deserializer
  • LI TCA954x Mux

The autoexposure of the image sensor is very slow, and the coarse time is changing its value randomly as shown in the video below

There is the function set_exposure of the sensor, is this latter seems correct ?

static int ar0820_set_exposure(struct tegracam_device *tc_dev, s64 val)
{
	struct ar0820 *priv = (struct ar0820 *)tegracam_get_privdata(tc_dev);
	struct camera_common_data *s_data = tc_dev->s_data;
	const struct sensor_mode_properties *mode =
	    &s_data->sensor_props.sensor_modes[s_data->mode];
	ar0820_reg reg_list[1];
	int err;
	u32 coarse_time;
	int i = 0;

	if (priv->frame_length == 0) {
		priv->frame_length = AR0820_DEFAULT_FRAME_LENGTH / 8;
	}

	coarse_time =
	    mode->signal_properties.pixel_clock.val * val /
	    mode->control_properties.framerate_factor /
	    mode->image_properties.line_length;

	if (coarse_time > priv->frame_length) {
		coarse_time = priv->frame_length;
	}

	if (coarse_time < 4) {
		coarse_time = 4;
	}

	ar0820_get_coarse_time_regs_shs1(reg_list, coarse_time);
	for (i = 0; i < 1; i++) {
		err = ar0820_write_reg(priv->s_data, reg_list[i].addr,
				       reg_list[i].val);
		if (err) {
			goto fail;
		}
	}

	return 0;

fail:
	dev_dbg(&priv->i2c_client->dev,
		"%s: set coarse time error\n", __func__);
	return err;
}

I printed the value of val and the coarse time and i’m having the following output when streaming

I tried to set several values of image sensor and serdes pixel clocks but it didn’t solve the issue
Can you please tell why it has this behavior ?

It looks like AE hutting. Suppose it cause by the sensor gain/exposure doesn’t linearity.

Try to fix gain by gainrange like below. Also can try fix exposure by exposuretimerange

gst-launch-1.0 nvarguscamerasrc gainrange=“8 8” …

Hi @ShaneCCC

Thank you for your support, i will try using the argument in nvarguscamerasrc, can you please tell if this gain can be set in the device tree or in the driver ?
And also is this behavior related to JetPack 5 ? Because i am not having this issue using JetPack 4

Thanks

Yes, you can modify the device tree to report the gain/exposure in some range to narrow down the issue too.

It doesn’t matter with JetPack 5.

But it works with JetPack 4.x, and i kept the same code for JetPack 5.x but i have this issue, so i guess it can be related to this latter ? @ShaneCCC

I would suggest using J5.x driver as template to rebuild the driver again.

@ShaneCCC

Thats why i did i used imx390 and a0334 templates to build my driver and it works fine, there is only an issue with autoexposure part

Could you check the badge info strings in tegra-camera-platform{} to check if duplicate with any reference sensor cause applied incorrect ISP file.

@ShaneCCC you can have look on the tegra-camera-platform node, the badge is correctly set for each sensor

	tegra-camera-platform {
		status = "okay";
		compatible = "nvidia, tegra-camera-platform";

		num_csi_lanes = <4>;
		max_lane_speed = <4000000>;
		min_bits_per_pixel = <12>;
		vi_peak_byte_per_pixel = <2>;
		vi_bw_margin_pct = <25>;
		max_pixel_rate = <750000>;
		isp_peak_byte_per_pixel = <5>;
		isp_bw_margin_pct = <25>;

		modules {
			module0 {
				status = "okay";
				badge = "ar0820_bottomleft";
				position = "bottomleft";
				orientation = "1";
				drivernode0 {
					/* Declare PCL support driver (classically known as guid)  */
					pcl_id = "v4l2_sensor";
					/* Driver v4l2 device name */
					devname = "ar0820 30-0010";
					/* Declare the device-tree hierarchy to driver instance */
					proc-device-tree = "/proc/device-tree/i2c@3180000/tca9546@70/i2c@0/ar0820_a@10";
				};
			};

			module1 {
				status = "okay";
				badge = "ar0820_bottomright";
				position = "bottomright";
				orientation = "1";
				drivernode0 {
					/* Declare PCL support driver (classically known as guid)  */
					pcl_id = "v4l2_sensor";
					/* Driver v4l2 device name */
					devname = "ar0820 31-0010";
					/* Declare the device-tree hierarchy to driver instance */
					proc-device-tree = "/proc/device-tree/i2c@3180000/tca9546@70/i2c@1/ar0820_c@10";
				};
			};
			module2 {
				status = "okay";
				badge = "ar0820_topleft";
				position = "topleft";
				orientation = "1";
				drivernode0 {
					/* Declare PCL support driver (classically known as guid)  */
					pcl_id = "v4l2_sensor";
					/* Driver v4l2 device name */
					devname = "ar0820 32-0010";
					/* Declare the device-tree hierarchy to driver instance */
					proc-device-tree = "/proc/device-tree/i2c@3180000/tca9546@70/i2c@2/ar0820_e@10";
				};
			};
			module3 {
				status = "okay";
				badge = "ar0820_topright";
				position = "topright";
				orientation = "1";
				drivernode0 {
					/* Declare PCL support driver (classically known as guid)  */
					pcl_id = "v4l2_sensor";
					/* Driver v4l2 device name */
					devname = "ar0820 33-0010";
					/* Declare the device-tree hierarchy to driver instance */
					proc-device-tree = "/proc/device-tree/i2c@3180000/tca9546@70/i2c@3/ar0820_g@10";
				};
			};
		};
	};



Suppose couldn’t be the incorrect ISP cause it.
Please set the gainrane/exposuretimerange to narrow down the problem.

Hi @ShaneCCC

It seems setting the gainrange to 8 8 solved the issue, the exposure is more stable, can you please tell if setting the gain in the DT as below is correct and if this are the only changes to make it correspond to the gainrange = “8 8” in the gst-launch command

mode0
{
                    ...

					gain_factor = "1";
					min_gain_val = "8"; // Updated
					max_gain_val = "8"; // Updated
					step_gain_val = "1";
					default_gain = "8"; // Updated
					min_hdr_ratio = "1";
					max_hdr_ratio = "1";
					framerate_factor = "1000000";
					min_framerate = "30000000";
					max_framerate = "30000000";
					step_framerate = "1";
					default_framerate ="30000000";
					exposure_factor ="1000000";
					min_exp_time = "15";
					max_exp_time = "33333";
					step_exp_time = "1";
					default_exp_time = "33333";
};

Thanks

You don’t need to modify the device tree just set the gainrane in gstreamer command. Now you can try “1-8” or “8-6”

Indeed, i already tried the command, and it worked, what i meant in my last answer if by setting the gain value in the Device tree as i did is the correct way.
The purpose of doing this is to use directly LibArgus and not using gstreamer

Thanks

Don’t undrestand what your mean. Both Argus and gstreamer able to set the gainrange.

Hi @ShaneCCC

The exposure is not sparkling when the gain_max and gain_min are the same, but if i set different values for this latter for example gain_range=“15 8”, it keeps sparkling.
Also the autoexposure is still slow, when the lens pass from dark to bright environnement, do you have any other suggestion for debugging autoexposure and also how to make it fast.

Does the serdes_pix_clk_hz related to this ? In fact that it has been changed from 833333333 hz to 416666666 due the jetpack 5.x calib deskew

Thanks

I don’t think the serdes_pix_clk_hz/pix_clk_hz relative to this issue.
Could you try fixed the exposure to check the gain control of sensor driver.

Could you try fixed the exposure to check the gain control of sensor driver. Do you mean by this setting the exposure time wtih constant and same values for min and max exp ?

					min_exp_time = "15";
					max_exp_time = "15";

Maybe try 16666.
BTW, did you try gainrange = “1 8” ?

Additional note if it can help… You may also try locking isp digital gain eg “4 4” and disable wb.

@Honey_Patouceul Thank you for suggestion, it really helped by setting the isp digital gain to “4 4” the autoexposure is faste, but there is still flickering behavior…

@Honey_Patouceul @ShaneCCC can you please where i can change the isp digital gain directly in the device tree ?

Can you please also tell how to disable WB ?

Can you check the logs below from capture trace

     kworker/2:1-5026    [002] ....  7346.320957: rtcpu_vinotify_event: tstamp:230275820537 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368815508128 data:0x00000000020231f4
     kworker/2:1-5026    [002] ....  7346.320958: rtcpu_vinotify_event: tstamp:230275820669 cch:1 vi:0 tag:FE channel:0x00 frame:0 vi_tstamp:7368815504064 data:0x0000000000000020
     kworker/2:1-5026    [002] ....  7346.320959: rtcpu_vinotify_event: tstamp:230275820825 cch:1 vi:0 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:7368815504064 data:0x0000000800000000
     kworker/2:1-5026    [002] ....  7346.320959: rtcpu_vinotify_event: tstamp:230275820953 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368815515008 data:0x00000000000231f4
     kworker/2:1-5026    [002] ....  7346.320960: rtcpu_vinotify_event: tstamp:230275821101 cch:1 vi:0 tag:FS channel:0x00 frame:0 vi_tstamp:7368817996320 data:0x0000000000000010
     kworker/2:1-5026    [002] ....  7346.320960: rtcpu_vinotify_event: tstamp:230275821232 cch:1 vi:0 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:7368817996320 data:0x0000000800000000
     kworker/2:1-5026    [002] ....  7346.320961: rtcpu_vinotify_event: tstamp:230275821381 cch:1 vi:0 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:7368818009376 data:0x0000000000000001
     kworker/2:1-5026    [002] ....  7346.320962: rtcpu_vinotify_event: tstamp:230275821508 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368818010944 data:0x00000000080231f5
     kworker/2:1-5026    [002] ....  7346.320962: rtcpu_vinotify_event: tstamp:230275821656 cch:1 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:7368818076128 data:0x379d550010000000
     kworker/2:1-5026    [002] ....  7346.320963: rtcpu_vinotify_event: tstamp:230275821784 cch:1 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:7368818082688 data:0x00000000310031f6
     kworker/2:1-5026    [002] ....  7346.320964: rtcpu_vinotify_event: tstamp:230275821935 cch:1 vi:0 tag:ATOMP_FRAME_NLINES_DONE channel:0x23 frame:0 vi_tstamp:7368825225472 data:0x0000000000000000
     kworker/2:1-5026    [002] ....  7346.320964: rtcpu_vinotify_event: tstamp:230275822063 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368825226912 data:0x00000000020231f5
     kworker/2:1-5026    [002] ....  7346.320965: rtcpu_isp_falcon_task_start: tstamp:2642416520 ch:0 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320966: rtcpu_isp_falcon_task_end: tstamp:2642416552 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320966: rtcpu_vinotify_event: tstamp:230276159983 cch:1 vi:0 tag:ATOMP_FRAME_NLINES_DONE channel:0x23 frame:0 vi_tstamp:7368832444992 data:0x0000000000000000
     kworker/2:1-5026    [002] ....  7346.320967: rtcpu_vinotify_event: tstamp:230276160116 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368832446496 data:0x00000000020231f5
     kworker/2:1-5026    [002] ....  7346.320968: rtcpu_vinotify_event: tstamp:230276240118 cch:1 vi:0 tag:ATOMP_FRAME_NLINES_DONE channel:0x23 frame:0 vi_tstamp:7368839664800 data:0x0000000000000000
     kworker/2:1-5026    [002] ....  7346.320968: rtcpu_vinotify_event: tstamp:230276240246 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368839666240 data:0x00000000020231f5
     kworker/2:1-5026    [002] ....  7346.320969: rtcpu_vinotify_event: tstamp:230276567350 cch:1 vi:0 tag:ATOMP_FRAME_NLINES_DONE channel:0x23 frame:0 vi_tstamp:7368846884608 data:0x0000000000000000
     kworker/2:1-5026    [002] ....  7346.320970: rtcpu_vinotify_event: tstamp:230276567481 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368846886048 data:0x00000000020231f5
     kworker/2:1-5026    [002] ....  7346.320971: rtcpu_vinotify_event: tstamp:230276567631 cch:1 vi:0 tag:CHANSEL_PXL_EOF channel:0x23 frame:0 vi_tstamp:7368848816928 data:0x0000000008770002
     kworker/2:1-5026    [002] ....  7346.320972: rtcpu_vinotify_event: tstamp:230276567758 cch:1 vi:0 tag:ATOMP_FRAME_DONE channel:0x23 frame:0 vi_tstamp:7368848817504 data:0x0000000000000000
     kworker/2:1-5026    [002] ....  7346.320973: rtcpu_vinotify_event: tstamp:230276567905 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368848820416 data:0x00000000020231f5
     kworker/2:1-5026    [002] ....  7346.320974: rtcpu_vinotify_event: tstamp:230276568033 cch:1 vi:0 tag:FE channel:0x00 frame:0 vi_tstamp:7368848817504 data:0x0000000000000020
     kworker/2:1-5026    [002] ....  7346.320974: rtcpu_vinotify_event: tstamp:230276568182 cch:1 vi:0 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:7368848817536 data:0x0000000800000000
     kworker/2:1-5026    [002] ....  7346.320975: rtcpu_vinotify_event: tstamp:230276568309 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368848826656 data:0x00000000000231f5
     kworker/2:1-5026    [002] ....  7346.320976: rtcpu_isp_falcon_task_start: tstamp:2643319643 ch:0 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320976: rtcpu_isp_falcon_task_end: tstamp:2643319658 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320977: rtcpu_isp_falcon_task_start: tstamp:2643319677 ch:0 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320977: rtcpu_isp_falcon_task_end: tstamp:2643319690 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320978: rtcpu_isp_falcon_task_start: tstamp:2643319708 ch:0 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320979: rtcpu_isp_falcon_task_end: tstamp:2643319721 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320979: rtcpu_isp_falcon_task_start: tstamp:2643319739 ch:0 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320980: rtcpu_isp_falcon_task_end: tstamp:2643319766 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.320981: rtcpu_isp_falcon: tag:0xa tstamp:2643319883 ch:0 seq:0 data:0x10000000 ext_data:0x3627f000
     kworker/2:1-5026    [002] ....  7346.320981: rtcpu_isp_falcon: tag:0xa tstamp:2643320039 ch:0 seq:243 data:0x210031f3 ext_data:0x36286c80
     kworker/2:1-5026    [002] ....  7346.320982: rtcpu_isp_falcon: tag:0xa tstamp:2643320218 ch:0 seq:243 data:0x320031f3 ext_data:0x00000000
     kworker/2:1-5026    [002] ....  7346.320983: rtcpu_isp_falcon_tile_start: tstamp:2643320366 ch:0 seq:243 tile_x:0 tile_y:0 tile_w:958 tile_h:510
     kworker/2:1-5026    [002] ....  7346.320983: rtcpu_isp_falcon_tile_end: tstamp:2643328522 ch:0 seq:243 tile_x:0 tile_y:0
     kworker/2:1-5026    [002] ....  7346.320984: rtcpu_isp_falcon_task_start: tstamp:2643328536 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320985: rtcpu_isp_falcon_tile_start: tstamp:2643328691 ch:0 seq:243 tile_x:1 tile_y:0 tile_w:960 tile_h:510
     kworker/2:1-5026    [002] ....  7346.320986: rtcpu_isp_falcon_task_end: tstamp:2643328741 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320986: rtcpu_isp_falcon_tile_end: tstamp:2643336844 ch:0 seq:243 tile_x:1 tile_y:0
     kworker/2:1-5026    [002] ....  7346.320987: rtcpu_isp_falcon_task_start: tstamp:2643336858 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320988: rtcpu_isp_falcon_tile_start: tstamp:2643336937 ch:0 seq:243 tile_x:2 tile_y:0 tile_w:960 tile_h:510
     kworker/2:1-5026    [002] ....  7346.320988: rtcpu_isp_falcon_task_end: tstamp:2643336951 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320989: rtcpu_isp_falcon_tile_end: tstamp:2643345091 ch:0 seq:243 tile_x:2 tile_y:0
     kworker/2:1-5026    [002] ....  7346.320990: rtcpu_isp_falcon_task_start: tstamp:2643345107 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320990: rtcpu_isp_falcon_tile_start: tstamp:2643345187 ch:0 seq:243 tile_x:3 tile_y:0 tile_w:970 tile_h:510
     kworker/2:1-5026    [002] ....  7346.320991: rtcpu_isp_falcon_task_end: tstamp:2643345200 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320992: rtcpu_isp_falcon_tile_end: tstamp:2643353297 ch:0 seq:243 tile_x:3 tile_y:0
     kworker/2:1-5026    [002] ....  7346.320992: rtcpu_isp_falcon_task_start: tstamp:2643353312 ch:0 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.320993: rtcpu_isp_falcon_tile_start: tstamp:2643353504 ch:0 seq:243 tile_x:0 tile_y:1 tile_w:958 tile_h:510
     kworker/2:1-5026    [002] ....  7346.320994: rtcpu_isp_falcon_task_end: tstamp:2643353517 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.320994: rtcpu_isp_falcon_tile_end: tstamp:2643361782 ch:0 seq:243 tile_x:0 tile_y:1
     kworker/2:1-5026    [002] ....  7346.320995: rtcpu_isp_falcon_task_start: tstamp:2643361798 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320996: rtcpu_isp_falcon_tile_start: tstamp:2643361960 ch:0 seq:243 tile_x:1 tile_y:1 tile_w:960 tile_h:510
     kworker/2:1-5026    [002] ....  7346.320996: rtcpu_isp_falcon_task_end: tstamp:2643362010 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320997: rtcpu_isp_falcon_tile_end: tstamp:2643370369 ch:0 seq:243 tile_x:1 tile_y:1
     kworker/2:1-5026    [002] ....  7346.320998: rtcpu_isp_falcon_task_start: tstamp:2643370384 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.320998: rtcpu_isp_falcon_tile_start: tstamp:2643370471 ch:0 seq:243 tile_x:2 tile_y:1 tile_w:960 tile_h:510
     kworker/2:1-5026    [002] ....  7346.320999: rtcpu_isp_falcon_task_end: tstamp:2643370484 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321000: rtcpu_isp_falcon_tile_end: tstamp:2643378881 ch:0 seq:243 tile_x:2 tile_y:1
     kworker/2:1-5026    [002] ....  7346.321000: rtcpu_isp_falcon_task_start: tstamp:2643378896 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321001: rtcpu_isp_falcon_tile_start: tstamp:2643378984 ch:0 seq:243 tile_x:3 tile_y:1 tile_w:970 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321001: rtcpu_isp_falcon_task_end: tstamp:2643378998 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321002: rtcpu_isp_falcon_tile_end: tstamp:2643387350 ch:0 seq:243 tile_x:3 tile_y:1
     kworker/2:1-5026    [002] ....  7346.321003: rtcpu_isp_falcon_task_start: tstamp:2643387365 ch:0 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.321003: rtcpu_isp_falcon_tile_start: tstamp:2643387556 ch:0 seq:243 tile_x:0 tile_y:2 tile_w:958 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321004: rtcpu_isp_falcon_task_end: tstamp:2643387569 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.321005: rtcpu_isp_falcon_tile_end: tstamp:2643395841 ch:0 seq:243 tile_x:0 tile_y:2
     kworker/2:1-5026    [002] ....  7346.321005: rtcpu_isp_falcon_task_start: tstamp:2643395856 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321006: rtcpu_isp_falcon_tile_start: tstamp:2643396018 ch:0 seq:243 tile_x:1 tile_y:2 tile_w:960 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321007: rtcpu_isp_falcon_task_end: tstamp:2643396068 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321007: rtcpu_isp_falcon_task_start: tstamp:2643396876 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321008: rtcpu_isp_falcon_task_end: tstamp:2643397009 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321009: rtcpu_isp_falcon_tile_end: tstamp:2643404426 ch:0 seq:243 tile_x:1 tile_y:2
     kworker/2:1-5026    [002] ....  7346.321009: rtcpu_isp_falcon_task_start: tstamp:2643404441 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321010: rtcpu_isp_falcon_tile_start: tstamp:2643404528 ch:0 seq:243 tile_x:2 tile_y:2 tile_w:960 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321010: rtcpu_isp_falcon_task_end: tstamp:2643404541 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321011: rtcpu_isp_falcon_task_start: tstamp:2643405809 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321012: rtcpu_isp_falcon_task_end: tstamp:2643405942 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321012: rtcpu_isp_falcon_tile_end: tstamp:2643412939 ch:0 seq:243 tile_x:2 tile_y:2
     kworker/2:1-5026    [002] ....  7346.321013: rtcpu_isp_falcon_task_start: tstamp:2643412954 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321014: rtcpu_isp_falcon_tile_start: tstamp:2643413041 ch:0 seq:243 tile_x:3 tile_y:2 tile_w:970 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321014: rtcpu_isp_falcon_task_end: tstamp:2643413055 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321015: rtcpu_isp_falcon_task_start: tstamp:2643413885 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321016: rtcpu_isp_falcon_task_end: tstamp:2643414019 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321016: rtcpu_isp_falcon_task_start: tstamp:2643414313 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321017: rtcpu_isp_falcon_task_end: tstamp:2643414447 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321018: rtcpu_isp_falcon_tile_end: tstamp:2643421402 ch:0 seq:243 tile_x:3 tile_y:2
     kworker/2:1-5026    [002] ....  7346.321018: rtcpu_isp_falcon_task_start: tstamp:2643421417 ch:0 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.321019: rtcpu_isp_falcon_tile_start: tstamp:2643421608 ch:0 seq:243 tile_x:0 tile_y:3 tile_w:958 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321019: rtcpu_isp_falcon_task_end: tstamp:2643421622 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.321020: rtcpu_isp_falcon_tile_end: tstamp:2643429881 ch:0 seq:243 tile_x:0 tile_y:3
     kworker/2:1-5026    [002] ....  7346.321021: rtcpu_isp_falcon_task_start: tstamp:2643429897 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321021: rtcpu_isp_falcon_tile_start: tstamp:2643429984 ch:0 seq:243 tile_x:1 tile_y:3 tile_w:960 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321022: rtcpu_isp_falcon_task_end: tstamp:2643429997 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321023: rtcpu_isp_falcon_tile_end: tstamp:2643438391 ch:0 seq:243 tile_x:1 tile_y:3
     kworker/2:1-5026    [002] ....  7346.321023: rtcpu_isp_falcon_task_start: tstamp:2643438406 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321024: rtcpu_isp_falcon_tile_start: tstamp:2643438493 ch:0 seq:243 tile_x:2 tile_y:3 tile_w:960 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321025: rtcpu_isp_falcon_task_end: tstamp:2643438506 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321025: rtcpu_isp_falcon_tile_end: tstamp:2643446904 ch:0 seq:243 tile_x:2 tile_y:3
     kworker/2:1-5026    [002] ....  7346.321026: rtcpu_isp_falcon_task_start: tstamp:2643446918 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321027: rtcpu_isp_falcon_tile_start: tstamp:2643447081 ch:0 seq:243 tile_x:3 tile_y:3 tile_w:970 tile_h:510
     kworker/2:1-5026    [002] ....  7346.321027: rtcpu_isp_falcon_task_end: tstamp:2643447131 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321028: rtcpu_isp_falcon_tile_end: tstamp:2643455447 ch:0 seq:243 tile_x:3 tile_y:3
     kworker/2:1-5026    [002] ....  7346.321028: rtcpu_isp_falcon_task_start: tstamp:2643455463 ch:0 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.321029: rtcpu_isp_falcon_tile_start: tstamp:2643455632 ch:0 seq:243 tile_x:0 tile_y:4 tile_w:958 tile_h:128
     kworker/2:1-5026    [002] ....  7346.321029: rtcpu_isp_falcon_task_end: tstamp:2643455646 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.321030: rtcpu_isp_falcon_tile_end: tstamp:2643458099 ch:0 seq:243 tile_x:0 tile_y:4
     kworker/2:1-5026    [002] ....  7346.321030: rtcpu_isp_falcon_task_start: tstamp:2643458114 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321031: rtcpu_isp_falcon_tile_start: tstamp:2643458195 ch:0 seq:243 tile_x:1 tile_y:4 tile_w:960 tile_h:128
     kworker/2:1-5026    [002] ....  7346.321031: rtcpu_isp_falcon_task_end: tstamp:2643458208 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321032: rtcpu_isp_falcon_task_start: tstamp:2643459603 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321032: rtcpu_isp_falcon_task_end: tstamp:2643459737 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321032: rtcpu_isp_falcon_tile_end: tstamp:2643460716 ch:0 seq:243 tile_x:1 tile_y:4
     kworker/2:1-5026    [002] ....  7346.321033: rtcpu_isp_falcon_task_start: tstamp:2643460732 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321033: rtcpu_isp_falcon_tile_start: tstamp:2643460813 ch:0 seq:243 tile_x:2 tile_y:4 tile_w:960 tile_h:128
     kworker/2:1-5026    [002] ....  7346.321033: rtcpu_isp_falcon_task_end: tstamp:2643460826 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321034: rtcpu_isp_falcon_task_start: tstamp:2643462645 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321034: rtcpu_isp_falcon_task_end: tstamp:2643462779 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321035: rtcpu_isp_falcon_tile_end: tstamp:2643463319 ch:0 seq:243 tile_x:2 tile_y:4
     kworker/2:1-5026    [002] ....  7346.321035: rtcpu_isp_falcon_task_start: tstamp:2643463334 ch:0 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321036: rtcpu_isp_falcon_tile_start: tstamp:2643463416 ch:0 seq:243 tile_x:3 tile_y:4 tile_w:970 tile_h:128
     kworker/2:1-5026    [002] ....  7346.321036: rtcpu_isp_falcon_task_end: tstamp:2643463429 task:SCHED_FINISH_TILE
     kworker/2:1-5026    [002] ....  7346.321036: rtcpu_isp_falcon_task_start: tstamp:2643464637 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321037: rtcpu_isp_falcon_task_end: tstamp:2643464771 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321037: rtcpu_isp_falcon_task_start: tstamp:2643464809 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321037: rtcpu_isp_falcon_task_end: tstamp:2643464942 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321038: rtcpu_isp_falcon_task_start: tstamp:2643465238 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321038: rtcpu_isp_falcon_task_end: tstamp:2643465371 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321039: rtcpu_isp_falcon_task_start: tstamp:2643465550 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321039: rtcpu_isp_falcon_task_end: tstamp:2643465692 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321040: rtcpu_isp_falcon_task_start: tstamp:2643465716 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321040: rtcpu_isp_falcon_task_end: tstamp:2643465849 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321040: rtcpu_vinotify_event: tstamp:230276829944 cch:1 vi:0 tag:FS channel:0x00 frame:0 vi_tstamp:7368851309760 data:0x0000000000000010
     kworker/2:1-5026    [002] ....  7346.321041: rtcpu_vinotify_event: tstamp:230276830083 cch:1 vi:0 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:7368851309792 data:0x0000000800000000
     kworker/2:1-5026    [002] ....  7346.321041: rtcpu_vinotify_event: tstamp:230276830262 cch:1 vi:0 tag:CHANSEL_PXL_SOF channel:0x23 frame:0 vi_tstamp:7368851322880 data:0x0000000000000001
     kworker/2:1-5026    [002] ....  7346.321042: rtcpu_vinotify_event: tstamp:230276830411 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368851324416 data:0x00000000080231f6
     kworker/2:1-5026    [002] ....  7346.321042: rtcpu_vinotify_event: tstamp:230276830568 cch:1 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:7368851390144 data:0x379d580010000000
     kworker/2:1-5026    [002] ....  7346.321042: rtcpu_vinotify_event: tstamp:230276830698 cch:1 vi:0 tag:VIFALC_TDSTATE channel:0x23 frame:0 vi_tstamp:7368851396704 data:0x00000000310031f7
     kworker/2:1-5026    [002] ....  7346.321043: rtcpu_vinotify_event: tstamp:230276830847 cch:1 vi:0 tag:ATOMP_FRAME_NLINES_DONE channel:0x23 frame:0 vi_tstamp:7368858538976 data:0x0000000000000000
     kworker/2:1-5026    [002] ....  7346.321043: rtcpu_vinotify_event: tstamp:230276830975 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368858540416 data:0x00000000020231f6
     kworker/2:1-5026    [002] ....  7346.321043: rtcpu_isp_falcon_task_start: tstamp:2643465966 ch:0 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321044: rtcpu_isp_falcon_task_end: tstamp:2643466232 task:SCHED_HANDLE_STAT
     kworker/2:1-5026    [002] ....  7346.321044: rtcpu_isp_falcon_tile_end: tstamp:2643466379 ch:0 seq:243 tile_x:3 tile_y:4
     kworker/2:1-5026    [002] ....  7346.321044: rtcpu_isp_falcon_task_start: tstamp:2643466393 ch:0 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.321045: rtcpu_isp_falcon: tag:0x12 tstamp:2643466458 ch:0 seq:0 data:0x00000000 ext_data:0x00000000
     kworker/2:1-5026    [002] ....  7346.321045: rtcpu_isp_falcon_task_end: tstamp:2643466745 task:SCHED_FINISH_SLICE
     kworker/2:1-5026    [002] ....  7346.321046: rtcpu_isp_falcon_task_start: tstamp:2643466763 ch:0 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.321046: rtcpu_isp_falcon_task_end: tstamp:2643466795 task:HANDLE_EVENT
     kworker/2:1-5026    [002] ....  7346.321046: rtcpu_vinotify_event: tstamp:230277144331 cch:1 vi:0 tag:ATOMP_FRAME_NLINES_DONE channel:0x23 frame:0 vi_tstamp:7368865758464 data:0x0000000000000000
     kworker/2:1-5026    [002] ....  7346.321047: rtcpu_vinotify_event: tstamp:230277144462 cch:1 vi:0 tag:VIFALC_ACTIONLST channel:0x23 frame:0 vi_tstamp:7368865759904 data:0x00000000020231f6

Thanks