Random failed when triggering video capture

frank_cf_weng · July 27, 2023, 8:00am

Hi

I am porting AR0233 module to NV Xavier-Industrial.
After driver initializes the module and generates the device node (/dev/video0), I try to trigger a video capture using test-launch command and VLC utility.
Sometimes, the video can be displayed at the client side, but sometimes failed.

Below are the related log files I collected.
Please help to give me some ideas, thanks.

dmesg_camera_capture_random_failed.log (9.1 KB)
vi_log_capture_random_failed.log (1017 Bytes)

root@ubuntu:/home/wistron# echo 1 > /sys/kernel/debug/bpmp/debug/clk/vi/mrq_rate_locked
root@ubuntu:/home/wistron# echo 1 > /sys/kernel/debug/bpmp/debug/clk/isp/mrq_rate_locked
root@ubuntu:/home/wistron# echo 1 > /sys/kernel/debug/bpmp/debug/clk/nvcsi/mrq_rate_locked
root@ubuntu:/home/wistron# echo 1 > /sys/kernel/debug/bpmp/debug/clk/emc/mrq_rate_locked
root@ubuntu:/home/wistron# cat /sys/kernel/debug/bpmp/debug/clk/vi/max_rate |tee /sys/kernel/debug/bpmp/debug/clk/vi/rate
819200000
root@ubuntu:/home/wistron# cat /sys/kernel/debug/bpmp/debug/clk/isp/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/isp/rate
1011200000
root@ubuntu:/home/wistron# cat /sys/kernel/debug/bpmp/debug/clk/nvcsi/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/nvcsi/rate
400000000
root@ubuntu:/home/wistron# cat /sys/kernel/debug/bpmp/debug/clk/emc/max_rate | tee /sys/kernel/debug/bpmp/debug/clk/emc/rate
2133000000

ShaneCCC · July 27, 2023, 8:19am

Please confirm the gst-launch-1.0 command in local to confirm the camera working stability to narrow down the issue.

Thanks

frank_cf_weng · July 27, 2023, 12:01pm

@ShaneCCC

Can you suggest me the gst-launch commands for the validation?
There is no display output for camera preview, so I verify the camera capture by RTSP streaming.

ShaneCCC · July 27, 2023, 12:04pm

Have below command to check it.

export DISPLAY=:0
gst-launch-1.0 nvarguscamerasrc ! 'video/x-raw(memory:NVMM), width=1920,height=1080,format=NV12' ! nvvidconv ! fpsdisplaysink video-sink=fakesink --verbose

frank_cf_weng · July 27, 2023, 11:50pm

Hi @ShaneCCC

Below are the relative messages after execute the commands, and seems not work.

wistron@ubuntu:~$ gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM), width=1920,height=1080’ ! nvvidconv ! fpsdisplaysink video-sink=fakesink --verbose
No protocol specified
No protocol specified
No protocol specified
No protocol specified
nvbuf_utils: Could not get EGL display connection
No protocol specified
No protocol specified
No protocol specified
No protocol specified
nvbufsurftransform: Could not get EGL display connection
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
Setting pipeline to PLAYING …
New clock: GstSystemClock
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, execute:751 No cameras available
/GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstTextOverlay:fps-display-text-overlay.GstPad:src: caps = video/x-raw(memory:NVMM, meta:GstVideoOverlayComposition), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:NVMM, meta:GstVideoOverlayComposition), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstTextOverlay:fps-display-text-overlay.GstPad:video_sink: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/Gstnvvconv:nvvconv0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)NV12, framerate=(fraction)30/1
WARNING: from element /GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: Pipeline construction is invalid, please add queues.
Additional debug info:
gstbasesink.c(1209): gst_base_sink_query_latency (): /GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0:
Not enough buffering available for the processing deadline of 0:00:00.020000000, add enough queues to buffer 0:00:00.020000000 additional data. Shortening processing latency to 0:00:00.000000000.
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
Got EOS from element “pipeline0”.
Execution ended after 0:00:00.025954112
Setting pipeline to NULL …
Freeing pipeline …

And also, here is the vi debug log.

frank_cf_weng · July 28, 2023, 12:00am

Hi @ShaneCCC

I try another gst-launch command and the log is such like as below.

wistron@ubuntu:~$ gst-launch-1.0 v4l2src device=/dev/video0 ! ‘video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY’ ! autovideosink -e -v
Setting pipeline to PAUSED …
No protocol specified
No protocol specified
No protocol specified
No protocol specified
No protocol specified
No protocol specified
No protocol specified
Using winsys: x11
No protocol specified
No protocol specified
No protocol specified
No protocol specified
No protocol specified
Pipeline is live and does not need PREROLL …
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0: Could not initialise Xv output
Additional debug info:
xvimagesink.c(1773): gst_xv_image_sink_open (): /GstXvImageSink:autovideosink0-actual-sink-xvimage:
Could not open display (null)
Setting pipeline to PLAYING …
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstFakeSink:fake-video-sink.GstPad:sink: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive

And I can see something via vi debug.
vi-debug-20230728.log (33.7 KB)

And dmesg shows…

[ 1132.804096] ar0233 2-0047: Index = 0x0000 , format = 0x59565955, width = 640, height = 480, frate num = 60
[ 1134.010560] ar0233 2-0047: Index = 0x0000 , format = 0x59565955, width = 640, height = 480, frate num = 60
[ 1134.010574] ar0233 2-0047: Skipping Previous mode set …
[ 1134.104036] tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 0, flags: 0, err_data 131072
[ 1134.120992] tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 0, flags: 0, err_data 131072
[ 1134.137381] tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 0, flags: 0, err_data 131072
[ 1134.154331] tegra-camrtc-capture-vi tegra-capture-vi: corr_err: discarding frame 0, flags: 0, err_data 131072

And here are other messages after I stop the gst-launch command.

[ 1493.120416] ar0233 2-0047: mcu_cam_stream_off 294 CAM Get CMD Stream off Success !!
[ 1493.120434] (NULL device ): vi_capture_control_message: NULL VI channel received
[ 1493.120660] t194-nvcsi 13e10000.host1x:nvcsi@15a00000: csi5_stream_close: Error in closing stream_id=2, csi_port=2
[ 1498.605406] CPU:0, Error: rce-noc@be00000, irq=21
[ 1498.605577] **************************************
[ 1498.605733] CPU:0, Error:rce-noc
[ 1498.605811] Error Logger : 0
[ 1498.605928] ErrLog0 : 0x80030000
[ 1498.606007] Transaction Type : RD - Read, Incrementing
[ 1498.606130] Error Code : SLV
[ 1498.606203] Error Source : Target
[ 1498.606283] Error Description : Target error detected by CBB slave
[ 1498.606448] AXI2APB_5 bridge error: RDFIFOF - Read Response FIFO Full interrupt
[ 1498.606605] Packet header Lock : 0
[ 1498.606683] Packet header Len1 : 3
[ 1498.606761] NOC protocol version : version >= 2.7
[ 1498.606865] ErrLog1 : 0x157600
[ 1498.606961] ErrLog2 : 0x0
[ 1498.607025] RouteId : 0x157600
[ 1498.607099] InitFlow : cpu_p_i/I/0
[ 1498.607209] Targflow : cbb_t/T/0
[ 1498.607288] TargSubRange : 27
[ 1498.607362] SeqId : 0
[ 1498.607428] ErrLog3 : 0x5c01814
[ 1498.607565] ErrLog4 : 0x0
[ 1498.607771] Address accessed : 0x15c01814
[ 1498.608079] ErrLog5 : 0x387e31
[ 1498.609374] [RCE] VM0 deactivating.VM0 activating.VM0 deactivating.VM0 activating.VM0 deactivating.** DATA ABORT EXCEPTION ***
[ 1498.609532] Master ID : RCE
[ 1498.609547] Security Group(GRPSEC): 0x3f
[ 1498.612697] [RCE] R0: 15c00000 R1: 00001814 R2: 00008010 R3: 0000000b
[ 1498.616883] Cache : 0x1 – Bufferable
[ 1498.616891] Protection : 0x1 – Privileged, Secure, Data Access
[ 1498.616897] FALCONSEC : 0x0
[ 1498.616902] Virtual Queuing Channel(VQC): 0x0
[ 1498.616927] **************************************
[ 1498.617043] CPU:0, Error: cbb-noc@2300000, irq=15
[ 1498.644798] **************************************
[ 1498.649526] CPU:0, Error:cbb-noc
[ 1498.653021] Error Logger : 0
[ 1498.656091] ErrLog0 : 0x80030000
[ 1498.659671] Transaction Type : RD - Read, Incrementing
[ 1498.664750] Error Code : SLV
[ 1498.668162] Error Source : Target
[ 1498.671838] Error Description : Target error detected by CBB slave
[ 1498.678405] Packet header Lock : 0
[ 1498.682071] Packet header Len1 : 3
[ 1498.685745] NOC protocol version : version >= 2.7
[ 1498.690476] ErrLog1 : 0x9528aa
[ 1498.694145] ErrLog2 : 0x0
[ 1498.696776] RouteId : 0x9528aa
[ 1498.700189] InitFlow : rce_p2ps/I/rce_p2ps
[ 1498.704821] Targflow : host1x_p2pm/T/host1x_p2pm
[ 1498.709479] TargSubRange : 20
[ 1498.713131] SeqId : 0
[ 1498.715588] ErrLog3 : 0x1814
[ 1498.718822] ErrLog4 : 0x0
[ 1498.721710] Address accessed : 0x15c01814
[ 1498.725677] ErrLog5 : 0x2af0fc71
[ 1498.729584] Non-Modify : 0x1
[ 1498.732996] AXI ID : 0x55
[ 1498.735712] Master ID : RCE
[ 1498.738863] Security Group(GRPSEC): 0x3f
[ 1498.743322] Cache : 0x1 – Bufferable
[ 1498.747177] Protection : 0x3 – Privileged, Non-Secure, Data Access
[ 1498.754002] FALCONSEC : 0x0
[ 1498.757151] Virtual Queuing Channel(VQC): 0x0
[ 1498.762047] **************************************
[ 1498.766966] Host read timeout at address 1814
[ 1498.841388] [RCE] R4: 0bcd0188 R5: 00000000 R6: 00000000 R7: 799ce800
[ 1498.897375] [RCE] R8: 0bcc27b0 R9: 0bcc27b2 R10: 0bcc27a8 R11: 002771e0
[ 1498.897389] [RCE] R12: 00060300 SP: 0bcc2768 LR: 0bcaaa2c PC: 0bcaaa48
[ 1498.897398] [RCE] SPSR: 6000011f
[ 1498.897407] [RCE] DFSR: 00001008 DFAR: 15c01814 ADFSR: 00500000
[ 1498.897443] [RCE] IFSR: 00000000 IFAR: 00000000 AIFSR: 00000000

ShaneCCC · July 28, 2023, 2:32am

Does it YUV sensor instead of Bayer format?
Try v4l2-ctl to like below.

v4l2-ctl --set-fmt-video=width=1920,height=1080 --set-ctrl bypass_mode=0 --stream-mmap

frank_cf_weng · July 28, 2023, 3:04am

Hi @ShaneCCC

After I execute your command, the terminal hang on and nothing happens.
I dump some information by v4l2-ctl.

wistron@ubuntu:~$ v4l2-ctl --list-devices
NVIDIA Tegra Video Input Device (platform:tegra-camrtc-ca):
/dev/media0

vi-output, ar0233 2-004d (platform:tegra-capture-vi:4):
/dev/video0

wistron@ubuntu:~$ v4l2-ctl --list-formats-ext --device /dev/video0
ioctl: VIDIOC_ENUM_FMT
Type: Video Capture

[0]: 'UYVY' (UYVY 4:2:2)
	Size: Discrete 640x480
		Interval: Discrete 0.017s (60.000 fps)
		Interval: Discrete 0.022s (45.000 fps)
	Size: Discrete 960x540
		Interval: Discrete 0.017s (58.000 fps)
		Interval: Discrete 0.033s (30.000 fps)
	Size: Discrete 1280x720
		Interval: Discrete 0.022s (45.000 fps)
	Size: Discrete 1920x1080
		Interval: Discrete 0.033s (30.000 fps)
[1]: 'NV16' (Y/CbCr 4:2:2)
	Size: Discrete 640x480
		Interval: Discrete 0.017s (60.000 fps)
		Interval: Discrete 0.022s (45.000 fps)
	Size: Discrete 960x540
		Interval: Discrete 0.017s (58.000 fps)
		Interval: Discrete 0.033s (30.000 fps)
	Size: Discrete 1280x720
		Interval: Discrete 0.022s (45.000 fps)
	Size: Discrete 1920x1080
		Interval: Discrete 0.033s (30.000 fps)

ShaneCCC · July 28, 2023, 3:17am

That tell the sensor HW or driver have problem to cause that.
Maybe get the trace log to check if more information.

echo 1 > /sys/kernel/debug/tracing/tracing_on
echo 30720 > /sys/kernel/debug/tracing/buffer_size_kb
echo 1 > /sys/kernel/debug/tracing/events/tegra_rtcpu/enable
echo 1 > /sys/kernel/debug/tracing/events/freertos/enable
echo 3 > /sys/kernel/debug/camrtc/log-level
echo 1 > /sys/kernel/debug/tracing/events/camera_common/enable
echo > /sys/kernel/debug/tracing/trace
cat /sys/kernel/debug/tracing/trace

run v4l2-ctl

cat /sys/kernel/debug/tracing/trace

frank_cf_weng · July 28, 2023, 3:24am

@ShaneCCC

Here is the log.
camera_debug_tracing_v4l2-ctl_20230728.log (31.3 MB)

frank_cf_weng · July 28, 2023, 3:27am

@ShaneCCC

I try to modify the resolution to 640x480, and it replies something.

wistron@ubuntu:~$ v4l2-ctl --set-fmt-video=width=640,height=480 --set-ctrl bypass_mode=0 --stream-mmap
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< 59.99 fps

ShaneCCC · July 28, 2023, 4:36am

How about below command.

gst-launch-1.0 v4l2src device=/dev/video0 ! ‘video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY’ ! fpsdisplaysink video-sink=fakesink -e -v

frank_cf_weng · July 28, 2023, 4:58am

@ShaneCCC

dmesg

[ 6734.549419] ar0233 2-004d: Index = 0x0000 , format = 0x59565955, width = 640, height = 480, frate num = 60
[ 6735.721464] ar0233 2-004d: Index = 0x0000 , format = 0x59565955, width = 640, height = 480, frate num = 60
[ 6735.721535] ar0233 2-004d: Skipping Previous mode set …
[ 6753.058449] ar0233 2-004d: mcu_cam_stream_off 294 CAM Get CMD Stream off Success !!
[ 6753.058510] (NULL device *): vi_capture_control_message: NULL VI channel received
[ 6753.058705] t194-nvcsi 13e10000.host1x:nvcsi@15a00000: csi5_stream_close: Error in closing stream_id=4, csi_port=4

command log
gst-launch-video0-fpsdisplaysink.log (13.1 KB)

tracing log
camera_debug_tracing_fpsdisplaysink0_20230728.log (2.1 MB)

ShaneCCC · July 28, 2023, 6:22am

Looks like working well.

frank_cf_weng · July 28, 2023, 6:55am

@ShaneCCC

I keep trying to trigger camera capture several times and sometimes it works NG.
Below is the records which I run the same command failed on another camera.

demsg

[ 242.247781] ar0233 2-0045: Index = 0x0000 , format = 0x59565955, width = 640, height = 480, frate num = 60
[ 242.247820] ar0233 2-0045: Skipping Previous mode set …
[ 242.350549] ar0233 2-0045: Index = 0x0000 , format = 0x59565955, width = 640, height = 480, frate num = 60
[ 242.350567] ar0233 2-0045: Skipping Previous mode set …
[ 242.455672] [RCE] VM0 deactivating.VM0 activating.ERROR: core/watchdog/heartbeat-task.c:195 [WatchdogCallbackTaskOutOfBounds] “task “cap-ctrl-ivc-0” has been detected as OOB - halting execution”
[ 242.502860] tegra186-cam-rtcpu bc00000.rtcpu: Alert: Camera RTCPU gone bad! restoring it immediately!!
[ 242.510079] [RCE] BUG: core/watchdog/heartbeat-task.c:162 [heartbeat_halt_execution] “*** RCE WATCHDOG FAILURE: HALTING ***”
[ 243.426091] tegra194-vi5 15c10000.vi: capture control message timed out
[ 243.426836] tegra-camrtc-capture-vi tegra-capture-vi: vi capture setup failed
[ 244.449975] tegra194-vi5 15c10000.vi: capture control message timed out
[ 244.450267] tegra194-vi5 15c10000.vi: csi_stream_release: failed to disable nvcsi tpg on stream 0 virtual channel 2

command log

wistron@ubuntu:~$ gst-launch-1.0 v4l2src device=/dev/video1 ! “video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY” ! fpsdisplaysink video-sink=fakesink -e -v
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0: sync = true
Setting pipeline to PLAYING …
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstTextOverlay:fps-display-text-overlay.GstPad:src: caps = video/x-raw(memory:SystemMemory, meta:GstVideoOverlayComposition), width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw(memory:SystemMemory, meta:GstVideoOverlayComposition), width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstTextOverlay:fps-display-text-overlay.GstPad:src: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstFakeSink:fakesink0.GstPad:sink: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0/GstTextOverlay:fps-display-text-overlay.GstPad:video_sink: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstFPSDisplaySink:fpsdisplaysink0.GstGhostPad:sink: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, width=(int)640, height=(int)480, format=(string)UYVY, framerate=(fraction)60/1, colorimetry=(string)2:4:7:1, interlace-mode=(string)progressive
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Failed to allocate required memory.
Additional debug info:
gstv4l2src.c(660): gst_v4l2src_decide_allocation (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
Buffer pool activation failed
EOS on shutdown enabled – waiting for EOS after Error
Waiting for EOS…
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data stream error.
Additional debug info:
gstbasesrc.c(3072): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming stopped, reason not-negotiated (-4)
^Chandling interrupt.
Interrupt: Stopping pipeline …
Interrupt while waiting for EOS - stopping pipeline…
Execution ended after 0:00:58.524652448
Setting pipeline to NULL …
Freeing pipeline …

tracing log
camera_capture_random_failed.log (2.3 MB)

ShaneCCC · July 28, 2023, 7:32am

From the behavior it could be sensor signal problem.
Maybe have some delay after sensor set mode or start streaming.

frank_cf_weng · July 28, 2023, 8:08am

@ShaneCCC

You mean to delay sensor to set mode or to start streaming from driver? or what?

ShaneCCC · July 28, 2023, 5:45pm

Yes, add delay in sensor driver.

system · August 22, 2023, 9:16am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.