Kernel panic when camera streaming restarts

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

Hi,

we are having a kernel panic issue when restarting camera streamings, the uart log is as following:

[orin1 2023-11-03 22:16:19.265620]: [10032.537089] ------------[ cut here ]------------
[orin1 2023-11-03 22:16:19.281574]: [10032.541904] WARNING: CPU: 2 PID: 672758 at /home/ck/prj_democar_rc352_dailybuild/prj_democar_rc352/orin/al/kernel/nvidia/drivers/platform/tegra/rtcpu/capture-ivc.c:176 tegra_capture_ivc_notify_chan_id+0x18c/0x1b0
[orin1 2023-11-03 22:16:19.282063]: [10032.561462] ---[ end trace 30c8413fe23dec59 ]---
[orin1 2023-11-03 22:16:19.297219]: [10032.566247] tegra194-vi5 13e40000.host1x:vi0@15c00000: failed to update control callback
[orin1 2023-11-03 22:16:19.297492]: [10032.574637] tegra194-vi5 13e40000.host1x:vi0@15c00000: vi capture setup failed
[orin1 2023-11-03 22:16:19.441488]: [10032.588592] bwmgr API not supported
[orin1 2023-11-03 22:16:20.321130]: [10032.737656] bwmgr API not supported
[orin1 2023-11-03 22:16:20.337179]: [10033.600895] tegra194-vi5 13e40000.host1x:vi0@15c00000: capture control message timed out
[orin1 2023-11-03 22:16:21.345308]: [10034.624862] tegra194-vi5 13e40000.host1x:vi0@15c00000: capture control message timed out
[orin1 2023-11-03 22:16:21.361462]: [10034.633257] tegra194-vi5 13e40000.host1x:vi0@15c00000: csi_stream_release: failed to disable nvcsi tpg on stream 0 virtual channel 1
[orin1 2023-11-03 22:16:21.505382]: [10034.776714] bwmgr API not supported
[orin1 2023-11-03 22:16:21.633258]: [10034.780447] bwmgr API not supported
[orin1 2023-11-03 22:16:22.369309]: [10035.041808] bwmgr API not supported
[orin1 2023-11-03 22:16:22.385351]: [10035.652855] tegra194-vi5 13e40000.host1x:vi0@15c00000: capture control message timed out
[orin1 2023-11-03 22:16:22.401141]: [10035.664843] tegra194-vi5 13e40000.host1x:vi0@15c00000: vi_capture_release: release channel IVC failed
[orin1 2023-11-03 22:16:22.417296]: [10035.674377] WARNING: CPU: 2 PID: 672758 at /home/ck/prj_democar_rc352_dailybuild/prj_democar_rc352/orin/al/kernel/nvidia/drivers/media/platform/tegra/camera/fusa-capture/capture-vi.c:971 vi_capture_release+0x2b4/0x2e0
[orin1 2023-11-03 22:16:22.417490]: [10035.694368] ---[ end trace 30c8413fe23dec5a ]---
[orin1 2023-11-03 22:16:22.417647]: [ 10144.960842] Camera-FW on t234-rce-safe started
[orin1 2023-11-03 22:16:22.433152]: TCU early console enabled.
[orin1 2023-11-03 22:16:22.449278]: [10035.709245] WARNING: CPU: 4 PID: 673695 at /home/ck/prj_democar_rc352_dailybuild/prj_democar_rc352/orin/al/kernel/nvidia/drivers/platform/tegra/rtcpu/capture-ivc.c:42 tegra_capture_ivc_tx+0x120/0x150
[orin1 2023-11-03 22:16:22.449469]: [10035.727638] ---[ end trace 30c8413fe23dec5b ]---
[orin1 2023-11-03 22:16:22.465123]: [10035.732566] tegra194-vi5 13e40000.host1x:vi0@15c00000: IVC capture submit failed
[orin1 2023-11-03 22:16:22.465410]: [10035.740325] tegra194-vi5 13e40000.host1x:vi0@15c00000: vi capture request submit failed
[orin1 2023-11-03 22:16:22.481009]: [ 10145.007784] Camera-FW on t234-rce-safe ready SHA1=10150ec0 (crt 0.611 ms, total boot 47.595 ms)
[orin1 2023-11-03 22:16:22.481157]: [10035.747910] ------------[ cut here ]------------
[orin1 2023-11-03 22:16:22.497255]: [10035.753353] WARNING: CPU: 2 PID: 672758 at /home/ck/prj_democar_rc352_dailybuild/prj_democar_rc352/orin/al/kernel/nvidia/drivers/platform/tegra/rtcpu/capture-ivc.c:306 tegra_capture_ivc_unregister_capture_cb+0xa4/0xd0
[orin1 2023-11-03 22:16:22.513147]: [10035.773297] ---[ end trace 30c8413fe23dec5c ]---
[orin1 2023-11-03 22:16:22.513385]: [10035.778058] ------------[ cut here ]------------
[orin1 2023-11-03 22:16:22.529244]: [10035.782825] WARNING: CPU: 2 PID: 672758 at /home/ck/prj_democar_rc352_dailybuild/prj_democar_rc352/orin/al/kernel/nvidia/drivers/platform/tegra/rtcpu/capture-ivc.c:262 tegra_capture_ivc_unregister_control_cb+0x120/0x140
[orin1 2023-11-03 22:16:22.529445]: [10035.802915] ---[ end trace 30c8413fe23dec5d ]---
[orin1 2023-11-03 22:16:22.545470]: [10035.807678] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000000
[orin1 2023-11-03 22:16:22.545666]: [10035.816714] Mem abort info:
[orin1 2023-11-03 22:16:22.545791]: [10035.819588]   ESR = 0x96000005
[orin1 2023-11-03 22:16:22.561080]: [10035.822732]   EC = 0x25: DABT (current EL), IL = 32 bits
[orin1 2023-11-03 22:16:22.561246]: [10035.828201]   SET = 0, FnV = 0
[orin1 2023-11-03 22:16:22.561365]: [10035.831335]   EA = 0, S1PTW = 0
[orin1 2023-11-03 22:16:22.561459]: [10035.834564] Data abort info:
[orin1 2023-11-03 22:16:22.561581]: [10035.837516]   ISV = 0, ISS = 0x00000005
[orin1 2023-11-03 22:16:22.577218]: [10035.841459]   CM = 0, WnR = 0
[orin1 2023-11-03 22:16:22.577669]: [10035.844509] user pgtable: 4k pages, 48-bit VAs, pgdp=00000006be8b8000
[orin1 2023-11-03 22:16:22.593139]: [10035.851127] [0000000000000000] pgd=0000000130528003, p4d=0000000130528003, pud=0000000000000000
[orin1 2023-11-03 22:16:22.593457]: [10035.860095] Internal error: Oops: 96000005 [#1] PREEMPT SMP
[orin1 2023-11-03 22:16:22.673618]: [10035.865818] Modules linked in: macvlan(E) nv_isx031(E) hx_fsync(E) nvidia_modeset(OE) fuse(E) hx_ar0820(E) max96712(E) mttcan(E) can_dev(E) lzo_rle(E) can_raw(E) lzo_compress(E) can(E) zram(E) ramoops(E) reed_solomon(E) loop(E) nvgpu(E) aes_ce_blk(E) crypto_simd(E) cryptd(E) aes_ce_cipher(E) ghash_ce(E) snd_soc_tegra186_asrc(E) sha2_ce(E) snd_soc_tegra210_ope(E) snd_soc_tegra186_dspk(E) snd_soc_tegra210_iqc(E) snd_soc_tegra186_arad(E) snd_soc_tegra210_admaif(E) snd_soc_tegra210_mvc(E) sha256_arm64(E) snd_soc_tegra210_afc(E) snd_hda_codec_hdmi(E) snd_soc_tegra210_adsp(E) snd_soc_tegra210_dmic(E) ucsi_ccg(E) snd_soc_tegra210_adx(E) snd_soc_tegra210_mixer(E) snd_soc_tegra_machine_driver(E) sha1_ce(E) snd_soc_tegra_pcm(E) snd_soc_tegra210_amx(E) snd_soc_tegra210_i2s(E) snd_soc_tegra210_sfc(E) snd_hda_tegra(E) typec_ucsi(E) snd_soc_tegra_utils(E) snd_hda_codec(E) nvadsp(E) typec(E) snd_soc_simple_card_utils(E) snd_soc_rt5640(E) snd_soc_spdif_tx(E) pwm_fan(E) ina3221(E) nct1008(E)
[orin1 2023-11-03 22:16:22.705297]: [10035.865861]  snd_hda_core(E) tegra_bpmp_thermal(E) snd_soc_tegra210_ahub(E) tegra210_adma(E) snd_soc_rl6231(E) userspace_alert(E) nvidia(OE) spi_tegra114(E) binfmt_misc(E) nvmap(E) ip_tables(E) x_tables(E) [last unloaded: mtd]
[orin1 2023-11-03 22:16:22.705771]: [10035.976892] CPU: 2 PID: 672758 Comm: camera_kit Tainted: G        W  OE     5.10.104-tegra #1
[orin1 2023-11-03 22:16:22.721293]: [10035.985660] Hardware name: Unknown Jetson AGX Orin/Jetson AGX Orin, BIOS 2.1-32413640 01/24/2023
[orin1 2023-11-03 22:16:22.721500]: [10035.994693] pstate: 60400009 (nZCv daif +PAN -UAO -TCO BTYPE=--)
[orin1 2023-11-03 22:16:22.721641]: [10036.000867] pc : vi_capture_request_unpin+0x44/0xd0
[orin1 2023-11-03 22:16:22.737295]: [10036.005879] lr : vi_capture_request_unpin+0x34/0xd0
[orin1 2023-11-03 22:16:22.737451]: [10036.010887] sp : ffff80001480bcb0
[orin1 2023-11-03 22:16:22.737630]: [10036.014294] x29: ffff80001480bcb0 x28: ffff0ea0e84bd700 
[orin1 2023-11-03 22:16:22.753236]: [10036.019762] x27: 0000000000000000 x26: 0000000000000000 
[orin1 2023-11-03 22:16:22.753442]: [10036.025222] x25: 0000000000000000 x24: 0000000000000000 
[orin1 2023-11-03 22:16:22.753604]: [10036.030679] x23: ffff0e9f80135060 x22: ffff0e9fad150688 
[orin1 2023-11-03 22:16:22.769161]: [10036.036142] x21: ffff0e9fad150400 x20: 0000000000000000 
[orin1 2023-11-03 22:16:22.769382]: [10036.041599] x19: 0000000000000000 x18: 0000000000000000 
[orin1 2023-11-03 22:16:22.769559]: [10036.047051] x17: 0000000000000000 x16: ffffc080b0ca3210 
[orin1 2023-11-03 22:16:22.785096]: [10036.052502] x15: ffff0ea0e84bdc70 x14: ffffffffffffffff 
[orin1 2023-11-03 22:16:22.785401]: [10036.057964] x13: ffffc080b2c99de8 x12: ffffc080b2c99a18 
[orin1 2023-11-03 22:16:22.785653]: [10036.063416] x11: 0000000000000040 x10: 0000000000000000 
[orin1 2023-11-03 22:16:22.801174]: [10036.068880] x9 : ffff80001480bb40 x8 : 6c64692073692031 
[orin1 2023-11-03 22:16:22.801365]: [10036.074347] x7 : 206c656e6e616863 x6 : c0000000ffffefff 
[orin1 2023-11-03 22:16:22.801513]: [10036.079807] x5 : ffff0ea6aebad958 x4 : ffffc080b2997968 
[orin1 2023-11-03 22:16:22.817115]: [10036.085271] x3 : 0000000000000000 x2 : ffff0ea0e84bd700 
[orin1 2023-11-03 22:16:22.817300]: [10036.090723] x1 : 0000000000000000 x0 : 0000000000000000 
[orin1 2023-11-03 22:16:22.817369]: [10036.096180] Call trace:
[orin1 2023-11-03 22:16:22.817505]: [10036.098686]  vi_capture_request_unpin+0x44/0xd0
[orin1 2023-11-03 22:16:22.833120]: [10036.103341]  vi_capture_shutdown+0x8c/0x100
[orin1 2023-11-03 22:16:22.833254]: [10036.107636]  vi_channel_close_ex+0x30/0x90
[orin1 2023-11-03 22:16:22.833348]: [10036.111841]  vi_channel_release+0x30/0x40
[orin1 2023-11-03 22:16:22.833419]: [10036.115963]  __fput+0x80/0x240
[orin1 2023-11-03 22:16:22.849181]: [10036.119092]  ____fput+0x24/0x30
[orin1 2023-11-03 22:16:22.849338]: [10036.122306]  task_work_run+0x88/0x140
[orin1 2023-11-03 22:16:22.849469]: [10036.126064]  do_notify_resume+0x23c/0xa00
[orin1 2023-11-03 22:16:22.849582]: [10036.130186]  work_pending+0xc/0x384
[orin1 2023-11-03 22:16:22.865283]: [10036.133776] Code: 52801901 f94156a0 9ba17e61 8b010014 (b8616800) 
[orin1 2023-11-03 22:16:22.865654]: [10036.140034] ---[ end trace 30c8413fe23dec5e ]---
[orin1 2023-11-03 22:16:22.881328]: [10036.149824] Kernel panic - not syncing: Oops: Fatal exception
[orin1 2023-11-03 22:16:22.881989]: [10036.155725] SMP: stopping secondary CPUs
[orin1 2023-11-03 22:16:22.882316]: [10036.159768] Kernel Offset: 0x4080a0c80000 from 0xffff800010000000
[orin1 2023-11-03 22:16:22.897467]: [10036.166019] PHYS_OFFSET: 0xfffff16180000000
[orin1 2023-11-03 22:16:22.898648]: [10036.170313] CPU features: 0x0040006,4a80aa38
[orin1 2023-11-03 22:16:22.899360]: [10036.174706] Memory Limit: none
[orin1 2023-11-03 22:16:22.914950]: [10036.182858] ---[ end Kernel panic - not syncing: Oops: Fatal exception ]---

Our use-case is running multiple cameras streaming using libargus on Jetson Orin. As we are facing another issue that streaming would occasionally stop due to error events (see Argus Streaming STATUS_CANCELLED), we have to abort the current streaming process and restart it. This kernel panic issue happens with a low probability when we do streaming restart.

Note that this issue is found both on JetPack 5.1.0 and JetPack5.1.2

3

hello Krisss,

could you please based-on the latest release, i.e. Jetpack-5.1.2/ l4t-r35.4.1
and… please apply the bug fixes from below threads for verification.
for example,
Topic 268833, for camera firmware to update deskew algorithm, and also stability fixes,
Topic 268519, to fix memory corruption within libnvargus

may I know the failure rate?
this kernel panic looks like a NULL pointer dereference. is it due to multi-cam race condition?
please try referring to Topic 258971, and apply the fix for capture-ivc.c .

4

Hi Jerry,

Failure rate is around 1/20.

Our use-case is indeed multi-camera streaming

This patch seems working and we see no kernel panic until now (60 times of streaming restart). We need to do more testing to confirm this.

Besides could you elaborate the root cause of the issue and the meaning of this fix?

5

that’s adding semaphore lock to avoid race condition (to update callback) for multi-cam scenario.

6

Hi Jerry,

kernel panic issue didn’t happen in the last few days, but we still see some vi capture setup errors occasionally

11月 09 22:27:13.430288 orin-2 kernel: ar0820 7-0018: ar0820_stop_streaming: err=-121, frame cnt=0x0
11月 09 22:27:13.454288 orin-2 kernel: bwmgr API not supported
11月 09 22:27:13.454418 orin-2 kernel: ar0820 1-0013: ar0820_stop_streaming: err=0, video_link=0x62
11月 09 22:27:13.478284 orin-2 kernel: ar0820 1-0013: ar0820_stop_streaming: err=-121, frame cnt=0x0
11月 09 22:27:13.478644 orin-2 kernel: bwmgr API not supported
11月 09 22:27:13.478666 orin-2 kernel: ar0820 7-0017: ar0820_stop_streaming: err=0, video_link=0x62
11月 09 22:27:13.502457 orin-2 kernel: ar0820 7-0017: ar0820_stop_streaming: err=-121, frame cnt=0x0
11月 09 22:27:13.514289 orin-2 kernel: bwmgr API not supported
11月 09 22:27:13.514402 orin-2 kernel: ar0820 7-0016: ar0820_stop_streaming: err=0, video_link=0x62
11月 09 22:27:13.534285 orin-2 kernel: ar0820 7-0016: ar0820_stop_streaming: err=-121, frame cnt=0x0
11月 09 22:27:13.546287 orin-2 kernel: bwmgr API not supported
11月 09 22:27:13.546416 orin-2 kernel: ar0820 1-0012: ar0820_stop_streaming: err=0, video_link=0x62
11月 09 22:27:13.566287 orin-2 kernel: ar0820 1-0012: ar0820_stop_streaming: err=-121, frame cnt=0x0
11月 09 22:27:13.578288 orin-2 kernel: bwmgr API not supported
11月 09 22:27:13.578426 orin-2 kernel: ar0820 7-0015: ar0820_stop_streaming: err=0, video_link=0x62
11月 09 22:27:13.598302 orin-2 kernel: ar0820 7-0015: ar0820_stop_streaming: err=-121, frame cnt=0x0
11月 09 22:27:13.618283 orin-2 kernel: bwmgr API not supported
11月 09 22:27:13.618403 orin-2 kernel: ar0820 1-0011: ar0820_stop_streaming: err=0, video_link=0x62
11月 09 22:27:13.638287 orin-2 kernel: ar0820 1-0011: ar0820_stop_streaming: err=-121, frame cnt=0x0
11月 09 22:27:28.386294 orin-2 kernel: bwmgr API not supported
11月 09 22:27:28.506287 orin-2 kernel: bwmgr API not supported
11月 09 22:27:28.506420 orin-2 kernel: ar0820 1-0011: ar0820_start_streaming: err=0, video_link=0x62
11月 09 22:27:28.526293 orin-2 kernel: ar0820 1-0011: ar0820_start_streaming: err=-121, frame cnt=0x0
11月 09 22:27:28.616628 orin-2 kernel: bwmgr API not supported
11月 09 22:27:28.616753 orin-2 kernel: tegra194-vi5 13e40000.host1x:vi1@14c00000: vi_capture_setup: control failed, errno 7
11月 09 22:27:28.617043 orin-2 kernel: tegra194-vi5 13e40000.host1x:vi1@14c00000: vi capture setup failed
11月 09 22:27:28.658370 orin-2 kernel: bwmgr API not supported
11月 09 22:27:28.658498 orin-2 kernel: ------------[ cut here ]------------
11月 09 22:27:28.658522 orin-2 kernel: Invalid rtcpu response id 65535
11月 09 22:27:28.658541 orin-2 kernel: WARNING: CPU: 0 PID: 780705 at /media/whn/ssd/orin/orin/al/kernel/nvidia/drivers/platform/tegra/rtcpu/capture-ivc.c:360 tegra_capture_ivc_worker+0xd8/0xf0
11月 09 22:27:28.658556 orin-2 kernel: Modules linked in: macvlan(E) fuse(E) nvidia_modeset(OE) lzo_rle(E) lzo_compress(E) zram(E) nv_isx031(E) hx_fsync(E) hx_ar0820(E) max96712(E) ath11k_pci(E) ath11k(E) mac80211(E) cfg80211(E) qrtr_mhi(E) qrtr(E) qmi_helpers(E) ns(E) mhi(E) rtase(E) mttcan(E) can_dev(E) ramoops(E) reed_solomon(E) loop(E) nvgpu(E) aes_ce_blk(E) crypto_simd(E) cryptd(E) aes_ce_cipher(E) snd_soc_tegra186_asrc(E) ghash_ce(E) snd_soc_tegra210_ope(E) snd_soc_tegra186_dspk(E) snd_soc_tegra210_admaif(E) snd_soc_tegra186_arad(E) snd_soc_tegra210_iqc(E) snd_soc_tegra210_mvc(E) sha2_ce(E) snd_hda_codec_hdmi(E) snd_soc_tegra210_afc(E) snd_soc_tegra210_dmic(E) ucsi_ccg(E) snd_soc_tegra210_adsp(E) snd_soc_tegra210_adx(E) snd_soc_tegra_pcm(E) snd_soc_tegra210_mixer(E) snd_soc_tegra_machine_driver(E) snd_soc_tegra210_amx(E) snd_soc_tegra210_i2s(E) snd_soc_tegra210_sfc(E) sha256_arm64(E) typec_ucsi(E) snd_hda_tegra(E) snd_soc_tegra_utils(E) sha1_ce(E) nvadsp(E) typec(E) snd_hda_codec(E)
11月 09 22:27:28.658603 orin-2 kernel:  snd_soc_simple_card_utils(E) pwm_fan(E) snd_soc_spdif_tx(E) nct1008(E) ina3221(E) snd_soc_rt5640(E) snd_hda_core(E) snd_soc_tegra210_ahub(E) userspace_alert(E) tegra_bpmp_thermal(E) tegra210_adma(E) snd_soc_rl6231(E) nvidia(OE) binfmt_misc(E) nvmap(E) ip_tables(E) x_tables(E) [last unloaded: mtd]
11月 09 22:27:28.658622 orin-2 kernel: CPU: 0 PID: 780705 Comm: kworker/0:2 Tainted: G        W  OE     5.10.104-tegra #20
11月 09 22:27:28.658636 orin-2 kernel: Hardware name: Unknown Jetson AGX Orin/Jetson AGX Orin, BIOS 2.1-32413640 01/24/2023
11月 09 22:27:28.658648 orin-2 kernel: Workqueue: events tegra_capture_ivc_worker
11月 09 22:27:28.658660 orin-2 kernel: pstate: 60c00009 (nZCv daif +PAN +UAO -TCO BTYPE=--)
11月 09 22:27:28.658672 orin-2 kernel: pc : tegra_capture_ivc_worker+0xd8/0xf0
11月 09 22:27:28.658688 orin-2 kernel: lr : tegra_capture_ivc_worker+0xd8/0xf0
11月 09 22:27:28.658702 orin-2 kernel: sp : ffff800045113d60
11月 09 22:27:28.658717 orin-2 kernel: x29: ffff800045113d60 x28: ffffbcbcefc26000 
11月 09 22:27:28.658730 orin-2 kernel: x27: ffff2c426eb72770 x26: ffff2c426eb72720 
11月 09 22:27:28.658743 orin-2 kernel: x25: 0000000000000000 x24: ffff2c3b413680d0 
11月 09 22:27:28.658756 orin-2 kernel: x23: 0000000000000038 x22: ffffbcbcef6f7e28 
11月 09 22:27:28.658774 orin-2 kernel: x21: ffff2c3b41607840 x20: ffff2c3b41607800 
11月 09 22:27:28.658795 orin-2 kernel: x19: ffff2c3b41368080 x18: 0000000000000000 
11月 09 22:27:28.658810 orin-2 kernel: x17: 0000000000000000 x16: 0000000000000000 
11月 09 22:27:28.658822 orin-2 kernel: x15: ffff2c3b4f138570 x14: ffffffffffffffff 
11月 09 22:27:28.658835 orin-2 kernel: x13: ffffbcbceff49de8 x12: ffffbcbceff49a22 
11月 09 22:27:28.658848 orin-2 kernel: x11: 0000000000000000 x10: 0000000000000a80 
11月 09 22:27:28.658860 orin-2 kernel: x9 : ffff800045113d60 x8 : 692065736e6f7073 
11月 09 22:27:28.658872 orin-2 kernel: x7 : 6572207570637472 x6 : c0000000ffffefff 
11月 09 22:27:28.658885 orin-2 kernel: x5 : ffff2c426eb60958 x4 : ffffbcbcefc47968 
11月 09 22:27:28.658898 orin-2 kernel: x3 : 0000000000000001 x2 : ffff2c426eb60960 
11月 09 22:27:28.658923 orin-2 kernel: x1 : 0000000000000000 x0 : 0000000000000000 
11月 09 22:27:28.658938 orin-2 kernel: Call trace:
11月 09 22:27:28.658952 orin-2 kernel:  tegra_capture_ivc_worker+0xd8/0xf0
11月 09 22:27:28.658971 orin-2 kernel:  process_one_work+0x1c4/0x4a0
11月 09 22:27:28.658983 orin-2 kernel:  worker_thread+0x54/0x430
11月 09 22:27:28.658995 orin-2 kernel:  kthread+0x148/0x170
11月 09 22:27:28.659007 orin-2 kernel:  ret_from_fork+0x10/0x24
11月 09 22:27:28.659021 orin-2 kernel: ---[ end trace a16bd119d9d4d498 ]---
11月 09 22:27:28.746281 orin-2 kernel: ar0820 1-0012: ar0820_start_streaming: err=0, video_link=0x62
11月 09 22:27:28.766303 orin-2 kernel: ar0820 1-0012: ar0820_start_streaming: err=-121, frame cnt=0x0
11月 09 22:27:28.843236 orin-2 kernel: bwmgr API not supported
11月 09 22:27:28.962288 orin-2 kernel: bwmgr API not supported
11月 09 22:27:28.962424 orin-2 kernel: ar0820 1-0013: ar0820_start_streaming: err=0, video_link=0x62
11月 09 22:27:28.982309 orin-2 kernel: ar0820 1-0013: ar0820_start_streaming: err=-121, frame cnt=0x0
11月 09 22:27:29.154290 orin-2 kernel: bwmgr API not supported
11月 09 22:27:29.654512 orin-2 kernel: bwmgr API not supported
11月 09 22:27:29.654658 orin-2 kernel: tegra194-vi5 13e40000.host1x:vi1@14c00000: capture control message timed out
11月 09 22:27:29.654936 orin-2 kernel: tegra194-vi5 13e40000.host1x:vi1@14c00000: csi_stream_release: failed to disable nvcsi tpg on stream 2 virtual channel 0
11月 09 22:27:29.910289 orin-2 kernel: bwmgr API not supported
11月 09 22:27:29.910428 orin-2 kernel: ar0820 7-0016: ar0820_start_streaming: err=0, video_link=0x62
11月 09 22:27:29.934289 orin-2 kernel: ar0820 7-0016: ar0820_start_streaming: err=-121, frame cnt=0x0
11月 09 22:27:30.030287 orin-2 kernel: bwmgr API not supported
11月 09 22:27:30.150286 orin-2 kernel: bwmgr API not supported
11月 09 22:27:30.150422 orin-2 kernel: ar0820 7-0017: ar0820_start_streaming: err=0, video_link=0x62
11月 09 22:27:30.174369 orin-2 kernel: ar0820 7-0017: ar0820_start_streaming: err=-121, frame cnt=0x0
11月 09 22:27:30.238294 orin-2 kernel: bwmgr API not supported
11月 09 22:27:30.358286 orin-2 kernel: bwmgr API not supported
11月 09 22:27:30.358434 orin-2 kernel: ar0820 7-0018: ar0820_start_streaming: err=0, video_link=0x62
11月 09 22:27:30.378286 orin-2 kernel: ar0820 7-0018: ar0820_start_streaming: err=-121, frame cnt=0x0
11月 09 22:27:30.445149 orin-2 kernel: bwmgr API not supported
11月 09 22:27:30.445288 orin-2 kernel: bwmgr API not supported
11月 09 22:27:30.554292 orin-2 kernel: bwmgr API not supported

Note that this error only leads to streaming failure but not to kernel panic, can you help check this?

7

What do you see from:
zcat /proc/config.gz | grep -i 'bwmgr'

8 
$ zcat /proc/config.gz | grep -i 'bwmgr'
CONFIG_TEGRA_BWMGR=y
9

Because you have that kernel feature it implies any failure is from something outside of the kernel, e.g., maybe a missing library. It seems likely there is a user space software issue when it says “bwmgr API not supported”. Maybe something as simple as an API version. For example, NFS has both a v3 and a v4 version…I don’t know what bwmgr actually requires, but I’d start by looking that up. Or perhaps it is just a bad error message, and something bwmgr needs is missing, and it is just bwmgr which is reporting the issue without saying what is really missing.

10

hello Krisss,

let me double confirm all the patch files you’ve applied.
did you based-on r35.4.1 to include those three updates as mentioned within comment #3?

what’s the scenario, or camera use-case you’ve running to reproduce these failure?
it looks like some errors for setting up capture request. can it restore by terminate the capture application and restart again?

that’s Bandwidth Manager, you may ignore these messages as bwmgr has disabled for Orin series.

12

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.