AGX Orin: arm-smmu 8000000.iommu: Unhandled context fault

This fault has been observed when running wpa_supplicant on the stock WiFi interface. I don’t have a deterministic method of reproducing it, but had seen it multiple times:

[ 2274.897067] arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xffc02000, fsynr=0x260003, cbfrsynra=0xc05, cb=5
[ 2274.910346] mc-err: unknown mcerr fault, int_status=0x00000000, ch_int_status=0x00000000, hubc_int_status=0x00000000 sbs_int_status=0x00000000, hub_int_status=0x00000000

When it occurs, WiFi stops working. Restarting wpa_supplicant restores the connection.

Sorry for the late response, have you managed to get issue resolved or still need the support? Thanks

I would like to understand this issue - why I am seeing this message.
I don’t know if I can consider WiFi reliable.

Hi,
Do you observe the error prints with the WIFI module along with Orin developer kit? Or you see it with your own WIFI module?

Yes, this is the error from the stock WiFi module that came with Orin DevKit.

I’m seeing the same error on my Orin with stock wifi module. Any guidance?

Here is more bad stuff observed with the wifi. This happened when wpa_supplicant was switching from one AP to another.
This time however the wifi connectivity recovered

Jan 12 22:58:53 orin kernel: ------------[ cut here ]------------
Jan 12 22:58:53 orin kernel: WARNING: CPU: 0 PID: 0 at /dvs/git/dirty/git-master_linux/kernel/nvidia/drivers/net/wireless/realtek/rtl8822ce/hal/hal_com.c:2250 rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 12 22:58:53 orin kernel: Modules linked in: xt_mark uvcvideo videobuf2_vmalloc nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter ip6table_nat overlay lzo_rle lzo_compress zram loop ip6table_filter ip6_tables xt_state xt_conntrack iptable_filter xt_MASQUERADE iptable_nat nf_nat nf_conntrack snd_soc_tegra186_dspk nf_defrag_ipv6 snd_soc_tegra186_asrc snd_soc_tegra210_ope nf_defrag_ipv4 snd_soc_tegra210_mvc libcrc32c snd_soc_tegra186_arad snd_soc_tegra210_iqc snd_soc_tegra210_afc snd_soc_tegra210_admaif snd_soc_tegra210_dmic snd_soc_tegra210_adx snd_soc_tegra_pcm snd_soc_tegra210_amx snd_soc_tegra210_sfc snd_soc_tegra210_i2s snd_soc_tegra210_mixer aes_ce_blk crypto_simd cryptd aes_ce_cipher snd_soc_tegra210_adsp rtk_btusb ucsi_ccg ghash_ce snd_soc_tegra_machine_driver typec_ucsi btusb nv_ar0234(E) sha2_ce snd_soc_tegra_utils sha256_arm64 sha1_ce snd_soc_tegra210_ahub typec nvadsp snd_soc_simple_card_utils snd_soc_spdif_tx btrtl nct1008 rtl8822ce bmi088 btbcm tegra210_adma max96712(E) userspace_alert
Jan 12 22:58:53 orin kernel:  kfifo_buf tegra_bpmp_thermal btintel snd_hda_codec_hdmi ofpart cmdlinepart snd_hda_tegra snd_hda_codec qspi_mtd snd_hda_core cfg80211 mtd spi_tegra114 nvidia(O) ina3221 pwm_fan nvgpu nvmap mttcan can_dev can_raw can ramoops reed_solomon ip_tables x_tables
Jan 12 22:58:53 orin kernel: CPU: 0 PID: 0 Comm: swapper/0 Tainted: G        W  OE     5.10.104-tegra #1
Jan 12 22:58:53 orin kernel: Hardware name:  /, BIOS 1.0-d7fb19b 08/10/2022
Jan 12 22:58:53 orin kernel: pstate: 00400009 (nzcv daif +PAN -UAO -TCO BTYPE=--)
Jan 12 22:58:53 orin kernel: pc : rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 12 22:58:53 orin kernel: lr : rtw_hal_update_sta_mimo_type+0x40/0x17c [rtl8822ce]
Jan 12 22:58:53 orin kernel: sp : ffff8000100039f0
Jan 12 22:58:53 orin kernel: x29: ffff8000100039f0 x28: ffffacabddbb6000
Jan 12 22:58:53 orin kernel: x27: ffff8000115012e8 x26: ffff800018297890
Jan 12 22:58:53 orin kernel: x25: ffff8000115011f1 x24: ffff800018387970
Jan 12 22:58:53 orin kernel: x23: ffff8000115010a8 x22: ffff1f350f0910f1
Jan 12 22:58:53 orin kernel: x21: 0000000000000000 x20: ffff800011501000
Jan 12 22:58:53 orin kernel: x19: ffff800018297890 x18: 0000000000000000
Jan 12 22:58:53 orin kernel: x17: 0000000000000000 x16: ffffacabdbee0eac
Jan 12 22:58:53 orin kernel: x15: 0000000000000000 x14: 0000000000000000
Jan 12 22:58:53 orin kernel: x13: 0000000000000000 x12: 0000000000000000
Jan 12 22:58:53 orin kernel: x11: 0000000000000000 x10: 0000000000000000
Jan 12 22:58:53 orin kernel: x9 : 0000000000000000 x8 : 1100000000000000
Jan 12 22:58:53 orin kernel: x7 : 0000000000000000 x6 : ffff800018297c28
Jan 12 22:58:53 orin kernel: x5 : ffff8000116a1000 x4 : 00000000000000ff
Jan 12 22:58:53 orin kernel: x3 : 0000000000000000 x2 : 0000000000000000
Jan 12 22:58:53 orin kernel: x1 : 0000000000000000 x0 : 0000000000000000
Jan 12 22:58:53 orin kernel: Call trace:
Jan 12 22:58:53 orin kernel:  rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 12 22:58:53 orin kernel:  rtw_hal_update_sta_ra_info+0x2c/0x50 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  rtw_joinbss_event_prehandle+0x410/0x6ec [rtl8822ce]
Jan 12 22:58:53 orin kernel:  report_join_res+0xcc/0x128 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  OnAssocRsp+0x1a0/0x388 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  OnAtim+0x21c/0x260 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  mgt_dispatcher+0x238/0x2a4 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  validate_recv_mgnt_frame+0x444/0x518 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  validate_recv_frame+0x364/0x5a8 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  recv_func_prehandle+0x50/0x94 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  recv_func+0x4c/0x1c8 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  rtw_recv_entry+0x2c/0x68 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  pre_recv_entry+0x100/0x154 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  rtl8822ce_tx_isr+0x428/0x748 [rtl8822ce]
Jan 12 22:58:53 orin kernel:  tasklet_action_common.isra.0+0x15c/0x180
Jan 12 22:58:53 orin kernel:  tasklet_hi_action+0x30/0x40
Jan 12 22:58:53 orin kernel:  __do_softirq+0x140/0x3e8
Jan 12 22:58:53 orin kernel:  irq_exit+0xc0/0xe0
Jan 12 22:58:53 orin kernel:  __handle_domain_irq+0x74/0xd0
Jan 12 22:58:53 orin kernel:  gic_handle_irq+0x68/0x134
Jan 12 22:58:53 orin kernel:  el1_irq+0xd0/0x180
Jan 12 22:58:53 orin kernel:  cpuidle_enter_state+0xb8/0x410
Jan 12 22:58:53 orin kernel:  cpuidle_enter+0x40/0x60
Jan 12 22:58:53 orin kernel:  call_cpuidle+0x44/0x80
Jan 12 22:58:53 orin kernel:  do_idle+0x208/0x270
Jan 12 22:58:53 orin kernel:  cpu_startup_entry+0x2c/0x70
Jan 12 22:58:53 orin kernel:  rest_init+0xdc/0xe8
Jan 12 22:58:53 orin kernel:  arch_call_rest_init+0x18/0x20
Jan 12 22:58:53 orin kernel:  start_kernel+0x514/0x54c
Jan 12 22:58:53 orin kernel: ---[ end trace 5e2d568a0a58a814 ]---
Jan 12 22:58:53 orin wpa_supplicant[3365136]: wlan0: Associated with 9c:ef:d5:fa:96:29
Jan 12 22:58:53 orin wpa_supplicant[3365136]: wlan0: CTRL-EVENT-SUBNET-STATUS-UPDATE status=0
Jan 12 22:58:57 orin wpa_supplicant[3365136]: wlan0: CTRL-EVENT-DISCONNECTED bssid=9c:ef:d5:fa:96:29 reason=15
Jan 12 22:58:57 orin wpa_supplicant[3365136]: wlan0: WPA: 4-Way Handshake failed - pre-shared key may be incorrect
Jan 12 22:58:57 orin wpa_supplicant[3365136]: wlan0: CTRL-EVENT-SSID-TEMP-DISABLED id=0 ssid="grapes" auth_failures=1 duration=10 reason=WRONG_KEY
Jan 12 22:58:57 orin wpa_supplicant[3365136]: wlan0: CTRL-EVENT-REGDOM-CHANGE init=CORE type=WORLD
Jan 12 22:59:07 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 12 22:59:11 orin wpa_supplicant[3365136]: wlan0: CTRL-EVENT-SSID-REENABLED id=0 ssid="grapes"
Jan 12 22:59:11 orin wpa_supplicant[3365136]: wlan0: Trying to associate with 9c:ef:d5:fa:96:29 (SSID='grapes' freq=5745 MHz)
Jan 12 22:59:11 orin wpa_supplicant[3365136]: nl80211: kernel reports: Authentication algorithm number required
Jan 12 22:59:11 orin wpa_supplicant[3365136]: wlan0: CTRL-EVENT-STARTED-CHANNEL-SWITCH freq=5745 ht_enabled=1 ch_offset=1 ch_width=40 MHz cf1=5755 cf2=0
Jan 12 22:59:11 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 12 22:59:11 orin kernel: ------------[ cut here ]------------
Jan 12 22:59:11 orin kernel: WARNING: CPU: 0 PID: 0 at /dvs/git/dirty/git-master_linux/kernel/nvidia/drivers/net/wireless/realtek/rtl8822ce/hal/hal_com.c:2250 rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 12 22:59:11 orin kernel: Modules linked in: xt_mark uvcvideo videobuf2_vmalloc nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter ip6table_nat overlay lzo_rle lzo_compress zram loop ip6table_filter ip6_tables xt_state xt_conntrack iptable_filter xt_MASQUERADE iptable_nat nf_nat nf_conntrack snd_soc_tegra186_dspk nf_defrag_ipv6 snd_soc_tegra186_asrc snd_soc_tegra210_ope nf_defrag_ipv4 snd_soc_tegra210_mvc libcrc32c snd_soc_tegra186_arad snd_soc_tegra210_iqc snd_soc_tegra210_afc snd_soc_tegra210_admaif snd_soc_tegra210_dmic snd_soc_tegra210_adx snd_soc_tegra_pcm snd_soc_tegra210_amx snd_soc_tegra210_sfc snd_soc_tegra210_i2s snd_soc_tegra210_mixer aes_ce_blk crypto_simd cryptd aes_ce_cipher snd_soc_tegra210_adsp rtk_btusb ucsi_ccg ghash_ce snd_soc_tegra_machine_driver typec_ucsi btusb nv_ar0234(E) sha2_ce snd_soc_tegra_utils sha256_arm64 sha1_ce snd_soc_tegra210_ahub typec nvadsp snd_soc_simple_card_utils snd_soc_spdif_tx btrtl nct1008 rtl8822ce bmi088 btbcm tegra210_adma max96712(E) userspace_alert
Jan 12 22:59:11 orin kernel:  kfifo_buf tegra_bpmp_thermal btintel snd_hda_codec_hdmi ofpart cmdlinepart snd_hda_tegra snd_hda_codec qspi_mtd snd_hda_core cfg80211 mtd spi_tegra114 nvidia(O) ina3221 pwm_fan nvgpu nvmap mttcan can_dev can_raw can ramoops reed_solomon ip_tables x_tables
Jan 12 22:59:11 orin kernel: CPU: 0 PID: 0 Comm: swapper/0 Tainted: G        W  OE     5.10.104-tegra #1
Jan 12 22:59:11 orin kernel: Hardware name:  /, BIOS 1.0-d7fb19b 08/10/2022
Jan 12 22:59:11 orin kernel: pstate: 00400009 (nzcv daif +PAN -UAO -TCO BTYPE=--)
Jan 12 22:59:11 orin kernel: pc : rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 12 22:59:11 orin kernel: lr : rtw_hal_update_sta_mimo_type+0x40/0x17c [rtl8822ce]
Jan 12 22:59:11 orin kernel: sp : ffff8000100039f0
Jan 12 22:59:11 orin kernel: x29: ffff8000100039f0 x28: ffffacabddbb6000
Jan 12 22:59:11 orin kernel: x27: ffff8000115012e8 x26: ffff800018298c98
Jan 12 22:59:11 orin kernel: x25: ffff8000115011f1 x24: ffff8000183889b0
Jan 12 22:59:11 orin kernel: x23: ffff8000115010a8 x22: ffff1f350f0948f1
Jan 12 22:59:11 orin kernel: x21: 0000000000000000 x20: ffff800011501000
Jan 12 22:59:11 orin kernel: x19: ffff800018298c98 x18: 0000000000000000
Jan 12 22:59:11 orin kernel: x17: 0000000000000000 x16: ffffacabdbee0eac
Jan 12 22:59:11 orin kernel: x15: 0000000000000000 x14: 0000000000000000
Jan 12 22:59:11 orin kernel: x13: 0000000000000000 x12: 0000000000000000
Jan 12 22:59:11 orin kernel: x11: 0000000000000000 x10: 0000000000000000
Jan 12 22:59:11 orin kernel: x9 : 0000000000000000 x8 : 1100000000000000
Jan 12 22:59:11 orin kernel: x7 : 0000000000000000 x6 : ffff800018299030
Jan 12 22:59:11 orin kernel: x5 : ffff8000116a1000 x4 : 00000000000000ff
Jan 12 22:59:11 orin kernel: x3 : 0000000000000000 x2 : 0000000000000000
Jan 12 22:59:11 orin kernel: x1 : 0000000000000000 x0 : 0000000000000000
Jan 12 22:59:11 orin kernel: Call trace:
Jan 12 22:59:11 orin kernel:  rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 12 22:59:11 orin kernel:  rtw_hal_update_sta_ra_info+0x2c/0x50 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  rtw_joinbss_event_prehandle+0x410/0x6ec [rtl8822ce]
Jan 12 22:59:11 orin kernel:  report_join_res+0xcc/0x128 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  OnAssocRsp+0x1a0/0x388 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  OnAtim+0x21c/0x260 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  mgt_dispatcher+0x238/0x2a4 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  validate_recv_mgnt_frame+0x444/0x518 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  validate_recv_frame+0x364/0x5a8 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  recv_func_prehandle+0x50/0x94 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  recv_func+0x4c/0x1c8 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  rtw_recv_entry+0x2c/0x68 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  pre_recv_entry+0x100/0x154 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  rtl8822ce_tx_isr+0x428/0x748 [rtl8822ce]
Jan 12 22:59:11 orin kernel:  tasklet_action_common.isra.0+0x15c/0x180
Jan 12 22:59:11 orin kernel:  tasklet_hi_action+0x30/0x40
Jan 12 22:59:11 orin kernel:  __do_softirq+0x140/0x3e8
Jan 12 22:59:11 orin kernel:  irq_exit+0xc0/0xe0
Jan 12 22:59:11 orin kernel:  __handle_domain_irq+0x74/0xd0
Jan 12 22:59:11 orin kernel:  gic_handle_irq+0x68/0x134
Jan 12 22:59:11 orin kernel:  el1_irq+0xd0/0x180
Jan 12 22:59:11 orin kernel:  cpuidle_enter_state+0xb8/0x410
Jan 12 22:59:11 orin kernel:  cpuidle_enter+0x40/0x60
Jan 12 22:59:11 orin kernel:  call_cpuidle+0x44/0x80
Jan 12 22:59:11 orin kernel:  do_idle+0x208/0x270
Jan 12 22:59:11 orin kernel:  cpu_startup_entry+0x2c/0x70
Jan 12 22:59:11 orin kernel:  rest_init+0xdc/0xe8
Jan 12 22:59:11 orin kernel:  arch_call_rest_init+0x18/0x20
Jan 12 22:59:11 orin kernel:  start_kernel+0x514/0x54c
Jan 12 22:59:11 orin kernel: ---[ end trace 5e2d568a0a58a815 ]---

The problem seems to occur during the roaming event. Say we have two APs with SSID "myap’ - only is strong and one is week. Initially Orin will connect to the strong one. The fault occurs when the strong AP is lost. Sometimes it will recover, sometimes not, sometimes it will take long time to recover.

Here is another crash:

Jan 15 17:56:04 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-DISCONNECTED bssid=00:c0:ca:b1:a8:2e reason=3
Jan 15 17:56:04 orin systemd-networkd[2213]: wlan0: Lost carrier
Jan 15 17:56:04 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-REGDOM-CHANGE init=CORE type=WORLD
Jan 15 17:56:04 orin systemd-networkd[2213]: wlan0: DHCP lease lost
Jan 15 17:56:14 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:56:23 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:56:27 orin wpa_supplicant[2250]: wlan0: Trying to associate with 9c:ef:d5:fa:96:29 (SSID='grapes' freq=5745 MHz)
Jan 15 17:56:27 orin wpa_supplicant[2250]: nl80211: kernel reports: Authentication algorithm number required
Jan 15 17:56:27 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-STARTED-CHANNEL-SWITCH freq=5745 ht_enabled=1 ch_offset=1 ch_width=40 MHz cf1=5755 cf2=0
Jan 15 17:56:29 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-ASSOC-REJECT status_code=1
Jan 15 17:56:29 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-REGDOM-CHANGE init=CORE type=WORLD
Jan 15 17:56:29 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:56:33 orin wpa_supplicant[2250]: wlan0: Trying to associate with 9c:ef:d5:fa:96:29 (SSID='grapes' freq=5745 MHz)
Jan 15 17:56:33 orin wpa_supplicant[2250]: nl80211: kernel reports: Authentication algorithm number required
Jan 15 17:56:33 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-STARTED-CHANNEL-SWITCH freq=5745 ht_enabled=1 ch_offset=1 ch_width=40 MHz cf1=5755 cf2=0
Jan 15 17:56:34 orin kernel: arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xff693000, fsynr=0x160003, cbfrsynra=0x805, cb=5
Jan 15 17:56:34 orin kernel: mc-err: unknown mcerr fault, int_status=0x00000000, ch_int_status=0x00000000, hubc_int_status=0x00000000 sbs_int_status=0x00000000, hub_int_status=0x00000000
Jan 15 17:56:34 orin kernel: arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xff693000, fsynr=0x160003, cbfrsynra=0x805, cb=5
Jan 15 17:56:34 orin kernel: mc-err: unknown mcerr fault, int_status=0x00000000, ch_int_status=0x00000000, hubc_int_status=0x00000000 sbs_int_status=0x00000000, hub_int_status=0x00000000
Jan 15 17:56:35 orin kernel: arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xff693800, fsynr=0x160003, cbfrsynra=0xc05, cb=5
Jan 15 17:56:35 orin kernel: mc-err: unknown mcerr fault, int_status=0x00000000, ch_int_status=0x00000000, hubc_int_status=0x00000000 sbs_int_status=0x00000000, hub_int_status=0x00000000
Jan 15 17:56:35 orin kernel: arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xff693800, fsynr=0x160003, cbfrsynra=0xc05, cb=5
Jan 15 17:56:35 orin kernel: mc-err: Too many MC errors; throttling prints
Jan 15 17:56:35 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-ASSOC-REJECT status_code=1
Jan 15 17:56:35 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-REGDOM-CHANGE init=CORE type=WORLD
Jan 15 17:56:37 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:56:40 orin wpa_supplicant[2250]: wlan0: Trying to associate with 9c:ef:d5:fa:96:29 (SSID='grapes' freq=5745 MHz)
Jan 15 17:56:40 orin wpa_supplicant[2250]: nl80211: kernel reports: Authentication algorithm number required
Jan 15 17:56:41 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-ASSOC-REJECT status_code=1
Jan 15 17:56:41 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-SSID-TEMP-DISABLED id=0 ssid="grapes" auth_failures=1 duration=10 reason=CONN_FAILED
Jan 15 17:56:50 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-SSID-REENABLED id=0 ssid="grapes"
Jan 15 17:56:50 orin wpa_supplicant[2250]: wlan0: Trying to associate with 9c:ef:d5:fa:96:29 (SSID='grapes' freq=5745 MHz)
Jan 15 17:56:50 orin wpa_supplicant[2250]: nl80211: kernel reports: Authentication algorithm number required
Jan 15 17:56:51 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-STARTED-CHANNEL-SWITCH freq=5745 ht_enabled=1 ch_offset=1 ch_width=40 MHz cf1=5755 cf2=0
Jan 15 17:56:51 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:56:53 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-ASSOC-REJECT status_code=1
Jan 15 17:56:53 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-SSID-TEMP-DISABLED id=0 ssid="grapes" auth_failures=2 duration=23 reason=CONN_FAILED
Jan 15 17:56:53 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-REGDOM-CHANGE init=CORE type=WORLD
Jan 15 17:57:17 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:57:21 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-SSID-REENABLED id=0 ssid="grapes"
Jan 15 17:57:26 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:57:35 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:57:44 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:57:53 orin kernel: start_addr=(0x20000), end_addr=(0x40000), buffer_size=(0x20000), smp_number_max=(16384)
Jan 15 17:57:57 orin wpa_supplicant[2250]: wlan0: Trying to associate with 9c:ef:d5:fa:96:29 (SSID='grapes' freq=5745 MHz)
Jan 15 17:57:57 orin wpa_supplicant[2250]: nl80211: kernel reports: Authentication algorithm number required
Jan 15 17:57:57 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-STARTED-CHANNEL-SWITCH freq=5745 ht_enabled=1 ch_offset=1 ch_width=40 MHz cf1=5755 cf2=0
Jan 15 17:57:58 orin kernel: ------------[ cut here ]------------
Jan 15 17:57:58 orin kernel: WARNING: CPU: 0 PID: 0 at /dvs/git/dirty/git-master_linux/kernel/nvidia/drivers/net/wireless/realtek/rtl8822ce/hal/hal_com.c:2250 rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 15 17:57:58 orin kernel: Modules linked in: rtl8822ce cfg80211 uvcvideo videobuf2_vmalloc nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter overlay lzo_rle lzo_compress zram loop ip6table_filter ip6_tables xt_state xt_conntrack iptable_filter xt_MASQUERADE iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c snd_soc_tegra210_ope snd_soc_tegra186_asrc snd_soc_tegra186_dspk snd_soc_tegra186_arad snd_soc_tegra210_mvc snd_soc_tegra210_iqc snd_soc_tegra210_dmic snd_soc_tegra210_afc snd_soc_tegra210_admaif snd_soc_tegra210_mixer snd_soc_tegra210_adx snd_soc_tegra210_amx snd_soc_tegra_pcm snd_soc_tegra210_i2s snd_soc_tegra210_sfc aes_ce_blk crypto_simd cryptd aes_ce_cipher ghash_ce sha2_ce sha256_arm64 snd_soc_tegra210_adsp sha1_ce ucsi_ccg snd_soc_tegra_machine_driver typec_ucsi snd_soc_tegra_utils snd_soc_spdif_tx snd_soc_simple_card_utils snd_soc_tegra210_ahub typec nvadsp tegra210_adma rtk_btusb nv_ar0234(E) snd_hda_codec_hdmi userspace_alert bmi088 btusb nct1008 kfifo_buf btrtl
Jan 15 17:57:58 orin kernel:  ofpart max96712(E) tegra_bpmp_thermal btbcm btintel cmdlinepart snd_hda_tegra snd_hda_codec snd_hda_core qspi_mtd mtd spi_tegra114 nvidia(O) ina3221 pwm_fan nvgpu nvmap mttcan can_dev can_raw can ramoops reed_solomon ip_tables x_tables [last unloaded: cfg80211]
Jan 15 17:57:58 orin kernel: CPU: 0 PID: 0 Comm: swapper/0 Tainted: G        W  OE     5.10.104-tegra #1
Jan 15 17:57:58 orin kernel: Hardware name:  /, BIOS 1.0-d7fb19b 08/10/2022
Jan 15 17:57:58 orin kernel: pstate: 00400009 (nzcv daif +PAN -UAO -TCO BTYPE=--)
Jan 15 17:57:58 orin kernel: pc : rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 15 17:57:58 orin kernel: lr : rtw_hal_update_sta_mimo_type+0x40/0x17c [rtl8822ce]
Jan 15 17:57:58 orin kernel: sp : ffff8000100039f0
Jan 15 17:57:58 orin kernel: x29: ffff8000100039f0 x28: ffffababdcbb6000
Jan 15 17:57:58 orin kernel: x27: ffff8000115012e8 x26: ffff8000182b9890
Jan 15 17:57:58 orin kernel: x25: ffff8000115011f1 x24: ffff80001827f780
Jan 15 17:57:58 orin kernel: x23: ffff8000115010a8 x22: ffff23b3f240a8f1
Jan 15 17:57:58 orin kernel: x21: 0000000000000000 x20: ffff800011501000
Jan 15 17:57:58 orin kernel: x19: ffff8000182b9890 x18: 0000000000000000
Jan 15 17:57:58 orin kernel: x17: 0000000000000000 x16: ffffababdaee0eac
Jan 15 17:57:58 orin kernel: x15: 0000000000000000 x14: 0000000000000000
Jan 15 17:57:58 orin kernel: x13: 0000000000000000 x12: 0000000000000000
Jan 15 17:57:58 orin kernel: x11: 0000000000000000 x10: 0000000000000000
Jan 15 17:57:58 orin kernel: x9 : 0000000000000000 x8 : 1100000000000000
Jan 15 17:57:58 orin kernel: x7 : 0000000000000000 x6 : ffff8000182b9c28
Jan 15 17:57:58 orin kernel: x5 : ffff8000115b5000 x4 : 00000000000000ff
Jan 15 17:57:58 orin kernel: x3 : 0000000000000000 x2 : 0000000000000000
Jan 15 17:57:58 orin kernel: x1 : 0000000000000000 x0 : 0000000000000000
Jan 15 17:57:58 orin kernel: Call trace:
Jan 15 17:57:58 orin kernel:  rtw_hal_update_sta_mimo_type+0x14c/0x17c [rtl8822ce]
Jan 15 17:57:58 orin kernel:  rtw_hal_update_sta_ra_info+0x2c/0x50 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  rtw_joinbss_event_prehandle+0x410/0x6ec [rtl8822ce]
Jan 15 17:57:58 orin kernel:  report_join_res+0xcc/0x128 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  OnAssocRsp+0x1a0/0x388 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  OnAtim+0x21c/0x260 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  mgt_dispatcher+0x238/0x2a4 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  validate_recv_mgnt_frame+0x444/0x518 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  validate_recv_frame+0x364/0x5a8 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  recv_func_prehandle+0x50/0x94 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  recv_func+0x4c/0x1c8 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  rtw_recv_entry+0x2c/0x68 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  pre_recv_entry+0x100/0x154 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  rtl8822ce_tx_isr+0x428/0x748 [rtl8822ce]
Jan 15 17:57:58 orin kernel:  tasklet_action_common.isra.0+0x15c/0x180
Jan 15 17:57:58 orin kernel:  tasklet_hi_action+0x30/0x40
Jan 15 17:57:58 orin kernel:  __do_softirq+0x140/0x3e8
Jan 15 17:57:58 orin kernel:  irq_exit+0xc0/0xe0
Jan 15 17:57:58 orin kernel:  __handle_domain_irq+0x74/0xd0
Jan 15 17:57:58 orin kernel:  gic_handle_irq+0x68/0x134
Jan 15 17:57:58 orin kernel:  el1_irq+0xd0/0x180
Jan 15 17:57:58 orin kernel:  cpuidle_enter_state+0xb8/0x410
Jan 15 17:57:58 orin kernel:  cpuidle_enter+0x40/0x60
Jan 15 17:57:58 orin kernel:  call_cpuidle+0x44/0x80
Jan 15 17:57:58 orin kernel:  do_idle+0x208/0x270
Jan 15 17:57:58 orin kernel:  cpu_startup_entry+0x2c/0x70
Jan 15 17:57:58 orin kernel:  rest_init+0xdc/0xe8
Jan 15 17:57:58 orin kernel:  arch_call_rest_init+0x18/0x20
Jan 15 17:57:58 orin kernel:  start_kernel+0x514/0x54c
Jan 15 17:57:58 orin kernel: ---[ end trace f5b36bbe0dafa83a ]---
Jan 15 17:57:58 orin wpa_supplicant[2250]: wlan0: Associated with 9c:ef:d5:fa:96:29
Jan 15 17:57:58 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-SUBNET-STATUS-UPDATE status=0
Jan 15 17:57:58 orin wpa_supplicant[2250]: wlan0: WPA: Key negotiation completed with 9c:ef:d5:fa:96:29 [PTK=CCMP GTK=CCMP]
Jan 15 17:57:58 orin wpa_supplicant[2250]: wlan0: CTRL-EVENT-CONNECTED - Connection to 9c:ef:d5:fa:96:29 completed [id=0 id_str=]
Jan 15 17:57:58 orin systemd-networkd[2213]: wlan0: Gained carrier
Jan 15 17:58:01 orin systemd-networkd[2213]: wlan0: DHCPv4 address 172.16.16.162/24 via 172.16.16.16

I am noticing the same thing:

label=“kernel”)
Feb 07 09:27:56 Artax systemd[151208]: Starting Tracker metadata database store and lookup manager…
Feb 07 09:27:56 Artax dbus-daemon[151266]: [session uid=1000 pid=151266] Successfully activated service ‘org.freedesktop.Tracker1’
Feb 07 09:27:56 Artax systemd[151208]: Started Tracker metadata database store and lookup manager.
Feb 07 09:27:56 Artax systemd[151208]: Started snap.go.go.03b063ba-5613-4599-b813-f3431481035f.scope.
Feb 07 09:27:56 Artax systemd[151208]: snap.go.go.03b063ba-5613-4599-b813-f3431481035f.scope: Succeeded.
Feb 07 09:28:06 Artax wpa_supplicant[151177]: TDLS: Invalid frame - payloadtype=1 category=240 action=26
Feb 07 09:28:24 Artax kernel: arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xffb06000, fsynr=0x200003, cbfrsynra=0x5, cb=5
Feb 07 09:28:24 Artax kernel: mc-err: unknown mcerr fault, int_status=0x00000000, ch_int_status=0x00000000, hubc_int_status=0x00000000 sbs_int_status=0x00000000, hub_int_status=0x00000000
Feb 07 09:28:26 Artax tracker-store[160576]: OK
Feb 07 09:28:26 Artax systemd[151208]: tracker-store.service: Succeeded.
Feb 07 09:28:28 Artax wpa_supplicant[151177]: wlan0: WPA: Group rekeying completed with e0:63:da:38:6f:f8 [GTK=CCMP]
Feb 07 09:28:29 Artax wpa_supplicant[151177]: wlan0: WPA: Group rekeying completed with e0:63:da:38:6f:f8 [GTK=CCMP]
Feb 07 09:28:30 Artax wpa_supplicant[151177]: wlan0: WPA: Group rekeying completed with e0:63:da:38:6f:f8 [GTK=CCMP]
Feb 07 09:28:31 Artax wpa_supplicant[151177]: wlan0: WPA: Group rekeying completed with e0:63:da:38:6f:f8 [GTK=CCMP]
Feb 07 09:28:32 Artax wpa_supplicant[151177]: wlan0: CTRL-EVENT-DISCONNECTED bssid=e0:63:da:38:6f:f8 reason=16
Feb 07 09:28:32 Artax NetworkManager[151136]: [1675780112.5579] sup-iface[0xaaaae3bd1110,wlan0]: connection disconnected (reason 16)
Feb 07 09:28:32 Artax kernel: arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xffae9000, fsynr=0x230003, cbfrsynra=0x805, cb=5
Feb 07 09:28:32 Artax kernel: arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xffc8d000, fsynr=0x200003, cbfrsynra=0xc05, cb=5
Feb 07 09:28:32 Artax kernel: mc-err: unknown mcerr fault, int_status=0x00000000, ch_int_status=0x00000000, hubc_int_status=0x00000000 sbs_int_status=0x00000000, hub_int_status=0x00000000
Feb 07 09:28:32 Artax wpa_supplicant[151177]: wlan0: CTRL-EVENT-REGDOM-CHANGE init=CORE type=WORLD
Feb 07 09:28:32 Artax NetworkManager[151136]: [1675780112.5914] device (wlan0): supplicant interface state: completed → disconnected
Feb 07 09:28:32 Artax NetworkManager[151136]: [1675780112.5915] device (p2p-dev-wlan0): supplicant management interface state: completed → disconnected
Feb 07 09:28:32 Artax gnome-shell[152198]: An active wireless connection, in infrastructure mode, involves no access point?
Feb 07 09:28:32 Artax NetworkManager[151136]: [1675780112.6632] device (wlan0): supplicant interface state: disconnected → scanning
Feb 07 09:28:32 Artax NetworkManager[151136]: [1675780112.6632] device (p2p-dev-wlan0): supplicant management interface state: disconnected → scanning
Feb 07 09:28:36 Artax wpa_supplicant[151177]: wlan0: Trying to associate with e0:63:da:38:40:99 (SSID=‘legit.ly’ freq=5240 MHz)
Feb 07 09:28:36 Artax wpa_supplicant[151177]: FT: Invalid key management type (2)
Feb 07 09:28:36 Artax wpa_supplicant[151177]: nl80211: kernel reports: Authentication algorithm number required
Feb 07 09:28:36 Artax wpa_supplicant[151177]: wlan0: CTRL-EVENT-STARTED-CHANNEL-SWITCH freq=5240 ht_enabled=1 ch_offset=-1 ch_width=40 MHz cf1=5230 cf2=0
Feb 07 09:28:36 Artax NetworkManager[151136]: [1675780116.5146] device (wlan0): supplicant interface state: scanning → associating
Feb 07 09:28:36 Artax NetworkManager[151136]: [1675780116.5146] device (p2p-dev-wlan0): supplicant management interface state: scanning → associating
Feb 07 09:28:36 Artax wpa_supplicant[151177]: wlan0: Associated with e0:63:da:38:40:99
Feb 07 09:28:36 Artax wpa_supplicant[151177]: wlan0: CTRL-EVENT-SUBNET-STATUS-UPDATE status=0
Feb 07 09:28:36 Artax NetworkManager[151136]: [1675780116.7011] device (wlan0): supplicant interface state: associating → associated
Feb 07 09:28:36 Artax NetworkManager[151136]: [1675780116.7011] device (p2p-dev-wlan0): supplicant management interface state: associating → associated
Feb 07 09:28:36 Artax NetworkManager[151136]: [1675780116.7170] device (wlan0): supplicant interface state: associated → 4-way handshake
Feb 07 09:28:36 Artax NetworkManager[151136]: [1675780116.7170] device (p2p-dev-wlan0): supplicant management interface state: associated → 4-way handshake
Feb 07 09:28:40 Artax wpa_supplicant[151177]: wlan0: CTRL-EVENT-DISCONNECTED bssid=e0:63:da:38:40:99 reason=15
Feb 07 09:28:40 Artax wpa_supplicant[151177]: wlan0: WPA: 4-Way Handshake failed - pre-shared key may be incorrect
Feb 07 09:28:40 Artax wpa_supplicant[151177]: wlan0: CTRL-EVENT-SSID-TEMP-DISABLED id=0 ssid=“legit.ly” auth_failures=1 duration=10 reason=WRONG_KEY
Feb 07 09:28:40 Artax wpa_supplicant[151177]: wlan0: CTRL-EVENT-REGDOM-CHANGE init=CORE type=WORLD
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.7448] sup-iface[0xaaaae3bd1110,wlan0]: connection disconnected (reason 15)
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.7496] device (wlan0): supplicant interface state: 4-way handshake → disconnected
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.7503] device (wlan0): Activation: (wifi) disconnected during association, asking for new key
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.7504] device (wlan0): state change: activated → need-auth (reason ‘supplicant-disconnect’, sys-iface-state: ‘managed’)
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.7794] dhcp4 (wlan0): canceled DHCP transaction
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.7794] dhcp4 (wlan0): state changed bound → done
Feb 07 09:28:40 Artax dbus-daemon[766]: [system] Activating via systemd: service name=‘org.freedesktop.nm_dispatcher’ unit=‘dbus-org.freedesktop.nm-dispatcher.service’ requested by ‘:1.167’ (uid=0 pid=151136 comm="/usr/sbin/NetworkManager --no-daemon " label=“kernel”)
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.7810] device (p2p-dev-wlan0): supplicant management interface state: 4-way handshake → disconnected
Feb 07 09:28:40 Artax systemd[1]: Starting Network Manager Script Dispatcher Service…
Feb 07 09:28:40 Artax dbus-daemon[766]: [system] Successfully activated service ‘org.freedesktop.nm_dispatcher’
Feb 07 09:28:40 Artax systemd[1]: Started Network Manager Script Dispatcher Service.
Feb 07 09:28:40 Artax nm-dispatcher[160634]: run-parts: failed to stat component /etc/network/if-post-down.d/avahi-daemon: No such file or directory
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.8498] device (wlan0): supplicant interface state: disconnected → inactive
Feb 07 09:28:40 Artax NetworkManager[151136]: [1675780120.8499] device (p2p-dev-wlan0): supplicant management interface state: disconnected → inactive
Feb 07 09:28:50 Artax systemd[1]: NetworkManager-dispatcher.service: Succeeded.
Feb 07 09:29:14 Artax NetworkManager[151136]: [1675780154.6622] dhcp4 (eth0): option dhcp_lease_time => ‘600’

Hi,

It looks like a known issue on our side. We will update later once we have a solution.

We seem to be having similar issues with out AGX Orin Devkits. @WayneWWW any updates? Here are some more logs that could be related for reference:

arm-smmu 8000000.iommu: Unhandled context fault: fsr=0x80000402, iova=0xffda1000, fsynr=0x340003, cbfrsynra=0x805, cb=5

mc-err: unknown mcerr fault, int_status=0x00000000, ch_int_status=0x00000000, hubc_int_status=0x00000000 sbs_int_status=0x00000000, hub_int_status=0x00000000

<info>  [1687458091.7589] device (wlan0): set-hw-addr: set MAC address to 32:**:**:**:**:40 (scanning)

<info>  [1687458091.7983] device (wlan0): supplicant interface state: inactive -> disconnected

<info>  [1687458091.7985] device (p2p-dev-wlan0): supplicant management interface state: inactive -> disconnected

<info>  [1687458092.0334] device (wlan0): supplicant interface state: disconnected -> inactive

<info>  [1687458092.0335] device (p2p-dev-wlan0): supplicant management interface state: disconnected -> inactive