Xavier AGX Devkit
L4T r35.4.1
We have several devkits that show this problem after moving to r35.4.1.
Every few boots the AGX Xavier is missing one of the USB busses. Anything plugged in to it is not detected. Removing and re-plugging the USB device does nothing.
Here are the logs when the USB does not come up:
$ lsusb
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
$ sudo dmesg | grep usb
[ 0.453676] usbcore: registered new interface driver usbfs
[ 0.453711] usbcore: registered new interface driver hub
[ 0.453749] usbcore: registered new device driver usb
[ 2.732921] usbcore: registered new interface driver r8152
[ 2.738470] usbcore: registered new interface driver asix
[ 2.743538] usbcore: registered new interface driver ax88179_178a
[ 2.749661] usbcore: registered new interface driver cdc_ether
[ 2.755908] usbcore: registered new interface driver net1080
[ 2.761500] usbcore: registered new interface driver cdc_subset
[ 2.767277] usbcore: registered new interface driver zaurus
[ 2.772980] usbcore: registered new interface driver cdc_ncm
[ 2.778654] usbcore: registered new interface driver aqc111
[ 2.800640] tegra-xusb 3610000.xhci: Adding to iommu group 0
[ 2.807090] usbcore: registered new interface driver uas
[ 2.811215] usbcore: registered new interface driver usb-storage
[ 2.828088] usbcore: registered new interface driver xpad
[ 3.025319] vdd-usb-3v3: supplied by regulator-dummy
[ 3.984136] usbcore: registered new interface driver usbhid
[ 3.984279] usbhid: USB HID core driver
[ 4.247582] usbcore: registered new interface driver snd-usb-audio
[ 6.197757] tegra-xusb-padctl 3520000.xusb_padctl: failed to setup XUSB ports: -517
[ 6.832927] tegra-xusb 3610000.xhci: Firmware timestamp: 2022-03-16 11:07:43 UTC, Version: 60.13 release
[ 6.836769] tegra-xusb 3610000.xhci: xHCI Host Controller
[ 6.852856] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 1
[ 6.866022] tegra-xusb 3610000.xhci: hcc params 0x0184ff25 hci version 0x110 quirks 0x0000000000050810
[ 6.878765] tegra-xusb 3610000.xhci: irq 198, io mem 0x03610000
[ 6.894479] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[ 6.908513] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 6.921701] usb usb1: Product: xHCI Host Controller
[ 6.921705] usb usb1: Manufacturer: Linux 5.10.120-tegra xhci-hcd
[ 6.921724] usb usb1: SerialNumber: 3610000.xhci
[ 6.966040] tegra-xusb 3610000.xhci: xHCI Host Controller
[ 6.976670] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 2
[ 6.976698] tegra-xusb 3610000.xhci: Host supports USB 3.1 Enhanced SuperSpeed
[ 7.101658] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[ 7.117628] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 7.117632] usb usb2: Product: xHCI Host Controller
[ 7.117636] usb usb2: Manufacturer: Linux 5.10.120-tegra xhci-hcd
[ 7.117639] usb usb2: SerialNumber: 3610000.xhci
[ 9.284572] tegra-xusb 3610000.xhci: entering ELPG done
[ 11.881064] usb0: HOST MAC fe:15:6a:0c:0f:ae
[ 11.881072] usb0: MAC fe:15:6a:0c:0f:af
[ 11.932253] l4tbr0: port 2(usb0) entered blocking state
[ 11.932283] l4tbr0: port 2(usb0) entered disabled state
[ 11.933145] device usb0 entered promiscuous mode
And here is the logs when it does
$ lsusb
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 003: ID 1199:9091 Sierra Wireless, Inc. Sierra Wireless EM7511 Qualcomm® Snapdragon™ X16 LTE-A
Bus 001 Device 002: ID 1286:204e Marvell Semiconductor, Inc. Bluetooth and Wireless LAN Composite Device
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
$ sudo dmesg | grep usb
[ 0.443079] usbcore: registered new interface driver usbfs
[ 0.443114] usbcore: registered new interface driver hub
[ 0.443149] usbcore: registered new device driver usb
[ 2.731226] usbcore: registered new interface driver r8152
[ 2.736780] usbcore: registered new interface driver asix
[ 2.742130] usbcore: registered new interface driver ax88179_178a
[ 2.747973] usbcore: registered new interface driver cdc_ether
[ 2.754206] usbcore: registered new interface driver net1080
[ 2.759778] usbcore: registered new interface driver cdc_subset
[ 2.765560] usbcore: registered new interface driver zaurus
[ 2.771287] usbcore: registered new interface driver cdc_ncm
[ 2.776939] usbcore: registered new interface driver aqc111
[ 2.799011] tegra-xusb 3610000.xhci: Adding to iommu group 0
[ 2.805295] usbcore: registered new interface driver uas
[ 2.809504] usbcore: registered new interface driver usb-storage
[ 2.826394] usbcore: registered new interface driver xpad
[ 3.023563] vdd-usb-3v3: supplied by regulator-dummy
[ 3.995373] usbcore: registered new interface driver usbhid
[ 3.995526] usbhid: USB HID core driver
[ 4.261340] usbcore: registered new interface driver snd-usb-audio
[ 6.209575] tegra-xusb-padctl 3520000.xusb_padctl: failed to setup XUSB ports: -517
[ 6.753434] tegra-xusb 3610000.xhci: Firmware timestamp: 2022-03-16 11:07:43 UTC, Version: 60.13 release
[ 6.753439] tegra-xusb 3610000.xhci: xHCI Host Controller
[ 6.753461] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 1
[ 6.754101] tegra-xusb 3610000.xhci: hcc params 0x0184ff25 hci version 0x110 quirks 0x0000000000050810
[ 6.754154] tegra-xusb 3610000.xhci: irq 198, io mem 0x03610000
[ 6.754476] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[ 6.754480] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 6.754483] usb usb1: Product: xHCI Host Controller
[ 6.754486] usb usb1: Manufacturer: Linux 5.10.120-tegra xhci-hcd
[ 6.754488] usb usb1: SerialNumber: 3610000.xhci
[ 6.755184] tegra-xusb 3610000.xhci: xHCI Host Controller
[ 6.755191] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 2
[ 6.755199] tegra-xusb 3610000.xhci: Host supports USB 3.1 Enhanced SuperSpeed
[ 6.755390] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[ 6.755394] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 6.755397] usb usb2: Product: xHCI Host Controller
[ 6.755399] usb usb2: Manufacturer: Linux 5.10.120-tegra xhci-hcd
[ 6.755402] usb usb2: SerialNumber: 3610000.xhci
[ 9.262837] tegra-xusb 3610000.xhci: entering ELPG done
[ 11.591575] usb0: HOST MAC fe:15:6a:0c:0f:ae
[ 11.591584] usb0: MAC fe:15:6a:0c:0f:af
[ 11.637820] l4tbr0: port 2(usb0) entered blocking state
[ 11.637862] l4tbr0: port 2(usb0) entered disabled state
[ 11.638101] device usb0 entered promiscuous mode
[ 15.189465] tegra-xusb 3610000.xhci: Firmware timestamp: 2022-03-16 11:07:43 UTC, Version: 60.13 release
[ 15.553446] usb 1-3: new high-speed USB device number 2 using tegra-xusb
[ 15.707473] usb 1-3: New USB device found, idVendor=1286, idProduct=204e, bcdDevice=32.01
[ 15.707483] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 15.707488] usb 1-3: Product: Bluetooth and Wireless LAN Composite Device
[ 15.707492] usb 1-3: Manufacturer: Marvell
[ 15.707495] usb 1-3: SerialNumber: 0000000000000000
[ 15.761205] btusb: disagrees about version of symbol hci_free_dev
[ 15.761402] btusb: Unknown symbol hci_free_dev (err -22)
[ 15.761579] btusb: Unknown symbol hci_alloc_dev_priv (err -2)
[ 15.761774] btusb: disagrees about version of symbol __hci_cmd_sync_ev
[ 15.761896] btusb: Unknown symbol __hci_cmd_sync_ev (err -22)
[ 15.762007] btusb: disagrees about version of symbol hci_unregister_dev
[ 15.762153] btusb: Unknown symbol hci_unregister_dev (err -22)
[ 15.762279] btusb: disagrees about version of symbol hci_recv_frame
[ 15.762398] btusb: Unknown symbol hci_recv_frame (err -22)
[ 15.762526] btusb: disagrees about version of symbol hci_register_dev
[ 15.762651] btusb: Unknown symbol hci_register_dev (err -22)
[ 15.762768] btusb: disagrees about version of symbol __hci_cmd_sync
[ 15.762886] btusb: Unknown symbol __hci_cmd_sync (err -22)
[ 15.763032] btusb: disagrees about version of symbol hci_recv_diag
[ 15.763264] btusb: Unknown symbol hci_recv_diag (err -22)
[ 15.797612] btusb: disagrees about version of symbol hci_free_dev
[ 15.797837] btusb: Unknown symbol hci_free_dev (err -22)
[ 15.798083] btusb: Unknown symbol hci_alloc_dev_priv (err -2)
[ 15.798321] btusb: disagrees about version of symbol __hci_cmd_sync_ev
[ 15.798491] btusb: Unknown symbol __hci_cmd_sync_ev (err -22)
[ 15.798653] btusb: disagrees about version of symbol hci_unregister_dev
[ 15.798832] btusb: Unknown symbol hci_unregister_dev (err -22)
[ 15.801630] btusb: disagrees about version of symbol hci_recv_frame
[ 15.807845] btusb: Unknown symbol hci_recv_frame (err -22)
[ 15.813607] btusb: disagrees about version of symbol hci_register_dev
[ 15.819876] btusb: Unknown symbol hci_register_dev (err -22)
[ 15.825583] btusb: disagrees about version of symbol __hci_cmd_sync
[ 15.831861] btusb: Unknown symbol __hci_cmd_sync (err -22)
[ 15.837162] btusb: disagrees about version of symbol hci_recv_diag
[ 15.843241] btusb: Unknown symbol hci_recv_diag (err -22)
[ 15.865623] btusb: disagrees about version of symbol hci_free_dev
[ 15.865810] btusb: Unknown symbol hci_free_dev (err -22)
[ 15.866033] btusb: Unknown symbol hci_alloc_dev_priv (err -2)
[ 15.866305] btusb: disagrees about version of symbol __hci_cmd_sync_ev
[ 15.872576] btusb: Unknown symbol __hci_cmd_sync_ev (err -22)
[ 15.878587] btusb: disagrees about version of symbol hci_unregister_dev
[ 15.885413] btusb: Unknown symbol hci_unregister_dev (err -22)
[ 15.891110] btusb: disagrees about version of symbol hci_recv_frame
[ 15.897593] btusb: Unknown symbol hci_recv_frame (err -22)
[ 15.902860] btusb: disagrees about version of symbol hci_register_dev
[ 15.909425] btusb: Unknown symbol hci_register_dev (err -22)
[ 15.915257] btusb: disagrees about version of symbol __hci_cmd_sync
[ 15.921293] btusb: Unknown symbol __hci_cmd_sync (err -22)
[ 15.926785] btusb: disagrees about version of symbol hci_recv_diag
[ 15.933007] btusb: Unknown symbol hci_recv_diag (err -22)
[ 15.957576] btusb: disagrees about version of symbol hci_free_dev
[ 15.957793] btusb: Unknown symbol hci_free_dev (err -22)
[ 15.958006] btusb: Unknown symbol hci_alloc_dev_priv (err -2)
[ 15.958269] btusb: disagrees about version of symbol __hci_cmd_sync_ev
[ 15.962105] btusb: Unknown symbol __hci_cmd_sync_ev (err -22)
[ 15.968106] btusb: disagrees about version of symbol hci_unregister_dev
[ 15.974671] btusb: Unknown symbol hci_unregister_dev (err -22)
[ 15.980901] btusb: disagrees about version of symbol hci_recv_frame
[ 15.987093] btusb: Unknown symbol hci_recv_frame (err -22)
[ 15.992394] btusb: disagrees about version of symbol hci_register_dev
[ 15.998906] btusb: Unknown symbol hci_register_dev (err -22)
[ 16.004786] btusb: disagrees about version of symbol __hci_cmd_sync
[ 16.010805] btusb: Unknown symbol __hci_cmd_sync (err -22)
[ 16.016289] btusb: disagrees about version of symbol hci_recv_diag
[ 16.022557] btusb: Unknown symbol hci_recv_diag (err -22)
[ 16.093491] usb 1-4: new high-speed USB device number 3 using tegra-xusb
[ 16.250055] usb 1-4: config 1 has an invalid interface number: 8 but max is 3
[ 16.250319] usb 1-4: config 1 has no interface number 1
[ 16.251153] usb 1-4: New USB device found, idVendor=1199, idProduct=9091, bcdDevice= 0.06
[ 16.251183] usb 1-4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 16.251188] usb 1-4: Product: Sierra Wireless EM7511 Qualcomm® Snapdragon™ X16 LTE-A
[ 16.251192] usb 1-4: Manufacturer: Sierra Wireless, Incorporated
[ 16.251195] usb 1-4: SerialNumber: YT10541051041049
[ 16.339363] usbcore: registered new interface driver cdc_wdm
[ 16.345281] usbcore: registered new interface driver qcserial
[ 16.345311] usbserial: USB Serial support registered for Qualcomm USB modem
[ 16.345331] usbserial: USB Serial support registered for Qualcomm USB modem
[ 16.347971] qmi_wwan 1-4:1.8 wwan0: register 'qmi_wwan' at usb-3610000.xhci-4, WWAN/QMI device, 2e:28:b6:89:c2:e7
[ 16.348449] usbcore: registered new interface driver qmi_wwan
[ 16.350158] usb 1-4: Qualcomm USB modem converter now attached to ttyUSB0
[ 16.354601] usb 1-4: Qualcomm USB modem converter now attached to ttyUSB1
[ 16.356463] usb 1-4: Qualcomm USB modem converter now attached to ttyUSB2
How should I got about fixing this problem?