A Xavier that was running on one of our products for about a year recently started having issues while trying to boot from eMMC. As shown in the boot logs it was stuck in a boot loop failing to boot the kernel from eMMC.
Rebooting system ...
��
[0000.055] W> RATCHET: MB1 binary ratchet value 4 is too large than ratchet level 2 from HW fuses.
[0000.063] I> MB1 (prd-version: 1.5.1.2-t194-41334769-9ec1833d)
[0000.069] I> Boot-mode: Coldboot
[0000.072] I> Chip revision : A02P
[0000.075] I> Bootrom patch version : 15 (correctly patched)
[0000.080] I> ATE fuse revision : 0x200
[0000.083] I> Ram repair fuse : 0x0
[0000.086] I> Ram Code : 0x2
[0000.089] I> rst_source : 0xb
[0000.092] I> rst_level : 0x1
[0000.095] I> Boot-device: eMMC
[0000.110] I> sdmmc DDR50 mode
[0000.114] W> No valid slot number is found in scratch register
[0000.120] W> Return default slot: _a
[0000.123] I> Active Boot chain : 0
[0000.126] I> Boot-device: eMMC
[0000.130] W> MB1_PLATFORM_CONFIG: device prod data is empty in MB1 BCT.
[0000.136] I> Temperature = 35000
[0000.139] W> Skipping boost for clk: BPMP_CPU_NIC
[0000.144] W> Skipping boost for clk: BPMP_APB
[0000.148] W> Skipping boost for clk: AXI_CBB
[0000.151] W> Skipping boost for clk: AON_CPU_NIC
[0000.156] W> Skipping boost for clk: CAN1
[0000.159] W> Skipping boost for clk: CAN2
[0000.164] I> Boot-device: eMMC
[0000.167] I> Boot-device: eMMC
[0000.176] I> Sdmmc: HS400 mode enabled
[0000.181] I> ECC region[0]: Start:0x0, End:0x0
[0000.185] I> ECC region[1]: Start:0x0, End:0x0
[0000.189] I> ECC region[2]: Start:0x0, End:0x0
[0000.193] I> ECC region[3]: Start:0x0, End:0x0
[0000.197] I> ECC region[4]: Start:0x0, End:0x0
[0000.201] I> Non-ECC region[0]: Start:0x80000000, End:0x100000000
[0000.207] I> Non-ECC region[1]: Start:0x0, End:0x0
[0000.211] I> Non-ECC region[2]: Start:0x0, End:0x0
[0000.216] I> Non-ECC region[3]: Start:0x0, End:0x0
[0000.220] I> Non-ECC region[4]: Start:0x0, End:0x0
[0000.226] E> FAILED: Thermal config
[0000.233] E> FAILED: MEMIO rail config
[0000.252] I> Boot-device: eMMC
[0000.261] I> sdmmc bdev is already initialized
[0000.331] I> MB1 done
����main enter
SPE VERSION #: R01.00.14 Created: Sep 19 2018 @ 11:03:21
HW Function test
Start Scheduler.
in late init
��
[0000.339] I> Welcome to MB2(TBoot-BPMP) (version: 00.00.2018.32-mobile-fc4604fb)
[0000.340] I> DMA Heap @ [0x526fa000 - 0x52ffa000]
[0000.341] I> Default Heap @ [0xd486400 - 0xd48a400]
[0000.341] E> DEVICE_PROD: Invalid value data = 70020000, size = 0.
[0000.347] W> device prod register failed
[0000.351] I> Boot-device: eMMC
[0000.354] I> Boot_device: SDMMC_BOOT instance: 3
[0000.360] I> sdmmc-3 params source = boot args
[0000.362] I> sdmmc bdev is already initialized
[0000.367] I> sdmmc-3 params source = boot args
[0000.373] I> Found 17 partitions in SDMMC_BOOT (instance 3)
[0000.380] I> Found 42 partitions in SDMMC_USER (instance 3)
[0000.383] W> No valid slot number is found in scratch register
[0000.388] W> Return default slot: _a
[0000.391] I> Active Boot chain : 0
[0000.395] I> parsing oem signed section of bpmp-fw header done
[0000.400] I> bpmp-fw binary init read from storage
[0000.405] I> oem authentication of bpmp-fw header done
[0000.412] I> bpmp-fw binary done read from storage
[0000.414] I> bpmp-fw: Authentication init Done
[0000.419] I> parsing oem signed section of cpubl header done
[0000.424] I> cpubl binary init read from storage
[0000.429] I> bpmp-fw: Authentication Finalize Done
[0000.433] I> oem authentication of cpubl header done
[0000.438] I> cpubl binary done read from storage
[0000.442] I> cpubl: Authentication init Done
[0000.447] I> parsing oem signed section of rce header done
[0000.452] I> rce binary init read from storage
[0000.456] I> Relocating BR-BCT
[0000.459] I> cpubl: Authentication Finalize Done
[0000.464] I> oem authentication of rce header done
[0000.468] I> rce binary done read from storage
[0000.472] I> rce: Authentication init Done
[0000.477] I> parsing oem signed section of ape header done
[0000.482] I> ape binary init read from storage
[0000.486] I> rce: Authentication Finalize Done
[0000.491] I> oem authentication of ape header done
[0000.495] I> ape binary done read from storage
[0000.499] I> ape: Authentication init Done
[0000.504] I> parsing oem signed section of tos header done
[0000.509] I> tos binary init read from storage
[0000.513] I> ape: Authentication Finalize Done
[0000.518] I> oem authentication of tos header done
[0000.522] I> tos binary done read from storage
[0000.526] I> tos: Authentication init Done
[0000.530] I> parsing oem signed section of bpmp-fw-dtb header done
[0000.536] I> bpmp-fw-dtb binary init read from storage
[0000.541] I> tos: Authentication Finalize Done
[0000.547] I> oem authentication of bpmp-fw-dtb header done
[0000.551] I> bpmp-fw-dtb binary done read from storage
[0000.556] I> bpmp-fw-dtb: Authentication init Done
[0000.562] I> parsing oem signed section of cpubl-dtb header done
[0000.566] I> cpubl-dtb binary init read from storage
[0000.571] I> bpmp-fw-dtb: Authentication Finalize Done
[0000.608] I> oem authentication of cpubl-dtb header done
[0000.608] I> cpubl-dtb binary done read from storage
[0000.609] I> cpubl-dtb: Authentication init Done
[0000.611] I> parsing oem signed section of eks header done
[0000.611] I> eks binary init read from storage
[0000.612] I> cpubl-dtb: Authentication Finalize Done
[0000.613] I> oem authentication of eks header done
[0000.616] I> eks binary done read from storage
[0000.621] I> eks: Authentication init Done
[0000.624] I> eks: Authentication Finalize Done
[0000.629] I> EKB detected (length: 0x410) @ VA:0x5270a400
��NOTICE: BL31: v1.3(release):23b153a63
NOTICE: BL31: Built : 22:43:07, Dec 9 2019
ipc-unittest-main: 1519: Welcome to IPC unittest!!!
ipc-unittest-main: 1531: waiting forever
ipc-unittest-srv: 329: Init unittest services!!!
keystore-demo: 141: Hello world from keystore-demo app
keystore-demo: 207: main: EKB contents match expected value
exit called, thread 0xffffffffea88ed58, name trusty_app_2_7d18fc60-e9fc-11e8
platform_bootstrap_epilog: trusty bootstrap complete
��
welcome to lk
calling constructors
initializing heap
creating bootstrap completion thread
top of bootstrap2()
initializing platform
bpmp: platform_init
tag is c1b4e372932429f2737cf722e1219e71
tag_show initialized
dt initialized
mail initialized
chipid initialized
fuse initialized
sku initialized
speedo initialized
ec_get_ec_list: found 45 ecs
ec initialized
ec_mrq initialized
vmon_populate_monitors: found 3 monitors
vmon initialized
adc initialized
fmon_populate_monitors: found 73 monitors
fmon initialized
fmon_mrq initialized
reset initialized
nvhs initialized
392 clocks registered
WARNING: pll_c4 has no dyn ramp
clk_mrq_init: mrq handler registered
clk initialized
nvlink initialized
io_dpd initialized
io_dpd initialized
thermal initialized
i2c5 controller initialized
initialized i2c mrq handling
i2c initialized
regulator initialized
avfs_clk_platform initialized
soctherm initialized
aotag initialized
powergate initialized
dvs initialized
pm initialized
pg_late initialized
strap initialized
tag initialized
emc initialized
clk_dt initialized
avfs_ccplex_platform initialized
tj_max: dt node not found
tj_init initialized
uphy_mrq_init: mrq handler registered
uphy_dt initialized
uphy initialized
safereg initialized
mrq initialized
��
[0001.044] I> Welcome to Cboot
[0001.044] I> Cboot Version: t194-8a9e8a5a
��fmon_post initialized
��[0001.044] I> CPU-BL Params @ 0xf2820000
[0001.045] I> 0) Base:0x00000000 Size:0x00000000
[0001.046] I> 1) Base:0xf1100000 Size:0x00100000
[0001.050] I> 2) Base:0xf2000000 Size:0x00200000
[0001.055] I> 3) Base:0xf1200000 Size:0x00200000
[0001.059] I> 4) Base:0xf1000000 Size:0x00100000
[0001.064] I> 5) Base:0xf0f00000 Size:0x00100000��clk_dt_late initialized
machine_check initialized
pm_post initialized
dbells initialized
avfs_clk_platform_post initialized
dmce initialized
cvc initialized
ccplex_avfs_hw_init: nafll_cluster0: not monitored
ccplex_avfs_hw_init: nafll_cluster1: not monitored
ccplex_avfs_hw_init: nafll_cluster2: not monitored
ccplex_avfs_hw_init: nafll_cluster3: not monitored
avfs_clk_mach_post initialized
regulator_post initialized
rm initialized
sc7_diag initialized
thermal_test initialized
serial_late initialized
clk_post initialized
clk_dt_post initialized
mc_reg initialized
pg_post initialized
dyn_modules initialized
sku_debugfs initialized
speedo_debugfs initialized
adc_debugfs initialized
clk_debugfs initialized
��
[0001.133] I> 6) Base:0xf3800000 Size:0x00400000
[0001.137] I> 7) Base:0xf1c00000 Size:0x00400000
[0001.142] I> 8) Base:0xf0e00000 Size:0x00100000
[0001.146] I> 9) Base:0xf0d00000 Size:0x00100000��emc_debugfs initialized
dvs_debugfs initialized
��
[0001.156] I> 10) Base:0xf3000000 Size:0x00800000
[0001.160] I> 11) Base:0x40000000 Size:0x00040000
��fmon_debugfs initialized
vmon_debugfs initialized
pg_debugfs initialized
profile_fs initialized
debugfs_cons initialized
mail_fs initialized
profile initialized
cvc_debugfs initialized
dmce_debugfs initialized
ec_debugfs initialized
rm_debugfs initialized
soctherm_debug initialized
gr_reader initialized
mods initialized
dt_fs initialized
debugfs_mrq initialized
debug_mrq initialized
debug_safereg initialized
initializing target
calling apps_init()
starting app shell
entering main console loop
] ��[0001.164] I> 12) Base:0xf0c00000 Size:0x00100000
[0001.215] I> 13) Base:0x40046000 Size:0x00002000
[0001.219] I> 14) Base:0x40048000 Size:0x00002000
[0001.224] I> 15) Base:0xac000000 Size:0x00004000
[0001.228] I> 16) Base:0x4004a000 Size:0x00002000
[0001.233] I> 17) Base:0xf0b00000 Size:0x00100000
[0001.237] I> 18) Base:0x4004c000 Size:0x00002000
[0001.242] I> 19) Base:0xf2200000 Size:0x00600000
[0001.246] I> 20) Base:0x4004e000 Size:0x00002000
[0001.251] I> 21) Base:0xf09d0000 Size:0x0000c000
[0001.255] I> 22) Base:0x00000000 Size:0x00000000
[0001.260] I> 23) Base:0xf09e0000 Size:0x00020000
[0001.264] I> 24) Base:0xf6000000 Size:0x02000000
[0001.269] I> 25) Base:0x40050000 Size:0x00002000
[0001.273] I> 26) Base:0x40040000 Size:0x00006000
[0001.277] I> 27) Base:0xf1800000 Size:0x00400000
[0001.282] I> 28) Base:0xf4c00000 Size:0x01400000
[0001.286] I> 29) Base:0xf1400000 Size:0x00400000
[0001.291] I> 30) Base:0xf0a00000 Size:0x00100000
[0001.295] I> 31) Base:0x00000000 Size:0x00000000
[0001.300] I> 32) Base:0xf8000000 Size:0x08000000
[0001.304] I> 33) Base:0x00000000 Size:0x00000000
[0001.309] I> 34) Base:0xf3c00000 Size:0x01000000
[0001.313] I> 35) Base:0xab000000 Size:0x01000000
[0001.318] I> 36) Base:0xa0000000 Size:0x0b000000
[0001.322] I> 37) Base:0xf2800000 Size:0x00800000
[0001.327] I> 38) Base:0x80000000 Size:0x20000000
[0001.331] I> 39) Base:0xb0000000 Size:0x08000000
[0001.335] I> 40) Base:0x00000000 Size:0x00000000
[0001.340] I> 41) Base:0x00000000 Size:0x00000000
[0001.344] I> 42) Base:0x00000000 Size:0x00000000
[0001.349] I> 43) Base:0x00000000 Size:0x00000000
[0001.353] I> 44) Base:0x00000000 Size:0x00000000
[0001.358] I> 45) Base:0x00000000 Size:0x00000000
[0001.362] GIC-SPI Target CPU: 0
[0001.365] Interrupts Init done
[0001.368] calling constructors
[0001.371] initializing heap
[0001.374] I> Heap: [0xa0690588 ... 0xab000000]
[0001.378] initializing threads
[0001.381] initializing timers
[0001.384] creating bootstrap completion thread
[0001.388] top of bootstrap2()
[0001.391] CPU: MIDR: 0x4E0F0040, MPIDR: 0x80000000
[0001.395] initializing platform
[0001.398] E> DEVICE_PROD: Invalid value data = 0, size = 0.
[0001.404] W> device prod register failed
[0001.407] I> Bl_dtb @0xaaf00000
[0001.415] E> "plugin-manager" doesn't exist, creating
[0001.416] E> "ids" doesn't exist, creating
[0001.421] E> "connection" doesn't exist, creating
[0001.424] E> "configs" doesn't exist, creating
[0001.435] I> Find /i2c@3160000's alias i2c0
[0001.435] I> Reading eeprom i2c=0 address=0x50
[0001.462] I> Device at /i2c@3160000:0x50
[0001.462] I> Reading eeprom i2c=0 address=0x56
[0001.463] E> I2C: slave not found in slaves.
[0001.463] E> I2C: Could not write 0 bytes to slave: 0x00ac with repeat start true.
[0001.464] E> I2C_DEV: Failed to send register address 0x00000000.
[0001.464] E> I2C_DEV: Could not read 256 registers of size 1 from slave 0xac at 0x00000000 via instance 0.
[0001.472] E> eeprom: Failed to read I2C slave device
[0001.477] I> Eeprom read failed 0x3526070d
[0001.482] I> Find /i2c@3180000's alias i2c2
[0001.485] I> Reading eeprom i2c=2 address=0x54
[0001.490] E> I2C: slave not found in slaves.
[0001.493] E> I2C: Could not write 0 bytes to slave: 0x00a8 with repeat start true.
[0001.501] E> I2C_DEV: Failed to send register address 0x00000000.
[0001.506] E> I2C_DEV: Could not read 256 registers of size 1 from slave 0xa8 at 0x00000000 via instance 2.
[0001.516] E> eeprom: Failed to read I2C slave device
[0001.521] I> Eeprom read failed 0x3526070d
[0001.525] I> Reading eeprom i2c=2 address=0x57
[0001.529] E> I2C: slave not found in slaves.
[0001.533] E> I2C: Could not write 0 bytes to slave: 0x00ae with repeat start true.
[0001.541] E> I2C_DEV: Failed to send register address 0x00000000.
[0001.546] E> I2C_DEV: Could not read 256 registers of size 1 from slave 0xae at 0x00000000 via instance 2.
[0001.556] E> eeprom: Failed to read I2C slave device
[0001.561] I> Eeprom read failed 0x3526070d
[0001.565] I> Reading eeprom i2c=2 address=0x52
[0001.569] E> I2C: slave not found in slaves.
[0001.573] E> I2C: Could not write 0 bytes to slave: 0x00a4 with repeat start true.
[0001.581] E> I2C_DEV: Failed to send register address 0x00000000.
[0001.586] E> I2C_DEV: Could not read 256 registers of size 1 from slave 0xa4 at 0x00000000 via instance 2.
[0001.596] E> eeprom: Failed to read I2C slave device
[0001.601] I> Eeprom read failed 0x3526070d
[0001.606] I> Find /i2c@c240000's alias i2c1
[0001.609] I> Reading eeprom i2c=1 address=0x52
[0001.614] E> I2C: slave not found in slaves.
[0001.617] E> I2C: Could not write 0 bytes to slave: 0x00a4 with repeat start true.
[0001.625] E> I2C_DEV: Failed to send register address 0x00000000.
[0001.631] E> I2C_DEV: Could not read 256 registers of size 1 from slave 0xa4 at 0x00000000 via instance 1.
[0001.640] E> eeprom: Retry to read I2C slave device.
[0001.645] E> I2C: slave not found in slaves.
[0001.649] E> I2C: Could not write 0 bytes to slave: 0x00a4 with repeat start true.
[0001.657] E> I2C_DEV: Failed to send register address 0x00000000.
[0001.662] E> I2C_DEV: Could not read 256 registers of size 1 from slave 0xa4 at 0x00000000 via instance 1.
[0001.672] E> eeprom: Failed to read I2C slave device
[0001.677] I> Eeprom read failed 0x3526070d
[0001.681] I> Reading eeprom i2c=1 address=0x50
[0001.685] E> I2C: slave not found in slaves.
[0001.689] E> I2C: Could not write 0 bytes to slave: 0x00a0 with repeat start true.
[0001.697] E> I2C_DEV: Failed to send register address 0x00000000.
[0001.703] E> I2C_DEV: Could not read 256 registers of size 1 from slave 0xa0 at 0x00000000 via instance 1.
[0001.712] E> eeprom: Retry to read I2C slave device.
[0001.717] E> I2C: slave not found in slaves.
[0001.721] E> I2C: Could not write 0 bytes to slave: 0x00a0 with repeat start true.
[0001.729] E> I2C_DEV: Failed to send register address 0x00000000.
[0001.734] E> I2C_DEV: Could not read 256 registers of size 1 from slave 0xa0 at 0x00000000 via instance 1.
[0001.744] E> eeprom: Failed to read I2C slave device
[0001.749] I> Eeprom read failed 0x3526070d
[0001.753] I> create_pm_ids: id: 2888-0004-400-L, len: 15
[0001.758] I> config: mem-type:00,power-config:00,misc-config:00,modem-config:00,touch-config:00,display-config:00,, len: 93
[0001.769] I> Adding plugin-manager/ids/2888-0004-400=/i2c@3160000:module@0x50
[0001.776] E> "i2c@3160000" doesn't exist, creating
[0001.781] E> "module@0x50" doesn't exist, creating
[0001.788] I> Adding plugin-manager/cvm
[0001.789] E> "chip-id" doesn't exist, creating
[0001.793] I> Adding plugin-manager/chip-id/A02P
[0001.798] I> Plugin-manager override starting
[0001.805] I> Disable plugin-manager status in FDT
[0001.806] I> Plugin-manager override finished successfully
[0001.811] I> gpio framework initialized
[0001.819] I> tegrabl_gpio_driver_register: register 'nvidia,tegra194-gpio' driver
[0001.826] I> tegrabl_gpio_driver_register: register 'nvidia,tegra194-gpio-aon' driver
[0001.830] I> tegrabl_tca9539_init: i2c bus: 1, slave addr: 0x46
[0001.841] E> fetch_driver_phandle_from_dt: failed to get node with compatible ti,tca9539
[0001.848] E> fetch_driver_phandle_from_dt: failed to get node with compatible nxp,tca9539
[0001.852] W> tegrabl_tca9539_init: failed to fetch phandle from dt
[0001.858] I> tegrabl_tca9539_init: i2c bus: 1, slave addr: 0x44
[0001.868] E> fetch_driver_phandle_from_dt: failed to get node with compatible ti,tca9539
[0001.875] E> fetch_driver_phandle_from_dt: failed to get node with compatible nxp,tca9539
[0001.880] W> tegrabl_tca9539_init: failed to fetch phandle from dt
[0001.888] I> fixed regulator driver initialized
[0001.901] I> register 'maxim' power off handle
[0001.902] I> virtual i2c enabled
[0001.902] I> registered 'maxim,max20024' pmic
[0001.903] I> tegrabl_gpio_driver_register: register 'max20024-gpio' driver
[0001.908] I> Boot-device: eMMC
[0001.911] I> Boot_device: SDMMC_BOOT instance: 3
[0001.920] I> sdmmc-3 params source = boot args
[0001.920] I> sdmmc bdev is already initialized
[0001.924] I> sdmmc-3 params source = boot args
[0001.955] I> Found 17 partitions in SDMMC_BOOT (instance 3)
[0001.968] I> Found 42 partitions in SDMMC_USER (instance 3)
[0001.981] E> no regulator info present for avdd_hdmi-supply
[0001.981] E> tegrabl_display_get_pdata, failed to parse dtb settings
[0001.987] E> no regulator info present for avdd_hdmi-supply
[0001.988] E> tegrabl_display_get_pdata, failed to parse dtb settings
[0001.989] E> cannot find any other nvdisp nodes
[0001.990] E> no valid display unit config found in dtb
[0001.991] W> display init failed
[0001.991] I> Load in CBoot Boot Options partition and parse it
[0001.997] E> Cannot read beyond partition boundary for CPUBL-CFG
[0002.003] E> tegrabl_read_cbo Failed to read CPUBL-CFG partition
[0002.009] W> platform_init: tegrabl_read_cbo failed with error 0xd0d0104
[0002.015] I> Hit any key to stop autoboot: 4 3 2 1
[0004.023] initializing target
[0004.023] calling apps_init()
[0004.024] starting app kernel_boot_app
[0004.043] I> found decompressor handler: lz4-legacy
[0004.044] I> decompressing BMP blob ...
[0004.048] I> Kernel type = Normal
[0004.049] I> Loading partition kernel-bootctrl at 0xa42b0000 from device(0x1)
[0004.055] W> tegrabl_get_kernel_bootctrl: magic number(0x00000000) is invalid
[0004.056] W> tegrabl_get_kernel_bootctrl: use default dummy boot control data
[0004.056] I> ########## SD boot ##########
[0004.057] I> No sdcard
[0004.057] I> -0 params source =
[0004.060] E> Blockdev open: exit error
[0004.064] E> SD boot failed, err: 724238353
[0004.068] I> ########## USB boot ##########
[0004.077] W> No valid slot number is found in scratch register
[0004.077] W> Return default slot: _a
[0004.093] I> USB Firmware Version: 60.06 release
[0004.152] I> enabling 'vdd-5v-sata' regulator
[0004.160] I> regulator of usb2-1 already enabled
[0004.167] I> regulator of usb2-2 already enabled
[0004.175] I> regulator of usb2-3 already enabled
[0005.243] I> USB 2.0 port 4 new high-speed USB device detected
[0005.244] W> Change usb2 root port id to 2
[0005.244] W> Change usb2 root port id to 3
[0005.244] W> Change usb2 root port id to 4
[0005.246] W> WARNING: event and command not matching, cmd_trb_ptr = 0xa069a300, cmd_ring.dma = 0xa069a380
[0005.246] E> slot id is 1
[0005.248] W> WARNING: event and command not matching, cmd_trb_ptr = 0xa069a300, cmd_ring.dma = 0xa069a380
[0005.261] W> WARNING: event and command not matching, cmd_trb_ptr = 0xa069a300, cmd_ring.dma = 0xa069a380
[0005.267] I>
[0005.268] I> Enumerated USB Device 1c28:c012
[0005.272] I>
[0005.273] E> Enumerated device doesn't belong to MSD class or protocol is not bulk-only!!
[0005.281] E> USBMSD: Failed to initialize Enumerated USB device either not an MSD device or supported protoco[0005.291] E> USBMSD: Failed to open usbmsd open, 0.
[0005.296] E> Error opening USBMSD driver 0, err: 7c7c0312
[0005.301] E> Failed to initialize device 5-0
[0005.305] E> USB boot failed, err: 2088502034
[0005.309] I> ########## Fixed storage boot ##########
[0005.314] I> Already published: 00010003
[0005.318] I> Look for boot partition
[0005.321] I> Fallback: assuming 0th partition is boot partition
[0005.327] I> Detect filesystem
[0005.354] I> Loading extlinux.conf ...
[0005.354] I> rootfs path: /sdmmc_user/boot/extlinux/extlinux.conf
[0005.403] I> L4T boot options
[0005.404] I> [1]: "primary kernel"
[0005.404] I> [2]: "backup kernel"
[0005.404] I> Enter choice:
[0008.405] I> Continuing with default option: 1
[0008.405] I> Loading kernel sig file from rootfs ...
[0008.405] I> rootfs path: /sdmmc_user/boot/Image.sig
[0008.442] I> Loading kernel binary from rootfs ...
[0008.442] I> rootfs path: /sdmmc_user/boot/Image
[0008.670] I> Validate kernel ...
[0008.670] I> T19x: Authenticate kernel (bin_type: 37), max size 0x5000000
[0008.984] E> digest on binary did not match!!
[0008.985] C> OEM authentication of kernel payload failed!
[0008.985] W> Failed to validate kernel binary (err=1077936152)
[0008.986] W> Security fuse not burned, continue to boot
[0009.004] I> Loading kernel-dtb sig file from rootfs ...
[0009.004] I> rootfs path: /sdmmc_user/boot/dtb/277-rogue-2xocto.dtb.sig
[0009.041] I> Loading kernel-dtb binary from rootfs ...
[0009.041] I> rootfs path: /sdmmc_user/boot/dtb/277-rogue-2xocto.dtb
[0009.078] I> Validate kernel-dtb ...
[0009.079] I> T19x: Authenticate kernel-dtb (bin_type: 38), max size 0x400000
[0009.083] E> digest on binary did not match!!
[0009.083] C> OEM authentication of kernel-dtb payload failed!
[0009.083] W> Failed to validate kernel-dtb binary (err=1077936152)
[0009.084] W> Security fuse not burned, continue to boot
[0009.085] I> Loading ramdisk from rootfs ...
[0009.089] I> rootfs path: /sdmmc_user/boot/initrd
[0009.154] I> Kernel hdr @0xa42b0000
[0009.154] I> Kernel dtb @0x90000000
[0009.155] I> decompressor handler not found
[0009.155] I> Copying kernel image (35221512 bytes) from 0xa42b0000 to 0x80080000 ... [0009.162] I> Done
[0009.163] I> Updated bpmp info to DTB
[0009.164] I> Ramdisk: Base: 0x91000000; Size: 0x54ead4
[0009.165] I> Updated initrd info to DTB
[0009.165] W> WARN: Fail to override "console=none" in commandline
[0009.167] E> tegrabl_linuxboot_add_disp_param, du 0 failed to get display params
[0009.174] E> tegrabl_linuxboot_add_disp_param, du 0 failed to get display params
[0009.182] E> tegrabl_linuxboot_add_disp_param, du 0 failed to get display params
[0009.189] W> No valid slot number is found in scratch register
[0009.195] W> Return default slot: _a
[0009.198] I> Active slot suffix:
[0009.201] I> add_boot_slot_suffix: slot_suffix =
[0009.206] I> Linux Cmdline: root=/dev/mmcblk0p1 rw rootwait console=ttyTCU0,115200n8 console=tty0 fbcon=map:0 net.ifnames=0 rootfstype=ext4 video=tegrafb no_console_suspend=1 earlycon=tegra_comb_uart,mm
[0009.238] I> Updated bootarg info to DTB
[0009.242] W> MAC addr invalid!
[0009.245] E> Failed to get WIFI MAC address
[0009.249] W> MAC addr invalid!
[0009.252] E> Failed to get Bluetooth MAC address
[0009.256] I> eeprom_get_mac_addr: MAC (type: 2): 48:b0:2d:13:3e:2b
[0009.263] E> "plugin-manager" doesn't exist, creating
[0009.267] I> Adding /chosen/plugin-manager/cvm
[0009.271] E> "chip-id" doesn't exist, creating
[0009.276] I> Adding /chosen/plugin-manager/chip-id
[0009.280] E> "configs" doesn't exist, creating
[0009.285] I> Adding /chosen/plugin-manager/configs
[0009.289] E> "ids" doesn't exist, creating
[0009.293] I> Adding /chosen/plugin-manager/ids
[0009.298] E> "odm-data" doesn't exist, creating
[0009.302] I> Adding /chosen/plugin-manager/odm-data
[0009.310] E> "memory" doesn't exist, creating
[0009.312] I> [0] START: 0x80000000, END: 0xac000000
[0009.315] I> [1] START: 0xac004000, END: 0xf09d0000
[0009.320] I> [2] START: 0xf09dc000, END: 0xf09e0000
[0009.325] I> dram_block larger than 80000000
[0009.329] I> [3] START: 0x100000000, END: 0x880000000
[0009.334] I> added [base:0x80000000, size:0x2c000000] to /memory
[0009.340] I> added [base:0xac200000, size:0x44600000] to /memory
[0009.346] I> added [base:0x100000000, size:0x780000000] to /memory
[0009.353] I> Updated memory info to DTB
[0009.356] E> add_disp_param: failed to get display params for du=0
[0009.362] E> "reset" doesn't exist, creating
[0009.367] I> NVG: Logical CPU: 0; MPIDR: 0x80000000
[0009.370] I> Enabled cpu-0 (mpidr: 0x0) node in FDT
[0009.375] I> NVG: Logical CPU: 1; MPIDR: 0x80000001
[0009.380] I> Enabled cpu-1 (mpidr: 0x1) node in FDT
[0009.384] I> NVG: Logical CPU: 2; MPIDR: 0x80000100
[0009.389] I> Enabled cpu-2 (mpidr: 0x100) node in FDT
[0009.394] I> NVG: Logical CPU: 3; MPIDR: 0x80000101
[0009.399] I> Enabled cpu-3 (mpidr: 0x101) node in FDT
[0009.404] I> NVG: Logical CPU: 4; MPIDR: 0x80000200
[0009.408] I> Enabled cpu-4 (mpidr: 0x200) node in FDT
[0009.413] I> NVG: Logical CPU: 5; MPIDR: 0x80000201
[0009.418] I> Enabled cpu-5 (mpidr: 0x201) node in FDT
[0009.423] I> NVG: Logical CPU: 6; MPIDR: 0x80000300
[0009.428] I> Enabled cpu-6 (mpidr: 0x300) node in FDT
[0009.432] I> NVG: Logical CPU: 7; MPIDR: 0x80000301
[0009.437] I> Enabled cpu-7 (mpidr: 0x301) node in FDT
[0009.443] E> "misc-data" doesn't exist, creating
[0009.447] I> Boot-device: eMMC
[0009.449] I> Add boot-sdmmc to plugin-manager/misc-data
[0009.455] I> Add storage-sdmmc to plugin-manager/misc-data
[0009.460] W> Unknown storage device
[0009.466] I> Add serial number:1422520020891 as DT property
[0009.470] I> Plugin-manager override starting
[0009.474] I> Disable plugin-manager status in FDT
[0009.477] I> Plugin-manager override finished successfully
[0009.483] I> tegrabl_load_kernel_and_dtb: Done
[0009.487] E> tegrabl_display_clear: display is not initialized
[0009.493] W> Boot logo display failed...
[0009.496] I> Kernel EP: 0x80080000, DTB: 0x90000000
[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 4.9.140-tegra-pmx+ (root@gke-x1-ci-090c7340-l1zj) (gcc version 7.3.1 20180425 [linaro-7.3-2018.05 revision d29120a424ecfbc167ef90065c0eeb7f91977701] (Linaro GCC 7.3-2018.05) 1
[ 0.000000] Boot CPU: AArch64 Processor [4e0f0040]
[ 0.000000] OF: fdt:memory scan node memory, reg size 48,
[ 0.000000] OF: fdt: - 80000000 , 2c000000
[ 0.000000] OF: fdt: - ac200000 , 44600000
[ 0.000000] OF: fdt: - 100000000 , 780000000
[ 0.000000] earlycon: tegra_comb_uart0 at MMIO32 0x000000000c168000 (options '')
[ 0.000000] bootconsole [tegra_comb_uart0] enabled
<hit enter to activate fiq debugger>
[ 1.855866] tegradc 15200000.nvdisplay: tegra_dc_parse_panel_ops: panel: /host1x/sor2/hdmi-display is not active
[ 1.855970] tegradc 15200000.nvdisplay: err:-19 parsing panel_ops
[ 4.237808] mmc0: RED error 4 !!!
[ 4.237922] sdhci: =========== REGISTER DUMP (mmc0)===========
[ 4.238032] sdhci: Sys addr: 0x00000000 | Version: 0x00000505
[ 4.238141] sdhci: Blk size: 0x00007200 | Blk cnt: 0x00000003
[ 4.238261] sdhci: Argument: 0x00018000 | Trn mode: 0x00000023
[ 4.238368] sdhci: Present: 0x01fb01f6 | Host ctl: 0x0000003d
[ 4.238477] sdhci: Power: 0x00000001 | Blk gap: 0x00000000
[ 4.238583] sdhci: Wake-up: 0x00000000 | Clock: 0x00000007
[ 4.238690] sdhci: Timeout: 0x0000000e | Int stat: 0x00004000
[ 4.238797] sdhci: Int enab: 0xffff4000 | Sig enab: 0xfffc4000
[ 4.238903] sdhci: AC12 err: 0x00000000 | Slot int: 0x00000000
[ 4.239011] sdhci: Caps: 0x3f6cd08c | Caps_1: 0x18002f77
[ 4.239123] sdhci: Cmd: 0x00000d1e | Max curr: 0x00000000
[ 4.239562] sdhci: Host ctl2: 0x0000300d
[ 4.239863] sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0x00000000ffee3810
[ 4.240371] sdhci: ===========================================
[ 4.240859] kernel BUG at /root/skel/scripts/provision/nvidia/build/xavier/Linux_for_Tegra/sources/kernel/kernel-4.9/drivers/mmc/host/cmdq_hci.c:681!
[ 4.250750] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
[ 4.256091] Modules linked in:
[ 4.258827] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.9.140-tegra-pmx+ #1
[ 4.265976] Hardware name: jetson-xavier (DT)
[ 4.270261] task: ffffff8009f31440 task.stack: ffffff8009f20000
[ 4.276128] PC is at cmdq_irq+0x224/0x230
[ 4.280318] LR is at cmdq_irq+0x224/0x230
[ 4.284086] pc : [<ffffff8008bf94c4>] lr : [<ffffff8008bf94c4>] pstate: 604001c5
[ 4.291524] sp : ffffffc7ffb86db0
[ 4.295201] x29: ffffffc7ffb86db0 x28: ffffff8009f31440
[ 4.300718] x27: ffffff800a171000 x26: 0000000000000000
[ 4.306564] x25: 000000003fffffff x24: 00000000000001c0
[ 4.312092] x23: ffffffc7d7e8df80 x22: ffffffc7dadc5000
[ 4.317687] x21: 0000000000004000 x20: 0000000000000004
[ 4.323462] x19: ffffffc7d7e8df00 x18: 0000000000000010
[ 4.329404] x17: 0000000000000002 x16: 0000000000000003
[ 4.334838] x15: ffffffffffffffff x14: ffffff808a222a82
[ 4.340524] x13: ffffff800a222a90 x12: 0000000000000004
[ 4.346213] x11: 0000000005f5e0ff x10: 00000000000003e9
[ 4.351638] x9 : 00000000ffffffd0 x8 : ffffff80084107f8
[ 4.357412] x7 : ffffff8009f92fb0 x6 : ffffff800840fbe8
[ 4.362924] x5 : 0000000000000000 x4 : 0000000000000000
[ 4.368515] x3 : ffffffffffffffff x2 : ffffff8009f44348
[ 4.373608] x1 : ffffff8009f31440 x0 : 0000000000000032
[ 4.378947]
[ 4.380595] Process swapper/0 (pid: 0, stack limit = 0xffffff8009f20000)
[ 4.386979] Call trace:
[ 4.389350] [<ffffff8008bf94c4>] cmdq_irq+0x224/0x230
[ 4.394170] [<ffffff8008bf1990>] sdhci_irq+0x98/0xd80
[ 4.398977] [<ffffff8008123260>] __handle_irq_event_percpu+0x68/0x288
[ 4.405093] [<ffffff80081234a8>] handle_irq_event_percpu+0x28/0x60
[ 4.410953] [<ffffff8008123530>] handle_irq_event+0x50/0x80
[ 4.416292] [<ffffff80081272f8>] handle_fasteoi_irq+0xc8/0x1b8
[ 4.421898] [<ffffff800812224c>] generic_handle_irq+0x34/0x50
[ 4.426972] [<ffffff8008122930>] __handle_domain_irq+0x68/0xc0
[ 4.432831] [<ffffff8008080d44>] gic_handle_irq+0x5c/0xb0
[ 4.437906] [<ffffff8008082be8>] el1_irq+0xe8/0x18c
[ 4.442206] [<ffffff8008bce890>] cpuidle_enter_state+0xb8/0x380
[ 4.448405] [<ffffff8008bcebcc>] cpuidle_enter+0x34/0x48
[ 4.453653] [<ffffff8008112a1c>] call_cpuidle+0x44/0x70
[ 4.458730] [<ffffff8008112d98>] cpu_startup_entry+0x1b0/0x200
[ 4.464594] [<ffffff8008f9b5c4>] rest_init+0x84/0x90
[ 4.469491] [<ffffff8009690b64>] start_kernel+0x370/0x384
[ 4.474915] [<ffffff8009690204>] __primary_switched+0x80/0x94
[ 4.480266] ---[ end trace 3aea85c047ad22ee ]---
[ 4.492971] Kernel panic - not syncing: Fatal exception in interrupt
[ 4.493115] SMP: stopping secondary CPUs
[ 4.495575] Kernel Offset: disabled
[ 4.499063] Memory Limit: none
[ 4.501956] trusty-log panic notifier - trusty version Built: 22:43:40 Dec 9 2019 [ 4.515891] Rebooting in 5 seconds..
����Shutdown state requested 1
Rebooting system ...
��
I was able to recover it once by flashing it. But soon after, within a couple of days, the boot issue came back. But this time I was unable to flash it.
[ 9.8208 ] Flashing the device
[ 9.8245 ] tegraparser_v2 --storageinfo storage_info.bin --generategpt --pt flash.xml.bin
[ 9.8293 ]
[ 9.8327 ] tegradevflash_v2 --pt flash.xml.bin --create
[ 9.8358 ] Bootloader version 01.00.0000
[ 9.8387 ] Erasing sdmmc_boot: 3 ......... [Done]
[ 10.9532 ] Writing partition secondary_gpt with gpt_secondary_0_3.bin
[ 10.9556 ] [................................................] 100%
[ 10.9865 ] Erasing sdmmc_user: 3 ......... [Done]
[ 12.6726 ] Writing partition master_boot_record with mbr_1_3.bin
[ 12.6739 ] [................................................] 100%
[ 12.6754 ] Writing partition primary_gpt with gpt_primary_1_3.bin
[ 12.6823 ] [................................................] 100%
[ 12.6836 ] 000000000d0d0001: o initialize partition table from GPT.
[ 12.6973 ]
[ 12.6973 ]
Error: Return value 1
Command tegradevflash_v2 --pt flash.xml.bin --create
Failed flashing t186ref.
L4T version: 32.3.1
I have seen another forum post about this same issue.
- What could have caused this?
- Is there a way to monitor eMMC health so we know when it might fail?