Sometimes not booting in Jetson Xavier NX

Autonomous Machines Jetson & Embedded Systems Jetson Xavier NX
,
1

I have a Jetson Xavier NX core board with a RTSO-6002e carrier board. Sometimes it does not boot. Thats mean, when the Nvidia logo disappears no boot logs is displayed and we see message “No signal” on monitor. Then nothing happens more.
Could anyone help me to solve this problem?
In addition, I have a capture of the serial output which in the following:

[    6.924710] tegradccommon 15200000.display-hub: host1x channel mapped
[    6.925007] tegradccommon 15200000.display-hub: dc_common syncpt # 1 allocated
[    6.925275] tegradccommon 15200000.display-hub: dma mapping done
[    6.927151] tegradc 15200000.display: Adding to iommu group 27
[    6.932349] tegradc 15200000.display: disp0 connected to head0->sor1
[    6.932753] generic_infoframe_type: 0x87
[    6.933008] tegradc 15200000.display: DT parsed successfully
[    6.933318] tegradc 15200000.display: Display dc.(____ptrval____) registered with id=0
[    6.940848] tegra_cec 3960000.tegra_cec: dt=1 start=0x03960000 end=0x03960FFF irq=63
[    6.942013] tegradc 15210000.display: Adding to iommu group 27
[    6.945519] tegra_nvdisp_bandwidth_register_max_config: max config iso bw = 15681600 KB/s
[    6.945532] tegra_nvdisp_bandwidth_register_max_config: max config EMC floor = 933000000 Hz
[    6.945536] tegra_nvdisp_bandwidth_register_max_config: max config hubclk = 300000000 Hz
[    6.946331] tegradc 15200000.display: vblank syncpt # 8 for dc 0
[    6.946399] tegradc 15200000.display: vpulse3 syncpt # 9 for dc 0
[    6.947506] tegra_cec 3960000.tegra_cec: Unpowergated DISP
[    6.947783] tegradc 15200000.display: Bootloader disp_param detected. Detected mode: 1280x720 (on 0x0mm) pclk=74175000
[    6.951966] tegradc 15200000.display: hdmi: can't get adpater for ddc bus 3
[    6.952904] tegradc 15200000.display: out->type:1 out_ops->init err = -517
[    6.954847] tegradc 15210000.display: disp0 connected to head1->sor
[    6.962758] tegra_cec 3960000.tegra_cec: Enable clock result: 0.
[    6.970614] tegradc 15210000.display: parse_dp_settings: No dp-lt-settings node
[    6.978785] tegra_cec 3960000.tegra_cec: tegra_cec_init started
[    6.984359] tegradc 15210000.display: DT parsed successfully
[    6.990596] tegra_cec 3960000.tegra_cec: cec_add_sysfs ret=0
[    6.995624] tegradc 15210000.display: dc.1 probe not in device tree order, deferring
[    7.006408] tegra_cec 3960000.tegra_cec: probed
[    7.070611] tegra-gpcdma 2600000.dma: Adding to iommu group 2
[    7.077752] tegra-gpcdma 2600000.dma: GPC DMA driver register 31 channels
[    7.082656] kfuse 3830000.kfuse: initialized
[    7.086969] tegra-fuse-burn efuse-burn: shutdown limit check disabled
[    7.093237] tegra-fuse-burn efuse-burn: Fuse burn driver initialized
[    7.100207] serial-tegra 3100000.serial: Adding to iommu group 2
[    7.106226] 3100000.serial: ttyTHS0 at MMIO 0x3100000 (irq = 31, base_baud = 0) is a TEGRA_UART
[    7.115988] serial-tegra 3110000.serial: Adding to iommu group 2
[    7.121330] 3110000.serial: ttyTHS1 at MMIO 0x3110000 (irq = 32, base_baud = 0) is a TEGRA_UART
[    7.130063] serial-tegra 3140000.serial: Adding to iommu group 2
[    7.135710] 3140000.serial: ttyTHS4 at MMIO 0x3140000 (irq = 33, base_baud = 0) is a TEGRA_UART
[    7.177675] tegra-i2c 31e0000.i2c: Adding to iommu group 2
[    7.196127] cpufreq: cpufreq_online: CPU0: Running at unlisted initial frequency: 1906000 KHz, changing to: 1907200 KHz
[    7.197231] tegra194-cpufreq ccplex: probed with BWMGR
[    7.198500] sdhci-tegra 3460000.sdhci: BWMGR client registration for eMC Successful
[    7.199497] sdhci-tegra 3440000.sdhci: BWMGR client registration for eMC Successful
[    7.202626] irq: IRQ262: trimming hierarchy from :pmc@c360000
[    7.202986] irq: IRQ263: trimming hierarchy from :pmc@c360000
[    7.203285] usb-conn-gpio 3520000.xusb_padctl:ports:usb2-0:connector: repeated role: 0
[    7.204967] tegra194-isp5 13e10000.host1x:isp@14800000: initialized
[    7.208833] irq: IRQ264: trimming hierarchy from :pmc@c360000
[    7.212263] sdhci-tegra 3440000.sdhci: wakeup init done, cdirq 264
[    7.219785] tegra194-vi5 15c10000.vi: initialized
[    7.220433] mmc0: CQHCI version 5.10
[    7.224134] tegradc 15200000.display: disp0 connected to head0->sor1
[    7.233280] generic_infoframe_type: 0x87
[    7.237426] tegradc 15200000.display: DT parsed successfully
[    7.243005] tegradc 15200000.display: Display dc.(____ptrval____) registered with id=0
[    7.253150] tegra_nvdisp_bandwidth_register_max_config: max config iso bw = 15681600 KB/s
[    7.256185] tegra-xusb 3610000.xhci: Firmware timestamp: 2022-03-16 11:07:43 UTC, Version: 60.13 release
[    7.259301] tegra_nvdisp_bandwidth_register_max_config: max config EMC floor = 933000000 Hz
[    7.259305] tegra_nvdisp_bandwidth_register_max_config: max config hubclk = 300000000 Hz
[    7.259627] tegradc 15200000.display: vblank syncpt # 11 for dc 0
[    7.266407] mmc1: SDHCI controller on 3440000.sdhci [3440000.sdhci] using ADMA 64-bit
[    7.268593] tegra-xusb 3610000.xhci: xHCI Host Controller
[    7.277234] tegradc 15200000.display: vpulse3 syncpt # 12 for dc 0
[    7.277440] tegradc 15200000.display: Bootloader disp_param detected. Detected mode: 8x4 (on 0x0mm) pclk=74175000
[    7.278172] mmc0: SDHCI controller on 3460000.sdhci [3460000.sdhci] using ADMA 64-bit
[    7.285038] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 1
[    7.292787] tegradc 15200000.display: hdmi: invalid prod list prod_list_hdmi_board
[    7.299785] tegra-xusb 3610000.xhci: hcc params 0x0184ff25 hci version 0x110 quirks 0x0000000000050810
[    7.304512] tegradc 15200000.display: hdmi: tegra_hdmi_tmds_range_read(bd) failed
[    7.310738] tegra-xusb 3610000.xhci: irq 188, io mem 0x03610000
[    7.311069] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    7.332590] CPU:0, Error: cbb-noc@2300000, irq=15
[    7.332748] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.336372] **************************************
[    7.336384] CPU:0, Error:cbb-noc
[    7.343999] usb usb1: Product: xHCI Host Controller
[    7.353435]  Error Logger            : 0
[    7.353450]  ErrLog0                 : 0x80030000
[    7.353458]    Transaction Type      : RD  - Read, Incrementing
[    7.360891] usb usb1: Manufacturer: Linux 5.10.104-tegra xhci-hcd
[    7.366652]    Error Code            : SLV
[    7.366658]    Error Source          : Target
[    7.366661]    Error Description     : Target error detected by CBB slave
[    7.366672]    AXI2APB_5 bridge error: RDFIFOF - Read Response FIFO Full interrupt
[    7.375237] usb usb1: SerialNumber: 3610000.xhci
[    7.379876]    Packet header Lock    : 0
[    7.387442] hub 1-0:1.0: USB hub found
[    7.391780]    Packet header Len1    : 3
[    7.391788]    NOC protocol version  : version >= 2.7
[    7.395504] hub 1-0:1.0: 4 ports detected
[    7.400164]  ErrLog1                 : 0x35242c
[    7.400170]  ErrLog2                 : 0x0
[    7.400174]    RouteId               : 0x35242c
[    7.400179]    InitFlow              : ccroc_p2ps/I/ccroc_p2ps
[    7.400187]    Targflow              : host1x_p2pm/T/host1x_p2pm
[    7.403754] tegra-xusb 3610000.xhci: xHCI Host Controller
[    7.407247]    TargSubRange          : 18
[    7.407251]    SeqId                 : 0
[    7.407256]  ErrLog3                 : 0x4045c
[    7.407260]  ErrLog4                 : 0x0
[    7.407289]    Address accessed      : 0x15b4045c
[    7.412776] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 2
[    7.419061]  ErrLog5                 : 0xb09f851
[    7.419066]    Non-Modify            : 0x1
[    7.419071]    AXI ID                : 0x16
[    7.419075]    Master ID             : CCPLEX
[    7.419102]    Security Group(GRPSEC): 0x7e
[    7.422169] tegra-xusb 3610000.xhci: Host supports USB 3.1 Enhanced SuperSpeed
[    7.425816]    Cache                 : 0x1 -- Bufferable
[    7.425823]    Protection            : 0x2 -- Unprivileged, Non-Secure, Data Access
[    7.425827]    FALCONSEC             : 0x0
[    7.425831]    Virtual Queuing Channel(VQC): 0x0
[    7.425836]  **************************************
[    7.425880] ------------[ cut here ]------------
[    7.432519] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[    7.440060] kernel BUG at drivers/soc/tegra/cbb/tegra194-cbb.c:2057!
[    7.440069] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
[    7.440078] Modules linked in:
[    7.444709] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.448369]
[    7.448399] CPU: 0 PID: 121 Comm: kworker/0:3 Not tainted 5.10.104-tegra #3
[    7.452325] usb usb2: Product: xHCI Host Controller
[    7.455912] Hardware name: Unknown NVIDIA Jetson Xavier NX Developer Kit/NVIDIA Jetson Xavier NX Developer Kit, BIOS 2.1-32413640 01/24/2023
[    7.455937] Workqueue: events_freezable mmc_rescan
[    7.460720] usb usb2: Manufacturer: Linux 5.10.104-tegra xhci-hcd
[    7.464733]
[    7.464742] pstate: 60400089 (nZCv daIf +PAN -UAO -TCO BTYPE=--)
[    7.464768] pc : tegra194_cbb_err_isr+0x19c/0x1b0
[    7.464780] lr : tegra194_cbb_err_isr+0x11c/0x1b0
[    7.468060] usb usb2: SerialNumber: 3610000.xhci
[    7.468465] hub 2-0:1.0: USB hub found
[    7.470864] sp : ffff800010003b40
[    7.470874] x29: ffff800010003b40 x28: 0000000000000001
[    7.470889] x27: 0000000000000080 x26: ffffbafd31c34668
[    7.470906] x25: ffffbafd3257ae10
[    7.473890] hub 2-0:1.0: 4 ports detected
[    7.478827] x24: 0000000000000001
[    7.478836] x23: ffffbafd31f17000 x22: ffffbafd3239ea00
[    7.478847] x21: 000000000000000f x20: 0000000000000005
[    7.478864] x19: ffffbafd3239e9f0 x18: 0000000000000060
[    7.700544] x17: 0000000000000007 x16: 0000000000000068
[    7.705715] x15: ffff29db96b993f0 x14: ffffffffffffffff
[    7.711485] x13: ffffbafd32528de8 x12: ffffbafd32528a2d
[    7.716736] x11: 0720072007200720 x10: 0720072007200720
[    7.722424] x9 : ffff800010003a50 x8 : 2a2a2a2a2a2a2a2a
[    7.727503] x7 : 2a2a2a2a2a2a2a2a x6 : 00000000299642cb
[    7.733187] x5 : 000000000000000c x4 : 00000000fffff27b
[    7.738266] x3 : 00000000ffffffff x2 : ffffbafd30717460
[    7.743862] x1 : ffff29db96b98e80 x0 : 0000000100010101
[    7.748957] Call trace:
[    7.751572]  tegra194_cbb_err_isr+0x19c/0x1b0
[    7.756117]  __handle_irq_event_percpu+0x60/0x2a0
[    7.760664]  handle_irq_event_percpu+0x3c/0xa0
[    7.764870]  handle_irq_event+0x4c/0xf0
[    7.768889]  handle_fasteoi_irq+0xbc/0x170
[    7.772912]  generic_handle_irq+0x3c/0x60
[    7.776936]  __handle_domain_irq+0x6c/0xc0
[    7.781140]  efi_header_end+0xa8/0xf0
[    7.784636]  el1_irq+0xd0/0x180
[    7.787610]  __do_softirq+0xb0/0x3e0
[    7.791287]  irq_exit+0xc0/0xe0
[    7.794262]  __handle_domain_irq+0x70/0xc0
[    7.798287]  efi_header_end+0xa8/0xf0
[    7.801961]  el1_irq+0xd0/0x180
[    7.804939]  _raw_spin_unlock_irqrestore+0x34/0x70
[    7.809496]  tegra_bpmp_transfer+0x158/0x370
[    7.814042]  tegra_bpmp_clk_transfer+0x8c/0xe0
[    7.818070]  tegra_bpmp_clk_determine_rate+0x90/0xd0
[    7.823226]  clk_core_determine_round_nolock.part.0+0x34/0x80
[    7.829001]  clk_core_round_rate_nolock+0x98/0xb0
[    7.833726]  clk_core_set_rate_nolock+0x64/0x1c0
[    7.838275]  clk_set_rate+0x40/0x100
[    7.841952]  tegra_sdhci_set_clock+0x60/0x150
[    7.845998]  sdhci_set_ios+0x28c/0x5e0
[    7.850092]  mmc_set_chip_select+0x34/0x40
[    7.854287]  mmc_go_idle+0xb8/0xf0
[    7.857356]  mmc_init_card+0x50/0x1830
[    7.861552]  mmc_attach_mmc+0xdc/0x180
[    7.865145]  mmc_rescan+0x288/0x390
[    7.868819]  process_one_work+0x1c0/0x4a0
[    7.873033]  worker_thread+0x50/0x420
[    7.876520]  kthread+0x148/0x170
[    7.880013]  ret_from_fork+0x10/0x18
[    7.883699] Code: a9446bf9 a94573fb a8c67bfd d65f03c0 (d4210000)
[    7.890000] ---[ end trace 13ab0848ac11e53b ]---
[    7.894711] Kernel panic - not syncing: Oops - BUG: Fatal exception in interrupt
[    7.902073] SMP: stopping secondary CPUs
[    7.906207] Kernel Offset: 0x3afd20560000 from 0xffff800010000000
[    7.912294] PHYS_OFFSET: 0xffffd626c0000000
[    7.916319] CPU features: 0x8240002,03802a30
[    7.920435] Memory Limit: none
[    7.923847] ---[ end Kernel panic - not syncing: Oops - BUG: Fatal exception in interrupt ]---

log2.txt (48.0 KB)

2

please check this post.

3

thanks for your support.
we used jetpack 5.1 and we don’t know where patching this code you provided on this post.
can you guide me?
Kernel panic as result of CPU:0, Error:cbb-noc error on L4t 35.4.1

4

The patch is based on jetpack5.1.2, jp5.1 is too old to apply it.

Also, even applying it in jp5.1 won’t take effect.

5

a.Even bypassing the logo won’t solve this problem in Jetpack 5.1?
b.How can I bypass the Nvidia logo?

6

@WayneWWW
Could you guide me, please?

7

No, too many changes between rel-35.1 and rel-35.4.1. It cannot work on jp5.1.
Please upgrade.

9

How can I bypass the Nvidia logo in 35.4.1?

10

Add bootloader status to disabled in display node device tree.

12

@WayneWWW
could you guide me more in that subject, please?
we added “bootloader-status=disabled” in 4 display controllers in tegra194-soc-base.dtsi but I still see boot logo

13

  1. How did you update the device tree after your modification?

  2. Full flash is needed because this thing is used for bootloader. Not only linux kernel.

  3. There are 2 pictures (NV logo) during the whole boot up. One is in UEFI and another one is in kernel. Only the UEFI one is the real boot logo that got disabled here.

14

  1. We added “bootloader-status=disabled” in 4 display controllers in /kernel_src/hardware/nvidia/soc/t19x/kernel-dts/tegra194-soc/tegra194-soc-base.dtsi file and updated the device tree like commands in update_DT.txt.
    update_DT.txt (2.2 KB)
    This is tegra194-soc-base.dtsi file after modification.
    tegra194-soc-base.txt (61.8 KB)

  2. We did full flash.

  3. how can I bypass both of them?

15

Hi,

  1. Your update_DT.txt is wrong. This issue is on jetpack5, but I am not sure why you are untar a 32.7.2 BSP here.
    Please be aware that jetpack5 are are rel-35…

  2. You don’t need to disable them both… if the one enabled UEFI is disabled, then boot logo which is related to this error has been disabled. The later one from kernel has nothing to do with this issue at all.

16

It’s just a typo and we’ve done all of that on R35.4.1. Is there anything else wrong besides those?
Is tegra194-soc-base file edited correctly?
Is the update process correct after modification?

17

How about you directly take a video of your current boot process and I can tell you whether your boot process has the boot log disabled or not?

18

current boot process

19

Please check whether /proc/device-tree really has your change or not.

20

Please watch the full video, after modification I encountered some errors during the boot and it did not boot completely, so I can not check /proc/device-tree.
Could you please check my modification in tegra194-soc-base file and tell if the changes are correct or not?
If is correct, could you please check my update process?
I think that my update process is wrong. Especially, I am not sure if I should include this file somewhere or not.

21

Hi,

You should use the serial console to check the board status…

I don’t really care about your process for now. They could be correct but maybe not precise. The board is on your side and could be various of reasons that lead to device tree not properly load.

Use the serial console to check /proc/device-tree first.

22

I have a question in this dtsi file.

head1: display@15210000 {
				status = "disabled";
				bootloader-status = "disabled";
				compatible = "nvidia,tegra194-dc";
				reg = <0x0 0x15210000 0x0 0x10000>;
				interrupts = <0 154 4>;

Do I have to change “status=‘disabled’” to “status=‘okay’” because I use custom carrier board?