Build the Real-Time Kernel

Hi

I am following the instruction at the document below to build the real time kernel

https://docs.nvidia.com/jetson/archives/r35.1/DeveloperGuide/text/SD/Kernel/KernelCustomization.html

### To Build the Real-Time Kernel

Apply RT patches to the kernel:

./kernel-5.10/scripts/rt-patch.sh apply-patches

Complete steps 2-6 as described in the previous section.

The build is done successfully on my Jetson Orin Developer Kit target system. When I follow “To Build the Kernel” step 5,

* Replace `Linux_for_Tegra/rootfs/usr/lib/modules/$(uname -r)/kernel/drivers/gpu/nvgpu/nvgpu.ko` with a copy of this file:

$kernel_out/drivers/gpu/nvgpu/nvgpu.ko

the folder, “Linux_for_Tegra/rootfs/usr/lib/modules/$(uname -r)/kernel/drivers/gpu/nvgpu”, doesn’t exist. The content of Linux_for_Tegra/rootfs is extracted from Tegra_Linux_Sample-Root-Filesystem_R35.1.0_aarch64.tbz2.

If the above issue can be resolved, how can I install the real time kernel after “To Build the Kernel” step 6.

Can “To Build the Kernel” step 7 be skipped for building the real time kernel?

For “To Build the Kernel” step 7, what is the script, apply_binaries.sh, used for?

I also try following steps at the section, “To Install the Real-Time Kernel Package”, but i get the error below when executing step 4, sudo apt install nvidia-l4t-rt-kernel nvidia-l4t-rt-kernel-headers

Reading package lists... Done
Building dependency tree       
Reading state information... Done
E: Unable to locate package nvidia-l4t-rt-kernel
E: Unable to locate package nvidia-l4t-rt-kernel-headers

The apt source in my /etc/apt/sources.list.d/nvidia-l4t-apt-source.list is

deb https://repo.download.nvidia.com/jetson/common r35.1 main
deb https://repo.download.nvidia.com/jetson/t234 r35.1 main
deb https://repo.download.nvidia.com/jetson/rt-kernel r35.1 main

Any kind of help is appreciated.

Wai Kwok

Sorry to tell we don’t support install RT kernel by apt-get and will update document in future release.
Please apply the Image from your build for RT kernel.

You can modify the /boot/extlinux/extlinux.conf to apply customized kernel

1 Like

HI

Thanks for your answer. I encounter some problems when I do the real time kernel build.

In my Orin developer kit target system, I create a directory, $HOME/Linux_for_Tegra, used for building the kernel. I follow the instruction in the document below to download the source and build the real-time kernel.

https://docs.nvidia.com/jetson/archives/r35.1/DeveloperGuide/text/SD/Kernel/KernelCustomization.html#

I also download Jetson Linux 35.1 BSP and sample root file system,

  1. https://developer.nvidia.com/embedded/l4t/r35_release_v1.0/release/jetson_linux_r35.1.0_aarch64.tbz2
  2. https://developer.nvidia.com/embedded/l4t/r35_release_v1.0/release/tegra_linux_sample-root-filesystem_r35.1.0_aarch64.tbz2

The BSP is extracted and stored under $HOME/Linux_for_Tegra while the root filesystem is extracted and stored under $HOME/Linux_for_Tegra/rootfs.

After the build of BSP source code is done, I follow To Build the Kernel Step 5

5 Replace `Linux_for_Tegra/rootfs/usr/lib/modules/$(uname -r)/kernel/drivers/gpu/nvgpu/nvgpu.ko` with a copy of this file:

$kernel_out/drivers/gpu/nvgpu/nvgpu.ko

But the folder Linux_for_Tegra/rootfs/usr/lib/modules doesn’t exist. I check usr/lib/modules is not in the sample root filesystem tar file, tegra_linux_sample-root-filesystem_r35.1.0_aarch64.tbz2.

Do I miss any step to create Linux_for_Tegra/rootfs/usr/lib/modules?

According to the section To Build the Real-Time Kernel

To Build the Real-Time Kernel

Apply RT patches to the kernel:

./kernel-5.10/scripts/rt-patch.sh apply-patches

Complete steps 2-6 as described in the previous section.

To Build the Kernel Step 7 can be skipped. Followings are my questions about step 7.

  1. What is step 7 used for?
  2. Is apply_binaries.sh run in step 7 for copying files from $HOME/Linux_for_Tegra/kernel to /lib/modules/<kernel_version>/ for kernel installation?
  3. Can it be skipped for real time kern build?

Can the RT kernel be installed separately in addition to the current kernel such that the RT and the current kernel can switched easily at boot time or by script configuration?

If the real time kernel is built on a host development system rather than the target system, should flashing be used to install the RT kernel? Can SDK manager be used to install the newly built kernel?

Sorry for having so many question as most of my past experience is on traditional hard real time operating system. Linux with RT patch is very new to me.

Thanks!

Wai Kwok

First need to complete below steps, than replace the Image(with RT patches) and nvgpu.kp and rebuild the kernel module

sudo tar xpf JAX-TX2-Jetson_Linux_R32.1.0_aarch64.tbz2
cd Linux_for_Tegra/rootfs/
sudo tar xpf ../../JAX-TX2-Tegra_Linux_Sample-Root-Filesystem_R32.1.0_aarch64.tbz2
cd ..
sudo ./apply_binaries.sh
sudo ./flash.sh --no-flash jetson-xxxx mmcblk0p1
sudo tar xpf JAX-TX2-Jetson_Linux_R32.1.0_aarch64.tbz2
cd Linux_for_Tegra/rootfs/
sudo tar xpf ../../JAX-TX2-Tegra_Linux_Sample-Root-Filesystem_R32.1.0_aarch64.tbz2
cd ..
sudo ./apply_binaries.sh
sudo ./flash.sh --no-flash jetson-xxxx mmcblk0p1
  1. Can you tell me which document has the above steps? I want to know which document do I miss reading so that I can find the answer myself next time.
  2. Since the build is for Jetson Linux 35.1. Should
    * JAX-TX2-Jetson_Linux_R32.1.0_aarch64.tbz2
    * JAX-TX2-Tegra_Linux_Sample-Root-Filesystem_R32.1.0_aarch64.tbz2
    be replaced by
    * jetson_linux_r35.1.0_aarch64.tbz2
    * tegra_linux_sample-root-filesystem_r35.1.0_aarch64.tbz2
  3. Does sudo ./apply_binaries.sh build all files under Linux_for_Tegra/rootfs/usr/lib/modules?
  4. what does sudo ./flash.sh --no-flash jetson-xxxx mmcblk0p1 do?
  5. Can you answer the questions below that are mentioned in me previous message or point me to any reference or document where I can find the answers.

According to the section To Build the Real-Time Kernel below

   To Build the Real-Time Kernel
            Apply RT patches to the kernel:
            ./kernel-5.10/scripts/rt-patch.sh apply-patches
    Complete steps 2-6 as described in the previous section.

Step 7 of the previous section, To Build the Kernel, is skipped. Followings are my questions about step 7.

  1. Is Step 7 of the previous section, To Build the Kernel, unnecessary for real time kernel build?
  2. What is step 7 used for?

Can the RT kernel be installed separately in addition to the current kernel such that the RT and the current kernel can be switched easily at boot time or by script configuration?

If the real time kernel is built on a host development system rather than the target system, should flashing be used to install the RT kernel? Can SDK manager be used to install the newly built kernel?

Please let me know the following steps are the ones I have to go through in order to build and install Jetson Linux 35.1 real time kernel

  1. Download Jetson Linux 35.1 BSP and sample root file system,
  2. Perform the steps you suggest below to extract BSP and sample root file system assuming Linux_for_Tegra is the build directory
sudo tar xpf JAX-TX2-Jetson_Linux_R32.1.0_aarch64.tbz2
cd Linux_for_Tegra/rootfs/
sudo tar xpf ../../JAX-TX2-Tegra_Linux_Sample-Root-Filesystem_R32.1.0_aarch64.tbz2
cd ..
sudo ./apply_binaries.sh
sudo ./flash.sh --no-flash jetson-xxxx mmcblk0p1
  1. Manually Downloading and Expanding Kernel Sources as described in the To Manually Download and Expand the Kernel Sources section of Kernel Customization — Jetson Linux<br/>Developer Guide 34.1 documentation
  2. Apply RT patch and build the real-time kernel as described in the Building the Kernel section of Kernel Customization — Jetson Linux<br/>Developer Guide 34.1 documentation
  3. Follow the instructions in the Preparing to Build External Kernel Modules section of Kernel Customization — Jetson Linux<br/>Developer Guide 34.1 documentation
  4. Follow the instructions in the To Build External Kernel Modules section of Kernel Customization — Jetson Linux<br/>Developer Guide 34.1 documentation
  5. Modify the /boot/extlinux/extlinux.conf to apply the real time kernel. How to use /boot/extlinux/extlinux.conf after jetpack 5.0 - #6 by linuxdev

No matter RT kernel or normal kernel both need step 7 to apply customized kernel
Below tell the steps of it.

https://docs.nvidia.com/jetson/archives/r35.1/DeveloperGuide/text/IN/QuickStart.html?highlight=rootfs

Hi Shane

I can build the rt kernel and flash it to my jetson orin developer kit. It boots up ok with a startup screen

However, after the above startup screen disappears a few seconds later, it doesn’t launch Ubuntu Desktop GUI, and the screen turns dark with no DP output signal from the developer kit anymore.

I plugin a usb cable to the micro usb c port of the developer kit. I can see a prompt for login and can login from there.

The linux version is

Linux jetson 5.10.104-rt63-tegra #1 SMP PREEMPT RT Thu Oct 6 15:50:01 PDT 2022 aarch64 aarch64 aarch64 GNU/Linux

The text file below (serial_term.txt) has the log captured from the serial terminal console via the micro usb port when the developer kit boots up after the reset button is pressed.

serial_term.txt (90.1 KB)

The connection between the developer kit and the monitor is a direct DP cable with no adapter.

I search the forum and find one close to my problem.

However, my problem is different. If it is a video driver issue, the startup screen should not be displayed at boot-up. Any kind of help is appreciated.

Thx!

Wai Kwok

Did you replace the nvgpu.ko?

Yes, I do.

After the kernel build is done, I perform the following steps.

  1. Replace Linux_for_Tegra/rootfs/usr/lib/modules/$(uname -r)/kernel/drivers/gpu/nvgpu/nvgpu.ko with a copy of this file:
    $kernel_out/drivers/gpu/nvgpu/nvgpu.ko

  2. For the device tree, replace the files in Linux_for_Tegra/kernel/dtb/ with a copy from:
    $kernel_out/arch/arm64/boot/dts/nvidia/

  3. Replace Linux_for_Tegra/kernel/Image with a copy of this file:
    $kernel_out/arch/arm64/boot/Image

  4. archive the installed kernel modules:
    $ cd <modules_install_path> $ tar --owner root --group root -cjf kernel_supplements.tbz2 lib/modules and make a copy of this archive to replace the one at this location on the target device: Linux_for_Tegra/kernel/kernel_supplements.tbz2

  5. Run apply_binary
    sudo ./apply_binaries.sh

  6. Flash the image
    sudo ./flash.sh jetson-agx-orin-devkit mmcblk0p1

I search the forum for issue related to rt kernel build and find the one below is similar to my problem

The above post confirms there is an issue with display driver, but there is no solution posted yet.

I don’t get any reply back from you since I answered nvgpu.ko is replaced.

As mentioned before, Liniux kernel with RT patch is built and install successfully, but ubuntu desktop GUI doesn’t launch that may be related to video driver issue. Please let me now how should I proceed?

can you send lsmod and dmesg command output from the fresh boot with RT kernel?

See the command outputs below. lsmod shows nothing.

wklaw@linux:~$ ls /lib/modules
5.10.104-tegra

wklaw@linux:~$ uname -a
Linux linux 5.10.104-rt63-tegra #1 SMP PREEMPT RT Mon Oct 10 09:19:22 PDT 2022 aarch64 aarch64 aarch64 GNU/Linux

wklaw@linux:~$ lsmod
Module Size Used by

wklaw@linux:~$ sudo dmesg

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd421]
[    0.000000] Linux version 5.10.104-rt63-tegra (wklaw@ubuntu) (aarch64-buildroot-linux-gnu-gcc.br_real (Buildroot 2020.08) 9.3.0, GNU ld (GNU Binutils) 2.33.1) #1 SMP PREEMPT RT Mon Oct 10 09:19:22 PDT 2022
[    0.000000] OF: fdt: memory scan node memory@80000000, reg size 16,
[    0.000000] OF: fdt:  - 80000000 ,  c0000000
[    0.000000] Machine model: Jetson AGX Orin
[    0.000000] efi: EFI v2.70 by EDK II
[    0.000000] efi: RTPROP=0x805405a98 SMBIOS=0xffff0000 SMBIOS 3.0=0x8039b0000 MEMATTR=0x80476d018 ESRT=0x80395ff98 RNG=0x827905a18 MEMRESERVE=0x80476ef18
[    0.000000] efi: seeding entropy pool
[    0.000000] esrt: Reserving ESRT space from 0x000000080395ff98 to 0x000000080395ffd0.
[    0.000000] Reserved memory: created CMA memory pool at 0x0000000817800000, size 256 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x0000000835ffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x00000000fffdffff]
[    0.000000]   node   0: [mem 0x00000000fffe0000-0x00000000ffffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x00000007ffffffff]
[    0.000000]   node   0: [mem 0x0000000800000000-0x00000008021bffff]
[    0.000000]   node   0: [mem 0x00000008021c0000-0x0000000803565fff]
[    0.000000]   node   0: [mem 0x0000000803566000-0x0000000803700fff]
[    0.000000]   node   0: [mem 0x0000000803701000-0x000000080399ffff]
[    0.000000]   node   0: [mem 0x00000008039a0000-0x00000008039bffff]
[    0.000000]   node   0: [mem 0x00000008039c0000-0x000000080453ffff]
[    0.000000]   node   0: [mem 0x0000000804540000-0x00000008046cffff]
[    0.000000]   node   0: [mem 0x00000008046d0000-0x000000080473ffff]
[    0.000000]   node   0: [mem 0x0000000804740000-0x000000080475ffff]
[    0.000000]   node   0: [mem 0x0000000804760000-0x000000080477ffff]
[    0.000000]   node   0: [mem 0x0000000804780000-0x000000080499ffff]
[    0.000000]   node   0: [mem 0x00000008049a0000-0x00000008049bffff]
[    0.000000]   node   0: [mem 0x00000008049c0000-0x0000000804a0ffff]
[    0.000000]   node   0: [mem 0x0000000804a10000-0x0000000804a9ffff]
[    0.000000]   node   0: [mem 0x0000000804aa0000-0x0000000804e4ffff]
[    0.000000]   node   0: [mem 0x0000000804e50000-0x0000000804e5ffff]
[    0.000000]   node   0: [mem 0x0000000804e60000-0x0000000804e6ffff]
[    0.000000]   node   0: [mem 0x0000000804e70000-0x0000000804e7ffff]
[    0.000000]   node   0: [mem 0x0000000804e80000-0x0000000804ebffff]
[    0.000000]   node   0: [mem 0x0000000804ec0000-0x000000080534ffff]
[    0.000000]   node   0: [mem 0x0000000805350000-0x000000080539ffff]
[    0.000000]   node   0: [mem 0x00000008053a0000-0x00000008053cffff]
[    0.000000]   node   0: [mem 0x00000008053d0000-0x00000008053effff]
[    0.000000]   node   0: [mem 0x00000008053f0000-0x000000080553ffff]
[    0.000000]   node   0: [mem 0x0000000805540000-0x00000008055dffff]
[    0.000000]   node   0: [mem 0x00000008055e0000-0x000000080568ffff]
[    0.000000]   node   0: [mem 0x0000000805690000-0x000000080572ffff]
[    0.000000]   node   0: [mem 0x0000000805730000-0x00000008057bffff]
[    0.000000]   node   0: [mem 0x00000008057c0000-0x000000080585ffff]
[    0.000000]   node   0: [mem 0x0000000805860000-0x000000080612ffff]
[    0.000000]   node   0: [mem 0x0000000806130000-0x000000080630ffff]
[    0.000000]   node   0: [mem 0x0000000806310000-0x00000008278bffff]
[    0.000000]   node   0: [mem 0x00000008278c0000-0x000000082790ffff]
[    0.000000]   node   0: [mem 0x0000000827910000-0x000000082b6affff]
[    0.000000]   node   0: [mem 0x000000082c400000-0x000000082c7fffff]
[    0.000000]   node   0: [mem 0x0000000834000000-0x0000000835ffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x0000000835ffffff]
[    0.000000] On node 0 totalpages: 8051376
[    0.000000]   DMA zone: 8192 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 524288 pages, LIFO batch:63
[    0.000000]   Normal zone: 118144 pages used for memmap
[    0.000000]   Normal zone: 7527088 pages, LIFO batch:63
[    0.000000] On node 0, zone Normal: 336 pages in unavailable ranges
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 27 pages/cpu s72896 r8192 d29504 u110592
[    0.000000] pcpu-alloc: s72896 r8192 d29504 u110592 alloc=27*4096
[    0.000000] pcpu-alloc: [0] 00 [0] 01 [0] 02 [0] 03 [0] 04 [0] 05 [0] 06 [0] 07
[    0.000000] pcpu-alloc: [0] 08 [0] 09 [0] 10 [0] 11
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: Virtualization Host Extensions
[    0.000000] CPU features: kernel page table isolation forced ON by KASLR
[    0.000000] CPU features: detected: Kernel page table isolation (KPTI)
[    0.000000] CPU features: detected: Spectre-v4
[    0.000000] alternatives: patching kernel code
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 7925040
[    0.000000] Kernel command line: root=/dev/mmcblk0p1 rw rootwait rootfstype=ext4 mminit_loglevel=4 console=ttyTCU0,115200 console=ttyAMA0,115200 console=tty0 firmware_class.path=/etc/firmware fbcon=map:0 net.ifnames=0
[    0.000000] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear)
[    0.000000] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x00000000effe0000-0x00000000fffe0000] (256MB)
[    0.000000] Memory: 30995040K/32205504K available (18176K kernel code, 3228K rwdata, 7064K rodata, 3904K init, 1124K bss, 948320K reserved, 262144K cma-reserved)
[    0.000000] random: get_random_u64 called from __kmem_cache_create+0x38/0x3b0 with crng_init=0
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=12, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=12.
[    0.000000] rcu:     RCU priority boosting: priority 1 delay 500 ms.
[    0.000000] rcu:     RCU_SOFTIRQ processing moved to rcuc kthreads.
[    0.000000]  No expedited grace period (rcu_normal_after_boot).
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000]  Rude variant of Tasks RCU enabled.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=12
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 960 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: 16 PPIs implemented
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x000000000f440000
[    0.000000] GICv2m: DT overriding V2M MSI_TYPER (base:608, num:70)
[    0.000000] GICv2m: range[mem 0x0f410000-0x0f41ffff], SPI[608:677]
[    0.000000] arch_timer: cp15 timer(s) running at 31.25MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xe6a171046, max_idle_ns: 881590405314 ns
[    0.000001] sched_clock: 56 bits at 31MHz, resolution 32ns, wraps every 4398046511088ns
[    0.000746] Console: colour dummy device 80x25
[    0.000754] printk: console [tty0] enabled
[    0.000793] Calibrating delay loop (skipped), value calculated using timer frequency.. 62.50 BogoMIPS (lpj=125000)
[    0.000799] pid_max: default: 32768 minimum: 301
[    0.000861] LSM: Security Framework initializing
[    0.000878] Yama: becoming mindful.
[    0.000896] SELinux:  Initializing.
[    0.001046] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.001150] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.003148] rcu: Hierarchical SRCU implementation.
[    0.003338] dyndbg: Ignore empty _ddebug table in a CONFIG_DYNAMIC_DEBUG_CORE build
[    0.004015] DTS File Name: /home/wklaw/nvidia/nvidia_sdk/JetPack_5.0.2_Linux_JETSON_AGX_ORIN_TARGETS/Linux_for_Tegra/source/public/kernel/kernel-5.10/arch/arm64/boot/dts/../../../../../../hardware/nvidia/platform/t23x/concord/kernel-dts/tegra234-p3701-0000-p3737-0000.dts
[    0.004020] DTB Build time: Oct 10 2022 09:46:35
[    0.005389] Tegra Revision: A01 SKU: 0xd0 CPU Process: 0 SoC Process: 0
[    0.005501] EFI runtime services will be disabled.
[    0.005768] smp: Bringing up secondary CPUs ...
[    0.034493] Detected PIPT I-cache on CPU1
[    0.034536] GICv3: CPU1: found redistributor 100 region 0:0x000000000f460000
[    0.034570] CPU1: Booted secondary processor 0x0000000100 [0x410fd421]
[    0.063242] Detected PIPT I-cache on CPU2
[    0.063252] GICv3: CPU2: found redistributor 200 region 0:0x000000000f480000
[    0.063266] CPU2: Booted secondary processor 0x0000000200 [0x410fd421]
[    0.091895] Detected PIPT I-cache on CPU3
[    0.091904] GICv3: CPU3: found redistributor 300 region 0:0x000000000f4a0000
[    0.091918] CPU3: Booted secondary processor 0x0000000300 [0x410fd421]
[    0.122599] Detected PIPT I-cache on CPU4
[    0.122624] GICv3: CPU4: found redistributor 10000 region 0:0x000000000f4c0000
[    0.122652] CPU4: Booted secondary processor 0x0000010000 [0x410fd421]
[    0.151357] Detected PIPT I-cache on CPU5
[    0.151367] GICv3: CPU5: found redistributor 10100 region 0:0x000000000f4e0000
[    0.151382] CPU5: Booted secondary processor 0x0000010100 [0x410fd421]
[    0.180030] Detected PIPT I-cache on CPU6
[    0.180040] GICv3: CPU6: found redistributor 10200 region 0:0x000000000f500000
[    0.180055] CPU6: Booted secondary processor 0x0000010200 [0x410fd421]
[    0.208718] Detected PIPT I-cache on CPU7
[    0.208729] GICv3: CPU7: found redistributor 10300 region 0:0x000000000f520000
[    0.208743] CPU7: Booted secondary processor 0x0000010300 [0x410fd421]
[    0.239423] Detected PIPT I-cache on CPU8
[    0.239449] GICv3: CPU8: found redistributor 20000 region 0:0x000000000f540000
[    0.239477] CPU8: Booted secondary processor 0x0000020000 [0x410fd421]
[    0.268178] Detected PIPT I-cache on CPU9
[    0.268190] GICv3: CPU9: found redistributor 20100 region 0:0x000000000f560000
[    0.268206] CPU9: Booted secondary processor 0x0000020100 [0x410fd421]
[    0.297464] Detected PIPT I-cache on CPU10
[    0.297475] GICv3: CPU10: found redistributor 20200 region 0:0x000000000f580000
[    0.297492] CPU10: Booted secondary processor 0x0000020200 [0x410fd421]
[    0.326764] Detected PIPT I-cache on CPU11
[    0.326775] GICv3: CPU11: found redistributor 20300 region 0:0x000000000f5a0000
[    0.326791] CPU11: Booted secondary processor 0x0000020300 [0x410fd421]
[    0.326855] smp: Brought up 1 node, 12 CPUs
[    0.326859] SMP: Total of 12 processors activated.
[    0.326862] CPU features: detected: Privileged Access Never
[    0.326863] CPU features: detected: LSE atomic instructions
[    0.326864] CPU features: detected: User Access Override
[    0.326865] CPU features: detected: 32-bit EL0 Support
[    0.326867] CPU features: detected: Common not Private translations
[    0.326868] CPU features: detected: RAS Extension Support
[    0.326868] CPU features: detected: Data cache clean to the PoU not required for I/D coherence
[    0.326869] CPU features: detected: CRC32 instructions
[    0.326870] CPU features: detected: Speculative Store Bypassing Safe (SSBS)
[    0.359307] CPU: All CPU(s) started at EL2
[    0.361526] devtmpfs: initialized
[    0.379869] Registered cp15_barrier emulation handler
[    0.379878] Registered setend emulation handler
[    0.379882] KASLR enabled
[    0.379999] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.380014] futex hash table entries: 4096 (order: 7, 524288 bytes, linear)
[    0.381671] pinctrl core: initialized pinctrl subsystem
[    0.382173] SMBIOS 3.0.0 present.
[    0.382177] DMI:  /, BIOS 1.0-d7fb19b 08/10/2022
[    0.382443] NET: Registered protocol family 16
[    0.383222] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[    0.383423] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.383615] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.383652] audit: initializing netlink subsys (disabled)
[    0.383721] audit: type=2000 audit(0.380:1): state=initialized audit_enabled=0 res=1
[    0.383903] thermal_sys: Registered thermal governor 'step_wise'
[    0.383905] thermal_sys: Registered thermal governor 'power_allocator'
[    0.383906] thermal_sys: Registered thermal governor 'pid_thermal_gov'
[    0.386011] cpuidle: using governor menu
[    0.386170] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.386307] ASID allocator initialised with 32768 entries
[    0.386413] Serial: AMBA PL011 UART driver
[    0.388255] tegra234_mc_sid_probe(): tegra234 mc-sid probe successful
[    0.388274] Tegra reboot handler registered.
[    0.407447] mc: mapped MMIO address: 0xffff8000112c0000 -> 0x2c10000
[    0.407457] mc: mapped MMIO address: 0xffff8000112e0000 -> 0x2c20000
[    0.407462] mc: mapped MMIO address: 0xffff800011300000 -> 0x2c30000
[    0.407467] mc: mapped MMIO address: 0xffff800011320000 -> 0x2c40000
[    0.407472] mc: mapped MMIO address: 0xffff800011340000 -> 0x2c50000
[    0.407477] mc: mapped MMIO address: 0xffff800011360000 -> 0x2b80000
[    0.407482] mc: mapped MMIO address: 0xffff800011380000 -> 0x2b90000
[    0.407487] mc: mapped MMIO address: 0xffff8000113a0000 -> 0x2ba0000
[    0.407491] mc: mapped MMIO address: 0xffff8000113c0000 -> 0x2bb0000
[    0.407496] mc: mapped MMIO address: 0xffff8000113e0000 -> 0x1700000
[    0.407504] mc: mapped MMIO address: 0xffff800011400000 -> 0x1710000
[    0.407509] mc: mapped MMIO address: 0xffff800011420000 -> 0x1720000
[    0.407514] mc: mapped MMIO address: 0xffff800011440000 -> 0x1730000
[    0.407519] mc: mapped MMIO address: 0xffff800011460000 -> 0x1740000
[    0.407525] mc: mapped MMIO address: 0xffff800011480000 -> 0x1750000
[    0.407529] mc: mapped MMIO address: 0xffff8000114a0000 -> 0x1760000
[    0.407534] mc: mapped MMIO address: 0xffff8000114c0000 -> 0x1770000
[    0.407542] nv-tegra-mc 2c10000.mc: No mssnvlink node
[    0.407567] mc-err: mcerr ops are set to t23x
[    0.407865] tegra234-cbb 13a00000.cbb-fabric: secure_irq = 21
[    0.407956] tegra234-cbb c600000.aon-fabric: secure_irq = 22
[    0.408028] tegra234-cbb d600000.bpmp-fabric: secure_irq = 23
[    0.408108] tegra234-cbb de00000.dce-fabric: secure_irq = 24
[    0.408188] tegra234-cbb be00000.rce-fabric: secure_irq = 25
[    0.408265] tegra234-cbb b600000.sce-fabric: secure_irq = 26
[    0.408551] 31d0000.serial: ttyAMA0 at MMIO 0x31d0000 (irq = 66, base_baud = 0) is a SBSA
[    0.408564] printk: console [ttyAMA0] enabled
[    0.413453] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.413456] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
[    0.413457] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.413458] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
[    0.415172] ACPI: Interpreter disabled.
[    0.416606] vdd-av1v1-hub: supplied by vdd-5v-sys
[    0.416800] vbusA-cvb: supplied by vdd-5v-sys
[    0.416906] vbusB-cvb: supplied by vdd-5v-sys
[    0.417048] vdd-usbc1-vbus: supplied by vdd-5v-sys
[    0.417148] vdd-usbc2-vbus: supplied by vdd-5v-sys
[    0.417490] iommu: Default domain type: Translated
[    0.417530] eventlib_kernel: keventlib is initialized, test id: 0
[    0.417730] SCSI subsystem initialized
[    0.417803] usbcore: registered new interface driver usbfs
[    0.417817] usbcore: registered new interface driver hub
[    0.417827] usbcore: registered new device driver usb
[    0.418022] mc: Linux media interface: v0.10
[    0.418035] videodev: Linux video capture interface: v2.00
[    0.418186] pps_core: LinuxPPS API ver. 1 registered
[    0.418188] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.418192] PTP clock support registered
[    0.418428] tegra_wdt_t18x 2190000.watchdog: Tegra WDT init timeout = 120 sec
[    0.418449] tegra_wdt_t18x 2190000.watchdog: Registered successfully
[    0.420277] FPGA manager framework
[    0.420319] Advanced Linux Sound Architecture Driver Initialized.
[    0.420612] Bluetooth: Core ver 2.22
[    0.420627] NET: Registered protocol family 31
[    0.420629] Bluetooth: HCI device and connection manager initialized
[    0.420635] Bluetooth: HCI socket layer initialized
[    0.420638] Bluetooth: L2CAP socket layer initialized
[    0.420646] Bluetooth: SCO socket layer initialized
[    0.421482] camchar: rtcpu character device driver loaded
[    0.421783] clocksource: Switched to clocksource arch_sys_counter
[    0.573086] VFS: Disk quotas dquot_6.6.0
[    0.573118] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.573256] pnp: PnP ACPI: disabled
[    0.575800] la/ptsa driver initialized.
[    0.575849] NET: Registered protocol family 2
[    0.576294] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.578555] tcp_listen_portaddr_hash hash table entries: 16384 (order: 8, 1048576 bytes, linear)
[    0.579009] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.579235] TCP bind hash table entries: 65536 (order: 9, 3670016 bytes, linear)
[    0.580833] TCP: Hash tables configured (established 262144 bind 65536)
[    0.580961] UDP hash table entries: 16384 (order: 9, 2097152 bytes, linear)
[    0.581918] UDP-Lite hash table entries: 16384 (order: 9, 2097152 bytes, linear)
[    0.582984] NET: Registered protocol family 1
[    0.583229] RPC: Registered named UNIX socket transport module.
[    0.583232] RPC: Registered udp transport module.
[    0.583233] RPC: Registered tcp transport module.
[    0.583236] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.583243] PCI: CLS 0 bytes, default 64
[    0.583341] Trying to unpack rootfs image as initramfs...
[    0.693668] Freeing initrd memory: 8196K
[    0.695517] hw perfevents: enabled with armv8_pmuv3 PMU driver, 7 counters available
[    0.696169] Initialise system trusted keyrings
[    0.696247] workingset: timestamp_bits=46 max_order=23 bucket_order=0
[    0.698767] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.699052] NFS: Registering the id_resolver key type
[    0.699064] Key type id_resolver registered
[    0.699065] Key type id_legacy registered
[    0.699099] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.699106] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    0.699117] ntfs: driver 2.1.32 [Flags: R/W].
[    0.710847] NET: Registered protocol family 38
[    0.710852] Key type asymmetric registered
[    0.710854] Asymmetric key parser 'x509' registered
[    0.710873] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 240)
[    0.710938] io scheduler mq-deadline registered
[    0.710940] io scheduler kyber registered
[    0.716721] tegra-pwm 3280000.pwm: PWM clk can sleep in ops
[    0.716745] tegra-pwm 32a0000.pwm: PWM clk can sleep in ops
[    0.716760] tegra-pwm 32c0000.pwm: PWM clk can sleep in ops
[    0.716775] tegra-pwm 32f0000.pwm: PWM clk can sleep in ops
[    0.719281] tegra_dc_assign_hw_data: no matching compatible node
[    0.719283] tegradccommon module_init failed
[    0.719285] tegradc module_init failed
[    0.719549] EINJ: ACPI disabled.
[    0.721050] tegra-pmc c360000.pmc: scratch reg offset dts data not present
[    0.721055] tegra-pmc: ### PMC reset source: SYS_RESET_N
[    0.721057] tegra-pmc: ### PMC reset level: L0
[    0.721059] tegra-pmc: ### PMC reset status reg: 0x0
[    0.722350] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.723329] printk: console [ttyTCU0] enabled
[    0.723849] arm-smmu 12000000.iommu: probing hardware configuration...
[    0.723852] arm-smmu 12000000.iommu: SMMUv2 with:
[    0.723855] arm-smmu 12000000.iommu:         stage 1 translation
[    0.723856] arm-smmu 12000000.iommu:         stage 2 translation
[    0.723857] arm-smmu 12000000.iommu:         nested translation
[    0.723859] arm-smmu 12000000.iommu:         stream matching with 128 register groups
[    0.723862] arm-smmu 12000000.iommu:         128 context banks (0 stage-2 only)
[    0.726463] arm-smmu 12000000.iommu:         Supported page sizes: 0x00001000
[    0.726465] arm-smmu 12000000.iommu:         Stage-1: 48-bit VA -> 48-bit IPA
[    0.726467] arm-smmu 12000000.iommu:         Stage-2: 48-bit IPA -> 48-bit PA
[    0.727347] arm-smmu 10000000.iommu: probing hardware configuration...
[    0.727348] arm-smmu 10000000.iommu: SMMUv2 with:
[    0.727350] arm-smmu 10000000.iommu:         stage 1 translation
[    0.727351] arm-smmu 10000000.iommu:         stage 2 translation
[    0.727352] arm-smmu 10000000.iommu:         nested translation
[    0.727353] arm-smmu 10000000.iommu:         stream matching with 128 register groups
[    0.727356] arm-smmu 10000000.iommu:         128 context banks (0 stage-2 only)
[    0.729863] arm-smmu 10000000.iommu:         Supported page sizes: 0x00001000
[    0.729865] arm-smmu 10000000.iommu:         Stage-1: 48-bit VA -> 48-bit IPA
[    0.729866] arm-smmu 10000000.iommu:         Stage-2: 48-bit IPA -> 48-bit PA
[    0.730337] arm-smmu 8000000.iommu: probing hardware configuration...
[    0.730339] arm-smmu 8000000.iommu: SMMUv2 with:
[    0.730340] arm-smmu 8000000.iommu:  stage 1 translation
[    0.730341] arm-smmu 8000000.iommu:  stage 2 translation
[    0.730342] arm-smmu 8000000.iommu:  nested translation
[    0.730343] arm-smmu 8000000.iommu:  stream matching with 128 register groups
[    0.730345] arm-smmu 8000000.iommu:  128 context banks (0 stage-2 only)
[    0.732872] arm-smmu 8000000.iommu:  Supported page sizes: 0x00001000
[    0.732873] arm-smmu 8000000.iommu:  Stage-1: 48-bit VA -> 48-bit IPA
[    0.732875] arm-smmu 8000000.iommu:  Stage-2: 48-bit IPA -> 48-bit PA
[    0.733651] arm-smmu-suspend 12000000.smmu_suspend: arm_smmu_suspend probe successful
[    0.736247] tegra_profiler: version: 1.147, samples/io: 49/28
[    0.736373] tegra_profiler: auth: init
[    0.736696] nvsciipc: loaded module
[    0.737703] tegra23x-qspi 3270000.spi: Adding to iommu group 0
[    0.737920] tegra23x-qspi 3270000.spi: Node prod has invalid entries
[    0.737923] tegra23x-qspi 3270000.spi: Node prod: Child has not proper setting
[    0.737925] tegra23x-qspi 3270000.spi: Node spi: Faild to read the Prod Setting.
[    0.737927] tegra23x-qspi 3270000.spi: Prod settings list not found
[    0.738053] tegra23x-qspi 3270000.spi: Failed to get reset control: -517
[    0.738706] tun: Universal TUN/TAP device driver, 1.6
[    0.739179] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[    0.739182] hns3: Copyright (c) 2017 Huawei Corporation.
[    0.739207] e1000e: Intel(R) PRO/1000 Network Driver
[    0.739209] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    0.739223] igb: Intel(R) Gigabit Ethernet Network Driver
[    0.739225] igb: Copyright (c) 2007-2014 Intel Corporation.
[    0.739399] PPP generic driver version 2.4.2
[    0.739444] PPP BSD Compression module registered
[    0.739446] PPP Deflate Compression module registered
[    0.739461] PPP MPPE Compression module registered
[    0.739481] usbcore: registered new interface driver r8152
[    0.739494] usbcore: registered new interface driver asix
[    0.739505] usbcore: registered new interface driver ax88179_178a
[    0.739515] usbcore: registered new interface driver cdc_ether
[    0.739523] usbcore: registered new interface driver net1080
[    0.739529] usbcore: registered new interface driver cdc_subset
[    0.739535] usbcore: registered new interface driver zaurus
[    0.739547] usbcore: registered new interface driver cdc_ncm
[    0.739557] usbcore: registered new interface driver aqc111
[    0.739683] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.739694] ohci-pci: OHCI PCI platform driver
[    0.739709] ohci-platform: OHCI generic platform driver
[    0.740000] tegra-xusb 3610000.xhci: Adding to iommu group 1
[    0.740534] usbcore: registered new interface driver uas
[    0.740551] usbcore: registered new interface driver usb-storage
[    0.740700] tegra-xudc 3550000.xudc: Adding to iommu group 2
[    0.741066] mousedev: PS/2 mouse device common for all mice
[    0.741083] usbcore: registered new interface driver xpad
[    0.742945] tegra_rtc c2a0000.rtc: registered as rtc1
[    0.743221] tegra_rtc c2a0000.rtc: setting system clock to 1970-01-01T00:00:25 UTC (25)
[    0.743239] tegra_rtc c2a0000.rtc: Tegra internal Real Time Clock
[    0.743423] i2c /dev entries driver
[    0.743523] tegra-i2c 3160000.i2c: Adding to iommu group 3
[    0.743737] tegra-i2c c240000.i2c: Adding to iommu group 3
[    0.743799] tegra-i2c 3180000.i2c: Adding to iommu group 3
[    0.743844] tegra-i2c 3190000.i2c: Adding to iommu group 3
[    0.743890] tegra-i2c 31b0000.i2c: Adding to iommu group 3
[    0.743946] tegra-i2c 31c0000.i2c: Adding to iommu group 3
[    0.743993] tegra-i2c c250000.i2c: Adding to iommu group 3
[    0.744037] tegra-i2c 31e0000.i2c: Adding to iommu group 3
[    0.746203] tegra-camrtc-capture-vi tegra-capture-vi: ep of_device is not enabled endpoint.
[    0.746207] tegra-camrtc-capture-vi tegra-capture-vi: ep of_device is not enabled endpoint.
[    0.747038] device-mapper: uevent: version 1.0.3
[    0.747126] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com
[    0.748314] sdhci: Secure Digital Host Controller Interface driver
[    0.748316] sdhci: Copyright(c) Pierre Ossman
[    0.748317] Synopsys Designware Multimedia Card Interface Driver
[    0.748398] sdhci-pltfm: SDHCI platform and OF driver helper
[    0.748540] sdhci-tegra 3460000.sdhci: Adding to iommu group 4
[    0.749130] sdhci-tegra 3400000.sdhci: Adding to iommu group 5
[    0.749299] SMCCC: SOC_ID: ID = jep106:036b:0023 Revision = 0x00000401
[    0.750202] tegra-bpmp bpmp: firmware: 888a114dda6bea50b6c6-eac380526d6
[    0.751137] nvvrs_pseq 4-003c: NVVRS Vendor ID: 0x9
[    0.751467] nvvrs_pseq 4-003c: NVVRS Model Rev: 0x81
[    0.754246] nvvrs-pseq-rtc nvvrs-pseq-rtc: registered as rtc0
[    0.754265] nvvrs_pseq 4-003c: NVVRS PSEQ probe successful
[    0.787398] random: fast init done
[    2.017149] hid: raw HID events driver (C) Jiri Kosina
[    2.017822] usbcore: registered new interface driver usbhid
[    2.017825] usbhid: USB HID core driver
[    2.018836] tegra-dce d800000.dce: Adding to iommu group 6
[    2.020089] dce: dce_ipc_channel_init:314  Invalid Channel State [0x0] for ch_type [2]
[    2.020597] tegra234-aon c000000.aon: Adding to iommu group 7
[    2.020884] dce: dce_mailbox_set_full_interrupt:165  Intr bit set multiple times for MB : [0x5]
[    2.020910] dce: dce_admin_ipc_handle_signal:89   Spurious signal on channel: [0]. Ignored...
[    2.020995] dce: dce_admin_send_cmd_ver:413  version : [0x2] err : [0x0]
[    2.021099] dce: dce_mailbox_set_full_interrupt:165  Intr bit set multiple times for MB : [0x1]
[    2.021104] dce: dce_admin_setup_clients_ipc:542  Channel Reset Complete for Type [1] ...
[    2.021105] dce: dce_admin_setup_clients_ipc:518  Get queue info failed for [2]
[    2.021107] dce: dce_admin_ipc_handle_signal:89   Spurious signal on channel: [1]. Ignored...
[    2.021116] dce: dce_admin_ipc_handle_signal:89   Spurious signal on channel: [1]. Ignored...
[    2.021205] dce: dce_admin_setup_clients_ipc:542  Channel Reset Complete for Type [3] ...
[    2.021209] dce: dce_admin_ipc_handle_signal:89   Spurious signal on channel: [3]. Ignored...
[    2.021218] dce: dce_admin_ipc_handle_signal:89   Spurious signal on channel: [3]. Ignored...
[    2.021377] dce: dce_start_boot_flow:100  DCE_BOOT_DONE
[    2.022211]  c000000.aon:hsp: probed
[    2.022416] tegra234-aon c000000.aon: init done
[    2.022705] tegra23x-psc e860000.psc: Adding to iommu group 8
[    2.023258] tegra23x-psc e860000.psc: ext_cfg base:(____ptrval____)
[    2.023263] tegra23x-psc e860000.psc: init done
[    2.023419] tegra186-cam-rtcpu bc00000.rtcpu: Adding to iommu group 9
[    2.024276] tegra186-cam-rtcpu bc00000.rtcpu: Trace buffer configured at IOVA=0xbff00000
[    2.027768] tegra-ivc-bus bc00000.rtcpu:ivc-bus: region 0: iova=0xbfec0000-0xbfee01ff size=131584
[    2.027818] tegra-ivc-bus bc00000.rtcpu:ivc-bus:echo@0: echo: ver=0 grp=1 RX[16x64]=0x1000-0x1480 TX[16x64]=0x1480-0x1900
[    2.027928] tegra-ivc-bus bc00000.rtcpu:ivc-bus:dbg@1: dbg: ver=0 grp=1 RX[1x448]=0x1900-0x1b40 TX[1x448]=0x1b40-0x1d80
[    2.027988] tegra-ivc-bus bc00000.rtcpu:ivc-bus:dbg@2: dbg: ver=0 grp=1 RX[1x8192]=0x1d80-0x3e00 TX[1x8192]=0x3e00-0x5e80
[    2.028398] tegra-ivc-bus bc00000.rtcpu:ivc-bus:ivccontrol@3: ivccontrol: ver=0 grp=1 RX[64x320]=0x5e80-0xaf00 TX[64x320]=0xaf00-0xff80
[    2.028438] tegra-ivc-bus bc00000.rtcpu:ivc-bus:ivccapture@4: ivccapture: ver=0 grp=1 RX[512x64]=0xff80-0x18000 TX[512x64]=0x18000-0x20080
[    2.028465] tegra-ivc-bus bc00000.rtcpu:ivc-bus:diag@5: diag: ver=0 grp=1 RX[1x64]=0x20080-0x20140 TX[1x64]=0x20140-0x20200
[    2.028743] tegra186-cam-rtcpu bc00000.rtcpu: using cam RTCPU IRQ (117)
[    2.028745] tegra186-cam-rtcpu bc00000.rtcpu: tegra_camrtc_mon_create is successful
[    2.029116] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.029120] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.029125] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.029126] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.029126] tegra186-cam-rtcpu bc00000.rtcpu: firmware version cpu=rce cmd=6 sha1=7a10e4613e151d2bf1df37dd80d456800f5b94d0
[    2.029127] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.029135] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.029136] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.029138] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.029139] tegra-hsp b950000.tegra-hsp: Try increasing MBOX_TX_QUEUE_LEN
[    2.030908] t19x_cache tegra-cache: probed
[    2.031328] scf-pmu-drv scf-pmu: Registered T23x SCF Uncore PMU
[    2.039338] optee: probing for conduit method.
[    2.039359] optee: revision 3.16 (65cc2218)
[    2.039455] optee: dynamic shared memory is enabled
[    2.039591] optee: initialized driver
[    2.051340] nvpmodel: initialized successfully
[    2.051435] tegra_hv: get_hvd: not initialized yet
[    2.051447] user_ivc_mempool: hypervisor not present
[    2.051732] usbcore: registered new interface driver snd-usb-audio
[    2.052460] u32 classifier
[    2.052463]     input device check on
[    2.052466]     Actions configured
[    2.052599] Initializing XFRM netlink socket
[    2.052946] NET: Registered protocol family 10
[    2.054767] Segment Routing with IPv6
[    2.054811] NET: Registered protocol family 17
[    2.054834] NET: Registered protocol family 15
[    2.054880] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    2.055626] Bluetooth: RFCOMM socket layer initialized
[    2.055657] Bluetooth: RFCOMM ver 1.11
[    2.055669] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[    2.055679] Bluetooth: HIDP socket layer initialized
[    2.056437] 9pnet: Installing 9P2000 support
[    2.056500] Key type dns_resolver registered
[    2.058136] printk: console [tty0]: printing thread started
[    2.058430] printk: console [ttyTCU0]: printing thread started
[    2.058850] printk: console [ttyAMA0]: printing thread started
[    2.058922] Loading compiled-in X.509 certificates
[    2.062058] Loaded X.509 cert 'Build time autogenerated kernel key: 634bc10d821957800e15eb2703cb9aadd8717845'
[    2.062381] tegra194-pcie 14100000.pcie: Adding to iommu group 10
[    2.068286] tegra194-pcie 14100000.pcie: Using GICv2m MSI allocator
[    2.068941] tegra194-pcie 14160000.pcie: Adding to iommu group 11
[    2.074400] tegra194-pcie 14160000.pcie: Using GICv2m MSI allocator
[    2.074828] tegra194-pcie 141a0000.pcie: Adding to iommu group 12
[    2.079788] tegra194-pcie 141a0000.pcie: Using GICv2m MSI allocator
[    2.079832] tegra194-pcie 141a0000.pcie: Failed to get slot regulators: -517
[    2.110335] tegra-soc-hwpm f100000.tegra_soc_hwpm: Adding to iommu group 13
[    2.113454] host1x 13e40000.host1x: Adding to iommu group 14
[    3.124953] t23x_init_gating_regs: Timed out waiting for syncpt ram init!
[    3.135071] host1x 13e40000.host1x: initialized
[    3.135401] iommu_context_dev 13e40000.host1x:niso0_ctx0: Adding to iommu group 15
[    3.135939] iommu_context_dev 13e40000.host1x:niso0_ctx0: initialized (streamid=53, iommu=smmu.0x0000000012000000)
[    3.137305] iommu_context_dev 13e40000.host1x:niso0_ctx1: Adding to iommu group 16
[    3.137582] iommu_context_dev 13e40000.host1x:niso0_ctx1: initialized (streamid=54, iommu=smmu.0x0000000012000000)
[    3.138908] iommu_context_dev 13e40000.host1x:niso0_ctx2: Adding to iommu group 17
[    3.139393] iommu_context_dev 13e40000.host1x:niso0_ctx2: initialized (streamid=55, iommu=smmu.0x0000000012000000)
[    3.140691] iommu_context_dev 13e40000.host1x:niso0_ctx3: Adding to iommu group 18
[    3.141218] iommu_context_dev 13e40000.host1x:niso0_ctx3: initialized (streamid=56, iommu=smmu.0x0000000012000000)
[    3.142578] iommu_context_dev 13e40000.host1x:niso0_ctx4: Adding to iommu group 19
[    3.143069] iommu_context_dev 13e40000.host1x:niso0_ctx4: initialized (streamid=57, iommu=smmu.0x0000000012000000)
[    3.144372] iommu_context_dev 13e40000.host1x:niso0_ctx5: Adding to iommu group 20
[    3.144854] iommu_context_dev 13e40000.host1x:niso0_ctx5: initialized (streamid=58, iommu=smmu.0x0000000012000000)
[    3.146170] iommu_context_dev 13e40000.host1x:niso0_ctx6: Adding to iommu group 21
[    3.146652] iommu_context_dev 13e40000.host1x:niso0_ctx6: initialized (streamid=59, iommu=smmu.0x0000000012000000)
[    3.147953] iommu_context_dev 13e40000.host1x:niso0_ctx7: Adding to iommu group 22
[    3.148668] iommu_context_dev 13e40000.host1x:niso0_ctx7: initialized (streamid=60, iommu=smmu.0x0000000012000000)
[    3.150030] iommu_context_dev 13e40000.host1x:niso1_ctx0: Adding to iommu group 23
[    3.150339] iommu_context_dev 13e40000.host1x:niso1_ctx0: initialized (streamid=53, iommu=smmu.0x0000000008000000)
[    3.151640] iommu_context_dev 13e40000.host1x:niso1_ctx1: Adding to iommu group 24
[    3.152152] iommu_context_dev 13e40000.host1x:niso1_ctx1: initialized (streamid=54, iommu=smmu.0x0000000008000000)
[    3.153456] iommu_context_dev 13e40000.host1x:niso1_ctx2: Adding to iommu group 25
[    3.153966] iommu_context_dev 13e40000.host1x:niso1_ctx2: initialized (streamid=55, iommu=smmu.0x0000000008000000)
[    3.155245] iommu_context_dev 13e40000.host1x:niso1_ctx3: Adding to iommu group 26
[    3.156080] iommu_context_dev 13e40000.host1x:niso1_ctx3: initialized (streamid=56, iommu=smmu.0x0000000008000000)
[    3.157379] iommu_context_dev 13e40000.host1x:niso1_ctx4: Adding to iommu group 27
[    3.158206] iommu_context_dev 13e40000.host1x:niso1_ctx4: initialized (streamid=57, iommu=smmu.0x0000000008000000)
[    3.159491] iommu_context_dev 13e40000.host1x:niso1_ctx5: Adding to iommu group 28
[    3.160031] iommu_context_dev 13e40000.host1x:niso1_ctx5: initialized (streamid=58, iommu=smmu.0x0000000008000000)
[    3.161345] iommu_context_dev 13e40000.host1x:niso1_ctx6: Adding to iommu group 29
[    3.161881] iommu_context_dev 13e40000.host1x:niso1_ctx6: initialized (streamid=59, iommu=smmu.0x0000000008000000)
[    3.163186] iommu_context_dev 13e40000.host1x:niso1_ctx7: Adding to iommu group 30
[    3.163894] iommu_context_dev 13e40000.host1x:niso1_ctx7: initialized (streamid=60, iommu=smmu.0x0000000008000000)
[    3.165229] falcon 15340000.vic: Adding to iommu group 31
[    3.170296] falcon 15340000.vic: initialized
[    3.170644] falcon 15380000.nvjpg: Adding to iommu group 32
[    3.173145] falcon 15380000.nvjpg: initialized
[    3.173284] falcon 15540000.nvjpg1: Adding to iommu group 33
[    3.175932] falcon 15540000.nvjpg1: initialized
[    3.176058] falcon 154c0000.nvenc: Adding to iommu group 34
[    3.180061] falcon 154c0000.nvenc: initialized
[    3.180189] falcon 15a50000.ofa: Adding to iommu group 35
[    3.182850] falcon 15a50000.ofa: initialized
[    3.182980] nvdec 15480000.nvdec: Adding to iommu group 36
[    3.187898] nvdec 15480000.nvdec: initialized
[    3.188011] tsec 15500000.tsec: Adding to iommu group 37
[    3.191926] tsec 15500000.tsec: initialized
[    3.193672] gic 2a41000.agic-controller: GIC IRQ controller registered
[    3.202877] tegra-aconnect aconnect@2a41000: Tegra ACONNECT bus registered
[    3.213746] gpio-394 (camera-control-output-low): hogged as output/low
[    3.213788] gpio-397 (camera-control-output-low): hogged as output/low
[    3.213826] gpio-487 (camera-control-output-low): hogged as output/low
[    3.213857] gpio-486 (camera-control-output-low): hogged as output/low
[    3.214819] gpiochip0: registered GPIOs 348 to 511 on tegra234-gpio
[    3.215590] gpiochip1: registered GPIOs 316 to 347 on tegra234-gpio-aon
[    3.215746] tegra-pwm 3280000.pwm: PWM clk can sleep in ops
[    3.216476] tegra-pwm 32a0000.pwm: PWM clk can sleep in ops
[    3.217143] tegra-pwm 32c0000.pwm: PWM clk can sleep in ops
[    3.217597] tegra-pwm 32f0000.pwm: PWM clk can sleep in ops
[    3.219792] misc tegra_camera_ctrl: tegra_camera_isomgr_register tpg_max_iso = 3916800KBs
[    3.219920] tegra194-isp5 14800000.isp: Adding to iommu group 38
[    3.222895] t194-nvcsi 13e40000.host1x:nvcsi@15a00000: context isolation disabled due to no IOMMU
[    3.223156] t194-nvcsi 13e40000.host1x:nvcsi@15a00000: initialized
[    3.223342] tegra194-vi5 13e40000.host1x:vi0@15c00000: Adding to iommu group 39
[    3.224055] tegra194-vi5 13e40000.host1x:vi1@14c00000: Adding to iommu group 40
[    3.224626] scare-pigeon 13e40000.host1x:vi0-thi@15f00000: context isolation disabled due to no IOMMU
[    3.224752] scare-pigeon 13e40000.host1x:vi0-thi@15f00000: initialized
[    3.224836] scare-pigeon 13e40000.host1x:vi1-thi@14f00000: context isolation disabled due to no IOMMU
[    3.224927] scare-pigeon 13e40000.host1x:vi1-thi@14f00000: initialized
[    3.225005] scare-pigeon 13e40000.host1x:isp-thi@14b00000: context isolation disabled due to no IOMMU
[    3.225099] scare-pigeon 13e40000.host1x:isp-thi@14b00000: initialized
[    3.225198] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx0: Adding to iommu group 41
[    3.225487] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx0: initialized (streamid=18, iommu=smmu.0x0000000008000000)
[    3.225588] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx1: Adding to iommu group 42
[    3.225895] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx1: initialized (streamid=19, iommu=smmu.0x0000000008000000)
[    3.225986] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx2: Adding to iommu group 43
[    3.226226] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx2: initialized (streamid=20, iommu=smmu.0x0000000008000000)
[    3.226316] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx3: Adding to iommu group 44
[    3.226564] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx3: initialized (streamid=21, iommu=smmu.0x0000000008000000)
[    3.226654] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx4: Adding to iommu group 45
[    3.226917] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx4: initialized (streamid=22, iommu=smmu.0x0000000008000000)
[    3.227007] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx5: Adding to iommu group 46
[    3.227255] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx5: initialized (streamid=23, iommu=smmu.0x0000000008000000)
[    3.227341] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx6: Adding to iommu group 47
[    3.227610] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx6: initialized (streamid=24, iommu=smmu.0x0000000008000000)
[    3.227699] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx7: Adding to iommu group 48
[    3.227933] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx7: initialized (streamid=25, iommu=smmu.0x0000000008000000)
[    3.228032] pva 16000000.pva0: Adding to iommu group 49
[    3.247120] pva 16000000.pva0: initialized
[    3.250561] nvdla 15880000.nvdla0: Adding to iommu group 50
[    3.258821] nvdla 15880000.nvdla0: initialized
[    3.260525] nvdla 158c0000.nvdla1: Adding to iommu group 51
[    3.268347] nvdla 158c0000.nvdla1: initialized
[    3.270056] tegra-gpcdma 2600000.gpcdma: Adding to iommu group 3
[    3.270949] tegra-gpcdma 2600000.gpcdma: GPC DMA driver register 31 channels
[    3.271165] tegra-fuse-burn efuse-burn: shutdown limit check disabled
[    3.271169] tegra-fuse-burn efuse-burn: Fuse burn driver initialized
[    3.271349] serial-tegra 3100000.serial: Adding to iommu group 3
[    3.271700] 3100000.serial: ttyTHS0 at MMIO 0x3100000 (irq = 13, base_baud = 0) is a TEGRA_UART
[    3.272135] serial-tegra 3130000.serial: Adding to iommu group 3
[    3.272475] 3130000.serial: ttyTHS3 at MMIO 0x3130000 (irq = 65, base_baud = 0) is a TEGRA_UART
[    3.272822] tegra23x-qspi 3270000.spi: Node prod has invalid entries
[    3.272826] tegra23x-qspi 3270000.spi: Node prod: Child has not proper setting
[    3.272827] tegra23x-qspi 3270000.spi: Node spi: Faild to read the Prod Setting.
[    3.272830] tegra23x-qspi 3270000.spi: Prod settings list not found
[    3.296900] tegra-xusb 3610000.xhci: Firmware timestamp: 2021-12-01 05:27:10 UTC, Version: 80.03 release
[    3.296911] tegra-xusb 3610000.xhci: xHCI Host Controller
[    3.296936] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 1
[    3.297751] tegra-xusb 3610000.xhci: hcc params 0x0180ff05 hci version 0x120 quirks 0x0000000000050810
[    3.298096] tegra-xusb 3610000.xhci: irq 235, io mem 0x03610000
[    3.298464] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    3.298469] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.298470] usb usb1: Product: xHCI Host Controller
[    3.298473] usb usb1: Manufacturer: Linux 5.10.104-rt63-tegra xhci-hcd
[    3.298473] usb usb1: SerialNumber: 3610000.xhci
[    3.299127] hub 1-0:1.0: USB hub found
[    3.299156] hub 1-0:1.0: 4 ports detected
[    3.299393] tegra-xusb 3610000.xhci: xHCI Host Controller
[    3.299406] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 2
[    3.299411] tegra-xusb 3610000.xhci: Host supports USB 3.1 Enhanced SuperSpeed
[    3.299484] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[    3.299487] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.299490] usb usb2: Product: xHCI Host Controller
[    3.299491] usb usb2: Manufacturer: Linux 5.10.104-rt63-tegra xhci-hcd
[    3.299492] usb usb2: SerialNumber: 3610000.xhci
[    3.299659] hub 2-0:1.0: USB hub found
[    3.299675] hub 2-0:1.0: 4 ports detected
[    3.331623] cpufreq: cpufreq_online: CPU0: Running at unlisted initial frequency: 2009000 KHz, changing to: 2035200 KHz
[    3.333905] cpufreq: cpufreq_online: CPU4: Running at unlisted initial frequency: 2009000 KHz, changing to: 2035200 KHz
[    3.336457] cpufreq: cpufreq_online: CPU8: Running at unlisted initial frequency: 2043000 KHz, changing to: 2112000 KHz
[    3.337947] tegra194-cpufreq e000000.ccplex: probed with ICC
[    3.339154] tegra194-pcie 14100000.pcie: Using GICv2m MSI allocator
[    3.342195] tegra194-pcie 14100000.pcie: host bridge /pcie@14100000 ranges:
[    3.342204] tegra194-pcie 14100000.pcie:       IO 0x0030100000..0x00301fffff -> 0x0030100000
[    3.342210] tegra194-pcie 14100000.pcie:      MEM 0x20a8000000..0x20afffffff -> 0x0040000000
[    3.342212] tegra194-pcie 14100000.pcie:      MEM 0x2080000000..0x20a7ffffff -> 0x2080000000
[    3.344006] sdhci-tegra 3400000.sdhci: Got CD GPIO
[    3.349391] mmc0: CQHCI version 5.10
[    3.353500] irq: IRQ302: trimming hierarchy from :interrupt-controller@f400000-1
[    3.353543] sdhci-tegra 3400000.sdhci: wakeup init done, cdirq 302
[    3.377955] mmc0: SDHCI controller on 3460000.sdhci [3460000.sdhci] using ADMA 64-bit
[    3.449915] tegra194-pcie 14100000.pcie: Link up
[    3.450832] tegra194-pcie 14100000.pcie: PCI host bridge to bus 0001:00
[    3.450835] pci_bus 0001:00: root bus resource [bus 00-ff]
[    3.450838] pci_bus 0001:00: root bus resource [io  0x0000-0xfffff] (bus address [0x30100000-0x301fffff])
[    3.450840] pci_bus 0001:00: root bus resource [mem 0x20a8000000-0x20afffffff] (bus address [0x40000000-0x47ffffff])
[    3.450842] pci_bus 0001:00: root bus resource [mem 0x2080000000-0x20a7ffffff pref]
[    3.450891] pci 0001:00:00.0: [10de:229e] type 01 class 0x060400
[    3.451059] pci 0001:00:00.0: PME# supported from D0 D3hot
[    3.455397] pci 0001:01:00.0: [10ec:c822] type 00 class 0x028000
[    3.455556] pci 0001:01:00.0: reg 0x10: [io  0x0000-0x00ff]
[    3.455755] pci 0001:01:00.0: reg 0x18: [mem 0x20a8000000-0x20a800ffff 64bit]
[    3.456849] pci 0001:01:00.0: supports D1 D2
[    3.456850] pci 0001:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    3.461120] pci 0001:00:00.0: BAR 14: assigned [mem 0x20a8000000-0x20a80fffff]
[    3.461124] pci 0001:00:00.0: BAR 13: assigned [io  0x1000-0x1fff]
[    3.461127] pci 0001:01:00.0: BAR 2: assigned [mem 0x20a8000000-0x20a800ffff 64bit]
[    3.461229] pci 0001:01:00.0: BAR 0: assigned [io  0x1000-0x10ff]
[    3.461260] pci 0001:00:00.0: PCI bridge to [bus 01-ff]
[    3.461264] pci 0001:00:00.0:   bridge window [io  0x1000-0x1fff]
[    3.461268] pci 0001:00:00.0:   bridge window [mem 0x20a8000000-0x20a80fffff]
[    3.461282] pci 0001:00:00.0: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    3.461356] pci 0001:01:00.0: Max Payload Size set to  128/ 128 (was  128), Max Read Rq  512
[    3.461608] pcieport 0001:00:00.0: Adding to iommu group 10
[    3.462033] pcieport 0001:00:00.0: PME: Signaling with IRQ 51
[    3.462360] pcieport 0001:00:00.0: AER: enabled with IRQ 51
[    3.463146] tegra194-pcie 14160000.pcie: Using GICv2m MSI allocator
[    3.464942] tegra194-pcie 14160000.pcie: host bridge /pcie@14160000 ranges:
[    3.464950] tegra194-pcie 14160000.pcie:       IO 0x0036100000..0x00361fffff -> 0x0036100000
[    3.464956] tegra194-pcie 14160000.pcie:      MEM 0x2428000000..0x242fffffff -> 0x0040000000
[    3.464960] tegra194-pcie 14160000.pcie:      MEM 0x2140000000..0x2427ffffff -> 0x2140000000
[    3.468109] mmc0: Command Queue Engine enabled
[    3.468112] mmc0: periodic cache flush enabled
[    3.468116] mmc0: new HS400 Enhanced strobe MMC card at address 0001
[    3.468470] mmcblk0: mmc0:0001 G1M15M 59.3 GiB
[    3.468697] mmcblk0rpmb: mmc0:0001 G1M15M partition 3 4.00 MiB, chardev (511:0)
[    3.471976]  mmcblk0: p1 p2 p3 p4 p5 p6 p7 p8 p9 p10 p11
[    3.553924] usb 1-3: new full-speed USB device number 2 using tegra-xusb
[    3.705895] usb 1-3: New USB device found, idVendor=13d3, idProduct=3549, bcdDevice= 0.00
[    3.705899] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    3.705901] usb 1-3: Product: Bluetooth Radio
[    3.705902] usb 1-3: Manufacturer: Realtek
[    3.705904] usb 1-3: SerialNumber: 00e04c000001
[    3.830637] usb 2-3: new SuperSpeedPlus Gen 2 USB device number 2 using tegra-xusb
[    3.868364] usb 2-3: New USB device found, idVendor=0bda, idProduct=0420, bcdDevice= 1.40
[    3.868367] usb 2-3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    3.868368] usb 2-3: Product: 4-Port USB 3.0 Hub
[    3.868370] usb 2-3: Manufacturer: Generic
[    3.878579] hub 2-3:1.0: USB hub found
[    3.880792] hub 2-3:1.0: 4 ports detected
[    3.985913] usb 1-4: new high-speed USB device number 3 using tegra-xusb
[    4.153615] usb 1-4: New USB device found, idVendor=0bda, idProduct=5420, bcdDevice= 1.40
[    4.153619] usb 1-4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.153621] usb 1-4: Product: 4-Port USB 2.0 Hub
[    4.153623] usb 1-4: Manufacturer: Generic
[    4.155060] hub 1-4:1.0: USB hub found
[    4.156557] hub 1-4:1.0: 4 ports detected
[    4.571087] tegra194-pcie 14160000.pcie: Phy link never came up
[    4.571154] tegra194-pcie 14160000.pcie: PCI host bridge to bus 0004:00
[    4.571157] pci_bus 0004:00: root bus resource [bus 00-ff]
[    4.571160] pci_bus 0004:00: root bus resource [io  0x100000-0x1fffff] (bus address [0x36100000-0x361fffff])
[    4.571162] pci_bus 0004:00: root bus resource [mem 0x2428000000-0x242fffffff] (bus address [0x40000000-0x47ffffff])
[    4.571164] pci_bus 0004:00: root bus resource [mem 0x2140000000-0x2427ffffff pref]
[    4.571208] pci 0004:00:00.0: [10de:229c] type 01 class 0x060400
[    4.571373] pci 0004:00:00.0: PME# supported from D0 D3hot
[    4.578991] pci 0004:00:00.0: PCI bridge to [bus 01-ff]
[    4.579013] pci 0004:00:00.0: Max Payload Size set to  256/ 256 (was  256), Max Read Rq  512
[    4.579275] pcieport 0004:00:00.0: Adding to iommu group 11
[    4.579671] pcieport 0004:00:00.0: PME: Signaling with IRQ 53
[    4.580268] pcieport 0004:00:00.0: AER: enabled with IRQ 53
[    4.580522] pci_bus 0004:01: busn_res: [bus 01-ff] is released
[    4.580611] pci 0004:00:00.0: Removing from iommu group 11
[    4.580620] pci_bus 0004:00: busn_res: [bus 00-ff] is released
[    4.582064] tegra194-pcie 141a0000.pcie: Using GICv2m MSI allocator
[    4.582079] tegra194-pcie 141a0000.pcie: Failed to get slot regulators: -517
[    4.582174] vdd-3v3-pcie: supplied by vdd-3v3-sys
[    4.582388] avdd-cam-2v8: supplied by vdd-3v3-sys
[    4.582481] vdd-dp: supplied by vdd-3v3-sys
[    4.582651] vdd-3v3-sd: supplied by vdd-3v3-sys
[    4.583057] dsi-vdd-1v8-bl-en: supplied by vdd-1v8-sys
[    4.584968] tegra194-isp5 14800000.isp: initialized
[    4.589072] tegra194-vi5 13e40000.host1x:vi0@15c00000: initialized
[    4.589146] (NULL device *): fops function table already registered
[    4.589967] tegra194-vi5 13e40000.host1x:vi1@14c00000: initialized
[    4.590469] tegra194-pcie 141a0000.pcie: Using GICv2m MSI allocator
[    4.590904] sdhci-tegra 3400000.sdhci: Got CD GPIO
[    4.601199] sdhci-tegra 3400000.sdhci: wakeup init done, cdirq 302
[    4.652634] random: crng init done
[    4.698340] tegra194-pcie 141a0000.pcie: host bridge /pcie@141a0000 ranges:
[    4.698353] tegra194-pcie 141a0000.pcie:       IO 0x003a100000..0x003a1fffff -> 0x003a100000
[    4.698359] tegra194-pcie 141a0000.pcie:      MEM 0x2b28000000..0x2b2fffffff -> 0x0040000000
[    4.698362] tegra194-pcie 141a0000.pcie:      MEM 0x2740000000..0x2b27ffffff -> 0x2740000000
[    4.857773] usb 1-4.2: new high-speed USB device number 4 using tegra-xusb
[    4.959858] usb 1-4.2: New USB device found, idVendor=0424, idProduct=2514, bcdDevice= b.b3
[    4.959862] usb 1-4.2: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.960757] hub 1-4.2:1.0: USB hub found
[    4.961231] hub 1-4.2:1.0: 3 ports detected
[    5.249771] usb 1-4.2.1: new high-speed USB device number 5 using tegra-xusb
[    5.359854] usb 1-4.2.1: New USB device found, idVendor=0424, idProduct=2640, bcdDevice= 0.00
[    5.359858] usb 1-4.2.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    5.360757] hub 1-4.2.1:1.0: USB hub found
[    5.361230] hub 1-4.2.1:1.0: 3 ports detected
[    5.445775] usb 1-4.2.2: new low-speed USB device number 6 using tegra-xusb
[    5.559604] usb 1-4.2.2: New USB device found, idVendor=413c, idProduct=2005, bcdDevice= 1.05
[    5.559607] usb 1-4.2.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    5.559608] usb 1-4.2.2: Product: DELL USB Keyboard
[    5.559609] usb 1-4.2.2: Manufacturer: DELL
[    5.565579] input: DELL DELL USB Keyboard as /devices/platform/3610000.xhci/usb1/1-4/1-4.2/1-4.2.2/1-4.2.2:1.0/0003:413C:2005.0001/input/input0
[    5.622381] hid-generic 0003:413C:2005.0001: input,hidraw0: USB HID v1.10 Keyboard [DELL DELL USB Keyboard] on usb-3610000.xhci-4.2.2/input0
[    5.649771] usb 1-4.2.1.1: new high-speed USB device number 7 using tegra-xusb
[    5.661854] mmc1: SDHCI controller on 3400000.sdhci [3400000.sdhci] using ADMA 64-bit
[    5.794108] usb 1-4.2.1.1: New USB device found, idVendor=0424, idProduct=4060, bcdDevice= 1.82
[    5.794112] usb 1-4.2.1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    5.794114] usb 1-4.2.1.1: Product: Ultra Fast Media Reader
[    5.794115] usb 1-4.2.1.1: Manufacturer: Generic
[    5.794116] usb 1-4.2.1.1: SerialNumber: \xe2\x83\xb1??000264001
[    5.795145] usb-storage 1-4.2.1.1:1.0: USB Mass Storage device detected
[    5.796201] scsi host0: usb-storage 1-4.2.1.1:1.0
[    5.806266] tegra194-pcie 141a0000.pcie: Phy link never came up
[    5.806320] tegra194-pcie 141a0000.pcie: PCI host bridge to bus 0005:00
[    5.806322] pci_bus 0005:00: root bus resource [bus 00-ff]
[    5.806325] pci_bus 0005:00: root bus resource [io  0x200000-0x2fffff] (bus address [0x3a100000-0x3a1fffff])
[    5.806327] pci_bus 0005:00: root bus resource [mem 0x2b28000000-0x2b2fffffff] (bus address [0x40000000-0x47ffffff])
[    5.806328] pci_bus 0005:00: root bus resource [mem 0x2740000000-0x2b27ffffff pref]
[    5.806370] pci 0005:00:00.0: [10de:229a] type 01 class 0x060400
[    5.806530] pci 0005:00:00.0: PME# supported from D0 D3hot
[    5.814183] pci 0005:00:00.0: PCI bridge to [bus 01-ff]
[    5.814204] pci 0005:00:00.0: Max Payload Size set to  256/ 256 (was  256), Max Read Rq  512
[    5.814456] pcieport 0005:00:00.0: Adding to iommu group 12
[    5.814848] pcieport 0005:00:00.0: PME: Signaling with IRQ 55
[    5.815187] pcieport 0005:00:00.0: AER: enabled with IRQ 55
[    5.815426] pci_bus 0005:01: busn_res: [bus 01-ff] is released
[    5.815512] pci 0005:00:00.0: Removing from iommu group 12
[    5.815522] pci_bus 0005:00: busn_res: [bus 00-ff] is released
[    5.817261] nvethernet 6810000.ethernet: Adding to iommu group 52
[    5.817852] nvethernet 6810000.ethernet: failed to read skip mac reset flag, default 0
[    5.817856] nvethernet 6810000.ethernet: failed to read MDIO address
[    5.817859] nvethernet 6810000.ethernet: setting to default DMA bit mask
[    5.817867] nvethernet 6810000.ethernet: failed to read UPHY GBE mode- default to 10G
[    5.837801] usb 1-4.2.3: new low-speed USB device number 8 using tegra-xusb
[    5.959655] usb 1-4.2.3: New USB device found, idVendor=046d, idProduct=c063, bcdDevice=57.00
[    5.959658] usb 1-4.2.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    5.959659] usb 1-4.2.3: Product: DELL USB Laser Mouse
[    5.959661] usb 1-4.2.3: Manufacturer: DELL
[    5.966260] input: DELL DELL USB Laser Mouse as /devices/platform/3610000.xhci/usb1/1-4/1-4.2/1-4.2.3/1-4.2.3:1.0/0003:046D:C063.0002/input/input1
[    5.967053] hid-generic 0003:046D:C063.0002: input,hidraw1: USB HID v1.10 Mouse [DELL DELL USB Laser Mouse] on usb-3610000.xhci-4.2.3/input0
[    6.210237] nvethernet 6810000.ethernet: Ethernet MAC address: 48:b0:2d:69:4e:1e
[    6.210311] -->macsec_probe()
[    6.210329] -->macsec_get_platform_res()
[    6.210353] <--macsec_get_platform_res()
[    6.210354] -->macsec_enable_car()
[    6.210567] <--macsec_enable_car()
[    6.210589] <--macsec_probe()
[    6.210590] nvethernet 6810000.ethernet: Macsec not enabled
[    6.210591] nvethernet 6810000.ethernet: Macsec: Reduced MTU: 1466 Max: 16383
[    6.212589] nvethernet 6810000.ethernet: eth0 (HW ver: 31) created with 10 DMA channels
[    6.213378] irq: IRQ304: trimming hierarchy from :pmc@c360000
[    6.213828] irq: IRQ305: trimming hierarchy from :interrupt-controller@f400000-1
[    6.214272] irq: IRQ306: trimming hierarchy from :pmc@c360000
[    6.214578] input: gpio-keys as /devices/platform/gpio-keys/input/input2
[    6.215026] tegra-se-nvhost 15810000.se: Adding to iommu group 53
[    6.215637] tegra-se-nvhost 15810000.se: initialized
[    6.225726] tegra-se-nvhost 15810000.se: tegra_se_probe: complete
[    6.225865] tegra-se-nvhost 15820000.se: Adding to iommu group 54
[    6.226301] tegra-se-nvhost 15820000.se: initialized
[    6.228483] tegra-se-nvhost 15820000.se: tegra_se_probe: complete
[    6.228568] tegra-se-nvhost 15840000.se: Adding to iommu group 55
[    6.228958] tegra-se-nvhost 15840000.se: initialized
[    6.233577] tegra-se-nvhost 15840000.se: tegra_se_probe: complete
[    6.234323] tegra_actmon d230000.actmon: in actmon_register()...
[    6.234592] tegra_actmon d230000.actmon: bwmgr_disable = 1
[    6.234973] tegra_actmon d230000.actmon: initialization Completed for the device mc_all
[    6.235156] hvc_sysfs: hypervisor is not present
[    6.366156] ALSA device list:
[    6.366160]   No soundcards found.
[    6.375664] Freeing unused kernel memory: 3904K
[    6.375747] Run /init as init process
[    6.375749]   with arguments:
[    6.375749]     /init
[    6.375750]   with environment:
[    6.375750]     HOME=/
[    6.375751]     TERM=linux
[    6.375751]     mminit_loglevel=4
[    6.395493] Root device found: mmcblk0p1
[    6.395974] Found dev node: /dev/mmcblk0p1
[    6.650298] EXT4-fs (mmcblk0p1): 1 orphan inode deleted
[    6.650303] EXT4-fs (mmcblk0p1): recovery complete
[    6.654187] EXT4-fs (mmcblk0p1): mounted filesystem with ordered data mode. Opts: (null)
[    6.655684] Rootfs mounted over mmcblk0p1
[    6.667164] Switching from initrd to actual rootfs
[    6.813757] systemd[1]: System time before build time, advancing clock.
[    6.829174] scsi 0:0:0:0: Direct-Access     Generic  Ultra HS-SD/MMC  1.82 PQ: 0 ANSI: 0
[    6.871463] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[    6.871943] systemd[1]: Detected architecture arm64.
[    6.889922] sd 0:0:0:0: [sda] Attached SCSI removable disk
[    7.045864] systemd[1]: Set hostname to <linux>.
[    7.256267] systemd[1]: system-modprobe.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[    7.256273] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[    7.257179] systemd[1]: Created slice system-modprobe.slice.
[    7.307819] systemd[1]: Created slice system-serial\x2dgetty.slice.
[    7.357482] systemd[1]: Created slice User and Session Slice.
[    7.390960] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    7.457134] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[    7.515377] systemd[1]: Reached target User and Group Name Lookups.
[    7.531501] systemd[1]: Reached target Slices.
[    7.531550] systemd[1]: Reached target Swap.
[    7.531829] systemd[1]: Listening on RPCbind Server Activation Socket.
[    7.531987] systemd[1]: Listening on Syslog Socket.
[    7.532141] systemd[1]: Listening on fsck to fsckd communication Socket.
[    7.532242] systemd[1]: Listening on initctl Compatibility Named Pipe.
[    7.532493] systemd[1]: Listening on Journal Audit Socket.
[    7.532629] systemd[1]: Listening on Journal Socket (/dev/log).
[    7.532801] systemd[1]: Listening on Journal Socket.
[    7.532963] systemd[1]: Listening on udev Control Socket.
[    7.533081] systemd[1]: Listening on udev Kernel Socket.
[    7.534360] systemd[1]: Mounting Huge Pages File System...
[    7.582251] systemd[1]: Mounting POSIX Message Queue File System...
[    7.611047] systemd[1]: Mounting RPC Pipe File System...
[    7.612320] systemd[1]: Mounting Kernel Debug File System...
[    7.613891] systemd[1]: Mounting Kernel Trace File System...
[    7.632517] systemd[1]: Starting Journal Service...
[    7.633999] systemd[1]: Starting Set the console keyboard layout...
[    7.645601] systemd[1]: Condition check resulted in Create list of static device nodes for the current kernel being skipped.
[    7.645647] systemd[1]: Condition check resulted in Load Kernel Module drm being skipped.
[    7.646786] systemd[1]: Starting NVIDIA specific first-boot udev script...
[    7.674602] systemd[1]: Started Nameserver information manager.
[    7.674873] systemd[1]: Reached target Network (Pre).
[    7.681909] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[    7.681980] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[    7.685051] systemd[1]: Starting Load Kernel Modules...
[    7.714596] systemd[1]: Starting Remount Root and Kernel File Systems...
[    7.716662] systemd[1]: Starting udev Coldplug all Devices...
[    7.718534] systemd[1]: Mounted Huge Pages File System.
[    7.729486] EXT4-fs (mmcblk0p1): re-mounted. Opts: (null)
[    7.742826] systemd[1]: Started Journal Service.
[    7.773394] systemd-journald[524]: Received client request to flush runtime journal.
[   11.595635] using random self ethernet address
[   11.595642] using random host ethernet address
[   13.650673] hwmon hwmon1: temp1_input not attached to any thermal zone
[   14.338295] Aquantia AQR113C 6810000.ethernet:00: No AQR phy_mode setting in DT
[   18.434356] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   18.436318] nvethernet 6810000.ethernet eth0: Link is Up - 1Gbps/Full - flow control rx/tx
[   20.977539] pwm-tegra-tachometer 39c0000.tachometer: Tachometer Overflow is detected
[   37.853802] vdd-12v-sys: disabling
[   37.853812] vdd-1v8-sys: disabling
[   37.853814] vdd-3v3-ftdi: disabling

This means that you have to install kernel modules after re-compiling them agains the rt kernel. There needs to be /lib/modules/5.10.104-rt63-tegra directory where re-compiled modules should reside. The compilation of the kernel module is general knowledge and it does not depend on the rt vs non rt kernel and steps for compilation and installation should be from the l4t dev guide.

Followings are the steps I follow after successfully building the rt kernel according to the kernel customization section in the developer guide

https://docs.nvidia.com/jetson/archives/r35.1/DeveloperGuide/text/SD/Kernel/KernelCustomization.html#building-the-kernel

  1. Replace Linux_for_Tegra/rootfs/usr/lib/modules/$(uname -r)/kernel/drivers/gpu/nvgpu/nvgpu.ko with a copy of this file:
    $kernel_out/drivers/gpu/nvgpu/nvgpu.ko
  2. For the device tree, replace the files in Linux_for_Tegra/kernel/dtb/ with a copy from:
    $kernel_out/arch/arm64/boot/dts/nvidia/
  3. Replace Linux_for_Tegra/kernel/Image with a copy of this file:
    $kernel_out/arch/arm64/boot/Image
  4. Run apply_binary
    sudo ./apply_binaries.sh
  5. Flash the image
    sudo ./flash.sh jetson-agx-orin-devkit mmcblk0p1

I search kernel module installation in the Jetson Linux develop guide

https://docs.nvidia.com/jetson/archives/r35.1/DeveloperGuide/text/SD/Kernel.html

but can’t find a section about kernel module installation. Can you point out what is messing in the above steps and which section of the develop guide has the kernel module installation instructions.

Installing modules compiled agains customized kernel is general knowledge so mostly it was left out from the dev-guide. I can check internally but you can always follow https://www.kernel.org/doc/Documentation/kbuild/modules.txt guidelines, especially modules_install and INSTALL_MOD_PATH.

Thanks for your help.

Embedded Linux is new to me. Most of my past experience is related to hard real-time operating system.

Here is my understanding of the steps I follow

  • Step 1 copies the driver kernel module, nvgpu.ko, from the build output folder to Linux_for_Tegra
  • Step 2 copies device tree from from the build output folder to Linux_for_Tegra
  • Step 3 copies kernel Image from the build output folder to Linux_for_Tegra
  • Step 4 will apply the binaries in Linux_for_Tegra to build the root filesystem
  • Step 5 will create a flash image form Linux_for_Tegra and then flash it to the target system
  1. Replace Linux_for_Tegra/rootfs/usr/lib/modules/$(uname -r)/kernel/drivers/gpu/nvgpu/nvgpu.ko with a copy of this file:
    $kernel_out/drivers/gpu/nvgpu/nvgpu.ko
  2. For the device tree, replace the files in Linux_for_Tegra/kernel/dtb/ with a copy from:
    $kernel_out/arch/arm64/boot/dts/nvidia/
  3. Replace Linux_for_Tegra/kernel/Image with a copy of this file:
    $kernel_out/arch/arm64/boot/Image
  4. Run apply_binary
    sudo ./apply_binaries.sh
  5. Flash the image
    sudo ./flash.sh jetson-agx-orin-devkit mmcblk0p1

Is kernel module installation already handled by apply_binaries.sh? If it is not, should the kernel module installation step be done between step (4) and step (5)?

1 Like

after step 3. I usually do as below.
sudo make INSTALL_MOD_PATH=<path to Linux_for_Tegra/rootfs> O= modules_install

The above step should have created Linux_for_Tegra/rootfs/lib/modules/5.10.104-rt63-tegra/ directory which should have all the modules for that kernel. You can verify if gpu module you are copying is that path or not, if not you can manually copy in above path.

After that, flash the Jetson device.