Flashing only Device Tree with bootburn -u A_1_kernel-dtb after enabling PCIe RP 5 causes system to hang on boot

DRIVE OS Version: 7.0.3

Issue Description: Partial flash with only kernel-dtb resulted in system that fails to boot completely.

After applying patch provided in

How to flash only DeviceTree and Kernel update on Drive AGX Thor - #13 by david.cattley

to enable bootburn to handle the -u A_1_kernel-dtb option the following test sequence was executed:

  1. Step 1: Start a fresh docker instance of the DOS 7.0.3 docker.
    • Bind image with PCIe Support for C5 in Root mode
    • cd $NV_WORKSPACE/drive-foundation && ./make/bind_partitions  -b p3960-10-sw03 drive_av.linux -p dev_nsr ENABLE_T264_PCIE_C5=y
      
    • Fully flash the device
    • cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2
      
    • After boot-up, verified with lspci that the C5 EP is listed (success)
  2. Step 2: Start a fresh docker instance of the DOS 7.0.3 docker.
    • Bind Image without PCIe Support
    • cd $NV_WORKSPACE/drive-foundation && ./make/bind_partitions  -b p3960-10-sw03 drive_av.linux -p dev_nsr
      
    • Fully flash device
    • cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2
      
    • After boot-up, verified with lspci that the C5 EP is not listed. (success)
    • Incrementally (e.g. from current state) run bind_partitions to enable PCIe C5
    • cd $NV_WORKSPACE/drive-foundation && ./make/bind_partitions  -b p3960-10-sw03 drive_av.linux -p dev_nsr ENABLE_T264_PCIE_C5=y
      
    • Apply bootburn patch to enable -u option processing (see other post)
    • Partially flash device
    • cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2 -u A_1_kernel-dtb
      
    • Device reboots and hangs during boot

This suggest that either the incremental bind_partitions operation or the partial (kernel-dtb) flash or both are insufficient to actually transition the unit to support PCIe C5 RP. The unit clearly supports PCIe C5 RP since doing a full clean bind and burn works as expected.

The console output from the linux boot is:

pl:[I]: UTC init successful
pl:[I]: storage is virtualized
pl:[I]: device_registration_virt_init Successful
pl:[I]: vse_check_decrypt_status - AES GCM decrypt success
pl:[I]: RSA_PSS authentication for binary PASSED
pl:[I]: EDDSA authentication for binary successful
pl:[I]: XMSS authentication for binary successful
pl:[I]: xmss_verify_test done
pl:[I]: KAT successful
pl:[I]: PVIT Loaded
pl:[I]: Platform ChipId 0x26
pl:[I]: BCH SHA512 digest verification successful
pl:[I]: PVIT entry found and SHA is matching
pl:[I]: Loaded PT
pl:[I]: dev_id 0xe instance 0xa part_name :pt part_id 0x1 start_addr 0x0 size 0x40000 end_addr 0x3ffff
pl:[I]: dev_id 0xe instance 0xa part_name :kernel-dtb part_id 0x2 start_addr 0x40000 size 0x80000 end_addr 0xbffff
pl:[I]: dev_id 0xe instance 0xa part_name :kernel part_id 0x3 start_addr 0xc0000 size 0x3b00000 end_addr 0x3bbffff
pl:[I]: dev_id 0xe instance 0xa part_name :ramdisk part_id 0x4 start_addr 0x3bc0000 size 0xb00000 end_addr 0x46bffff
pl:[I]: Booted chain A
pl:[I]: GCC version: 13.2.0
pl:[I]: Loading Ramdisk Image
pl:[I]: multi_sku_enabled = 0x0, sku_val = 0x0
pl:[I]: BCH SHA512 digest verification successful
pl:[I]: PVIT entry found and SHA is matching
pl:[I]: Ratchet Version Check for partition type: 33
pl:[I]: Ratchet Version Check Successful
pl:[I]: meta-blob hash verify success 0x3bc3000
pl:[I]: Plaintext SHA512 validation successful
pl:[I]: Loading vUEFI DTB image
pl:[E]: Partition cpu-bl-dtb not found
pl:[I]: DTB partition not found, continue..
pl:[I]: Loading UEFI Image
pl:[E]: Partition cpu-bl not found
pl:[I]: Partition cpu-bl not found. e= 0x30018
pl:[I]: UEFI partition not found, continue..
pl:[I]: Loading kernel DTB image
pl:[I]: multi_sku_enabled = 0x0, sku_val = 0x0
pl:[I]: BCH SHA512 digest verification successful
pl:[I]: PVIT entry found and SHA is matching
pl:[I]: Ratchet Version Check for partition type: 5
pl:[I]: Ratchet Version Check Successful
pl:[I]: sysinfo_query_mem_info base 80000000 size f45200000 ram_size f45200000pl:[I]: max_vcpus 14
pl:[I]: Added mpidr:0x10000 to  vcpu:0 node
pl:[I]: Added mpidr:0x20000 to  vcpu:1 node
pl:[I]: Added mpidr:0x30000 to  vcpu:2 node
pl:[I]: Added mpidr:0x40000 to  vcpu:3 node
pl:[I]: Added mpidr:0x50000 to  vcpu:4 node
pl:[I]: Added mpidr:0x60000 to  vcpu:5 node
pl:[I]: Added mpidr:0x70000 to  vcpu:6 node
pl:[I]: Added mpidr:0x80000 to  vcpu:7 node
pl:[I]: Added mpidr:0x90000 to  vcpu:8 node
pl:[I]: Added mpidr:0xa0000 to  vcpu:9 node
pl:[I]: Added mpidr:0xb0000 to  vcpu:10 node
pl:[I]: Added mpidr:0xc0000 to  vcpu:11 node
pl:[I]: Added mpidr:0xd0000 to  vcpu:12 node
pl:[I]: Added mpidr:0x0 to  vcpu:13 node
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[I]: device type not cpu
pl:[W]: PVIT entry not found for gos0-ifs2
pl:[W]: PVIT entry not found for gos0-ifs2_1
pl:[W]: PVIT entry not found for gos0-ifs2_2
pl:[W]: PVIT entry not found for gos0-ifs2_3
pl:[W]: PVIT entry not found for gos0-ifs2_4
pl:[W]: PVIT entry not found for gos0-ifs2_5
pl:[W]: PVIT entry not found for gos0-ifs2_6
pl:[W]: PVIT entry not found for gos0-ifs2_7
pl:[I]: Added PVIT data for SIFS bins
pl:[I]: CARVEOUT_HPSE base(0x1ffb6a80000) size(0x400000)
pl:[I]: CARVEOUT_FSI_CPU_NS base(0x1ffb6e80000) size(0xff0000)
pl:[I]: signed customer data version is less than 3
pl:[I]: MAC Controller Count = 2
pl:[I]: MAC Controller = 0, MAC instances = 0
pl:[I]: mac_count is '0' for mac controller 0, skipping mac populations
pl:[I]: MAC Controller = 1, MAC instances = 11
pl:[I]: total mac_address 11
pl:[W]: Unable to find /smmu-static-mapping node : FDT_ERR_NOTFOUND
pl:[I]: Added HWRNG info to DTB
pl:[I]: vecid[0]:0x0, vecid[1]:0x0, vecid[14]:0x0, vecid[15]:0x0
pl:[I]: Added PKC revoke status
pl:[I]: GR carveout not found, skipping
pl:[I]: Kernel Cmdline: aurixfw=AFW root=/dev/vblkdev0 usr_fs=/dev/vblkdev1:/mnt/persistent/metadata usr_fs2=/dev/vblkdev2:/home rw_overlay=/dev/vblkdev30:/mnt/rw_overlay nvlog=/dev/vblkdev33:/mnt/nvlog_logs rootfstype=ext4 rw gpt gpt_sector=0x13401 tegra_keep_boot_clocks disable_android_paranoid_network sdhci_tegra.en_boot_part_access=1 console=ttyUTC0,115200 earlyprintk=tegra_utc,mmio32,0xc5a0000 earlycon=tegra_utc,mmio32,0xc5a0000 clk_ignore_unused pci=pcie_bus_perf pci=ecrc=on pcie_port_pm=force verity=0 board_name=p3960-10-sw03 pct=linux pct_variant=dev_nsr du_ctx=/dev/vblkdev60  nokaslr tegraid=26.4.1.0.0 tegra_bootloader_debug.bl_prof_dataptr=65536@0x1ffb7e80000 tegra_bootloader_debug.bl_prof_ro_ptr=131072@0x1ffb7e70000 
pl:[I]: Kernel Bootconfig: 

pl:[I]: Loading Kernel Image
pl:[I]: multi_sku_enabled = 0x0, sku_val = 0x0
pl:[I]: BCH SHA512 digest verification successful
pl:[I]: PVIT entry found and SHA is matching
pl:[I]: Ratchet Version Check for partition type: 4
pl:[I]: Ratchet Version Check Successful
pl:[I]: Randomized load_addr: 0x80600000
pl:[I]: meta-blob hash verify success 0xc6000
pl:[I]: Plaintext SHA512 validation successful
pl:[I]: Jumping to next stage at 0x80600000 (virtual 0x80c00000)
[    0.000000] [TS:7677870804] Booting Linux on physical CPU 0x0000010000 [0x410fd830]
[    0.000000] [TS:7677880016] Linux version 6.1.119-rt45-rt-tegra (buildbrain@9293b6c0-8961-4911-a34f-2bea302fa83c-nbzv-hhtkt) (aarch64-buildroot-linux-gnu-gcc.br_real (Buildroot 2021.11-11272-ge2962af-dirty) 13.2.0, GNU ld (GNU Binutils) 2.42) #1 SMP PREEMPT_RT Wed Jun 11 22:09:03 PDT 2025
[    0.000000] [TS:7678192044] random: crng init done
[    0.000000] [TS:7678591405] Machine model: p3960-0010
[    0.000000] [TS:7679153785] earlycon: tegra_utc0 at MMIO32 0x000000000c5a0000 (options '')
[    0.000000] [TS:7717661350] printk: bootconsole [tegra_utc0] enabled
[    0.000000] [TS:7718173942] efi: UEFI not found.
[    0.000000] [TS:7718294516] Reserved memory: created DMA memory pool at 0x0000000fb5200000, size 256 MiB
[    0.000000] [TS:7718295396] OF: reserved mem: initialized node smmu_carveout, compatible id shared-dma-pool
[    0.000000] [TS:7718300841] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-poolB
[    0.000000] [TS:7720042526] NUMA: NODE_DATA [mem 0xf54f0f580-0xf54f11fff]
[    0.000000] [TS:7720175489] Zone ranges:
[    0.000000] [TS:7720177285]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000] [TS:7720180211]   DMA32    empty
[    0.000000] [TS:7720181257]   Normal   [mem 0x0000000100000000-0x0000000fc51fffff]
[    0.000000] [TS:7720182202] Movable zone start for each node
[    0.000000] [TS:7720182646] Early memory node ranges
[    0.000000] [TS:7720182905]   node   0: [mem 0x0000000080000000-0x000000008606ffff]
[    0.000000] [TS:7720184081]   node   0: [mem 0x0000000086070000-0x0000000086071fff]
[    0.000000] [TS:7720184591]   node   0: [mem 0x0000000086072000-0x0000000f551fffff]
[    0.000000] [TS:7720189628]   node   0: [mem 0x0000000f55200000-0x0000000f951fffff]
[    0.000000] [TS:7720190202]   node   0: [mem 0x0000000f95200000-0x0000000fb51fffff]
[    0.000000] [TS:7720190841]   node   0: [mem 0x0000000fb5200000-0x0000000fc51fffff]
[    0.000000] [TS:7803183952] On node 0, zone Normal: 11776 pages in unavailable ranges1fffff]
[    0.000000] [TS:7803284516] psci: probing for conduit method from DT.
[    0.000000] [TS:7803291081] psci: Using standard PSCI v0.2 function IDs
[    0.000000] [TS:7803292665] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] [TS:7803367970] percpu: Embedded 30 pages/cpu s82496 r8192 d32192 u122880
[    0.000000] [TS:7803396202] Detected PIPT I-cache on CPU0
[    0.000000] [TS:7803406711] CPU features: detected: Address authentication (architected QARMA3 algorithm)
[    0.000000] [TS:7803409841] CPU features: detected: GIC system register CPU interface
[    0.000000] [TS:7803411257] CPU features: detected: Hardware dirty bit management
[    0.000000] [TS:7803418489] CPU features: detected: Spectre-BHB
[    0.000000] [TS:7803468183] Fallback order for Node 0: 0 lternatives
[    0.000000] [TS:7803470618] Built 1 zonelists, mobility grouping on.  Total pages: 15761592
[    0.000000] [TS:7803471702] Policy zone: Normal
[    0.000000] [TS:7803473137] Kernel command line: aurixfw=AFW root=/dev/vblkdev0 usr_fs=/dev/vblkdev1:/mnt/persistent/metadata usr_fs2=/dev/vblkdev2:/home rw_overlay=/dev/vblkdev30:/mnt/rw_overlay nvlog=/dev/vblkdev33:/mnt/nvlog_logs rootfstype=ext4 rw gpt gpt_sector=0x13401 tegra_keep_boot_clocks disable_android_paranoid_network sdhci_tegra.en_boot_part_access=1 console=ttyUTC0,115200 earlyprintk=tegra_utc,mmio32,0xc5a0000 earlycon=tegra_utc,mmio32,0xc5a0000 clk_ignore_unused pci=pcie_bus_perf pci=ecrc=on pcie_port_pm=force verity=0 board_name=p3960-10-sw03 pct=linux pct_variant=dev_nsr du_ctx=/dev/vblkdev60  nokaslr tegraid=26.4.1.0.[    0.000000] [TS:7803588878] Unknown kernel command line parameters "tegra_keep_boot_clocks disable_android_paranoid_network nokaslr aurixfw=AFW usr_fs=/dev/vblkdev1:/mnt/persistent/metadata usr_fs2=/dev/vblkdev2:/home rw_overlay=/dev/vblkdev30:/mnt/rw_overlay nvlog=/dev/vblkdev33:/mnt/nvlog_logs earlyprintk=tegra_utc,mmio32,0xc5a0000 verity=0 board_name=p3960-10-sw03 pct=linux pct_variant=dev_nsr du_ctx=/dev/vblkdev60 tegraid=26.4.1.0.0", will be passed to user space.
[    0.000000] [TS:7804303507] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear)
[    0.000000] [TS:7804657322] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear)
[    0.000000] [TS:7804662637] software IO TLB: area num 16.), heap alloc:off, heap free:off
[    0.000000] [TS:7881237600] Memory: 60983396K/64047104K available (19264K kernel code, 4850K rwdata, 11032K rodata, 9024K init, 933K bss, 2539420K reserved, 524288K cma-reserved)
[    0.000000] [TS:7881303470] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=14, Nodes=1
[    0.000000] [TS:7881339952] trace event string verifier disabled
[    0.000000] [TS:7881407479] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] [TS:7881408155] rcu: 	RCU event tracing is enabled.
[    0.000000] [TS:7881408868] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=14.
[    0.000000] [TS:7881409646] rcu: 	RCU priority boosting: priority 1 delay 500 ms.
[    0.000000] [TS:7881410637] rcu: 	RCU_SOFTIRQ processing moved to rcuc kthreads.
[    0.000000] [TS:7881411609] 	No expedited grace period (rcu_normal_after_boot).
[    0.000000] [TS:7881413183] 	Tracing variant of Tasks RCU enabled.ed.
[    0.000000] [TS:7881414211] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] [TS:7881415202] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=14
[    0.000000] [TS:7882388905] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] [TS:7883114609] GICv3: 960 SPIs implemented
[    0.000000] [TS:7883169192] GICv3: GICv3 features: 48 PPIsrqented
[    0.000000] [TS:7886470841] GICv3: CPU0: found redistributor 10000 region 0:0x0000008146080000
[    0.000000] [TS:7886573905] ITS [mem 0x8146040000-0x814607ffff]
[    0.000000] [TS:7886593544] ITS@0x0000008146040000: allocated 8192 Devices @100110000 (indirect, esz 8, psz 64K, shr 0)
[    0.000000] [TS:7886603128] ITS: using cache flushing for cmd queue
[    0.000000] [TS:7886629470] GICv3: using LPI property table @0x0000000100120000
[    0.000000] [TS:7886687850] GIC: using cache flushing for LPI property table
[    0.000000] [TS:7886692091] GICv3: CPU0: using allocated LPI pending table @0x0000000100130000
[    0.000000] [TS:7891637711] arch_timer: cp15 timer(s) running at 1000.00MHz (virt).ention.
[    0.000000] [TS:7891640220] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000382] [TS:7892024711] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)
[    0.000420] [TS:7892062766] Console: colour dummy device 80x25
[    0.738820] [TS:8630462924] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)
[    0.738849] [TS:8630491553] Yama: becoming mindful. initializing
[    0.738874] [TS:8630516674] AppArmor: AppArmor initialized
[    0.738906] [TS:8630549276] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.738924] [TS:8630566776] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.800268] [TS:8691911276] cblist_init_generic: Setting shift to 4 and lim to 1.lback queues.
[    0.816334] [TS:8707976776] cblist_init_generic: Setting shift to 4 and lim to 1.lback queues.
[    0.824067] [TS:8715709757] rcu: HierMax phase no-delay instances is 1000.
[    0.844418] [TS:8736060785] Platform MSI: its@8146040000 domain createdhread started
[    0.844464] [TS:8736106488] PCI/MSI: /interrupt-controller@8146000000/its@8146040000 domain created
[    0.844499] [TS:8736141711] fsl-mc MSI: its@8146040000 domain created
[    0.845446] [TS:8737088803] EFI services will not be available.
[    0.845554] [TS:8737196692] smp: Bringing up secondary CPUs ...
[    0.878593] [TS:8770235470] Detected PIPT I-cache on CPU1
[    0.878611] [TS:8770254368] GICv3: CPU1: found redistributor 20000 region 0:0x00000081460c0000
[    0.878648] [TS:8770291442] GICv3: CPU1: using allocated LPI pending table @0x0000000100140000
[    0.909001] [TS:8800644229] Detected PIPT I-cache on CPU2sor 0x0000020000 [0x410fd830]
[    0.909059] [TS:8800701831] GICv3: CPU2: using allocated LPI pending table @0x0000000100150000
[    0.909146] [TS:8800788970] CPU2: Booted secondary processor 0x0000030000 [0x410fd830]
[    0.939723] [TS:8831366146] Detected PIPT I-cache on CPU3
[    0.939745] [TS:8831388109] GICv3: CPU3: found redistributor 40000 region 0:0x0000008146140000
[    0.939785] [TS:8831427544] GICv3: CPU3: using allocated LPI pending table @0x0000000100160000
[    0.970117] [TS:8861759507] Detected PIPT I-cache on CPU4sor 0x0000040000 [0x410fd830]
[    0.970176] [TS:8861819414] GICv3: CPU4: using allocated LPI pending table @0x0000000100170000
[    0.970261] [TS:8861903470] CPU4: Booted secondary processor 0x0000050000 [0x410fd830]
[    1.000841] [TS:8892483813] Detected PIPT I-cache on CPU5
[    1.000862] [TS:8892505183] GICv3: CPU5: found redistributor 60000 region 0:0x00000081461c0000
[    1.000902] [TS:8892544757] GICv3: CPU5: using allocated LPI pending table @0x0000000100180000
[    1.031230] [TS:8922873044] Detected PIPT I-cache on CPU6sor 0x0000060000 [0x410fd830]
[    1.031293] [TS:8922936026] GICv3: CPU6: using allocated LPI pending table @0x0000000100190000
[    1.031379] [TS:8923022405] CPU6: Booted secondary processor 0x0000070000 [0x410fd830]
[    1.061963] [TS:8953606053] Detected PIPT I-cache on CPU7
[    1.061988] [TS:8953630887] GICv3: CPU7: found redistributor 80000 region 0:0x0000008146240000
[    1.062028] [TS:8953671118] GICv3: CPU7: using allocated LPI pending table @0x00000001001a0000
[    1.092347] [TS:8983989738] Detected PIPT I-cache on CPU8sor 0x0000080000 [0x410fd830]
[    1.092416] [TS:8984058479] GICv3: CPU8: using allocated LPI pending table @0x00000001001b0000
[    1.092496] [TS:8984138933] CPU8: Booted secondary processor 0x0000090000 [0x410fd830]
[    1.123078] [TS:9014721016] Detected PIPT I-cache on CPU9
[    1.123106] [TS:9014749405] GICv3: CPU9: found redistributor a0000 region 0:0x00000081462c0000
[    1.123148] [TS:9014790646] GICv3: CPU9: using allocated LPI pending table @0x00000001001c0000
[    1.153465] [TS:9045108063] Detected PIPT I-cache on CPU10or 0x00000a0000 [0x410fd830]
[    1.153495] [TS:9045137729] GICv3: CPU10: found redistributor b0000 region 0:0x0000008146300000
[    1.153535] [TS:9045177794] GICv3: CPU10: using allocated LPI pending table @0x00000001001d0000
[    1.153618] [TS:9045261424] CPU10: Booted secondary processor 0x00000b0000 [0x410fd830]
[    1.184549] [TS:9076191803] Detected PIPT I-cache on CPU11
[    1.184580] [TS:9076223007] GICv3: CPU11: found redistributor c0000 region 0:0x0000008146340000
[    1.184618] [TS:9076261350] GICv3: CPU11: using allocated LPI pending table @0x00000001001e0000
[    1.184701] [TS:9076343822] CPU11: Booted secondary processor 0x00000c0000 [0x410fd830]
[    1.215658] [TS:9107301016] GICv3: CPU12: found redistributor d0000 region 0:0x0000008146380000
[    1.215699] [TS:9107341525] GICv3: CPU12: using allocated LPI pending table @0x00000001001f0000
[    1.215782] [TS:9107424451] CPU12: Booted secondary processor 0x00000d0000 [0x410fd830]
[    1.246360] [TS:9138002516] Detected PIPT I-cache on CPU13
[    1.246395] [TS:9138037535] GICv3: CPU13: found redistributor 0 region 0:0x00000081463c0000
[    1.246433] [TS:9138075674] GICv3: CPU13: using allocated LPI pending table @0x0000000100200000
[    1.246512] [TS:9138154618] CPU13: Booted secondary processor 0x0000000000 [0x410fd830]
[    1.276973] [TS:9168616035] smp: Brought up 1 node, 14 CPUs
[    1.276975] [TS:9168617868] SMP: Total of 14 processors activated.
[    1.276976] [TS:9168619405] CPU features: detected: Branch Target Identification
[    1.276978] [TS:9168620711] CPU features: detected: ARMv8.4 Translation Table Level
[    1.276979] [TS:9168622146] CPU features: detected: Data cache clean to the PoU not required for I/D coherencence
[    1.276980] [TS:9168622701] CPU features: detected: Common not Private translations
[    1.276980] [TS:9168623220] CPU features: detected: CRC32 instructions
[    1.276981] [TS:9168623590] CPU features: detected: Data cache clean to Point of Deep Persistence
[    1.276982] [TS:9168625100] CPU features: detected: Enhanced Counter Virtualizationrsistence
[    1.276984] [TS:9168626525] CPU features: detected: Generic authentication (architected QARMA3 algorithm)
[    1.276985] [TS:9168627451] CPU features: detected: RCpc load-acquire (LDAPR)
[    1.276985] [TS:9168627933] CPU features: detected: LSE atomic instructions
[    1.276985] [TS:9168628313] CPU features: detected: Privileged Access Never
[    1.276987] [TS:9168629683] CPU features: detected: TLB range maintenance instructions
[    1.276987] [TS:9168630238] CPU features: detected: Speculative Store Bypassing Safe (SSBS)
[    1.277028] [TS:9168671433] CPU features: detected CPU4: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671581] CPU features: detected CPU9: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671711] CPU features: detected CPU2: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671831] CPU features: detected CPU0: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671627] CPU features: detected CPU11: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671738] CPU features: detected CPU3: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671729] CPU features: detected CPU1: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671942] CPU features: detected CPU5: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671822] CPU features: detected CPU6: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671590] CPU features: detected CPU10: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671720] CPU features: detected CPU13: Activity Monitors Unit (AMU)
[    1.277029] [TS:9168671664] CPU features: detected CPU8: Activity Monitors Unit (AMU))
[    1.554619] [TS:9446262146] SVE: maximum available vector length 16 bytes per vector
[    1.554620] [TS:9446263322] SVE: default vector length 16 bytes per vector
[    1.554625] [TS:9446267572] alternatives: applying system-wide alternatives
[    1.557095] [TS:9448738359] devtmpfs: initialized
[    1.568308] [TS:9459950442] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    1.568311] [TS:9459954090] futex hash table entries: 4096 (order: 6, 262144 bytes, linear)
[    1.569554] [TS:9461196812] pinctrl core: initialized pinctrl subsystem
[    1.570144] [TS:9461787164] DMI not present or invalid.
[    1.570334] [TS:9461976618] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    1.573300] [TS:9464942748] DMA: preallocated 8192 KiB GFP_KERNEL pool for atomic allocations
[    1.573462] [TS:9465104757] DMA: preallocated 8192 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    1.573618] [TS:9465260970] DMA: preallocated 8192 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    1.573632] [TS:9465275081] audit: initializing netlink subsys (disabled)
[    1.573994] [TS:9465636683] thermal_sys: Registered thermal governor 'user_space'dit_enabled=0 res=1
[    1.573994] [TS:9465637164] thermal_sys: Registered thermal governor 'power_allocator'
[    1.574117] [TS:9465759979] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    1.577405] [TS:9469047794] Serial: AMBA PL011 UART driverh 65536 entries
[    1.584924] [TS:9476566442] tegra_hv: adding ivc256: rx_base=ffff80000d690000 tx_base = ffff80000d6a8080 size=18080 irq = 45 (736)
[    1.584931] [TS:9476573868] tegra_hv: adding ivc257: rx_base=ffff80000d6a8080 tx_base = ffff80000d690000 size=18080 irq = 46 (737)
[    1.584932] [TS:9476574887] tegra_hv: added ivc257
[    1.584937] [TS:9476579803] tegra_hv: adding ivc266: rx_base=ffff80000d680000 tx_base = ffff80000d680480 size=480 irq = 47 (73[    1.584938] [TS:9476580905] tegra_hv: added ivc266
[    1.584943] [TS:9476585488] tegra_hv: adding ivc267: rx_base=ffff80000d680480 tx_base = ffff80000d680000 size=480 irq = 48 (739)
[    1.584944] [TS:9476586609] tegra_hv: added ivc267
[    1.584950] [TS:9476592516] tegra_hv: adding ivc200: rx_base=ffff80000d630000 tx_base = ffff80000d630100 size=100 irq = 49 (740)
[    1.584950] [TS:9476593359] tegra_hv: added ivc200
[    1.584955] [TS:9476598312] tegra_hv: adding ivc0: rx_base=ffff80000d830000 tx_base = ffff80000d830100 size=100 irq = 50 (741)
[    1.584956] [TS:9476599405] tegra_hv: added ivc0
[    1.584961] [TS:9476603896] tegra_hv: adding ivc1: rx_base=ffff80000d820000 tx_base = ffff80000d820100 size=100 irq = 51 (742)
[    1.584962] [TS:9476604757] tegra_hv: added ivc1
[    1.584967] [TS:9476610220] tegra_hv: adding ivc2: rx_base=ffff80000d810000 tx_base = ffff80000d810100 size=100 irq = 52 (743)
[    1.584968] [TS:9476611016] tegra_hv: added ivc2
[    1.584973] [TS:9476616312] tegra_hv: adding ivc3: rx_base=ffff80000d800000 tx_base = ffff80000d800100 size=100 irq = 53 (744)
[    1.584974] [TS:9476617081] tegra_hv: added ivc3
[    1.584979] [TS:9476621562] tegra_hv: adding ivc66: rx_base=ffff80000d650000 tx_base = ffff80000d652080 size=2080 irq = 54 (745)
[    1.584980] [TS:9476622600] tegra_hv: added ivc66
[    1.584984] [TS:9476627248] tegra_hv: adding ivc59: rx_base=ffff80000d9d0000 tx_base = ffff80000d9d2080 size=2080 irq = 55 (746)
[    1.584990] [TS:9476632924] tegra_hv: adding ivc60: rx_base=ffff80000d9c0000 tx_base = ffff80000d9c2080 size=2080 irq = 56 (74[    1.584991] [TS:9476633748] tegra_hv: added ivc60
[    1.584998] [TS:9476640433] tegra_hv: adding ivc61: rx_base=ffff80000d9b0000 tx_base = ffff80000d9b2080 size=2080 irq = 57 (748)
[    1.585003] [TS:9476646109] tegra_hv: adding ivc62: rx_base=ffff80000d9a0000 tx_base = ffff80000d9a2080 size=2080 irq = 58 (74[    1.585004] [TS:9476646924] tegra_hv: added ivc62
[    1.585008] [TS:9476651090] tegra_hv: adding ivc65: rx_base=ffff80000d990000 tx_base = ffff80000d992080 size=2080 irq = 59 (750)
[    1.585013] [TS:9476656275] tegra_hv: adding ivc67: rx_base=ffff80000d980000 tx_base = ffff80000d982080 size=2080 irq = 60 (75[    1.585014] [TS:9476657229] tegra_hv: added ivc67
[    1.585020] [TS:9476662451] tegra_hv: adding ivc68: rx_base=ffff80000d970000 tx_base = ffff80000d972080 size=2080 irq = 61 (752)
[    1.585025] [TS:9476667729] tegra_hv: adding ivc69: rx_base=ffff80000d960000 tx_base = ffff80000d962080 size=2080 irq = 62 (75[    1.585026] [TS:9476668572] tegra_hv: added ivc69
[    1.585030] [TS:9476673099] tegra_hv: adding ivc70: rx_base=ffff80000d950000 tx_base = ffff80000d952080 size=2080 irq = 63 (754)
[    1.585036] [TS:9476678590] tegra_hv: adding ivc71: rx_base=ffff80000d940000 tx_base = ffff80000d942080 size=2080 irq = 64 (75[    1.585037] [TS:9476679664] tegra_hv: added ivc71
[    1.585042] [TS:9476684868] tegra_hv: adding ivc72: rx_base=ffff80000d930000 tx_base = ffff80000d932080 size=2080 irq = 65 (756)
[    1.585047] [TS:9476690312] tegra_hv: adding ivc73: rx_base=ffff80000d920000 tx_base = ffff80000d922080 size=2080 irq = 66 (75[    1.585048] [TS:9476691137] tegra_hv: added ivc73
[    1.585053] [TS:9476696118] tegra_hv: adding ivc74: rx_base=ffff80000d910000 tx_base = ffff80000d912080 size=2080 irq = 67 (758)
[    1.585059] [TS:9476701646] tegra_hv: adding ivc75: rx_base=ffff80000d900000 tx_base = ffff80000d902080 size=2080 irq = 68 (75[    1.585060] [TS:9476702461] tegra_hv: added ivc75
[    1.585067] [TS:9476709785] tegra_hv: adding ivc300: rx_base=ffff800010c40000 tx_base = ffff800010c40880 size=880 irq = 69 (760)
[    1.585068] [TS:9476710692] tegra_hv: added ivc300
[    1.585072] [TS:9476715387] tegra_hv: adding ivc301: rx_base=ffff800010c30000 tx_base = ffff800010c30880 size=880 irq = 70 (761)
[    1.585073] [TS:9476716266] tegra_hv: added ivc301
[    1.585078] [TS:9476720451] tegra_hv: adding ivc302: rx_base=ffff800010c20000 tx_base = ffff800010c20880 size=880 irq = 71 (762)
[    1.585078] [TS:9476721303] tegra_hv: added ivc302
[    1.585083] [TS:9476725840] tegra_hv: adding ivc303: rx_base=ffff800010c10000 tx_base = ffff800010c10880 size=880 irq = 72 (763)
[    1.585084] [TS:9476727025] tegra_hv: added ivc303
[    1.585090] [TS:9476732905] tegra_hv: adding ivc304: rx_base=ffff800010c00000 tx_base = ffff800010c00880 size=880 irq = 73 (764)
[    1.585091] [TS:9476733924] tegra_hv: added ivc304
[    1.585095] [TS:9476738396] tegra_hv: adding ivc305: rx_base=ffff800010bf0000 tx_base = ffff800010bf0880 size=880 irq = 74 (765)
[    1.585097] [TS:9476739433] tegra_hv: added ivc305
[    1.585101] [TS:9476744044] tegra_hv: adding ivc306: rx_base=ffff800010be0000 tx_base = ffff800010be0880 size=880 irq = 75 (766)
[    1.585102] [TS:9476745220] tegra_hv: added ivc306
[    1.585108] [TS:9476750451] tegra_hv: adding ivc307: rx_base=ffff800010bd0000 tx_base = ffff800010bd0880 size=880 irq = 76 (775)
[    1.585109] [TS:9476751488] tegra_hv: added ivc307
[    1.585113] [TS:9476756322] tegra_hv: adding ivc308: rx_base=ffff800010bc0000 tx_base = ffff800010bc0880 size=880 irq = 77 (776)
[    1.585114] [TS:9476757303] tegra_hv: added ivc308
[    1.585119] [TS:9476761664] tegra_hv: adding ivc309: rx_base=ffff800010bb0000 tx_base = ffff800010bb0880 size=880 irq = 78 (777)
[    1.585120] [TS:9476762470] tegra_hv: added ivc309
[    1.585124] [TS:9476767377] tegra_hv: adding ivc310: rx_base=ffff800010ba0000 tx_base = ffff800010ba0880 size=880 irq = 79 (778)
[    1.585125] [TS:9476768433] tegra_hv: added ivc310
[    1.585130] [TS:9476772896] tegra_hv: adding ivc311: rx_base=ffff800010b90000 tx_base = ffff800010b90880 size=880 irq = 80 (779)
[    1.585131] [TS:9476773877] tegra_hv: added ivc311
[    1.585136] [TS:9476778636] tegra_hv: adding ivc312: rx_base=ffff800010b80000 tx_base = ffff800010b80880 size=880 irq = 81 (780)
[    1.585136] [TS:9476779424] tegra_hv: added ivc312
[    1.585141] [TS:9476784285] tegra_hv: adding ivc313: rx_base=ffff800010b70000 tx_base = ffff800010b70880 size=880 irq = 82 (781)
[    1.585142] [TS:9476785109] tegra_hv: added ivc313
[    1.585147] [TS:9476789433] tegra_hv: adding ivc314: rx_base=ffff800010b60000 tx_base = ffff800010b60880 size=880 irq = 83 (782)
[    1.585147] [TS:9476790238] tegra_hv: added ivc314
[    1.585153] [TS:9476795488] tegra_hv: adding ivc315: rx_base=ffff800010b50000 tx_base = ffff800010b50880 size=880 irq = 84 (783)
[    1.585154] [TS:9476796488] tegra_hv: added ivc315
[    1.585159] [TS:9476801488] tegra_hv: adding ivc316: rx_base=ffff800010b40000 tx_base = ffff800010b40880 size=880 irq = 85 (784)
[    1.585160] [TS:9476802461] tegra_hv: added ivc316
[    1.585164] [TS:9476806961] tegra_hv: adding ivc317: rx_base=ffff800010b30000 tx_base = ffff800010b30880 size=880 irq = 86 (785)
[    1.585165] [TS:9476807748] tegra_hv: added ivc317
[    1.585169] [TS:9476812248] tegra_hv: adding ivc318: rx_base=ffff800010b20000 tx_base = ffff800010b20880 size=880 irq = 87 (786)
[    1.585170] [TS:9476813025] tegra_hv: added ivc318
[    1.585175] [TS:9476817609] tegra_hv: adding ivc319: rx_base=ffff800010b10000 tx_base = ffff800010b10880 size=880 irq = 88 (787)
[    1.585175] [TS:9476818414] tegra_hv: added ivc319
[    1.585181] [TS:9476824211] tegra_hv: adding ivc320: rx_base=ffff800010b00000 tx_base = ffff800010b00880 size=880 irq = 89 (788)
[    1.585182] [TS:9476824998] tegra_hv: added ivc320
[    1.585186] [TS:9476829433] tegra_hv: adding ivc321: rx_base=ffff800010af0000 tx_base = ffff800010af0880 size=880 irq = 90 (789)
[    1.585187] [TS:9476830257] tegra_hv: added ivc321
[    1.585192] [TS:9476834525] tegra_hv: adding ivc322: rx_base=ffff800010ae0000 tx_base = ffff800010ae0880 size=880 irq = 91 (790)
[    1.585193] [TS:9476835498] tegra_hv: added ivc322
[    1.585197] [TS:9476839868] tegra_hv: adding ivc323: rx_base=ffff800010ad0000 tx_base = ffff800010ad0880 size=880 irq = 92 (791)
[    1.585198] [TS:9476840720] tegra_hv: added ivc323
[    1.585203] [TS:9476845933] tegra_hv: adding ivc324: rx_base=ffff800010ac0000 tx_base = ffff800010ac0880 size=880 irq = 93 (792)
[    1.585204] [TS:9476846905] tegra_hv: added ivc324
[    1.585208] [TS:9476851238] tegra_hv: adding ivc325: rx_base=ffff800010ab0000 tx_base = ffff800010ab0880 size=880 irq = 94 (793)
[    1.585209] [TS:9476852146] tegra_hv: added ivc325
[    1.585214] [TS:9476856451] tegra_hv: adding ivc326: rx_base=ffff800010aa0000 tx_base = ffff800010aa0880 size=880 irq = 95 (794)
[    1.585214] [TS:9476857229] tegra_hv: added ivc326
[    1.585219] [TS:9476861766] tegra_hv: adding ivc327: rx_base=ffff800010a90000 tx_base = ffff800010a90880 size=880 irq = 96 (795)
[    1.585220] [TS:9476862553] tegra_hv: added ivc327
[    1.585224] [TS:9476867396] tegra_hv: adding ivc328: rx_base=ffff800010a80000 tx_base = ffff800010a80880 size=880 irq = 97 (796)
[    1.585225] [TS:9476868192] tegra_hv: added ivc328
[    1.585230] [TS:9476872775] tegra_hv: adding ivc329: rx_base=ffff800010a70000 tx_base = ffff800010a70880 size=880 irq = 98 (797)
[    1.585231] [TS:9476873572] tegra_hv: added ivc329
[    1.585235] [TS:9476878155] tegra_hv: adding ivc330: rx_base=ffff800010a60000 tx_base = ffff800010a60880 size=880 irq = 99 (798)
[    1.585236] [TS:9476878951] tegra_hv: added ivc330
[    1.585241] [TS:9476883516] tegra_hv: adding ivc331: rx_base=ffff800010a50000 tx_base = ffff800010a50880 size=880 irq = 100 (799)
[    1.585241] [TS:9476884359] tegra_hv: added ivc331
[    1.585246] [TS:9476889331] tegra_hv: adding ivc332: rx_base=ffff800010a40000 tx_base = ffff800010a40880 size=880 irq = 101 (8[    1.585247] [TS:9476890137] tegra_hv: added ivc332
[    1.585252] [TS:9476894544] tegra_hv: adding ivc334: rx_base=ffff800010a30000 tx_base = ffff800010a30880 size=880 irq = 102 (8[    1.585252] [TS:9476895377] tegra_hv: added ivc334
[    1.585256] [TS:9476899312] tegra_hv: adding ivc335: rx_base=ffff800010a20000 tx_base = ffff800010a20880 size=880 irq = 103 (8[    1.585257] [TS:9476900127] tegra_hv: added ivc335
[    1.585262] [TS:9476904609] tegra_hv: adding ivc336: rx_base=ffff800010a10000 tx_base = ffff800010a10880 size=880 irq = 104 (8[    1.585263] [TS:9476905553] tegra_hv: added ivc336
[    1.585269] [TS:9476911775] tegra_hv: adding ivc337: rx_base=ffff800010a00000 tx_base = ffff800010a00880 size=880 irq = 105 (8[    1.585270] [TS:9476912692] tegra_hv: added ivc337
[    1.585274] [TS:9476917109] tegra_hv: adding ivc338: rx_base=ffff8000109f0000 tx_base = ffff8000109f0880 size=880 irq = 106 (8[    1.585275] [TS:9476917775] tegra_hv: added ivc338
[    1.585279] [TS:9476922285] tegra_hv: adding ivc339: rx_base=ffff8000109e0000 tx_base = ffff8000109e0880 size=880 irq = 107 (8[    1.585280] [TS:9476922887] tegra_hv: added ivc339
[    1.585284] [TS:9476927192] tegra_hv: adding ivc340: rx_base=ffff8000109d0000 tx_base = ffff8000109d0880 size=880 irq = 108 (8[    1.585285] [TS:9476927803] tegra_hv: added ivc340
[    1.585290] [TS:9476932942] tegra_hv: adding ivc341: rx_base=ffff8000109c0000 tx_base = ffff8000109c0880 size=880 irq = 109 (8[    1.585291] [TS:9476933544] tegra_hv: added ivc341
[    1.585295] [TS:9476937748] tegra_hv: adding ivc342: rx_base=ffff8000109b0000 tx_base = ffff8000109b0880 size=880 irq = 110 (8[    1.585295] [TS:9476938368] tegra_hv: added ivc342
[    1.585300] [TS:9476942785] tegra_hv: adding ivc343: rx_base=ffff8000109a0000 tx_base = ffff8000109a0880 size=880 irq = 111 (8[    1.585300] [TS:9476943396] tegra_hv: added ivc343
[    1.585305] [TS:9476947683] tegra_hv: adding ivc344: rx_base=ffff800010990000 tx_base = ffff800010990880 size=880 irq = 112 (8[    1.585305] [TS:9476948285] tegra_hv: added ivc344
[    1.585310] [TS:9476952933] tegra_hv: adding ivc345: rx_base=ffff800010980000 tx_base = ffff800010980880 size=880 irq = 113 (8[    1.585311] [TS:9476953535] tegra_hv: added ivc345
[    1.585315] [TS:9476957970] tegra_hv: adding ivc346: rx_base=ffff800010970000 tx_base = ffff800010970880 size=880 irq = 114 (8[    1.585316] [TS:9476958581] tegra_hv: added ivc346
[    1.585320] [TS:9476962748] tegra_hv: adding ivc347: rx_base=ffff800010960000 tx_base = ffff800010960880 size=880 irq = 115 (8[    1.585320] [TS:9476963349] tegra_hv: added ivc347
[    1.585325] [TS:9476968257] tegra_hv: adding ivc348: rx_base=ffff800010950000 tx_base = ffff800010950880 size=880 irq = 116 (8[    1.585326] [TS:9476968868] tegra_hv: added ivc348
[    1.585331] [TS:9476973794] tegra_hv: adding ivc349: rx_base=ffff800010940000 tx_base = ffff800010940880 size=880 irq = 117 (8[    1.585332] [TS:9476974535] tegra_hv: added ivc349
[    1.585336] [TS:9476979007] tegra_hv: adding ivc350: rx_base=ffff800010930000 tx_base = ffff800010930880 size=880 irq = 118 (8[    1.585337] [TS:9476979627] tegra_hv: added ivc350
[    1.585341] [TS:9476984062] tegra_hv: adding ivc351: rx_base=ffff800010920000 tx_base = ffff800010920880 size=880 irq = 119 (822)
[    1.585342] [TS:9476984664] tegra_hv: added ivc351
[    1.585346] [TS:9476988757] tegra_hv: adding ivc352: rx_base=ffff800010910000 tx_base = ffff800010910880 size=880 irq = 120 (823)
[    1.585346] [TS:9476989368] tegra_hv: added ivc352
[    1.585352] [TS:9476994748] tegra_hv: adding ivc353: rx_base=ffff800010900000 tx_base = ffff800010900880 size=880 irq = 121 (8[    1.585352] [TS:9476995349] tegra_hv: added ivc353
[    1.585357] [TS:9476999590] tegra_hv: adding ivc354: rx_base=ffff8000108f0000 tx_base = ffff8000108f0880 size=880 irq = 122 (8[    1.585357] [TS:9477000211] tegra_hv: added ivc354
[    1.585362] [TS:9477004711] tegra_hv: adding ivc355: rx_base=ffff8000108e0000 tx_base = ffff8000108e0880 size=880 irq = 123 (8[    1.585362] [TS:9477005312] tegra_hv: added ivc355
[    1.585367] [TS:9477010007] tegra_hv: adding ivc356: rx_base=ffff8000108d0000 tx_base = ffff8000108d0880 size=880 irq = 124 (8[    1.585368] [TS:9477010794] tegra_hv: added ivc356
[    1.585373] [TS:9477015757] tegra_hv: adding ivc357: rx_base=ffff8000108c0000 tx_base = ffff8000108c0880 size=880 irq = 125 (8[    1.585374] [TS:9477016507] tegra_hv: added ivc357
[    1.585378] [TS:9477021303] tegra_hv: adding ivc358: rx_base=ffff8000108b0000 tx_base = ffff8000108b0880 size=880 irq = 126 (8[    1.585379] [TS:9477021914] tegra_hv: added ivc358
[    1.585383] [TS:9477026405] tegra_hv: adding ivc359: rx_base=ffff8000108a0000 tx_base = ffff8000108a0880 size=880 irq = 127 (8[    1.585384] [TS:9477027183] tegra_hv: added ivc359
[    1.585389] [TS:9477031674] tegra_hv: adding ivc360: rx_base=ffff800010890000 tx_base = ffff800010890880 size=880 irq = 128 (8[    1.585390] [TS:9477032451] tegra_hv: added ivc360
[    1.585395] [TS:9477037711] tegra_hv: adding ivc361: rx_base=ffff800010880000 tx_base = ffff800010880880 size=880 irq = 129 (8[    1.585396] [TS:9477038470] tegra_hv: added ivc361
[    1.585404] [TS:9477047072] tegra_hv: adding ivc362: rx_base=ffff800010870000 tx_base = ffff800010870880 size=880 irq = 130 (8[    1.585405] [TS:9477047729] tegra_hv: added ivc362
[    1.585409] [TS:9477052211] tegra_hv: adding ivc363: rx_base=ffff800010860000 tx_base = ffff800010860880 size=880 irq = 131 (8[    1.585410] [TS:9477052979] tegra_hv: added ivc363
[    1.585415] [TS:9477057609] tegra_hv: adding ivc364: rx_base=ffff800010850000 tx_base = ffff800010850880 size=880 irq = 132 (8[    1.585415] [TS:9477058229] tegra_hv: added ivc364
[    1.585420] [TS:9477062979] tegra_hv: adding ivc365: rx_base=ffff800010840000 tx_base = ffff800010840880 size=880 irq = 133 (8[    1.585421] [TS:9477063590] tegra_hv: added ivc365
[    1.585426] [TS:9477068479] tegra_hv: adding ivc366: rx_base=ffff800010830000 tx_base = ffff800010830880 size=880 irq = 134 (8[    1.585426] [TS:9477069099] tegra_hv: added ivc366
[    1.585430] [TS:9477073414] tegra_hv: adding ivc367: rx_base=ffff800010820000 tx_base = ffff800010820880 size=880 irq = 135 (8[    1.585431] [TS:9477074025] tegra_hv: added ivc367
[    1.585436] [TS:9477078803] tegra_hv: adding ivc368: rx_base=ffff800010810000 tx_base = ffff800010810880 size=880 irq = 136 (8[    1.585436] [TS:9477079405] tegra_hv: added ivc368
[    1.585442] [TS:9477085312] tegra_hv: adding ivc369: rx_base=ffff800010800000 tx_base = ffff800010800880 size=880 irq = 137 (8[    1.585443] [TS:9477086109] tegra_hv: added ivc369
[    1.585448] [TS:9477090461] tegra_hv: adding ivc162: rx_base=ffff80000d6e0000 tx_base = ffff80000d6e0880 size=880 irq = 138 (8[    1.585449] [TS:9477091525] tegra_hv: added ivc162
[    1.585453] [TS:9477095859] tegra_hv: adding ivc42: rx_base=ffff80000d7d0000 tx_base = ffff80000d7d0180 size=180 irq = 139 (842)
[    1.585454] [TS:9477096729] tegra_hv: added ivc42
[    1.585458] [TS:9477101174] tegra_hv: adding ivc426: rx_base=ffff80000da40000 tx_base = ffff80000da41080 size=1080 irq = 140 ([    1.585459] [TS:9477102025] tegra_hv: added ivc426
[    1.585464] [TS:9477107099] tegra_hv: adding ivc428: rx_base=ffff80000da30000 tx_base = ffff80000da31080 size=1080 irq = 141 (844)
[    1.585469] [TS:9477112322] tegra_hv: adding ivc429: rx_base=ffff80000da20000 tx_base = ffff80000da21080 size=1080 irq = 142 (845)
[    1.585470] [TS:9477113137] tegra_hv: added ivc429
[    1.585475] [TS:9477117498] tegra_hv: adding ivc430: rx_base=ffff80000da10000 tx_base = ffff80000da11080 size=1080 irq = 143 ([    1.585475] [TS:9477118312] tegra_hv: added ivc430
[    1.585480] [TS:9477122803] tegra_hv: adding ivc431: rx_base=ffff80000da00000 tx_base = ffff80000da01080 size=1080 irq = 144 (847)
[    1.585485] [TS:9477128090] tegra_hv: adding ivc407: rx_base=ffff80000d870000 tx_base = ffff80000d870100 size=100 irq = 145 (848)
[    1.585491] [TS:9477133488] tegra_hv: adding ivc10: rx_base=ffff80000d860000 tx_base = ffff80000d860100 size=100 irq = 146 (849)
[    1.585491] [TS:9477134322] tegra_hv: added ivc10
[    1.585492] [TS:9477134905] tegra_hv: added mempool 3: ipa=1ffbdc00000 size=40000000 peer=0
[    1.585493] [TS:9477135701] tegra_hv: added mempool 100: ipa=1ffbcc00000 size=1000000 peer=3
[    1.585494] [TS:9477136507] tegra_hv: added mempool 97: ipa=1ffbc800000 size=400000 peer=4
[    1.585495] [TS:9477138109] tegra_hv: added mempool 73: ipa=1ffbac00000 size=800000 peer=117
[    1.585496] [TS:9477138637] tegra_hv: added mempool 30: ipa=1ffba400000 size=800000 peer=5
[    1.585496] [TS:9477139109] tegra_hv: added mempool 31: ipa=1ffb9c00000 size=800000 peer=5
[    1.585497] [TS:9477140294] tegra_hv: Memory usage: ivc:0x79f80 mempool=0x448000000 peer=4
[    1.587530] [TS:9479172822] KASLR disabled on command lineed successfully
[    1.600794] [TS:9492436803] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page pages
[    1.600795] [TS:9492438053] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages
[    1.600796] [TS:9492438516] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page
[    1.600796] [TS:9492439192] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    1.600797] [TS:9492439544] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page
[    1.600797] [TS:9492440035] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages
[    1.600798] [TS:9492440553] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page
[    1.622412] [TS:9514054674] ACPI: Interpreter disabled.
[    1.622979] [TS:9514621627] iommu: Default domain type: Translated 
[    1.622980] [TS:9514623211] iommu: DMA domain TLB invalidation policy: strict mode 
[    1.623128] [TS:9514770720] usbcore: registered new interface driver usbfs
[    1.623135] [TS:9514778192] usbcore: registered new interface driver hub
[    1.623140] [TS:9514783349] usbcore: registered new device driver usb
[    1.623372] [TS:9515015192] pps_core: LinuxPPS API ver. 1 registered
[    1.623373] [TS:9515016164] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.623401] [TS:9515044220] EDAC MC: Ver: 3.0.0egistered
[    1.623791] [TS:9515433581] FPGA manager frameworkreturned not supported
[    1.623998] [TS:9515640461] vgaarb: loaded Sound Architecture Driver Initialized.
[    1.624257] [TS:9515899794] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.624390] [TS:9516033211] pnp: PnP ACPI: disabledsystem Enabled
[    1.626341] [TS:9517983775] NET: Registered PF_INET protocol family
[    1.626388] [TS:9518031331] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    1.628466] [TS:9520108507] tcp_listen_portaddr_hash hash table entries: 32768 (order: 8, 1310720 bytes, linear)
[    1.628677] [TS:9520319572] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    1.630033] [TS:9521675831] TCP bind hash table entries: 65536 (order: 10, 5242880 bytes, linear)
[    1.630713] [TS:9522355553] TCP: Hash tables configured (established 524288 bind 65536)
[    1.630759] [TS:9522401951] UDP hash table entries: 32768 (order: 9, 3145728 bytes, linear)
[    1.632018] [TS:9523660674] RPC: Registered named UNIX socket transport module.28 bytes, linear)
[    1.632018] [TS:9523661368] RPC: Registered udp transport module.
[    1.632019] [TS:9523661775] RPC: Registered tcp transport module.
[    1.632019] [TS:9523662405] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.632021] [TS:9523664312] PCI: CLS 0 bytes, default 64
[    1.644317] [TS:9535959470] Unpacking initramfs...
[    1.649087] [TS:9540729887] Freeing initrd memory: 10296K
[    1.672705] [TS:9564347757] Initialise system trusted keyringspmuv3 PMU driver, 7 counters available
[    1.674402] [TS:9566044951] squashfs: version 4.0 (2009/01/31) Phillip Lougherorder=0
[    1.674573] [TS:9566215831] Key type id_resolver registeredr key type
[    1.674574] [TS:9566216599] Key type id_legacy registered
[    1.674590] [TS:9566233025] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    1.674592] [TS:9566235340] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    1.674613] [TS:9566255618] ntfs: driver 2.1.32 [Flags: R/O].
[    1.684748] [TS:9576390886] NET: Registered PF_ALG protocol family support
[    1.684751] [TS:9576393553] Key type asymmetric registered
[    1.684752] [TS:9576394562] Asymmetric key parser 'x509' registered
[    1.684765] [TS:9576407924] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    1.684767] [TS:9576409757] io scheduler mq-deadline registered
[    1.695469] [TS:9587111766] pci-host-generic b0b0000000.pcie:      MEM 0x0030000000..0x0037ffffff -> 0x0030000000
[    1.695472] [TS:9587115174] pci-host-generic b0b0000000.pcie:      MEM 0xb0c0000000..0xb87fffffff -> 0xb0c0000000
[    1.695474] [TS:9587116849] pci-host-generic b0b0000000.pcie:       IO 0xb084000000..0xb0841fffff -> 0x0084000000
[    1.695488] [TS:9587131303] pci-host-generic b0b0000000.pcie: ECAM at [mem 0xb0b0000000-0xb0bfffffff] for [bus 00-ff]
[    1.695516] [TS:9587158877] pci_bus 0002:00: root bus resource [bus 00-ff]dge to bus 0002:00
[    1.695517] [TS:9587160238] pci_bus 0002:00: root bus resource [mem 0x30000000-0x37ffffff]
[    1.695518] [TS:9587161072] pci_bus 0002:00: root bus resource [mem 0xb0c0000000-0xb87fffffff pref]
[    1.695707] [TS:9587350035] pci 0002:00:00.0: PME# supported from D0 D3hot060400fff] (bus address [0x84000000-0x841fffff])
[    1.696703] [TS:9588345590] pci 0002:00:00.0: PCI bridge to [bus 01-ff]
[    1.696715] [TS:9588357868] pci_bus 0002:00: resource 4 [mem 0x30000000-0x37ffffff]
[    1.696716] [TS:9588359377] pci_bus 0002:00: resource 5 [mem 0xb0c0000000-0xb87fffffff pref]
[    1.696717] [TS:9588360201] pci_bus 0002:00: resource 6 [io  0x0000-0x1fffff]
[    1.696727] [TS:9588370164] pci 0002:00:00.0: Max Payload Size set to  512/ 512 (was  128), Max Read Rq  512
[    1.696760] [TS:9588402970] pci-host-generic c8b0000000.pcie: host bridge /bus@0/pcie@c8b0000000 ranges:
[    1.696764] [TS:9588406924] pci-host-generic c8b0000000.pcie:      MEM 0x0048000000..0x004fffffff -> 0x0048000000
[    1.696767] [TS:9588409655] pci-host-generic c8b0000000.pcie:      MEM 0xc8c0000000..0xd07fffffff -> 0xc8c0000000
[    1.696768] [TS:9588411377] pci-host-generic c8b0000000.pcie:       IO 0xc884000000..0xc8841fffff -> 0x0084000000
[    1.696784] [TS:9588427211] pci-host-generic c8b0000000.pcie: ECAM at [mem 0xc8b0000000-0xc8bfffffff] for [bus 00-ff]
[    1.696804] [TS:9588446877] pci_bus 0005:00: root bus resource [bus 00-ff]dge to bus 0005:00
[    1.696805] [TS:9588447683] pci_bus 0005:00: root bus resource [mem 0x48000000-0x4fffffff]
[    1.696806] [TS:9588449303] pci_bus 0005:00: root bus resource [mem 0xc8c0000000-0xd07fffffff pref]
[    1.696807] [TS:9588450396] pci_bus 0005:00: root bus resource [io  0x200000-0x3fffff] (bus address [0x84000000-0x841fffff])
[   22.696150] [TS:30587792512] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[   22.696154] [TS:30587797188] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=5250 jiffies(starved)
[   22.696157] 	(detected by 4, t=5252 jiffies, g=-1135, q=4 ncpus=14)
[   22.696159] [TS:30587802225] Task dump for CPU 10:
[   22.696160] [TS:30587802966] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[   22.696164] [TS:30587806771] Call trace:
[   22.696165] [TS:30587807669]  __switch_to+0xe0/0x140
[   22.696174] [TS:30587817012] rcu: rcu_preempt kthread starved for 5240 jiffies! g-1135 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[   22.696176] [TS:30587818484] rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[   22.696177] [TS:30587819669] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[   22.696179] [TS:30587821494] Call trace:
[   22.696182] [TS:30587825382]  schedule_timeout+0x9c/0x1e0
[   22.696186] [TS:30587828799]  rcu_gp_fqs_loop+0x130/0x6f0
[   22.696193] [TS:30587836336]  kthread+0x11c/0x1304/0x2a0
[   22.696197] [TS:30587840299]  ret_from_fork+0x10/0x20
[   22.696200] [TS:30587842771] rcu: Stack dump where RCU GP kthread last ran:
[   22.696200] [TS:30587843290] Task dump for CPU 10:
[   22.696201] [TS:30587843901] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[   22.696202] [TS:30587844947] Call trace:
[   22.696202] [TS:30587845262]  __switch_to+0xe0/0x140
[   85.716149] [TS:93607792407] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[   85.716157] [TS:93607799620] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=21005 ji[   85.716163] [TS:93607805648] Task dump for CPU 10:135, q=4 ncpus=14)
[   85.716164] [TS:93607806648] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[   85.716167] [TS:93607810231] Call trace:
[   85.716168] [TS:93607811213]  __switch_to+0xe0/0x140
[   85.716178] [TS:93607820833] rcu: rcu_preempt kthread starved for 20995 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->[   85.716179] [TS:93607822389] rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[   85.716181] [TS:93607823787] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[   85.716183] [TS:93607825500] Call trace:
[   85.716186] [TS:93607829407]  schedule_timeout+0x9c/0x1e0
[   85.716192] [TS:93607835231]  rcu_gp_fqs_loop+0x130/0x6f0
[   85.716202] [TS:93607844833]  kthread+0x11c/0x1304/0x2a0
[   85.716207] [TS:93607849787]  ret_from_fork+0x10/0x20
[   85.716210] [TS:93607853241] rcu: Stack dump where RCU GP kthread last ran:
[   85.716211] [TS:93607854046] Task dump for CPU 10:
[   85.716212] [TS:93607854722] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[   85.716213] [TS:93607855870] Call trace:
[   85.716213] [TS:93607856148]  __switch_to+0xe0/0x140
[  148.736149] [TS:156627791608] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  148.736151] [TS:156627794173] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=36760 jiffies(starved)
[  148.736153] 	(detected by 4, t=36762 jiffies, g=-1135, q=4 ncpus=14)
[  148.736154] [TS:156627797423] Task dump for CPU 10:
[  148.736155] [TS:156627798293] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  148.736157] [TS:156627799867] Call trace:
[  148.736158] [TS:156627800534]  __switch_to+0xe0/0x140
[  148.736161] [TS:156627804136]  0xffff80000acbb970
[  148.736162] [TS:156627804988]  0xea60
[  148.736163] [TS:156627805895] rcu: rcu_preempt kthread starved for 36750 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  148.736165] [TS:156627807941] rcu: RCU grace-period kthread stack dump:fficient CPU time, OOM is now expected behavior.
[  148.736166] [TS:156627808562] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  148.736167] [TS:156627809738] Call trace:
[  148.736167] [TS:156627810145]  __switch_to+0xe0/0x140
[  148.736168] [TS:156627811015]  __schedule+0x310/0x840
[  148.736169] [TS:156627811812]  schedule+0x5c/0xe0
[  148.736170] [TS:156627812701]  schedule_timeout+0x9c/0x1e0
[  148.736172] [TS:156627814534]  rcu_gp_fqs_loop+0x130/0x6f0
[  148.736175] [TS:156627817812]  rcu_gp_kthread+0x254/0x2a0
[  148.736177] [TS:156627819645]  kthread+0x11c/0x130
[  148.736179] [TS:156627821488]  ret_from_fork+0x10/0x20
[  148.736181] [TS:156627823701] rcu: Stack dump where RCU GP kthread last ran:
[  148.736181] [TS:156627824108] Task dump for CPU 10:
[  148.736182] [TS:156627824478] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  148.736183] [TS:156627825728]  __switch_to+0xe0/0x140
[  148.736184] [TS:156627826515]  0xffff80000acbb970
[  148.736184] [TS:156627827025]  0xea60
[  211.756149] [TS:219647791577] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  211.756150] [TS:219647792827] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=52515 jiffies(starved)
[  211.756151] 	(detected by 4, t=52517 jiffies, g=-1135, q=4 ncpus=14)
[  211.756152] [TS:219647795179] Task dump for CPU 10:
[  211.756153] [TS:219647795855] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  211.756154] [TS:219647797198] Call trace:
[  211.756155] [TS:219647797624]  __switch_to+0xe0/0x140
[  211.756156] [TS:219647798818]  0xffff80000acbb970
[  211.756157] [TS:219647799790]  0xea60
[  211.756158] [TS:219647800651] rcu: rcu_preempt kthread starved for 52505 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  211.756159] [TS:219647802068] rcu: RCU grace-period kthread stack dump:fficient CPU time, OOM is now expected behavior.
[  211.756160] [TS:219647802577] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  211.756161] [TS:219647803670] Call trace:
[  211.756161] [TS:219647804087]  __switch_to+0xe0/0x140
[  211.756162] [TS:219647804874]  __schedule+0x310/0x840
[  211.756163] [TS:219647805846]  schedule+0x5c/0xe0
[  211.756164] [TS:219647806790]  schedule_timeout+0x9c/0x1e0
[  211.756166] [TS:219647808503]  rcu_gp_fqs_loop+0x130/0x6f0
[  211.756168] [TS:219647810624]  rcu_gp_kthread+0x254/0x2a0
[  211.756170] [TS:219647812577]  kthread+0x11c/0x130
[  211.756171] [TS:219647814401]  ret_from_fork+0x10/0x20
[  211.756173] [TS:219647816040] rcu: Stack dump where RCU GP kthread last ran:
[  211.756174] [TS:219647816475] Task dump for CPU 10:
[  211.756174] [TS:219647816799] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  211.756176] [TS:219647818512]  __switch_to+0xe0/0x140
[  211.756177] [TS:219647819438]  0xffff80000acbb970
[  211.756177] [TS:219647820059]  0xea60
[  274.776149] [TS:282667791556] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  274.776150] [TS:282667792760] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=68270 ji[  274.776152] [TS:282667795000] Task dump for CPU 10:35, q=4 ncpus=14)
[  274.776153] [TS:282667795824] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  274.776155] [TS:282667797435] Call trace:
[  274.776155] [TS:282667797926]  __switch_to+0xe0/0x140
[  274.776156] [TS:282667798972]  0xffff80000acbb970
[  274.776157] [TS:282667799574]  0xea60
[  274.776157] [TS:282667800297] rcu: rcu_preempt kthread starved for 68260 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  274.776159] [TS:282667801852] rcu: RCU grace-period kthread stack dump:fficient CPU time, OOM is now expected behavior.
[  274.776159] [TS:282667802250] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  274.776160] [TS:282667803204] Call trace:
[  274.776161] [TS:282667803528]  __switch_to+0xe0/0x140
[  274.776161] [TS:282667804306]  __schedule+0x310/0x840
[  274.776162] [TS:282667805084]  schedule+0x5c/0xe0
[  274.776163] [TS:282667805852]  schedule_timeout+0x9c/0x1e0
[  274.776164] [TS:282667807269]  rcu_gp_fqs_loop+0x130/0x6f0
[  274.776166] [TS:282667809074]  rcu_gp_kthread+0x254/0x2a0
[  274.776168] [TS:282667810963]  kthread+0x11c/0x130
[  274.776170] [TS:282667812510]  ret_from_fork+0x10/0x20
[  274.776171] [TS:282667813778] rcu: Stack dump where RCU GP kthread last ran:
[  274.776171] [TS:282667814056] Task dump for CPU 10:
[  274.776171] [TS:282667814352] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  274.776173] [TS:282667815667]  __switch_to+0xe0/0x140
[  274.776173] [TS:282667816426]  0xffff80000acbb970
[  274.776174] [TS:282667817361]  0xea60
[  337.796149] [TS:345687791608] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  337.796150] [TS:345687792729] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=84025 ji[  337.796152] [TS:345687795062] Task dump for CPU 10:35, q=4 ncpus=14)
[  337.796153] [TS:345687795627] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  337.796154] [TS:345687797183] Call trace:
[  337.796155] [TS:345687797655]  __switch_to+0xe0/0x140
[  337.796156] [TS:345687798701]  0xffff80000acbb970
[  337.796157] [TS:345687799433]  0xea60
[  337.796157] [TS:345687800044] rcu: rcu_preempt kthread starved for 84015 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  337.796159] [TS:345687801525] rcu: RCU grace-period kthread stack dump:fficient CPU time, OOM is now expected behavior.
[  337.796159] [TS:345687802182] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  337.796160] [TS:345687803238] Call trace:
[  337.796161] [TS:345687803608]  __switch_to+0xe0/0x140
[  337.796162] [TS:345687804710]  __schedule+0x310/0x840
[  337.796163] [TS:345687805470]  schedule+0x5c/0xe0
[  337.796163] [TS:345687806247]  schedule_timeout+0x9c/0x1e0
[  337.796165] [TS:345687807803]  rcu_gp_fqs_loop+0x130/0x6f0
[  337.796167] [TS:345687809766]  rcu_gp_kthread+0x254/0x2a0
[  337.796169] [TS:345687811682]  kthread+0x11c/0x130
[  337.796170] [TS:345687813331]  ret_from_fork+0x10/0x20
[  337.796172] [TS:345687814645] rcu: Stack dump where RCU GP kthread last ran:
[  337.796172] [TS:345687815053] Task dump for CPU 10:
[  337.796172] [TS:345687815349] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  337.796174] [TS:345687816525]  __switch_to+0xe0/0x140
[  337.796174] [TS:345687817312]  0xffff80000acbb970
[  337.796175] [TS:345687817831]  0xea60
[  400.816149] [TS:408707791550] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  400.816150] [TS:408707792661] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=99780 ji[  400.816152] [TS:408707794828] Task dump for CPU 10:35, q=4 ncpus=14)
[  400.816152] [TS:408707795263] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  400.816154] [TS:408707796818] Call trace:
[  400.816154] [TS:408707797374]  __switch_to+0xe0/0x140
[  400.816155] [TS:408707798411]  0xffff80000acbb970
[  400.816156] [TS:408707799133]  0xea60
[  400.816157] [TS:408707799856] rcu: rcu_preempt kthread starved for 99770 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  400.816158] [TS:408707801309] rcu: RCU grace-period kthread stack dump:fficient CPU time, OOM is now expected behavior.
[  400.816159] [TS:408707801744] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  400.816160] [TS:408707802818] Call trace:
[  400.816160] [TS:408707803096]  __switch_to+0xe0/0x140
[  400.816161] [TS:408707803846]  __schedule+0x310/0x840
[  400.816162] [TS:408707804606]  schedule+0x5c/0xe0
[  400.816163] [TS:408707805513]  schedule_timeout+0x9c/0x1e0
[  400.816164] [TS:408707807078]  rcu_gp_fqs_loop+0x130/0x6f0
[  400.816166] [TS:408707808855]  rcu_gp_kthread+0x254/0x2a0
[  400.816168] [TS:408707810587]  kthread+0x11c/0x130
[  400.816169] [TS:408707812189]  ret_from_fork+0x10/0x20
[  400.816171] [TS:408707813439] rcu: Stack dump where RCU GP kthread last ran:
[  400.816171] [TS:408707813874] Task dump for CPU 10:
[  400.816171] [TS:408707814170] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  400.816173] [TS:408707815587]  __switch_to+0xe0/0x140
[  400.816173] [TS:408707816337]  0xffff80000acbb970
[  400.816174] [TS:408707816865]  0xea60
[  463.836149] [TS:471727792149] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  463.836151] [TS:471727793806] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=115535 jiffies(starved)
[  463.836153] 	(detected by 7, t=115537 jiffies, g=-1135, q=4 ncpus=14)
[  463.836154] [TS:471727796667] Task dump for CPU 10:
[  463.836155] [TS:471727797436] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  463.836156] [TS:471727799130] Call trace:
[  463.836157] [TS:471727799603]  __switch_to+0xe0/0x140
[  463.836158] [TS:471727800723]  0xffff80000acbb970
[  463.836159] [TS:471727801501]  0xea60
[  463.836159] [TS:471727802260] rcu: rcu_preempt kthread starved for 115525 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  463.836160] [TS:471727803417] rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[  463.836161] [TS:471727804047] rcu: RCU grace-period kthread stack dump:
[  463.836162] [TS:471727804649] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  463.836163] [TS:471727805945] Call trace:
[  463.836163] [TS:471727806214]  __switch_to+0xe0/0x140
[  463.836164] [TS:471727807056]  __schedule+0x310/0x840
[  463.836165] [TS:471727807927]  schedule+0x5c/0xe0
[  463.836167] [TS:471727810186]  rcu_gp_fqs_loop+0x130/0x6f0
[  463.836171] [TS:471727813917]  kthread+0x11c/0x1304/0x2a0
[  463.836173] [TS:471727815806]  ret_from_fork+0x10/0x20
[  463.836175] [TS:471727817482] rcu: Stack dump where RCU GP kthread last ran:
[  463.836175] [TS:471727817769] Task dump for CPU 10:
[  463.836175] [TS:471727818066] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  463.836176] [TS:471727819288]  __switch_to+0xe0/0x140
[  463.836177] [TS:471727820112]  0xffff80000acbb970
[  463.836178] [TS:471727820603]  0xea60
[  526.856149] [TS:534747791600] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  526.856150] [TS:534747792868] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=131290 jiffies(starved)
[  526.856151] 	(detected by 7, t=131292 jiffies, g=-1135, q=4 ncpus=14)
[  526.856152] [TS:534747795248] Task dump for CPU 10:
[  526.856153] [TS:534747795766] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  526.856154] [TS:534747797229] Call trace:
[  526.856155] [TS:534747797720]  __switch_to+0xe0/0x140
[  526.856156] [TS:534747798831]  0xffff80000acbb970
[  526.856157] [TS:534747799785]  0xea60
[  526.856158] [TS:534747800572] rcu: rcu_preempt kthread starved for 131280 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  526.856158] [TS:534747801424] rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[  526.856159] [TS:534747801803] rcu: RCU grace-period kthread stack dump:
[  526.856160] [TS:534747802544] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  526.856161] [TS:534747803738] Call trace:
[  526.856161] [TS:534747804007]  __switch_to+0xe0/0x140
[  526.856162] [TS:534747804785]  __schedule+0x310/0x840
[  526.856163] [TS:534747805720]  schedule+0x5c/0xe0
[  526.856165] [TS:534747807914]  rcu_gp_fqs_loop+0x130/0x6f0
[  526.856169] [TS:534747811609]  kthread+0x11c/0x1304/0x2a0
[  526.856170] [TS:534747813331]  ret_from_fork+0x10/0x20
[  526.856172] [TS:534747814859] rcu: Stack dump where RCU GP kthread last ran:
[  526.856172] [TS:534747815155] Task dump for CPU 10:
[  526.856173] [TS:534747815729] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  526.856174] [TS:534747817035]  __switch_to+0xe0/0x140
[  526.856175] [TS:534747817831]  0xffff80000acbb970
[  526.856175] [TS:534747818313]  0xea60
[  589.876148] [TS:597767791402] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  589.876150] [TS:597767792624] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=147045 jiffies(starved)
[  589.876151] 	(detected by 4, t=147047 jiffies, g=-1135, q=4 ncpus=14)
[  589.876152] [TS:597767794911] Task dump for CPU 10:
[  589.876153] [TS:597767795754] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  589.876154] [TS:597767797143] Call trace:
[  589.876155] [TS:597767797745]  __switch_to+0xe0/0x140
[  589.876156] [TS:597767798736]  0xffff80000acbb970
[  589.876157] [TS:597767799532]  0xea60
[  589.876157] [TS:597767800217] rcu: rcu_preempt kthread starved for 147035 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  589.876158] [TS:597767801254] rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[  589.876159] [TS:597767802041] rcu: RCU grace-period kthread stack dump:
[  589.876160] [TS:597767802634] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  589.876161] [TS:597767803736] Call trace:
[  589.876161] [TS:597767804152]  __switch_to+0xe0/0x140
[  589.876162] [TS:597767804893]  __schedule+0x310/0x840
[  589.876163] [TS:597767805782]  schedule+0x5c/0xe0
[  589.876165] [TS:597767808069]  rcu_gp_fqs_loop+0x130/0x6f0
[  589.876169] [TS:597767812097]  kthread+0x11c/0x1304/0x2a0
[  589.876171] [TS:597767813726]  ret_from_fork+0x10/0x20
[  589.876172] [TS:597767815032] rcu: Stack dump where RCU GP kthread last ran:
[  589.876173] [TS:597767815486] Task dump for CPU 10:
[  589.876173] [TS:597767815948] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  589.876174] [TS:597767817124]  __switch_to+0xe0/0x140
[  589.876175] [TS:597767818134]  0xffff80000acbb970
[  589.876176] [TS:597767818893]  0xea60
[  652.896149] [TS:660787791621] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[  652.896150] [TS:660787792955] rcu: 	10-...!: (0 ticks this GP) idle=390c/1/0x4000000000000000 softirq=0/0 fqs=6 rcuc=162800 jiffies(starved)
[  652.896151] 	(detected by 4, t=162802 jiffies, g=-1135, q=4 ncpus=14)
[  652.896152] [TS:660787795168] Task dump for CPU 10:
[  652.896153] [TS:660787795844] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  652.896154] [TS:660787797140] Call trace:
[  652.896155] [TS:660787797779]  __switch_to+0xe0/0x140
[  652.896156] [TS:660787799066]  0xffff80000acbb970
[  652.896157] [TS:660787800020]  0xea60
[  652.896158] [TS:660787800844] rcu: rcu_preempt kthread starved for 162790 jiffies! g-1135 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[  652.896159] [TS:660787801658] rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[  652.896159] [TS:660787802205] rcu: RCU grace-period kthread stack dump:
[  652.896160] [TS:660787802483] task:rcu_preempt     state:R  running task     stack:0     pid:17    ppid:2      flags:0x00000008
[  652.896160] [TS:660787803427] Call trace:
[  652.896161] [TS:660787803853]  __switch_to+0xe0/0x140
[  652.896162] [TS:660787804621]  __schedule+0x310/0x840
[  652.896163] [TS:660787805520]  schedule+0x5c/0xe0
[  652.896165] [TS:660787807825]  rcu_gp_fqs_loop+0x130/0x6f0
[  652.896169] [TS:660787812001]  kthread+0x11c/0x1304/0x2a0
[  652.896171] [TS:660787813797]  ret_from_fork+0x10/0x20
[  652.896172] [TS:660787815279] rcu: Stack dump where RCU GP kthread last ran:
[  652.896173] [TS:660787816010] Task dump for CPU 10:
[  652.896174] [TS:660787816510] task:swapper/0       state:R  running task     stack:0     pid:1     ppid:0      flags:0x0000000a
[  652.896175] [TS:660787817816]  __switch_to+0xe0/0x140
[  652.896176] [TS:660787818686]  0xffff80000acbb970
[  652.896176] [TS:660787819288]  0xea60

Is there a method to flash a minimum set of partitions to effect a Device Tree change to modify the PCIe C4 and C5 port configurations without having to reflash the entire unit and thus lose customizations?

This method works in DOS 6.0.10 with Drive AGX Orin

Dear @david.cattley ,
That means bind_partition with out ENABLE_T264_PCIE_C5=y followed by boot_burn.py with -u option works with out any issue and able to boot? The issue is noticed only when you enable ENABLE_T264_PCIE_C5=y in bind_partition?

No, not exactly.

The issue occurs when the device has been fully flashed with an image bound without any ENABLE_T264_PCIE_XX flags. and then is flashed partially from an image bound with ENABLE_T264_PCIE_C5=y flag specified.

In other words, the device is flashed and operating without any PCIe ports enabled in either RP or EP.

A new image is bound with the only change being that ENABLE_T264_PCIE_C5=y is specified.

If that image is flashed “partially” with only the -u A_1_kernel-dtb flag the system will not boot.

If that image is flashed “fully” (without the -u A_1_kernel-dtb flag) the system will boot.

The details:

Drive AGX Thor Incremental Device Tree Flashing

The goal of this testing is to validate that Device Tree only changes to the target can be flashed as a minimal subset.

Test incremental flash of device tree from incremental bind

The purpose of this test is to validate that incremental changes to the bound image generated by specifying differing PCIe configuration flags during subsequent bind operations can be flashed to the target with a subset of partitions which minimally specify the Device Tree.

The image is bound fully only once. Subsequent changes are made by re-running bind_partitions on the current state.

  1. Start a fresh docker instance of the DOS 7.0.3 docker

    • Bind image with PCIe support for C5 in Root mode
      cd $NV_WORKSPACE/drive-foundation && ./make/bind_partitions  -b p3960-10-sw03 drive_av.linux -p dev_nsr ENABLE_T264_PCIE_C5=y
      
    • Fully flash the device
      cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2
      
    • After boot-up verify with lspci that C5 RP is present
  2. Start a fresh docker instance of the DOS 7.0.3 docker.

    • Bind Image without PCIe Support

      cd $NV_WORKSPACE/drive-foundation && ./make/bind_partitions  -b p3960-10-sw03 drive_av.linux -p dev_nsr
      
    • Fully flash device

      cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2
      
    • After boot-up, verified with lspci that the C5 EP is not listed. (success)

    • Incrementally (e.g. from current state) run bind_partitions to enable PCIe C5

      cd $NV_WORKSPACE/drive-foundation && ./make/bind_partitions  -b p3960-10-sw03 drive_av.linux -p dev_nsr ENABLE_T264_PCIE_C5=y
      
    • Apply bootburn patch to enable -u option processing (pathed file in /drive_flashing)

      cp /drive_flashing/bootburn_lib.py $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn_t264_py/
      
    • Partially flash device

      cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2 -u A_1_kernel-dtb
      
    • Device reboots and hangs during boot

Test incremental flash of device tree from clean bind

The purpose of this test is to validate that changes to the bound image generated by specifying differing PCIe configuration flags during subsequent bind operations can be flashed to the target with a subset of partitions which minimally specify the Device Tree.

Each image is created fully with bind_partitions being run from a clean docker image to eliminate the possiblity that incremental bind operations do not work as expected.

  1. Start a fresh docker instance of the DOS 7.0.3 docker

    • Bind partitions without PCIe support
      cd $NV_WORKSPACE/drive-foundation && ./make/bind_partitions  -b p3960-10-sw03 drive_av.linux -p dev_nsr
      
    • Flash full image
      cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2
      
  2. Verify PCI configuration does not include C5 Root Port

    nvidia@tegra-ubuntu:~$ lspci
    0000:00:00.0 PCI bridge: NVIDIA Corporation Device 22e6
    0000:01:00.0 3D controller: NVIDIA Corporation Device 2b00 (rev a1)
    0002:00:00.0 PCI bridge: NVIDIA Corporation Device 22d8
    nvidia@tegra-ubuntu:~$
    
  3. Terminate docker instance

  4. Start a fresh docker instance of the DOS 7.0.3 docker

    • Apply bootburn patch to enable -u option processing (pathed file in /drive_flashing)
      cp /drive_flashing/bootburn_lib.py $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn_t264_py/
      
    • Bind image with PCIe support for C5 in Root mode
      cd $NV_WORKSPACE/drive-foundation && ./make/bind_partitions  -b p3960-10-sw03 drive_av.linux -p dev_nsr ENABLE_T264_PCIE_C5=y
      
    • Inrementally flash device tree only
      cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2 -u A_1_kernel-dtb
      
    • After reboot the device hangs on boot

    To recover the system to a bootable state and with PCIe C5 RP enabled one needs only to fully flash the device using the current bound image.

    • Flash full image
      cd $NV_WORKSPACE/drive-foundation/tools/flashtools/bootburn/ && ./bootburn.py  -b p3960-10-sw03  -x /dev/ttyACM2
      
  5. Verify PCI configuration does include C5 Root Port

    nvidia@tegra-ubuntu:~$ lspci
    0000:00:00.0 PCI bridge: NVIDIA Corporation Device 22e6
    0000:01:00.0 3D controller: NVIDIA Corporation Device 2b00 (rev a1)
    0002:00:00.0 PCI bridge: NVIDIA Corporation Device 22d8
    0005:00:00.0 PCI bridge: NVIDIA Corporation Device 22d8
    nvidia@tegra-ubuntu:~$ 
    

Conclusion

The image is thus not the issue. The issue is that the incremental flash operation specifying only the -u A_1_kernel-dtb does not result in a bootable system.