AGX Orin: GPUDirect RDMA on Jetpack 5.1.2

Hi,

I’m interested in using GPUDirect RDMA on my Jetson AGX Orin Dev kit.

I’ve seen several posts like this one where the official response was that “The issue (symbol conflict) is fixed in the r35.4.1/JetPack 5.1.2. ”.

I’ve just flashed my Orin using SDK Manager with JetPack 5.1.2 and all SDK Components. However I am still getting the same error when trying to insert the picoevb-rdma kernel module provided here.

user@user-desktop:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo ./build-for-jetson-drive-igpu-native.sh 
make -C "/lib/modules/5.10.192-tegra/build" "M=$PWD" "modules"
make[1]: Entering directory '/usr/src/linux-headers-5.10.192-tegra-ubuntu20.04_aarch64/kernel-5.10'
  CC [M]  /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.o
  MODPOST /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/Module.symvers
  CC [M]  /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.mod.o
  LD [M]  /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.ko
make[1]: Leaving directory '/usr/src/linux-headers-5.10.192-tegra-ubuntu20.04_aarch64/kernel-5.10'
user@user-desktop:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo insmod ./picoevb-rdma.ko
insmod: ERROR: could not insert module ./picoevb-rdma.ko: Unknown symbol in module
user@user-desktop:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ 

dmesg log:

[  629.996197] picoevb_rdma: module verification failed: signature and/or required key missing - tainting kernel
[  630.006674] picoevb_rdma: Unknown symbol nvidia_p2p_dma_unmap_pages (err -2)
[  630.014071] picoevb_rdma: Unknown symbol nvidia_p2p_get_pages (err -2)
[  630.020847] picoevb_rdma: Unknown symbol nvidia_p2p_put_pages (err -2)
[  630.027613] picoevb_rdma: Unknown symbol nvidia_p2p_dma_map_pages (err -2)
[  630.034749] picoevb_rdma: Unknown symbol nvidia_p2p_free_page_table (err -2)

I thought JetPack 5.1.2 was supposed to fix these errors? Is there a new way to install and use GPUDirect RDMA Drivers on AGX Orin?

Thank you,
Cason

Hi,

It should work but please insert the nvidia-p2p.ko first.
Please check below comment for the details:

Thanks.

Hi @AastaLLL ,

I inserted nvidia-p2p.ko first, and it does get rid of symbol errors, but according to dmesg the module verification fails and it does not show up in “Kernel driver in use:”

Note: Similar to this post, I’m attempting to use Xilinx VCK190 FPGA not HTG-K800 but the Internal Xilinx IP is the same.

user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo apt install build-essential bc
Reading package lists... Done
Building dependency tree       
Reading state information... Done
bc is already the newest version (1.07.1-2build1).
build-essential is already the newest version (12.8ubuntu1.1).
The following packages were automatically installed and are no longer required:
  apt-clone archdetect-deb bogl-bterm busybox-static cryptsetup-bin
  dctrl-tools dpkg-repack gdal-data gir1.2-timezonemap-1.0 gir1.2-xkl-1.0
  grub-common libaec0 libarmadillo9 libarpack2 libavcodec-dev libavformat-dev
  libavresample-dev libavresample4 libavutil-dev libcfitsio8 libcharls2
  libdap25 libdapclient6v5 libdc1394-22-dev libdebian-installer4 libepsilon1
  libexif-dev libfreexl1 libfyba0 libgdal26 libgdcm-dev libgdcm3.0
  libgeos-3.8.0 libgeos-c1v5 libgeotiff5 libgl2ps1.4 libgphoto2-dev
  libhdf4-0-alt libhdf5-103 libhdf5-openmpi-103 libilmbase-dev libjbig-dev
  libjpeg-dev libjpeg-turbo8-dev libjpeg8-dev libkmlbase1 libkmldom1
  libkmlengine1 liblept5 liblzma-dev libminizip1 libnetcdf-c++4 libnetcdf15
  libodbc1 libogdi4.1 libopencv-calib3d4.2 libopencv-contrib4.2
  libopencv-dnn4.2 libopencv-features2d4.2 libopencv-flann4.2
  libopencv-highgui4.2 libopencv-imgcodecs4.2 libopencv-imgproc4.2
  libopencv-ml4.2 libopencv-objdetect4.2 libopencv-photo4.2 libopencv-shape4.2
  libopencv-stitching4.2 libopencv-superres4.2 libopencv-video4.2
  libopencv-videoio4.2 libopencv-videostab4.2 libopencv-viz4.2
  libopencv4.2-java libopencv4.2-jni libopenexr-dev libpng-dev libpq5
  libproj15 libqhull7 libraw1394-dev libsocket++1 libspatialite7 libsuperlu5
  libswresample-dev libswscale-dev libsz2 libtesseract4 libtiff-dev libtiffxx5
  libtimezonemap-data libtimezonemap1 liburiparser1 libvtk6.3 libxerces-c3.2
  odbcinst odbcinst1debian2 os-prober proj-data python3-icu python3-pam rdate
  tasksel tasksel-data
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 276 not upgraded.
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ ./build-for-jetson-drive-igpu-native.sh 
make -C "/lib/modules/5.10.120-tegra/build" "M=$PWD" "modules"
make[1]: Entering directory '/usr/src/linux-headers-5.10.120-tegra-ubuntu20.04_aarch64/kernel-5.10'
  CC [M]  /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.o
  MODPOST /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/Module.symvers
  CC [M]  /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.mod.o
  LD [M]  /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.ko
make[1]: Leaving directory '/usr/src/linux-headers-5.10.120-tegra-ubuntu20.04_aarch64/kernel-5.10'
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo insmod /lib/modules/5.10.120-tegra/kernel/drivers/nv-p2p/nvidia-p2p.ko
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo insmod ./picoevb-rdma.ko
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo dmesg
[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd421]
[    0.000000] Linux version 5.10.120-tegra (buildbrain@mobile-u64-6422-d7000) (aarch64-buildroot-linux-gnu-gcc.br_real (Buildroot 2020.08) 9.3.0, GNU ld (GNU Binutils) 2.33.1) #1 SMP PREEMPT Tue Aug 1 12:32:50 PDT 2023
[    0.000000] OF: fdt: memory scan node memory@80000000, reg size 16,
[    0.000000] OF: fdt:  - 80000000 ,  c0000000
[    0.000000] Machine model: Jetson AGX Orin Developer Kit
[    0.000000] efi: EFI v2.70 by EDK II
[    0.000000] efi: RTPROP=0x82531df98 SMBIOS=0xffff0000 SMBIOS 3.0=0x805260000 MEMATTR=0x806822018 ESRT=0x805162818 RNG=0x806d2f198 MEMRESERVE=0x806824f18 
[    0.000000] efi: seeding entropy pool
[    0.000000] esrt: Reserving ESRT space from 0x0000000805162818 to 0x0000000805162850.
[    0.000000] Reserved memory: created CMA memory pool at 0x0000000818c00000, size 256 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000ffffffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   [mem 0x0000000100000000-0x0000000833ffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x00000000fffdffff]
[    0.000000]   node   0: [mem 0x00000000fffe0000-0x00000000ffffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x0000000804674fff]
[    0.000000]   node   0: [mem 0x0000000804675000-0x0000000804a4efff]
[    0.000000]   node   0: [mem 0x0000000804a4f000-0x0000000804dfffff]
[    0.000000]   node   0: [mem 0x0000000804e00000-0x0000000804e0ffff]
[    0.000000]   node   0: [mem 0x0000000804e10000-0x00000008051bffff]
[    0.000000]   node   0: [mem 0x00000008051c0000-0x000000080526ffff]
[    0.000000]   node   0: [mem 0x0000000805270000-0x00000008066dffff]
[    0.000000]   node   0: [mem 0x00000008066e0000-0x000000080677ffff]
[    0.000000]   node   0: [mem 0x0000000806780000-0x00000008067dffff]
[    0.000000]   node   0: [mem 0x00000008067e0000-0x000000080680ffff]
[    0.000000]   node   0: [mem 0x0000000806810000-0x000000080683ffff]
[    0.000000]   node   0: [mem 0x0000000806840000-0x000000080685ffff]
[    0.000000]   node   0: [mem 0x0000000806860000-0x000000080693ffff]
[    0.000000]   node   0: [mem 0x0000000806940000-0x000000080695ffff]
[    0.000000]   node   0: [mem 0x0000000806960000-0x000000080698ffff]
[    0.000000]   node   0: [mem 0x0000000806990000-0x0000000806b6ffff]
[    0.000000]   node   0: [mem 0x0000000806b70000-0x0000000806c3ffff]
[    0.000000]   node   0: [mem 0x0000000806c40000-0x0000000806cdffff]
[    0.000000]   node   0: [mem 0x0000000806ce0000-0x0000000806d1ffff]
[    0.000000]   node   0: [mem 0x0000000806d20000-0x0000000806faffff]
[    0.000000]   node   0: [mem 0x0000000806fb0000-0x00000008070affff]
[    0.000000]   node   0: [mem 0x00000008070b0000-0x000000080714ffff]
[    0.000000]   node   0: [mem 0x0000000807150000-0x000000080719ffff]
[    0.000000]   node   0: [mem 0x00000008071a0000-0x000000080723ffff]
[    0.000000]   node   0: [mem 0x0000000807240000-0x000000080775ffff]
[    0.000000]   node   0: [mem 0x0000000807760000-0x000000080793ffff]
[    0.000000]   node   0: [mem 0x0000000807940000-0x0000000828faffff]
[    0.000000]   node   0: [mem 0x0000000828fb0000-0x0000000828ffffff]
[    0.000000]   node   0: [mem 0x0000000829000000-0x000000082d1fffff]
[    0.000000]   node   0: [mem 0x000000082d210000-0x000000082d21ffff]
[    0.000000]   node   0: [mem 0x0000000832000000-0x0000000833ffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x0000000833ffffff]
[    0.000000] On node 0 totalpages: 8057360
[    0.000000]   DMA zone: 8192 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 524288 pages, LIFO batch:63
[    0.000000]   Normal zone: 118016 pages used for memmap
[    0.000000]   Normal zone: 7533072 pages, LIFO batch:63
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] psci: SMC Calling Convention v1.2
[    0.000000] percpu: Embedded 32 pages/cpu s90328 r8192 d32552 u131072
[    0.000000] pcpu-alloc: s90328 r8192 d32552 u131072 alloc=32*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 [0] 6 [0] 7 
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: GIC system register CPU interface
[    0.000000] CPU features: detected: Virtualization Host Extensions
[    0.000000] CPU features: kernel page table isolation forced ON by KASLR
[    0.000000] CPU features: detected: Kernel page table isolation (KPTI)
[    0.000000] CPU features: detected: Spectre-v4
[    0.000000] CPU features: detected: Spectre-BHB
[    0.000000] alternatives: patching kernel code
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 7931152
[    0.000000] Kernel command line: root=/dev/mmcblk0p1 rw rootwait rootfstype=ext4 mminit_loglevel=4 console=ttyTCU0,115200 console=ttyAMA0,115200 console=tty0 firmware_class.path=/etc/firmware fbcon=map:0 net.ifnames=0 nospectre_bhb nv-auto-config 
[    0.000000] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear)
[    0.000000] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x00000000effe0000-0x00000000fffe0000] (256MB)
[    0.000000] Memory: 31051584K/32229440K available (18560K kernel code, 3166K rwdata, 7196K rodata, 3968K init, 1416K bss, 915712K reserved, 262144K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu: 	RCU event tracing is enabled.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=8.
[    0.000000] 	Trampoline variant of Tasks RCU enabled.
[    0.000000] 	Rude variant of Tasks RCU enabled.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[    0.000000] GICv3: 960 SPIs implemented
[    0.000000] GICv3: 0 Extended SPIs implemented
[    0.000000] GICv3: Distributor has no Range Selector support
[    0.000000] GICv3: 16 PPIs implemented
[    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x000000000f440000
[    0.000000] GICv2m: DT overriding V2M MSI_TYPER (base:608, num:70)
[    0.000000] GICv2m: range[mem 0x0f410000-0x0f41ffff], SPI[608:677]
[    0.000000] arch_timer: cp15 timer(s) running at 31.25MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xe6a171046, max_idle_ns: 881590405314 ns
[    0.000003] sched_clock: 56 bits at 31MHz, resolution 32ns, wraps every 4398046511088ns
[    0.000756] Console: colour dummy device 80x25
[    0.000937] printk: console [tty0] enabled
[    0.000981] Calibrating delay loop (skipped), value calculated using timer frequency.. 62.50 BogoMIPS (lpj=125000)
[    0.000993] pid_max: default: 32768 minimum: 301
[    0.001099] LSM: Security Framework initializing
[    0.001132] Yama: becoming mindful.
[    0.001154] SELinux:  Initializing.
[    0.001265] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.001314] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.003224] rcu: Hierarchical SRCU implementation.
[    0.003334] dyndbg: Ignore empty _ddebug table in a CONFIG_DYNAMIC_DEBUG_CORE build
[    0.004114] DTS File Name: /dvs/git/dirty/git-master_linux/kernel/kernel-5.10/arch/arm64/boot/dts/../../../../../../hardware/nvidia/platform/t23x/concord/kernel-dts/tegra234-p3701-0004-p3737-0000.dts
[    0.004125] DTB Build time: Aug  1 2023 12:44:17
[    0.005751] Tegra Revision: A01 SKU: 0xd2 CPU Process: 0 SoC Process: 0
[    0.006082] Remapping and enabling EFI services.
[    0.006618] smp: Bringing up secondary CPUs ...
[    0.035348] Detected PIPT I-cache on CPU1
[    0.035385] GICv3: CPU1: found redistributor 100 region 0:0x000000000f460000
[    0.035424] CPU1: Booted secondary processor 0x0000000100 [0x410fd421]
[    0.064096] Detected PIPT I-cache on CPU2
[    0.064106] GICv3: CPU2: found redistributor 200 region 0:0x000000000f480000
[    0.064121] CPU2: Booted secondary processor 0x0000000200 [0x410fd421]
[    0.092734] Detected PIPT I-cache on CPU3
[    0.092743] GICv3: CPU3: found redistributor 300 region 0:0x000000000f4a0000
[    0.092756] CPU3: Booted secondary processor 0x0000000300 [0x410fd421]
[    0.123436] Detected PIPT I-cache on CPU4
[    0.123457] GICv3: CPU4: found redistributor 10000 region 0:0x000000000f4c0000
[    0.123482] CPU4: Booted secondary processor 0x0000010000 [0x410fd421]
[    0.152158] Detected PIPT I-cache on CPU5
[    0.152168] GICv3: CPU5: found redistributor 10100 region 0:0x000000000f4e0000
[    0.152183] CPU5: Booted secondary processor 0x0000010100 [0x410fd421]
[    0.180820] Detected PIPT I-cache on CPU6
[    0.180830] GICv3: CPU6: found redistributor 10200 region 0:0x000000000f500000
[    0.180845] CPU6: Booted secondary processor 0x0000010200 [0x410fd421]
[    0.209479] Detected PIPT I-cache on CPU7
[    0.209489] GICv3: CPU7: found redistributor 10300 region 0:0x000000000f520000
[    0.209504] CPU7: Booted secondary processor 0x0000010300 [0x410fd421]
[    0.209562] smp: Brought up 1 node, 8 CPUs
[    0.209607] SMP: Total of 8 processors activated.
[    0.209612] CPU features: detected: Privileged Access Never
[    0.209615] CPU features: detected: LSE atomic instructions
[    0.209617] CPU features: detected: User Access Override
[    0.209620] CPU features: detected: 32-bit EL0 Support
[    0.209623] CPU features: detected: Common not Private translations
[    0.209626] CPU features: detected: RAS Extension Support
[    0.209628] CPU features: detected: Data cache clean to the PoU not required for I/D coherence
[    0.209632] CPU features: detected: CRC32 instructions
[    0.209635] CPU features: detected: Speculative Store Bypassing Safe (SSBS)
[    0.226853] spectre-bhb mitigation disabled by command line option
[    0.226855] spectre-bhb mitigation disabled by command line option
[    0.226857] spectre-bhb mitigation disabled by command line option
[    0.226858] spectre-bhb mitigation disabled by command line option
[    0.226861] spectre-bhb mitigation disabled by command line option
[    0.226862] spectre-bhb mitigation disabled by command line option
[    0.226867] spectre-bhb mitigation disabled by command line option
[    0.226869] spectre-bhb mitigation disabled by command line option
[    0.242640] CPU: All CPU(s) started at EL2
[    0.245026] devtmpfs: initialized
[    0.266338] Registered cp15_barrier emulation handler
[    0.266353] Registered setend emulation handler
[    0.266360] KASLR enabled
[    0.266484] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.266499] futex hash table entries: 2048 (order: 5, 131072 bytes, linear)
[    0.268144] pinctrl core: initialized pinctrl subsystem
[    0.268615] SMBIOS 3.0.0 present.
[    0.268624] DMI: Unknown Jetson AGX Orin Developer Kit/Jetson AGX Orin Developer Kit, BIOS 4.1-33958178 08/01/2023
[    0.268958] NET: Registered protocol family 16
[    0.269616] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[    0.269818] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.270016] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.270044] audit: initializing netlink subsys (disabled)
[    0.270133] audit: type=2000 audit(0.268:1): state=initialized audit_enabled=0 res=1
[    0.270335] thermal_sys: Registered thermal governor 'step_wise'
[    0.270337] thermal_sys: Registered thermal governor 'power_allocator'
[    0.270342] thermal_sys: Registered thermal governor 'pid_thermal_gov'
[    0.272749] cpuidle: using governor menu
[    0.272865] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.272945] ASID allocator initialised with 32768 entries
[    0.273045] Serial: AMBA PL011 UART driver
[    0.275024] tegra234_mc_sid_probe(): tegra234 mc-sid probe successful
[    0.275047] Tegra reboot handler registered.
[    0.294581] mc: mapped MMIO address: 0xffff800011110000 -> 0x2c10000
[    0.294593] mc: mapped MMIO address: 0xffff800011130000 -> 0x2c20000
[    0.294601] mc: mapped MMIO address: 0xffff800011150000 -> 0x2c30000
[    0.294609] mc: mapped MMIO address: 0xffff800011170000 -> 0x2c40000
[    0.294621] mc: mapped MMIO address: 0xffff800011190000 -> 0x2c50000
[    0.294629] mc: mapped MMIO address: 0xffff8000111b0000 -> 0x2b80000
[    0.294636] mc: mapped MMIO address: 0xffff8000111d0000 -> 0x2b90000
[    0.294645] mc: mapped MMIO address: 0xffff8000111f0000 -> 0x2ba0000
[    0.294654] mc: mapped MMIO address: 0xffff800011210000 -> 0x2bb0000
[    0.294661] mc: mapped MMIO address: 0xffff800011230000 -> 0x1700000
[    0.294668] mc: mapped MMIO address: 0xffff800011250000 -> 0x1710000
[    0.294674] mc: mapped MMIO address: 0xffff800011270000 -> 0x1720000
[    0.294681] mc: mapped MMIO address: 0xffff800011290000 -> 0x1730000
[    0.294689] mc: mapped MMIO address: 0xffff8000112b0000 -> 0x1740000
[    0.294701] mc: mapped MMIO address: 0xffff8000112d0000 -> 0x1750000
[    0.294708] mc: mapped MMIO address: 0xffff8000112f0000 -> 0x1760000
[    0.294715] mc: mapped MMIO address: 0xffff800011310000 -> 0x1770000
[    0.294724] nv-tegra-mc 2c10000.mc: No mssnvlink node
[    0.294771] mc-err: mcerr ops are set to t23x
[    0.295502] 31d0000.serial: ttyAMA0 at MMIO 0x31d0000 (irq = 80, base_baud = 0) is a SBSA
[    1.500777] printk: console [ttyAMA0] enabled
[    1.509448] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    1.516158] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
[    1.522857] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    1.529556] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
[    1.538354] ACPI: Interpreter disabled.
[    1.543386] vdd-av1v1-hub: supplied by vdd-5v-sys
[    1.548237] vbusA-cvb: supplied by vdd-5v-sys
[    1.552700] vbusB-cvb: supplied by vdd-5v-sys
[    1.557172] vdd-usbc1-vbus: supplied by vdd-5v-sys
[    1.562126] vdd-usbc2-vbus: supplied by vdd-5v-sys
[    1.567440] iommu: Default domain type: Translated 
[    1.572466] eventlib_kernel: keventlib is initialized, test id: 0
[    1.578811] SCSI subsystem initialized
[    1.582641] usbcore: registered new interface driver usbfs
[    1.588138] usbcore: registered new interface driver hub
[    1.593458] usbcore: registered new device driver usb
[    1.598822] mc: Linux media interface: v0.10
[    1.603098] videodev: Linux video capture interface: v2.00
[    1.608732] pps_core: LinuxPPS API ver. 1 registered
[    1.613696] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.622832] PTP clock support registered
[    1.626990] tegra_wdt_t18x 2190000.watchdog: Tegra WDT init timeout = 120 sec
[    1.634173] tegra_wdt_t18x 2190000.watchdog: Registered successfully
[    1.641883] Registered efivars operations
[    1.646464] FPGA manager framework
[    1.649913] Advanced Linux Sound Architecture Driver Initialized.
[    1.656276] Bluetooth: Core ver 2.22
[    1.659858] NET: Registered protocol family 31
[    1.664300] Bluetooth: HCI device and connection manager initialized
[    1.670656] Bluetooth: HCI socket layer initialized
[    1.675532] Bluetooth: L2CAP socket layer initialized
[    1.680586] Bluetooth: SCO socket layer initialized
[    1.686102] camchar: rtcpu character device driver loaded
[    1.691829] clocksource: Switched to clocksource arch_sys_counter
[    1.862017] VFS: Disk quotas dquot_6.6.0
[    1.865986] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.873371] pnp: PnP ACPI: disabled
[    1.878800] la/ptsa driver initialized.
[    1.882703] NET: Registered protocol family 2
[    1.887263] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    1.897069] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear)
[    1.905821] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    1.914116] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[    1.922024] TCP: Hash tables configured (established 262144 bind 65536)
[    1.928739] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    1.935675] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    1.943128] NET: Registered protocol family 1
[    1.947748] RPC: Registered named UNIX socket transport module.
[    1.953675] RPC: Registered udp transport module.
[    1.958378] RPC: Registered tcp transport module.
[    1.963078] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.969525] PCI: CLS 0 bytes, default 64
[    1.973558] Trying to unpack rootfs image as initramfs...
[    2.107887] Freeing initrd memory: 9552K
[    2.113789] hw perfevents: enabled with armv8_pmuv3 PMU driver, 7 counters available
[    2.121755] kvm [1]: IPA Size Limit: 48 bits
[    2.126046] kvm [1]: GICv3: no GICV resource entry
[    2.130836] kvm [1]: disabling GICv2 emulation
[    2.135299] kvm [1]: GIC system register CPU interface enabled
[    2.141203] kvm [1]: vgic interrupt IRQ9
[    2.145239] kvm [1]: VHE mode initialized successfully
[    2.151071] Initialise system trusted keyrings
[    2.155623] workingset: timestamp_bits=46 max_order=23 bucket_order=0
[    2.164473] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    2.170649] NFS: Registering the id_resolver key type
[    2.175725] Key type id_resolver registered
[    2.179908] Key type id_legacy registered
[    2.183949] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    2.190657] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    2.198064] ntfs: driver 2.1.32 [Flags: R/W].
[    2.214036] NET: Registered protocol family 38
[    2.218483] Key type asymmetric registered
[    2.222579] Asymmetric key parser 'x509' registered
[    2.227473] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 239)
[    2.234931] io scheduler mq-deadline registered
[    2.239465] io scheduler kyber registered
[    2.248084] tegra-pwm 3280000.pwm: PWM clk can sleep in ops
[    2.253686] tegra-pwm 32a0000.pwm: PWM clk can sleep in ops
[    2.259272] tegra-pwm 32c0000.pwm: PWM clk can sleep in ops
[    2.264858] tegra-pwm 32f0000.pwm: PWM clk can sleep in ops
[    2.271268] efifb: probing for efifb
[    2.274880] efifb: framebuffer at 0x839e00000, using 8640k, total 8640k
[    2.281496] efifb: mode is 1920x1080x32, linelength=8192, pages=1
[    2.287588] efifb: scrolling: redraw
[    2.291160] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    2.299735] Console: switching to colour frame buffer device 240x67
[    2.308774] fb0: EFI VGA frame buffer device
[    2.314913] tegra_dc_assign_hw_data: no matching compatible node
[    2.320936] tegradccommon module_init failed
[    2.325212] tegradc module_init failed
[    2.329245] EINJ: ACPI disabled.
[    2.334149] tegra-pmc c360000.pmc: scratch reg offset dts data not present
[    2.341045] tegra-pmc: ### PMC reset source: MAINSWRST
[    2.346194] tegra-pmc: ### PMC reset level: L1
[    2.350643] tegra-pmc: ### PMC reset status reg: 0x2d
[    2.357023] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    4.004852] printk: console [ttyTCU0] enabled
[    4.013929] arm-smmu 12000000.iommu: probing hardware configuration...
[    4.021954] arm-smmu 12000000.iommu: SMMUv2 with:
[    4.026801] arm-smmu 12000000.iommu: 	stage 1 translation
[    4.032357] arm-smmu 12000000.iommu: 	stage 2 translation
[    4.037913] arm-smmu 12000000.iommu: 	nested translation
[    4.043371] arm-smmu 12000000.iommu: 	stream matching with 128 register groups
[    4.050791] arm-smmu 12000000.iommu: 	128 context banks (0 stage-2 only)
[    4.059912] arm-smmu 12000000.iommu: 	Supported page sizes: 0x00001000
[    4.066618] arm-smmu 12000000.iommu: 	Stage-1: 48-bit VA -> 48-bit IPA
[    4.073321] arm-smmu 12000000.iommu: 	Stage-2: 48-bit IPA -> 48-bit PA
[    4.080895] arm-smmu 10000000.iommu: probing hardware configuration...
[    4.087601] arm-smmu 10000000.iommu: SMMUv2 with:
[    4.092430] arm-smmu 10000000.iommu: 	stage 1 translation
[    4.097968] arm-smmu 10000000.iommu: 	stage 2 translation
[    4.103518] arm-smmu 10000000.iommu: 	nested translation
[    4.108973] arm-smmu 10000000.iommu: 	stream matching with 128 register groups
[    4.116391] arm-smmu 10000000.iommu: 	128 context banks (0 stage-2 only)
[    4.125399] arm-smmu 10000000.iommu: 	Supported page sizes: 0x00001000
[    4.132101] arm-smmu 10000000.iommu: 	Stage-1: 48-bit VA -> 48-bit IPA
[    4.138804] arm-smmu 10000000.iommu: 	Stage-2: 48-bit IPA -> 48-bit PA
[    4.145937] arm-smmu 8000000.iommu: probing hardware configuration...
[    4.152559] arm-smmu 8000000.iommu: SMMUv2 with:
[    4.157296] arm-smmu 8000000.iommu: 	stage 1 translation
[    4.162754] arm-smmu 8000000.iommu: 	stage 2 translation
[    4.168208] arm-smmu 8000000.iommu: 	nested translation
[    4.173568] arm-smmu 8000000.iommu: 	stream matching with 128 register groups
[    4.180900] arm-smmu 8000000.iommu: 	128 context banks (0 stage-2 only)
[    4.189833] arm-smmu 8000000.iommu: 	Supported page sizes: 0x00001000
[    4.196451] arm-smmu 8000000.iommu: 	Stage-1: 48-bit VA -> 48-bit IPA
[    4.203056] arm-smmu 8000000.iommu: 	Stage-2: 48-bit IPA -> 48-bit PA
[    4.210392] arm-smmu-suspend 12000000.smmu_suspend: arm_smmu_suspend probe successful
[    4.220638] tegra_profiler: version: 1.151, samples/io: 51/30
[    4.227212] tegra_profiler: auth: init
[    4.231961] nvsciipc: loaded module
[    4.237740] tun: Universal TUN/TAP device driver, 1.6
[    4.243973] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[    4.251944] hns3: Copyright (c) 2017 Huawei Corporation.
[    4.257979] e1000e: Intel(R) PRO/1000 Network Driver
[    4.263622] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    4.270261] igb: Intel(R) Gigabit Ethernet Network Driver
[    4.276359] igb: Copyright (c) 2007-2014 Intel Corporation.
[    4.282802] PPP generic driver version 2.4.2
[    4.287779] PPP BSD Compression module registered
[    4.293151] PPP Deflate Compression module registered
[    4.298881] PPP MPPE Compression module registered
[    4.304379] usbcore: registered new interface driver r8152
[    4.310568] usbcore: registered new interface driver asix
[    4.316667] usbcore: registered new interface driver ax88179_178a
[    4.323472] usbcore: registered new interface driver cdc_ether
[    4.330025] usbcore: registered new interface driver net1080
[    4.336397] usbcore: registered new interface driver cdc_subset
[    4.343019] usbcore: registered new interface driver zaurus
[    4.349278] usbcore: registered new interface driver cdc_ncm
[    4.355620] usbcore: registered new interface driver aqc111
[    4.361976] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    4.368850] ohci-pci: OHCI PCI platform driver
[    4.373934] ohci-platform: OHCI generic platform driver
[    4.380123] tegra-xusb 3610000.xhci: Adding to iommu group 0
[    4.386911] usbcore: registered new interface driver uas
[    4.392914] usbcore: registered new interface driver usb-storage
[    4.399738] tegra-xudc 3550000.xudc: Adding to iommu group 1
[    4.406386] mousedev: PS/2 mouse device common for all mice
[    4.412638] usbcore: registered new interface driver xpad
[    4.420556] tegra_rtc c2a0000.rtc: registered as rtc1
[    4.426545] tegra_rtc c2a0000.rtc: setting system clock to 1970-01-01T00:00:25 UTC (25)
[    4.435298] tegra_rtc c2a0000.rtc: Tegra internal Real Time Clock
[    4.442233] i2c /dev entries driver
[    4.446407] tegra-i2c 3160000.i2c: Adding to iommu group 2
[    4.452740] tegra-i2c c240000.i2c: Adding to iommu group 2
[    4.458982] tegra-i2c 3180000.i2c: Adding to iommu group 2
[    4.465280] tegra-i2c 3190000.i2c: Adding to iommu group 2
[    4.471602] tegra-i2c 31c0000.i2c: Adding to iommu group 2
[    4.477806] tegra-i2c c250000.i2c: Adding to iommu group 2
[    4.484008] tegra-i2c 31e0000.i2c: Adding to iommu group 2
[    4.490253] tegra-i2c 31b0000.i2c: Adding to iommu group 2
[    4.498653] tegra-camrtc-capture-vi tegra-capture-vi: ep of_device is not enabled endpoint.
[    4.507809] tegra-camrtc-capture-vi tegra-capture-vi: ep of_device is not enabled endpoint.
[    4.517857] device-mapper: uevent: version 1.0.3
[    4.523196] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com
[    4.533560] sdhci: Secure Digital Host Controller Interface driver
[    4.540441] sdhci: Copyright(c) Pierre Ossman
[    4.545446] Synopsys Designware Multimedia Card Interface Driver
[    4.552237] sdhci-pltfm: SDHCI platform and OF driver helper
[    4.558749] sdhci-tegra 3460000.sdhci: Adding to iommu group 3
[    4.559130] sdhci-tegra 3400000.sdhci: Adding to iommu group 4
[    4.559291] SMCCC: SOC_ID: ID = jep106:036b:0023 Revision = 0x00000401
[    4.560188] tegra-bpmp bpmp: firmware: 6969245516d6bf7e0f23-925eece486b
[    4.561494] nvvrs_pseq 4-003c: NVVRS Vendor ID: 0x9 
[    4.562067] nvvrs_pseq 4-003c: NVVRS Model Rev: 0x81
[    4.568654] nvvrs-pseq-rtc nvvrs-pseq-rtc: registered as rtc0
[    4.604695] nvvrs_pseq 4-003c: NVVRS PSEQ probe successful
[    5.779486] hid: raw HID events driver (C) Jiri Kosina
[    5.785632] usbcore: registered new interface driver usbhid
[    5.791932] usbhid: USB HID core driver
[    5.797009] tegra-dce d800000.dce: Adding to iommu group 5
[    5.804847] dce: dce_ipc_channel_init:319  Invalid Channel State [0x0] for ch_type [2]
[    5.814322] tegra234-aon c000000.aon: Adding to iommu group 6
[    5.821516] dce: dce_mailbox_set_full_interrupt:165  Intr bit set multiple times for MB : [0x5]
[    5.825453]  c000000.aon:hsp: probed
[    5.831078] dce: dce_admin_ipc_handle_signal:90   Spurious signal on channel: [0]. Ignored...
[    5.844873] tegra234-aon c000000.aon: init done
[    5.845562] tegra23x-psc e860000.psc: Adding to iommu group 7
[    5.850159] dce: dce_admin_send_cmd_ver:424  version : [0x2] err : [0x0]
[    5.857299] tegra23x-psc e860000.psc: ext_cfg base:(____ptrval____)
[    5.864799] dce: dce_mailbox_set_full_interrupt:165  Intr bit set multiple times for MB : [0x1]
[    5.871489] tegra23x-psc e860000.psc: init done
[    5.881123] dce: dce_admin_setup_clients_ipc:553  Channel Reset Complete for Type [1] ...
[    5.881125] dce: dce_admin_ipc_handle_signal:90   Spurious signal on channel: [1]. Ignored...
[    5.881136] dce: dce_admin_ipc_handle_signal:90   Spurious signal on channel: [1]. Ignored...
[    5.886692] tegra186-cam-rtcpu bc00000.rtcpu: Adding to iommu group 8
[    5.895570] dce: dce_admin_setup_clients_ipc:529  Get queue info failed for [2]
[    5.896071] dce: dce_mailbox_set_full_interrupt:165  Intr bit set multiple times for MB : [0x2]
[    5.905646] tegra186-cam-rtcpu bc00000.rtcpu: Trace buffer configured at IOVA=0xbff00000
[    5.914526] dce: dce_admin_setup_clients_ipc:553  Channel Reset Complete for Type [3] ...
[    5.914528] dce: dce_admin_ipc_handle_signal:90   Spurious signal on channel: [3]. Ignored...
[    5.914539] dce: dce_admin_ipc_handle_signal:90   Spurious signal on channel: [3]. Ignored...
[    5.976620] dce: dce_start_boot_flow:173  DCE_BOOT_DONE
[    5.978669] tegra-ivc-bus bc00000.rtcpu:ivc-bus: region 0: iova=0xbfec0000-0xbfee01ff size=131584
[    5.992640] tegra-ivc-bus bc00000.rtcpu:ivc-bus:echo@0: echo: ver=0 grp=1 RX[16x64]=0x1000-0x1480 TX[16x64]=0x1480-0x1900
[    6.005021] tegra-ivc-bus bc00000.rtcpu:ivc-bus:dbg@1: dbg: ver=0 grp=1 RX[1x448]=0x1900-0x1b40 TX[1x448]=0x1b40-0x1d80
[    6.017658] tegra-ivc-bus bc00000.rtcpu:ivc-bus:dbg@2: dbg: ver=0 grp=1 RX[1x8192]=0x1d80-0x3e00 TX[1x8192]=0x3e00-0x5e80
[    6.030135] tegra-ivc-bus bc00000.rtcpu:ivc-bus:ivccontrol@3: ivccontrol: ver=0 grp=1 RX[64x320]=0x5e80-0xaf00 TX[64x320]=0xaf00-0xff80
[    6.043449] tegra-ivc-bus bc00000.rtcpu:ivc-bus:ivccapture@4: ivccapture: ver=0 grp=1 RX[512x64]=0xff80-0x18000 TX[512x64]=0x18000-0x20080
[    6.057032] tegra-ivc-bus bc00000.rtcpu:ivc-bus:diag@5: diag: ver=0 grp=1 RX[1x64]=0x20080-0x20140 TX[1x64]=0x20140-0x20200
[    6.070050] tegra186-cam-rtcpu bc00000.rtcpu: using cam RTCPU IRQ (119)
[    6.077608] tegra186-cam-rtcpu bc00000.rtcpu: tegra_camrtc_mon_create is successful
[    6.086750] tegra186-cam-rtcpu bc00000.rtcpu: firmware version cpu=rce cmd=6 sha1=8676d22a01443bdbc66581b7dde3b6d6828cc925
[    6.101121] t19x_cache tegra-cache: probed
[    6.106315] scf-pmu-drv scf-pmu: Registered T23x SCF Uncore PMU
[    6.119343] optee: probing for conduit method.
[    6.124692] optee: revision 3.21 (d8269f24)
[    6.183479] optee: dynamic shared memory is enabled
[    6.194406] optee: initialized driver
[    6.214889] nvpmodel: initialized successfully
[    6.220318] tegra_hv: get_hvd: not initialized yet
[    6.226017] user_ivc_mempool: hypervisor not present
[    6.232708] usbcore: registered new interface driver snd-usb-audio
[    6.240764] u32 classifier
[    6.244321]     input device check on
[    6.248870]     Actions configured
[    6.253279] Initializing XFRM netlink socket
[    6.258922] NET: Registered protocol family 10
[    6.265946] Segment Routing with IPv6
[    6.270544] NET: Registered protocol family 17
[    6.275911] NET: Registered protocol family 15
[    6.281305] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    6.296327] Bluetooth: RFCOMM socket layer initialized
[    6.302431] Bluetooth: RFCOMM ver 1.11
[    6.307086] Bluetooth: HIDP (Human Interface Emulation) ver 1.2
[    6.313974] Bluetooth: HIDP socket layer initialized
[    6.320779] 9pnet: Installing 9P2000 support
[    6.326180] Key type dns_resolver registered
[    6.332677] registered taskstats version 1
[    6.337692] Loading compiled-in X.509 certificates
[    6.355163] Loaded X.509 cert 'Build time autogenerated kernel key: d94b64a20d69a5a32183bad4f211c4cae67041a9'
[    6.366793] tegra194-pcie 14100000.pcie: Adding to iommu group 9
[    6.380704] tegra194-pcie 14100000.pcie: Using GICv2m MSI allocator
[    6.389766] tegra194-pcie 14160000.pcie: Adding to iommu group 10
[    6.403457] tegra194-pcie 14160000.pcie: Using GICv2m MSI allocator
[    6.411186] tegra194-pcie 141a0000.pcie: Adding to iommu group 11
[    6.424241] tegra194-pcie 141a0000.pcie: Using GICv2m MSI allocator
[    6.431541] tegra194-pcie 141a0000.pcie: Failed to get slot regulators: -517
[    6.457053] tegra-soc-hwpm f100000.tegra_soc_hwpm: Adding to iommu group 12
[    6.472549] simple-framebuffer chosen:framebuffer: framebuffer at 0x839e00000, 0x870000 bytes, mapped to 0x(____ptrval____)
[    6.484823] simple-framebuffer chosen:framebuffer: format=x8r8g8b8, mode=1920x1080x32, linelength=8192
[    6.495193] checking generic (839e00000 870000) vs hw (839e00000 870000)
[    6.495197] fb0: switching to simple from EFI VGA
[    6.501890] Console: switching to colour dummy device 80x25
[    6.510781] Console: switching to colour frame buffer device 240x67
[    6.519974] simple-framebuffer chosen:framebuffer: fb0: simplefb registered!
[    6.527560] host1x 13e40000.host1x: Adding to iommu group 13
[    6.555029] host1x 13e40000.host1x: initialized
[    6.560171] iommu_context_dev 13e40000.host1x:niso0_ctx0: Adding to iommu group 14
[    6.568300] iommu_context_dev 13e40000.host1x:niso0_ctx0: initialized (streamid=53, iommu=smmu.0x0000000012000000)
[    6.580334] iommu_context_dev 13e40000.host1x:niso0_ctx1: Adding to iommu group 15
[    6.588382] iommu_context_dev 13e40000.host1x:niso0_ctx1: initialized (streamid=54, iommu=smmu.0x0000000012000000)
[    6.600388] iommu_context_dev 13e40000.host1x:niso0_ctx2: Adding to iommu group 16
[    6.608406] iommu_context_dev 13e40000.host1x:niso0_ctx2: initialized (streamid=55, iommu=smmu.0x0000000012000000)
[    6.620420] iommu_context_dev 13e40000.host1x:niso0_ctx3: Adding to iommu group 17
[    6.628430] iommu_context_dev 13e40000.host1x:niso0_ctx3: initialized (streamid=56, iommu=smmu.0x0000000012000000)
[    6.640445] iommu_context_dev 13e40000.host1x:niso0_ctx4: Adding to iommu group 18
[    6.648490] iommu_context_dev 13e40000.host1x:niso0_ctx4: initialized (streamid=57, iommu=smmu.0x0000000012000000)
[    6.660460] iommu_context_dev 13e40000.host1x:niso0_ctx5: Adding to iommu group 19
[    6.668484] iommu_context_dev 13e40000.host1x:niso0_ctx5: initialized (streamid=58, iommu=smmu.0x0000000012000000)
[    6.680502] iommu_context_dev 13e40000.host1x:niso0_ctx6: Adding to iommu group 20
[    6.688540] iommu_context_dev 13e40000.host1x:niso0_ctx6: initialized (streamid=59, iommu=smmu.0x0000000012000000)
[    6.700528] iommu_context_dev 13e40000.host1x:niso0_ctx7: Adding to iommu group 21
[    6.708584] iommu_context_dev 13e40000.host1x:niso0_ctx7: initialized (streamid=60, iommu=smmu.0x0000000012000000)
[    6.720636] iommu_context_dev 13e40000.host1x:niso1_ctx0: Adding to iommu group 22
[    6.728712] iommu_context_dev 13e40000.host1x:niso1_ctx0: initialized (streamid=53, iommu=smmu.0x0000000008000000)
[    6.740751] iommu_context_dev 13e40000.host1x:niso1_ctx1: Adding to iommu group 23
[    6.748768] iommu_context_dev 13e40000.host1x:niso1_ctx1: initialized (streamid=54, iommu=smmu.0x0000000008000000)
[    6.760753] iommu_context_dev 13e40000.host1x:niso1_ctx2: Adding to iommu group 24
[    6.768785] iommu_context_dev 13e40000.host1x:niso1_ctx2: initialized (streamid=55, iommu=smmu.0x0000000008000000)
[    6.780753] iommu_context_dev 13e40000.host1x:niso1_ctx3: Adding to iommu group 25
[    6.788785] iommu_context_dev 13e40000.host1x:niso1_ctx3: initialized (streamid=56, iommu=smmu.0x0000000008000000)
[    6.800790] iommu_context_dev 13e40000.host1x:niso1_ctx4: Adding to iommu group 26
[    6.808816] iommu_context_dev 13e40000.host1x:niso1_ctx4: initialized (streamid=57, iommu=smmu.0x0000000008000000)
[    6.820812] iommu_context_dev 13e40000.host1x:niso1_ctx5: Adding to iommu group 27
[    6.828849] iommu_context_dev 13e40000.host1x:niso1_ctx5: initialized (streamid=58, iommu=smmu.0x0000000008000000)
[    6.840845] iommu_context_dev 13e40000.host1x:niso1_ctx6: Adding to iommu group 28
[    6.848892] iommu_context_dev 13e40000.host1x:niso1_ctx6: initialized (streamid=59, iommu=smmu.0x0000000008000000)
[    6.860915] iommu_context_dev 13e40000.host1x:niso1_ctx7: Adding to iommu group 29
[    6.868960] iommu_context_dev 13e40000.host1x:niso1_ctx7: initialized (streamid=60, iommu=smmu.0x0000000008000000)
[    6.880994] falcon 15340000.vic: Adding to iommu group 30
[    6.891352] falcon 15340000.vic: initialized
[    6.896106] falcon 15380000.nvjpg: Adding to iommu group 31
[    6.905049] falcon 15380000.nvjpg: initialized
[    6.909774] falcon 15540000.nvjpg1: Adding to iommu group 32
[    6.918664] falcon 15540000.nvjpg1: initialized
[    6.923484] falcon 154c0000.nvenc: Adding to iommu group 33
[    6.933772] falcon 154c0000.nvenc: initialized
[    6.939204] falcon 15a50000.ofa: Adding to iommu group 34
[    6.948045] falcon 15a50000.ofa: initialized
[    6.953292] nvdec 15480000.nvdec: Adding to iommu group 35
[    6.965397] nvdec 15480000.nvdec: initialized
[    6.970712] tsec 15500000.tsec: Adding to iommu group 36
[    6.980859] tsec 15500000.tsec: initialized
[    6.988440] gic 2a41000.agic-controller: GIC IRQ controller registered
[    7.006875] tegra-aconnect aconnect@2a41000: Tegra ACONNECT bus registered
[    7.025286] gpio-394 (camera-control-output-low): hogged as output/low
[    7.032767] gpio-397 (camera-control-output-low): hogged as output/low
[    7.040232] gpio-487 (camera-control-output-low): hogged as output/low
[    7.047673] gpio-486 (camera-control-output-low): hogged as output/low
[    7.055798] gpiochip0: registered GPIOs 348 to 511 on tegra234-gpio
[    7.063615] gpiochip1: registered GPIOs 316 to 347 on tegra234-gpio-aon
[    7.071281] tegra-pwm 3280000.pwm: PWM clk can sleep in ops
[    7.078495] tegra-pwm 32a0000.pwm: PWM clk can sleep in ops
[    7.085600] tegra-pwm 32c0000.pwm: PWM clk can sleep in ops
[    7.092487] tegra-pwm 32f0000.pwm: PWM clk can sleep in ops
[    7.101089] misc tegra_camera_ctrl: tegra_camera_isomgr_register tpg_max_iso = 3916800KBs
[    7.110337] tegra194-isp5 14800000.isp: Adding to iommu group 37
[    7.120333] t194-nvcsi 13e40000.host1x:nvcsi@15a00000: context isolation disabled due to no IOMMU
[    7.130321] t194-nvcsi 13e40000.host1x:nvcsi@15a00000: initialized
[    7.137593] tegra194-vi5 13e40000.host1x:vi0@15c00000: Adding to iommu group 38
[    7.146365] tegra194-vi5 13e40000.host1x:vi1@14c00000: Adding to iommu group 39
[    7.155000] scare-pigeon 13e40000.host1x:vi0-thi@15f00000: context isolation disabled due to no IOMMU
[    7.165320] scare-pigeon 13e40000.host1x:vi0-thi@15f00000: initialized
[    7.172801] scare-pigeon 13e40000.host1x:vi1-thi@14f00000: context isolation disabled due to no IOMMU
[    7.183060] scare-pigeon 13e40000.host1x:vi1-thi@14f00000: initialized
[    7.190543] scare-pigeon 13e40000.host1x:isp-thi@14b00000: context isolation disabled due to no IOMMU
[    7.200832] scare-pigeon 13e40000.host1x:isp-thi@14b00000: initialized
[    7.208325] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx0: Adding to iommu group 40
[    7.217675] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx0: initialized (streamid=18, iommu=smmu.0x0000000008000000)
[    7.229726] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx1: Adding to iommu group 41
[    7.239041] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx1: initialized (streamid=19, iommu=smmu.0x0000000008000000)
[    7.251093] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx2: Adding to iommu group 42
[    7.260422] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx2: initialized (streamid=20, iommu=smmu.0x0000000008000000)
[    7.272484] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx3: Adding to iommu group 43
[    7.281842] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx3: initialized (streamid=21, iommu=smmu.0x0000000008000000)
[    7.293882] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx4: Adding to iommu group 44
[    7.303209] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx4: initialized (streamid=22, iommu=smmu.0x0000000008000000)
[    7.315231] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx5: Adding to iommu group 45
[    7.324557] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx5: initialized (streamid=23, iommu=smmu.0x0000000008000000)
[    7.336611] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx6: Adding to iommu group 46
[    7.345946] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx6: initialized (streamid=24, iommu=smmu.0x0000000008000000)
[    7.357984] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx7: Adding to iommu group 47
[    7.367298] pva_iommu_context_dev 16000000.pva0:pva0_niso1_ctx7: initialized (streamid=25, iommu=smmu.0x0000000008000000)
[    7.379347] pva 16000000.pva0: Adding to iommu group 48
[    7.403666] pva 16000000.pva0: initialized
[    7.416783] nvdla 15880000.nvdla0: Adding to iommu group 49
[    7.431465] nvdla 15880000.nvdla0: initialized
[    7.438427] nvdla 158c0000.nvdla1: Adding to iommu group 50
[    7.452588] nvdla 158c0000.nvdla1: initialized
[    7.459537] tegra-gpcdma 2600000.gpcdma: Adding to iommu group 2
[    7.467330] tegra-gpcdma 2600000.gpcdma: GPC DMA driver register 31 channels
[    7.475494] tegra-fuse-burn efuse-burn: shutdown limit check disabled
[    7.482792] tegra-fuse-burn efuse-burn: Fuse burn driver initialized
[    7.490193] serial-tegra 3100000.serial: Adding to iommu group 2
[    7.497459] 3100000.serial: ttyTHS0 at MMIO 0x3100000 (irq = 26, base_baud = 0) is a TEGRA_UART
[    7.507537] serial-tegra 3110000.serial: Adding to iommu group 2
[    7.514826] 3110000.serial: ttyTHS1 at MMIO 0x3110000 (irq = 78, base_baud = 0) is a TEGRA_UART
[    7.524785] serial-tegra 3130000.serial: Adding to iommu group 2
[    7.531991] 3130000.serial: ttyTHS3 at MMIO 0x3130000 (irq = 79, base_baud = 0) is a TEGRA_UART
[    7.557871] tegra-xusb 3610000.xhci: Firmware timestamp: 2023-02-10 03:48:10 UTC, Version: 80.05 release
[    7.568321] tegra-xusb 3610000.xhci: xHCI Host Controller
[    7.574593] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 1
[    7.583936] tegra-xusb 3610000.xhci: hcc params 0x0180ff05 hci version 0x120 quirks 0x0000000000050810
[    7.594251] tegra-xusb 3610000.xhci: irq 236, io mem 0x03610000
[    7.601396] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    7.610623] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.618783] usb usb1: Product: xHCI Host Controller
[    7.624518] usb usb1: Manufacturer: Linux 5.10.120-tegra xhci-hcd
[    7.631521] usb usb1: SerialNumber: 3610000.xhci
[    7.637364] hub 1-0:1.0: USB hub found
[    7.641983] hub 1-0:1.0: 4 ports detected
[    7.647054] tegra-xusb 3610000.xhci: xHCI Host Controller
[    7.653327] tegra-xusb 3610000.xhci: new USB bus registered, assigned bus number 2
[    7.661845] tegra-xusb 3610000.xhci: Host supports USB 3.1 Enhanced SuperSpeed
[    7.670108] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[    7.679358] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    7.687527] usb usb2: Product: xHCI Host Controller
[    7.693288] usb usb2: Manufacturer: Linux 5.10.120-tegra xhci-hcd
[    7.700310] usb usb2: SerialNumber: 3610000.xhci
[    7.705945] hub 2-0:1.0: USB hub found
[    7.710595] hub 2-0:1.0: 4 ports detected
[    7.736926] tegra23x-oc-event soctherm-oc-event: Finished tegra23x overcurrent event probing
[    7.763050] cpufreq: cpufreq_online: CPU0: Running at unlisted initial frequency: 2021000 KHz, changing to: 2035200 KHz
[    7.776678] cpufreq: cpufreq_online: CPU4: Running at unlisted initial frequency: 2010000 KHz, changing to: 2035200 KHz
[    7.789326] tegra194-cpufreq e000000.ccplex: probed with ICC, cl:3
[    7.797574] tegra194-pcie 14100000.pcie: Using GICv2m MSI allocator
[    7.803514] sdhci-tegra 3400000.sdhci: Got CD GPIO
[    7.806138] tegra194-pcie 14100000.pcie: host bridge /pcie@14100000 ranges:
[    7.807671] mmc0: CQHCI version 5.10
[    7.820083] irq: IRQ303: trimming hierarchy from :interrupt-controller@f400000-1
[    7.822615] tegra194-pcie 14100000.pcie:       IO 0x0030100000..0x00301fffff -> 0x0030100000
[    7.830976] sdhci-tegra 3400000.sdhci: wakeup init done, cdirq 303
[    7.835593] mmc0: SDHCI controller on 3460000.sdhci [3460000.sdhci] using ADMA 64-bit
[    7.840335] tegra194-pcie 14100000.pcie:      MEM 0x20a8000000..0x20afffffff -> 0x0040000000
[    7.865602] tegra194-pcie 14100000.pcie:      MEM 0x2080000000..0x20a7ffffff -> 0x2080000000
[    7.903831] usb 1-3: new full-speed USB device number 2 using tegra-xusb
[    7.924662] mmc0: Command Queue Engine enabled
[    7.929953] mmc0: periodic cache flush enabled
[    7.935229] mmc0: new HS400 Enhanced strobe MMC card at address 0001
[    7.942834] mmcblk0: mmc0:0001 G1M15M 59.3 GiB 
[    7.948276] mmcblk0rpmb: mmc0:0001 G1M15M partition 3 4.00 MiB, chardev (510:0)
[    7.965467]  mmcblk0: p1 p2 p3 p4 p5 p6 p7 p8 p9 p10 p11 p12 p13 p14 p15
[    7.979983] tegra194-pcie 14100000.pcie: Link up
[    7.986382] tegra194-pcie 14100000.pcie: PCI host bridge to bus 0001:00
[    7.993907] pci_bus 0001:00: root bus resource [bus 00-ff]
[    8.000254] pci_bus 0001:00: root bus resource [io  0x0000-0xfffff] (bus address [0x30100000-0x301fffff])
[    8.010816] pci_bus 0001:00: root bus resource [mem 0x20a8000000-0x20afffffff] (bus address [0x40000000-0x47ffffff])
[    8.022362] pci_bus 0001:00: root bus resource [mem 0x2080000000-0x20a7ffffff pref]
[    8.030996] pci 0001:00:00.0: [10de:229e] type 01 class 0x060400
[    8.038041] pci 0001:00:00.0: PME# supported from D0 D3hot
[    8.049360] pci 0001:01:00.0: [10ec:c822] type 00 class 0x028000
[    8.056417] pci 0001:01:00.0: reg 0x10: [io  0x0000-0x00ff]
[    8.063047] pci 0001:01:00.0: reg 0x18: [mem 0x20a8000000-0x20a800ffff 64bit]
[    8.072157] pci 0001:01:00.0: supports D1 D2
[    8.075960] usb 1-3: New USB device found, idVendor=13d3, idProduct=3549, bcdDevice= 0.00
[    8.077255] pci 0001:01:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    8.086392] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    8.098720] pci 0001:00:00.0: BAR 14: assigned [mem 0x20a8000000-0x20a80fffff]
[    8.101995] usb 1-3: Product: Bluetooth Radio
[    8.101997] usb 1-3: Manufacturer: Realtek
[    8.110164] pci 0001:00:00.0: BAR 13: assigned [io  0x1000-0x1fff]
[    8.115371] usb 1-3: SerialNumber: 00e04c000001
[    8.132764] pci 0001:01:00.0: BAR 2: assigned [mem 0x20a8000000-0x20a800ffff 64bit]
[    8.141462] pci 0001:01:00.0: BAR 0: assigned [io  0x1000-0x10ff]
[    8.148471] pci 0001:00:00.0: PCI bridge to [bus 01-ff]
[    8.154545] pci 0001:00:00.0:   bridge window [io  0x1000-0x1fff]
[    8.161514] pci 0001:00:00.0:   bridge window [mem 0x20a8000000-0x20a80fffff]
[    8.169556] pci 0001:00:00.0: Max Payload Size set to  128/ 256 (was  256), Max Read Rq  512
[    8.178996] pci 0001:01:00.0: Max Payload Size set to  128/ 128 (was  128), Max Read Rq  512
[    8.188669] pcieport 0001:00:00.0: Adding to iommu group 9
[    8.195278] pcieport 0001:00:00.0: PME: Signaling with IRQ 64
[    8.200703] usb 2-3: new SuperSpeedPlus Gen 2 USB device number 2 using tegra-xusb
[    8.202111] pcieport 0001:00:00.0: AER: enabled with IRQ 64
[    8.217630] tegra194-pcie 14160000.pcie: Using GICv2m MSI allocator
[    8.226801] tegra194-pcie 14160000.pcie: host bridge /pcie@14160000 ranges:
[    8.234659] tegra194-pcie 14160000.pcie:       IO 0x0036100000..0x00361fffff -> 0x0036100000
[    8.244026] tegra194-pcie 14160000.pcie:      MEM 0x2428000000..0x242fffffff -> 0x0040000000
[    8.246124] usb 2-3: New USB device found, idVendor=0bda, idProduct=0420, bcdDevice= 1.40
[    8.253388] tegra194-pcie 14160000.pcie:      MEM 0x2140000000..0x2427ffffff -> 0x2140000000
[    8.271938] usb 2-3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    8.279979] usb 2-3: Product: 4-Port USB 3.0 Hub
[    8.285421] usb 2-3: Manufacturer: Generic
[    8.299344] hub 2-3:1.0: USB hub found
[    8.305577] hub 2-3:1.0: 4 ports detected
[    8.363833] usb 1-4: new high-speed USB device number 3 using tegra-xusb
[    8.540908] usb 1-4: New USB device found, idVendor=0bda, idProduct=5420, bcdDevice= 1.40
[    8.550016] usb 1-4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    8.558055] usb 1-4: Product: 4-Port USB 2.0 Hub
[    8.563487] usb 1-4: Manufacturer: Generic
[    8.570461] hub 1-4:1.0: USB hub found
[    8.576301] hub 1-4:1.0: 4 ports detected
[    9.025688] usb 2-3.1: new SuperSpeed Gen 1 USB device number 3 using tegra-xusb
[    9.067858] usb 2-3.1: New USB device found, idVendor=0bda, idProduct=0411, bcdDevice= 0.01
[    9.077138] usb 2-3.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    9.085333] usb 2-3.1: Product: USB3.2 Hub
[    9.090234] usb 2-3.1: Manufacturer: Generic
[    9.102357] hub 2-3.1:1.0: USB hub found
[    9.108669] hub 2-3.1:1.0: 4 ports detected
[    9.279830] usb 1-4.1: new high-speed USB device number 4 using tegra-xusb
[    9.361286] tegra194-pcie 14160000.pcie: Phy link never came up
[    9.368080] tegra194-pcie 14160000.pcie: PCI host bridge to bus 0004:00
[    9.375534] pci_bus 0004:00: root bus resource [bus 00-ff]
[    9.381806] pci_bus 0004:00: root bus resource [io  0x100000-0x1fffff] (bus address [0x36100000-0x361fffff])
[    9.381807] pci_bus 0004:00: root bus resource [mem 0x2428000000-0x242fffffff] (bus address [0x40000000-0x47ffffff])
[    9.381810] pci_bus 0004:00: root bus resource [mem 0x2140000000-0x2427ffffff pref]
[    9.409608] usb 1-4.1: New USB device found, idVendor=0bda, idProduct=5411, bcdDevice= 0.01
[    9.412625] pci 0004:00:00.0: [10de:229c] type 01 class 0x060400
[    9.421823] usb 1-4.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    9.428830] pci 0004:00:00.0: PME# supported from D0 D3hot
[    9.436847] usb 1-4.1: Product: USB2.1 Hub
[    9.447993] usb 1-4.1: Manufacturer: Generic
[    9.451716] pci 0004:00:00.0: PCI bridge to [bus 01-ff]
[    9.456151] hub 1-4.1:1.0: USB hub found
[    9.459089] pci 0004:00:00.0: Max Payload Size set to  256/ 256 (was  256), Max Read Rq  512
[    9.466903] hub 1-4.1:1.0: 4 ports detected
[    9.473383] pcieport 0004:00:00.0: Adding to iommu group 10
[    9.484666] pcieport 0004:00:00.0: PME: Signaling with IRQ 66
[    9.491480] pcieport 0004:00:00.0: AER: enabled with IRQ 66
[    9.498084] pci_bus 0004:01: busn_res: [bus 01-ff] is released
[    9.504827] pci 0004:00:00.0: Removing from iommu group 10
[    9.511121] pci_bus 0004:00: busn_res: [bus 00-ff] is released
[    9.519100] tegra194-pcie 141a0000.pcie: Using GICv2m MSI allocator
[    9.524642] usb 2-3.1.1: new SuperSpeed Gen 1 USB device number 4 using tegra-xusb
[    9.526207] tegra194-pcie 141a0000.pcie: Failed to get slot regulators: -517
[    9.534725] vdd-3v3-pcie: supplied by vdd-3v3-sys
[    9.540404] avdd-cam-2v8: supplied by vdd-3v3-sys
[    9.545964] vdd-dp: supplied by vdd-3v3-sys
[    9.551051] vdd-3v3-sd: supplied by vdd-3v3-sys
[    9.556744] dsi-vdd-1v8-bl-en: supplied by vdd-1v8-sys
[    9.564217] tegra194-isp5 14800000.isp: initialized
[    9.564727] usb 2-3.1.1: New USB device found, idVendor=0bda, idProduct=0411, bcdDevice= 0.02
[    9.571778] tegra194-vi5 13e40000.host1x:vi0@15c00000: initialized
[    9.579265] usb 2-3.1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    9.579266] usb 2-3.1.1: Product: USB3.2 Hub
[    9.579266] usb 2-3.1.1: Manufacturer: Generic
[    9.589328] hub 2-3.1.1:1.0: USB hub found
[    9.594711] (NULL device *): fops function table already registered
[    9.602188] hub 2-3.1.1:1.0: 4 ports detected
[    9.605762] tegra194-vi5 13e40000.host1x:vi1@14c00000: initialized
[    9.629482] sdhci-tegra 3400000.sdhci: Got CD GPIO
[    9.629529] tegra194-pcie 141a0000.pcie: Using GICv2m MSI allocator
[    9.644153] sdhci-tegra 3400000.sdhci: wakeup init done, cdirq 303
[    9.749412] tegra194-pcie 141a0000.pcie: host bridge /pcie@141a0000 ranges:
[    9.757235] tegra194-pcie 141a0000.pcie:       IO 0x003a100000..0x003a1fffff -> 0x003a100000
[    9.763833] usb 1-4.1.1: new high-speed USB device number 5 using tegra-xusb
[    9.766593] tegra194-pcie 141a0000.pcie:      MEM 0x2b28000000..0x2b2fffffff -> 0x0040000000
[    9.783827] tegra194-pcie 141a0000.pcie:      MEM 0x2740000000..0x2b27ffffff -> 0x2740000000
[    9.889179] usb 1-4.1.1: New USB device found, idVendor=0bda, idProduct=5411, bcdDevice= 0.02
[    9.898591] usb 1-4.1.1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    9.899978] tegra194-pcie 141a0000.pcie: Link up
[    9.906942] usb 1-4.1.1: Product: USB2.1 Hub
[    9.906945] usb 1-4.1.1: Manufacturer: Generic
[    9.913371] tegra194-pcie 141a0000.pcie: PCI host bridge to bus 0005:00
[    9.918155] random: crng init done
[    9.922624] pci_bus 0005:00: root bus resource [bus 00-ff]
[    9.922626] pci_bus 0005:00: root bus resource [io  0x200000-0x2fffff] (bus address [0x3a100000-0x3a1fffff])
[    9.922628] pci_bus 0005:00: root bus resource [mem 0x2b28000000-0x2b2fffffff] (bus address [0x40000000-0x47ffffff])
[    9.922629] pci_bus 0005:00: root bus resource [mem 0x2740000000-0x2b27ffffff pref]
[    9.922668] pci 0005:00:00.0: [10de:229a] type 01 class 0x060400
[    9.922677] hub 1-4.1.1:1.0: USB hub found
[    9.930139] hub 1-4.1.1:1.0: 4 ports detected
[    9.934389] pci 0005:00:00.0: PME# supported from D0 D3hot
[    9.999289] pci 0005:01:00.0: [10ee:b03f] type 00 class 0x058000
[   10.006280] pci 0005:01:00.0: reg 0x10: [mem 0x00000000-0x0000ffff 64bit]
[   10.013973] pci 0005:01:00.0: reg 0x18: [mem 0x00000000-0x0001ffff]
[   10.022133] pci 0005:01:00.0: supports D1
[   10.026904] pci 0005:01:00.0: PME# supported from D0 D1 D3hot D3cold
[   10.038791] pci 0005:00:00.0: BAR 14: assigned [mem 0x2b28000000-0x2b280fffff]
[   10.046884] pci 0005:01:00.0: BAR 2: assigned [mem 0x2b28000000-0x2b2801ffff]
[   10.054908] pci 0005:01:00.0: BAR 0: assigned [mem 0x2b28020000-0x2b2802ffff 64bit]
[   10.063508] pci 0005:00:00.0: PCI bridge to [bus 01-ff]
[   10.069525] pci 0005:00:00.0:   bridge window [mem 0x2b28000000-0x2b280fffff]
[   10.077521] pci 0005:00:00.0: Max Payload Size set to  256/ 256 (was  256), Max Read Rq  512
[   10.086901] pci 0005:01:00.0: Max Payload Size set to  256/ 512 (was  128), Max Read Rq  512
[   10.096488] pcieport 0005:00:00.0: Adding to iommu group 11
[   10.103100] pcieport 0005:00:00.0: PME: Signaling with IRQ 68
[   10.109889] pcieport 0005:00:00.0: AER: enabled with IRQ 68
[   10.117297] nvethernet 6810000.ethernet: Adding to iommu group 51
[   10.124573] nvethernet 6810000.ethernet: failed to read skip mac reset flag, default 0
[   10.133379] nvethernet 6810000.ethernet: failed to read MDIO address
[   10.140561] nvethernet 6810000.ethernet: setting to default DMA bit mask
[   10.148103] nvethernet 6810000.ethernet: failed to read UPHY GBE mode- default to 10G
[   10.235828] usb 1-4.1.1.2: new full-speed USB device number 6 using tegra-xusb
[   10.358921] usb 1-4.1.1.2: New USB device found, idVendor=413c, idProduct=2101, bcdDevice= 2.01
[   10.368505] usb 1-4.1.1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[   10.377015] usb 1-4.1.1.2: Product: Dell Smart Card Reader Keyboard
[   10.384096] usb 1-4.1.1.2: Manufacturer: Dell
[   10.394882] input: Dell Dell Smart Card Reader Keyboard as /devices/platform/3610000.xhci/usb1/1-4/1-4.1/1-4.1.1/1-4.1.1.2/1-4.1.1.2:1.0/0003:413C:2101.0001/input/input0
[   10.468279] hid-generic 0003:413C:2101.0001: input,hidraw0: USB HID v1.11 Keyboard [Dell Dell Smart Card Reader Keyboard] on usb-3610000.xhci-4.1.1.2/input0
[   10.539774] nvethernet 6810000.ethernet: Ethernet MAC address: 48:b0:2d:94:80:7b
[   10.548467] -->macsec_probe()
[   10.548489] nvethernet 6810000.ethernet: macsec param in DT is missing or disabled
[   10.556946] <--macsec_probe()
[   10.556948] nvethernet 6810000.ethernet: Macsec not supported/Not enabled in DT
[   10.563977] usb 1-4.1.1.3: new low-speed USB device number 7 using tegra-xusb
[   10.567090] nvethernet 6810000.ethernet: eth0 (HW ver: 31) created with 10 DMA channels
[   10.582732] irq: IRQ305: trimming hierarchy from :pmc@c360000
[   10.589436] irq: IRQ306: trimming hierarchy from :interrupt-controller@f400000-1
[   10.597843] irq: IRQ307: trimming hierarchy from :pmc@c360000
[   10.604502] input: gpio-keys as /devices/platform/gpio-keys/input/input1
[   10.612443] tegra-se-nvhost 15810000.se: Adding to iommu group 52
[   10.619708] tegra-se-nvhost 15810000.se: initialized
[   10.636194] tegra-se-nvhost 15810000.se: tegra_se_probe: complete
[   10.643246] tegra-se-nvhost 15820000.se: Adding to iommu group 53
[   10.650464] tegra-se-nvhost 15820000.se: initialized
[   10.658566] tegra-se-nvhost 15820000.se: tegra_se_probe: complete
[   10.665646] tegra-se-nvhost 15840000.se: Adding to iommu group 54
[   10.673165] tegra-se-nvhost 15840000.se: initialized
[   10.682935] tegra-se-nvhost 15840000.se: tegra_se_probe: complete
[   10.683896] mmc1: SDHCI controller on 3400000.sdhci [3400000.sdhci] using ADMA 64-bit
[   10.690561] tegra_actmon d230000.actmon: in actmon_register()...
[   10.705760] tegra_actmon d230000.actmon: bwmgr_disable = 1
[   10.713475] tegra_actmon d230000.actmon: initialization Completed for the device mc_all
[   10.722570] hvc_sysfs: hypervisor is not present
[   10.724423] usb 1-4.1.1.3: New USB device found, idVendor=0461, idProduct=4d51, bcdDevice= 7.17
[   10.737596] usb 1-4.1.1.3: New USB device strings: Mfr=0, Product=2, SerialNumber=0
[   10.746116] usb 1-4.1.1.3: Product: DELL Laser Mouse
[   10.757310] input: DELL Laser Mouse as /devices/platform/3610000.xhci/usb1/1-4/1-4.1/1-4.1.1/1-4.1.1.3/1-4.1.1.3:1.0/0003:0461:4D51.0002/input/input2
[   10.771863] hid-generic 0003:0461:4D51.0002: input,hidraw1: USB HID v1.11 Mouse [DELL Laser Mouse] on usb-3610000.xhci-4.1.1.3/input0
[   10.854876] ALSA device list:
[   10.858657]   No soundcards found.
[   10.863446] Freeing unused kernel memory: 3968K
[   10.868834] Run /init as init process
[   10.873275]   with arguments:
[   10.873276]     /init
[   10.873277]     nv-auto-config
[   10.873278]   with environment:
[   10.873278]     HOME=/
[   10.873279]     TERM=linux
[   10.873280]     mminit_loglevel=4
[   10.884908] Root device found: mmcblk0p1
[   10.895243] Found dev node: /dev/mmcblk0p1
[   10.926262] EXT4-fs (mmcblk0p1): mounted filesystem with ordered data mode. Opts: (null)
[   10.945078] Rootfs mounted over mmcblk0p1
[   10.960826] Switching from initrd to actual rootfs
[   11.092961] systemd[1]: System time before build time, advancing clock.
[   11.140968] systemd[1]: systemd 245.4-4ubuntu3.21 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[   11.166147] systemd[1]: Detected architecture arm64.
[   11.213598] systemd[1]: Set hostname to <ubuntu>.
[   11.398611] systemd[1]: system-modprobe.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[   11.412477] systemd[1]: (This warning is only shown for the first unit using IP firewalling.)
[   11.422980] systemd[1]: Created slice system-modprobe.slice.
[   11.430918] systemd[1]: Created slice system-serial\x2dgetty.slice.
[   11.439369] systemd[1]: Created slice User and Session Slice.
[   11.447042] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[   11.456806] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[   11.468303] systemd[1]: Reached target User and Group Name Lookups.
[   11.476519] systemd[1]: Reached target Slices.
[   11.482832] systemd[1]: Reached target Mounting snaps.
[   11.489814] systemd[1]: Reached target Mounted snaps.
[   11.496677] systemd[1]: Reached target Swap.
[   11.502935] systemd[1]: Listening on RPCbind Server Activation Socket.
[   11.511402] systemd[1]: Listening on Syslog Socket.
[   11.518184] systemd[1]: Listening on fsck to fsckd communication Socket.
[   11.526817] systemd[1]: Listening on initctl Compatibility Named Pipe.
[   11.535408] systemd[1]: Listening on Journal Audit Socket.
[   11.542855] systemd[1]: Listening on Journal Socket (/dev/log).
[   11.550782] systemd[1]: Listening on Journal Socket.
[   11.557734] systemd[1]: Listening on udev Control Socket.
[   11.565102] systemd[1]: Listening on udev Kernel Socket.
[   11.573433] systemd[1]: Mounting Huge Pages File System...
[   11.581840] systemd[1]: Mounting POSIX Message Queue File System...
[   11.590960] systemd[1]: Mounting RPC Pipe File System...
[   11.599118] systemd[1]: Mounting Kernel Debug File System...
[   11.607645] systemd[1]: Mounting Kernel Trace File System...
[   11.616458] systemd[1]: Starting Journal Service...
[   11.624449] systemd[1]: Starting Set the console keyboard layout...
[   11.633628] systemd[1]: Starting Create list of static device nodes for the current kernel...
[   11.645161] systemd[1]: Starting Load Kernel Module chromeos_pstore...
[   11.653838] systemd[1]: Condition check resulted in Load Kernel Module drm being skipped.
[   11.654801] systemd[1]: Starting Load Kernel Module efi_pstore...
[   11.672513] systemd[1]: Starting Load Kernel Module pstore_blk...
[   11.681401] systemd[1]: Starting Load Kernel Module pstore_zone...
[   11.690347] systemd[1]: Starting Load Kernel Module ramoops...
[   11.699048] systemd[1]: Starting NVIDIA specific first-boot udev script...
[   11.708883] systemd[1]: Started Nameserver information manager.
[   11.716787] systemd[1]: Reached target Network (Pre).
[   11.725846] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[   11.736011] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[   11.753959] systemd[1]: Starting Load Kernel Modules...
[   11.761892] systemd[1]: Starting Remount Root and Kernel File Systems...
[   11.770088] EXT4-fs (mmcblk0p1): re-mounted. Opts: (null)
[   11.770579] nvmap_heap_init: nvmap_heap_init: created heap block cache
[   11.784427] tegra-carveouts tegra-carveouts: fsi :dma coherent mem declare 0x0000000838e00000,16777216
[   11.785516] systemd[1]: Starting udev Coldplug all Devices...
[   11.794779] tegra-carveouts tegra-carveouts: assigned reserved memory node fsi-carveout
[   11.810458] tegra-carveouts tegra-carveouts: vpr :dma coherent mem declare 0x0000000849800000,914358272
[   11.820883] tegra-carveouts tegra-carveouts: assigned reserved memory node vpr-carveout
[   11.820890] nvmap_page_pool_init: Total RAM pages: 7831812
[   11.836317] nvmap_page_pool_init: nvmap page pool size: 978976 pages (3824 MB)
[   11.836350] nvmap_background_zero_thread: PP zeroing thread starting.
[   11.836444] misc nvmap: created heap vpr base 0x0000000849800000 size (892928KiB)
[   11.839442] misc nvmap: created heap fsi base 0x0000000838e00000 size (16384KiB)
[   11.871518] systemd[1]: Started Journal Service.
[   11.896142] nvgpu: 17000000.ga10b          nvgpu_nvhost_syncpt_init:135  [INFO]  syncpt_unit_base 60000000 syncpt_unit_size 4000000 size 10000

[   11.930482] systemd-journald[277]: Received client request to flush runtime journal.
[   12.214701] using random self ethernet address
[   12.221415] using random host ethernet address
[   12.340622] spi-tegra114 3210000.spi: Adding to iommu group 2
[   12.345866] spi-tegra114 3230000.spi: Adding to iommu group 2
[   12.364250] nvidia: loading out-of-tree module taints kernel.
[   12.372123] tegra-adma 2930000.adma: Tegra210 ADMA driver registered 16 channels
[   12.376521] nv_platform 13800000.display: Adding to iommu group 55
[   12.377914] platform 13800000.display:nvdisplay-niso: Adding to iommu group 56
[   12.378602] cpu-throttle-alert cooling device registered.
[   12.378686] gpu-throttle-alert cooling device registered.
[   12.378745] cv0-throttle-alert cooling device registered.
[   12.378805] cv1-throttle-alert cooling device registered.
[   12.378856] cv2-throttle-alert cooling device registered.
[   12.378913] soc0-throttle-alert cooling device registered.
[   12.378960] soc1-throttle-alert cooling device registered.
[   12.379032] soc2-throttle-alert cooling device registered.
[   12.379135] hot-surface-alert cooling device registered.
[   12.380608] NVRM: loading NVIDIA UNIX Open Kernel Module for aarch64  35.4.1  Release Build  (buildbrain@mobile-u64-6422-d7000)  Tue Aug  1 12:45:41 PDT 2023
[   12.381551] irq: IRQ308: trimming hierarchy from :pmc@c360000
[   12.442331] nvvrs11 4-0020: NVVRS11 Vendor ID: 0x11 
[   12.442646] nvvrs11 4-0020: NVVRS11 Model Rev: 0x81
[   12.442650] nvvrs11 4-0020: NVVRS11 probe successful
[   12.442909] irq: IRQ309: trimming hierarchy from :pmc@c360000
[   12.442916] nct1008_nct72 4-004c: starting parse dt
[   12.442971] nct1008_nct72 4-004c: !!!Found deprecated property!!!
[   12.442973] nct1008_nct72 4-004c: success parsing dt
[   12.443023] nvvrs11 4-0022: NVVRS11 Vendor ID: 0x11 
[   12.443045] nct1008_nct72 4-004c: success in enabling tmp451 VDD rail
[   12.443273] nvvrs11 4-0022: NVVRS11 Model Rev: 0x81
[   12.443275] nvvrs11 4-0022: NVVRS11 probe successful
[   12.444892] tegra-hda 3510000.hda: Adding to iommu group 57
[   12.479329] nct1008_nct72 4-004c: LOC shutdown limit 107
[   12.479950] nct1008_nct72 4-004c: EXT shutdown limit 107
[   12.483102] nvadsp 2993000.adsp: Adding to iommu group 58
[   12.483219] nvadsp 2993000.adsp: in probe()...
[   12.483781] nvadsp 2993000.adsp: nvadsp_app_module_probe
[   12.516349] nct1008_nct72 4-004c: initial LOC temp: 33000 
[   12.516829] nct1008_nct72 4-004c: initial EXT temp: 34750 
[   12.517764] nct1008_nct72 4-004c: hi_b:-4, lo_b:0
[   12.518510] nct1008_nct72 4-004c: nct1008_probe: initialized
[   12.532601] input: NVIDIA Jetson AGX Orin HDA HDMI/DP,pcm=3 as /devices/platform/3510000.hda/sound/card0/input3
[   12.532765] input: NVIDIA Jetson AGX Orin HDA HDMI/DP,pcm=7 as /devices/platform/3510000.hda/sound/card0/input4
[   12.532854] input: NVIDIA Jetson AGX Orin HDA HDMI/DP,pcm=8 as /devices/platform/3510000.hda/sound/card0/input5
[   12.532989] input: NVIDIA Jetson AGX Orin HDA HDMI/DP,pcm=9 as /devices/platform/3510000.hda/sound/card0/input6
[   12.561030] irq: IRQ311: trimming hierarchy from :pmc@c360000
[   12.572320] loop: module loaded
[   12.576606] tegra-asoc: sound: Adding to iommu group 58
[   12.591435] OF: graph: no port node found in /i2c@c240000/ucsi_ccg@8/connector@0
[   12.599667] ucsi_ccg 1-0008: Port-0: no role switch found
[   12.607624] tegra210-adsp aconnect@2a41000:adsp_audio: Adding to iommu group 58
[   12.607645] tegra210_adsp_audio_probe: platform probe started
[   12.608595] tegra210-adsp tegra210-adsp: Default param-type to BYTE for mp3-dec1
[   12.609128] tegra210-adsp tegra210-adsp: Default param-type to BYTE for spkprot
[   12.609358] tegra210-adsp tegra210-adsp: Default param-type to BYTE for src
[   12.609610] tegra210-adsp tegra210-adsp: Default param-type to BYTE for aac-dec1
[   12.609845] tegra210-adsp tegra210-adsp: Default param-type to BYTE for aec
[   12.610067] tegra210-adsp tegra210-adsp: Default param-type to BYTE for wire
[   12.610070] tegra210-adsp tegra210-adsp: adma channel page address dt entry not found
[   12.610071] tegra210-adsp tegra210-adsp: using adma channel page 0
[   12.610122] nvadsp 2993000.adsp: ADSP OS firmware already loaded
[   12.623319] cdi_tsc c6a0000.tsc_sig_gen: CDI TSC probing...
[   12.623389] cdi_tsc_probe: Initializing the driver
[   12.624016] cdi_tsc_probe: Successfully initialized the tsc char driver
[   12.666902] usbcore: registered new interface driver btusb
[   12.677674] rtl88x2ce 0001:01:00.0: Adding to iommu group 9
[   12.677987] rtl88x2ce 0001:01:00.0: enabling device (0000 -> 0003)
[   12.680908] cryptd: max_cpu_qlen set to 1000
[   12.683856] OF: graph: no port node found in /i2c@c240000/ucsi_ccg@8/connector@0
[   12.692056] OF: graph: no port node found in /i2c@c240000/ucsi_ccg@8/connector@0
[   12.700485] rtk_btusb: Realtek Bluetooth USB driver ver 3.1
[   12.700490] rtk_btcoex: rtk_btcoex_init: version: 1.2
[   12.700491] rtk_btcoex: create workqueue
[   12.700563] rtk_btcoex: alloc buffers 1792, 2432 for ev and l2
[   12.700605] rtk_btusb: btusb_probe intf->cur_altsetting->desc.bInterfaceNumber 0
[   12.700606] rtk_btusb: btusb_probe can_wakeup 1, may wakeup 0
[   12.700607] rtk_btusb: patch_add
[   12.700609] rtk_btusb: auto suspend is disabled
[   12.700611] rtk_btusb: pid = 0x3549
[   12.700612] rtk_btusb: patch_add: Reset gEVersion to 0xff
[   12.700618] rtk_btusb: set_bit(HCI_QUIRK_RESET_ON_CLOSE, &hdev->quirks);
[   12.702153] rtk_btusb: btusb_probe: done
[   12.702202] rtk_btusb: btusb_open start
[   12.702205] rtk_btusb: btusb_open hdev->promisc ==0
[   12.702206] rtk_btusb: download_patch start
[   12.702208] rtk_btusb: chip type value: 0x73
[   12.702211] rtk_btusb: HCI reset.
[   12.703281] usbcore: registered new interface driver rtk_btusb
[   12.713093] rtk_btusb: read_ver_rsp->lmp_subver = 0x8822
[   12.713100] rtk_btusb: read_ver_rsp->hci_rev = 0xc
[   12.713102] rtk_btusb: patch_entry->lmp_sub = 0x8822
[   12.713104] rtk_btusb: load_firmware start
[   12.713105] rtk_btusb: lmp_version = 0x8822
[   12.713107] rtk_btusb: config filename rtl8822cu_config
[   12.720649] rtk_btusb: no bdaddr file /opt/bdaddr
[   12.720656] rtk_btusb: 55 ab 23 87 00 00
[   12.720664] rtk_btusb: Config file length 6, new length 6
[   12.720666] rtk_btusb: fw name is  rtl8822cu_fw
[   12.724256] rtk_btusb: This is not 8723a, use new patch style!
[   12.724262] rtk_btusb: rtk_get_eversion: gEVersion 255
[   12.726071] rtk_btusb: eversion->status = 0x0, eversion->version = 0x3
[   12.726078] rtk_btusb: load_firmware: New gEVersion 3
[   12.726081] rtk_btusb: rtk_get_fw_project_id: opcode 0, len 1, data 13
[   12.726083] rtk_btusb: lmp_version is 8822, project_id is 8822, match!
[   12.726084] rtk_btusb: fw_version = 0x9a8cbc9
[   12.726085] rtk_btusb: number_of_total_patch = 3
[   12.726086] rtk_btusb: chipID 4
[   12.726087] rtk_btusb: patch_length 0x8590
[   12.726088] rtk_btusb: start_offset 0x00005d00
[   12.726089] rtk_btusb: Svn version: 1940234490
[   12.726090] rtk_btusb: Coexistence: BTCOEX_20210106-2020
[   12.726091] rtk_btusb: buf_len = 0x8596
[   12.726101] rtk_btusb: fw: exists, config file: exists
[   12.726102] rtk_btusb: load_firmware done
[   12.726114] rtk_btusb: download_data start
[   12.899085] rtk_btusb: download_data done
[   12.899091] rtk_btusb: HCI reset.
[   12.910068] rtk_btusb: read_ver_rsp->lmp_subver = 0xcbc9
[   12.910074] rtk_btusb: read_ver_rsp->hci_rev = 0x9a8
[   12.910076] rtk_btusb: patch_entry->lmp_sub = 0x8822
[   12.910084] rtk_btusb: Rtk patch end 0
[   12.910087] rtk_btusb: btusb_open set HCI_RUNNING
[   12.910108] rtk_btcoex: Open BTCOEX
[   12.910110] rtk_btusb: btusb_open end
[   12.912044] tegra210-adsp tegra210-adsp: Loaded app wire
[   12.912050] tegra210-adsp tegra210-adsp: Loaded app apm
[   12.912052] tegra210-adsp tegra210-adsp: Loaded app adma
[   12.912054] tegra210-adsp tegra210-adsp: Loaded app adma_tx
[   12.912058] nvadsp_set_adma_dump_reg: callback for adma reg dump is sent to 0000000068b37f53
[   12.912085] rtk_btcoex: BTCOEX hci_rev 0x09a8
[   12.912087] rtk_btcoex: BTCOEX lmp_subver 0xcbc9
[   12.914877] Mass Storage Function, version: 2009/09/11
[   12.914885] LUN: removable file: (no medium)
[   12.917621] using random self ethernet address
[   12.923186] using random host ethernet address
[   12.938055] tegra210-adsp tegra210-adsp: Tegra210 ADSP driver successfully registered
[   12.941108] rtk_btusb: btusb_notify: hci0 evt 3
[   12.945689] rndis0: HOST MAC fe:1c:1f:a3:d4:08
[   12.945694] rndis0: MAC fe:1c:1f:a3:d4:09
[   12.946183] usb0: HOST MAC fe:1c:1f:a3:d4:0a
[   12.946187] usb0: MAC fe:1c:1f:a3:d4:0b
[   12.947012] tegra-xudc 3550000.xudc: EP 0 (type: ctrl, dir: out) enabled
[   12.950035] l4tbr0: port 1(rndis0) entered blocking state
[   12.950047] l4tbr0: port 1(rndis0) entered disabled state
[   12.950192] device rndis0 entered promiscuous mode
[   12.956833] input: NVIDIA Jetson AGX Orin APE Headset Jack as /devices/platform/sound/sound/card1/input7
[   12.968384] l4tbr0: port 2(usb0) entered blocking state
[   12.968397] l4tbr0: port 2(usb0) entered disabled state
[   12.968570] device usb0 entered promiscuous mode
[   13.945141] pstore: Using crash dump compression: deflate
[   13.945194] printk: console [ramoops-1] enabled
[   13.945196] pstore: Registered ramoops as persistent store backend
[   13.945198] ramoops: using 0x200000@0x82d270000, ecc: 0
[   13.962201] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[   13.962216] Bluetooth: BNEP socket layer initialized
[   14.234098] nvgpu: 17000000.ga10b                  gk20a_scale_init:541  [INFO]  enabled scaling for GPU

[   14.838006] irq: IRQ313: trimming hierarchy from :interrupt-controller@f400000-1
[   14.838571] hwmon hwmon6: temp1_input not attached to any thermal zone
[   15.137121] Aquantia AQR113C 6810000.ethernet:00: No AQR phy_mode setting in DT
[   15.457396] zram: Added device: zram0
[   15.458672] zram: Added device: zram1
[   15.458903] zram: Added device: zram2
[   15.459080] zram: Added device: zram3
[   15.459284] zram: Added device: zram4
[   15.459438] zram: Added device: zram5
[   15.459585] zram: Added device: zram6
[   15.459705] zram: Added device: zram7
[   15.523593] zram0: detected capacity change from 0 to 2004946944
[   15.611974] Adding 1957952k swap on /dev/zram0.  Priority:5 extents:1 across:1957952k SS
[   15.615403] zram1: detected capacity change from 0 to 2004946944
[   15.644004] Adding 1957952k swap on /dev/zram1.  Priority:5 extents:1 across:1957952k SS
[   15.646974] zram2: detected capacity change from 0 to 2004946944
[   15.687896] Adding 1957952k swap on /dev/zram2.  Priority:5 extents:1 across:1957952k SS
[   15.689927] zram3: detected capacity change from 0 to 2004946944
[   15.732011] Adding 1957952k swap on /dev/zram3.  Priority:5 extents:1 across:1957952k SS
[   15.734065] zram4: detected capacity change from 0 to 2004946944
[   15.783916] Adding 1957952k swap on /dev/zram4.  Priority:5 extents:1 across:1957952k SS
[   15.785870] zram5: detected capacity change from 0 to 2004946944
[   15.823994] Adding 1957952k swap on /dev/zram5.  Priority:5 extents:1 across:1957952k SS
[   15.826060] zram6: detected capacity change from 0 to 2004946944
[   15.867933] Adding 1957952k swap on /dev/zram6.  Priority:5 extents:1 across:1957952k SS
[   15.869971] zram7: detected capacity change from 0 to 2004946944
[   15.920028] Adding 1957952k swap on /dev/zram7.  Priority:5 extents:1 across:1957952k SS
[   16.206959] Bridge firewalling registered
[   16.452877] fuse: init (API version 7.32)
[   16.735304] nvidia-modeset: Loading NVIDIA UNIX Open Kernel Mode Setting Driver for aarch64  35.4.1  Release Build  (buildbrain@mobile-u64-6422-d7000)  Tue Aug  1 12:45:42 PDT 2023
[   23.241690] nvethernet 6810000.ethernet: [xpcs_lane_bring_up][477][type:0x4][loga-0x0] PCS block lock SUCCESS
[   23.241764] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   23.242247] nvethernet 6810000.ethernet eth0: Link is Up - 1Gbps/Full - flow control rx/tx
[   24.466145] pwm-tegra-tachometer 39c0000.tachometer: Tachometer Overflow is detected
[   42.431881] vdd-12v-sys: disabling
[   42.431898] vdd-3v3-ftdi: disabling
[  226.002525] picoevb_rdma: module verification failed: signature and/or required key missing - tainting kernel
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ lspci -v
0001:00:00.0 PCI bridge: NVIDIA Corporation Device 229e (rev a1) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 64
	Bus: primary=00, secondary=01, subordinate=ff, sec-latency=0
	I/O behind bridge: 00001000-00001fff [size=4K]
	Memory behind bridge: 40000000-400fffff [size=1M]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: <access denied>
	Kernel driver in use: pcieport

0001:01:00.0 Network controller: Realtek Semiconductor Co., Ltd. RTL8822CE 802.11ac PCIe Wireless Network Adapter
	Subsystem: AzureWave RTL8822CE 802.11ac PCIe Wireless Network Adapter
	Flags: bus master, fast devsel, latency 0, IRQ 312
	I/O ports at 1000 [size=256]
	Memory at 20a8000000 (64-bit, non-prefetchable) [size=64K]
	Capabilities: <access denied>
	Kernel driver in use: rtl88x2ce
	Kernel modules: rtl8822ce

0005:00:00.0 PCI bridge: NVIDIA Corporation Device 229a (rev a1) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 68
	Bus: primary=00, secondary=01, subordinate=ff, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: 40000000-400fffff [size=1M]
	Prefetchable memory behind bridge: [disabled]
	Capabilities: <access denied>
	Kernel driver in use: pcieport

0005:01:00.0 Memory controller: Xilinx Corporation Device b03f
	Subsystem: Xilinx Corporation Device 0007
	Flags: fast devsel
	Memory at 2b28020000 (64-bit, non-prefetchable) [disabled] [size=64K]
	Memory at 2b28000000 (32-bit, non-prefetchable) [disabled] [size=128K]
	Capabilities: <access denied>

Below is the output of ‘sudo lspci’, ‘sudo lspci -tv’, and ‘sudo lspci -vv’ for additional reference:

user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo lspci
[sudo] password for user: 
0001:00:00.0 PCI bridge: NVIDIA Corporation Device 229e (rev a1)
0001:01:00.0 Network controller: Realtek Semiconductor Co., Ltd. RTL8822CE 802.11ac PCIe Wireless Network Adapter
0005:00:00.0 PCI bridge: NVIDIA Corporation Device 229a (rev a1)
0005:01:00.0 Memory controller: Xilinx Corporation Device b03f
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ 
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ 
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo lspci -tv
-+-[0005:00]---00.0-[01-ff]----00.0  Xilinx Corporation Device b03f
 +-[0001:00]---00.0-[01-ff]----00.0  Realtek Semiconductor Co., Ltd. RTL8822CE 802.11ac PCIe Wireless Network Adapter
 \-[0000:00]-
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ 
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ 
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo lspci -vv
0001:00:00.0 PCI bridge: NVIDIA Corporation Device 229e (rev a1) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 64
	Bus: primary=00, secondary=01, subordinate=ff, sec-latency=0
	I/O behind bridge: 00001000-00001fff [size=4K]
	Memory behind bridge: 40000000-400fffff [size=1M]
	Prefetchable memory behind bridge: [disabled]
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [70] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0
			ExtTag- RBE+
		DevCtl:	CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr+ TransPend-
		LnkCap:	Port #0, Speed 16GT/s, Width x1, ASPM not supported
			ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt+ AutBWInt-
		LnkSta:	Speed 2.5GT/s (downgraded), Width x1 (ok)
			TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
		RootCap: CRSVisible+
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible+
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, NROPrPrP+, LTR+
			 10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
			 EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
			 FRS-, LN System CLS Not Supported, TPHComp-, ExtTPHComp-, ARIFwd+
			 AtomicOpsCap: Routing- 32bit- 64bit- 128bitCAS-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled ARIFwd-
			 AtomicOpsCtl: ReqEn- EgressBlck-
		LnkCtl2: Target Link Speed: 16GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [b0] MSI-X: Enable- Count=1 Masked-
		Vector table: BAR=0 offset=00000000
		PBA: BAR=0 offset=00000000
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		AERCap:	First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
			MultHdrRecCap+ MultHdrRecEn- TLPPfxPres- HdrLogCap-
		HeaderLog: 00000000 00000000 00000000 00000000
		RootCmd: CERptEn+ NFERptEn+ FERptEn+
		RootSta: CERcvd- MultCERcvd- UERcvd- MultUERcvd-
			 FirstFatal- NonFatalMsg- FatalMsg- IntMsg 0
		ErrorSrc: ERR_COR: 0000 ERR_FATAL/NONFATAL: 0000
	Capabilities: [148 v1] Secondary PCI Express
		LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
		LaneErrStat: 0
	Capabilities: [158 v1] Physical Layer 16.0 GT/s <?>
	Capabilities: [17c v1] Lane Margining at the Receiver <?>
	Capabilities: [190 v1] L1 PM Substates
		L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
			  PortCommonModeRestoreTime=60us PortTPowerOnTime=40us
		L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
			   T_CommonMode=10us
		L1SubCtl2: T_PwrOn=10us
	Capabilities: [1a0 v1] Vendor Specific Information: ID=0002 Rev=4 Len=100 <?>
	Capabilities: [2a0 v1] Vendor Specific Information: ID=0001 Rev=1 Len=038 <?>
	Capabilities: [2d8 v1] Data Link Feature <?>
	Capabilities: [2e4 v1] Precision Time Measurement
		PTMCap: Requester:- Responder:+ Root:+
		PTMClockGranularity: 16ns
		PTMControl: Enabled:- RootSelected:-
		PTMEffectiveGranularity: Unknown
	Capabilities: [2f0 v1] Vendor Specific Information: ID=0004 Rev=1 Len=054 <?>
	Capabilities: [358 v1] Vendor Specific Information: ID=0006 Rev=0 Len=018 <?>
	Kernel driver in use: pcieport

0001:01:00.0 Network controller: Realtek Semiconductor Co., Ltd. RTL8822CE 802.11ac PCIe Wireless Network Adapter
	Subsystem: AzureWave RTL8822CE 802.11ac PCIe Wireless Network Adapter
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 312
	Region 0: I/O ports at 1000 [size=256]
	Region 2: Memory at 20a8000000 (64-bit, non-prefetchable) [size=64K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 000000000f410040  Data: 0260
	Capabilities: [70] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <4us, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
		DevCtl:	CorrErr- NonFatalErr- FatalErr- UnsupReq-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr+ TransPend-
		LnkCap:	Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <4us, L1 <64us
			ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk-
			ExtSynch- ClockPM+ AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s (ok), Width x1 (ok)
			TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+, NROPrPrP-, LTR+
			 10BitTagComp-, 10BitTagReq-, OBFF Via message/WAKE#, ExtFmt-, EETLPPrefix-
			 EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
			 FRS-, TPHComp-, ExtTPHComp-
			 AtomicOpsCap: 32bit- 64bit- 128bitCAS-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis+, LTR+, OBFF Disabled
			 AtomicOpsCtl: ReqEn-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		AERCap:	First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
			MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
		HeaderLog: 00000000 00000000 00000000 00000000
	Capabilities: [148 v1] Device Serial Number 00-e0-4c-ff-fe-c8-22-01
	Capabilities: [158 v1] Latency Tolerance Reporting
		Max snoop latency: 0ns
		Max no snoop latency: 0ns
	Capabilities: [160 v1] L1 PM Substates
		L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
			  PortCommonModeRestoreTime=30us PortTPowerOnTime=60us
		L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
			   T_CommonMode=0us LTR1.2_Threshold=0ns
		L1SubCtl2: T_PwrOn=10us
	Kernel driver in use: rtl88x2ce
	Kernel modules: rtl8822ce

0005:00:00.0 PCI bridge: NVIDIA Corporation Device 229a (rev a1) (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0
	Interrupt: pin A routed to IRQ 68
	Bus: primary=00, secondary=01, subordinate=ff, sec-latency=0
	I/O behind bridge: [disabled]
	Memory behind bridge: 40000000-400fffff [size=1M]
	Prefetchable memory behind bridge: [disabled]
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
		Address: 0000000000000000  Data: 0000
		Masking: 00000000  Pending: 00000000
	Capabilities: [70] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0
			ExtTag- RBE+
		DevCtl:	CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr+ TransPend-
		LnkCap:	Port #0, Speed 16GT/s, Width x8, ASPM not supported
			ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt+ AutBWInt-
		LnkSta:	Speed 16GT/s (ok), Width x4 (downgraded)
			TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt+
		RootCap: CRSVisible+
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible+
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, NROPrPrP+, LTR+
			 10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
			 EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
			 FRS-, LN System CLS Not Supported, TPHComp-, ExtTPHComp-, ARIFwd+
			 AtomicOpsCap: Routing- 32bit- 64bit- 128bitCAS-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR+, OBFF Disabled ARIFwd+
			 AtomicOpsCtl: ReqEn- EgressBlck-
		LnkCtl2: Target Link Speed: 16GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [b0] MSI-X: Enable- Count=8 Masked-
		Vector table: BAR=2 offset=00000000
		PBA: BAR=2 offset=00010000
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		AERCap:	First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
			MultHdrRecCap+ MultHdrRecEn- TLPPfxPres- HdrLogCap-
		HeaderLog: 00000000 00000000 00000000 00000000
		RootCmd: CERptEn+ NFERptEn+ FERptEn+
		RootSta: CERcvd- MultCERcvd- UERcvd- MultUERcvd-
			 FirstFatal- NonFatalMsg- FatalMsg- IntMsg 0
		ErrorSrc: ERR_COR: 0000 ERR_FATAL/NONFATAL: 0000
	Capabilities: [148 v1] Secondary PCI Express
		LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
		LaneErrStat: 0
	Capabilities: [168 v1] Physical Layer 16.0 GT/s <?>
	Capabilities: [190 v1] Lane Margining at the Receiver <?>
	Capabilities: [1c0 v1] L1 PM Substates
		L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2- ASPM_L1.1- L1_PM_Substates+
			  PortCommonModeRestoreTime=60us PortTPowerOnTime=40us
		L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
			   T_CommonMode=60us
		L1SubCtl2: T_PwrOn=10us
	Capabilities: [1d0 v1] Vendor Specific Information: ID=0002 Rev=4 Len=100 <?>
	Capabilities: [2d0 v1] Vendor Specific Information: ID=0001 Rev=1 Len=038 <?>
	Capabilities: [308 v1] Data Link Feature <?>
	Capabilities: [314 v1] Precision Time Measurement
		PTMCap: Requester:+ Responder:+ Root:+
		PTMClockGranularity: 16ns
		PTMControl: Enabled:- RootSelected:-
		PTMEffectiveGranularity: Unknown
	Capabilities: [320 v1] Vendor Specific Information: ID=0004 Rev=1 Len=054 <?>
	Capabilities: [388 v1] Vendor Specific Information: ID=0006 Rev=0 Len=018 <?>
	Kernel driver in use: pcieport

0005:01:00.0 Memory controller: Xilinx Corporation Device b03f
	Subsystem: Xilinx Corporation Device 0007
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Region 0: Memory at 2b28020000 (64-bit, non-prefetchable) [disabled] [size=64K]
	Region 2: Memory at 2b28000000 (32-bit, non-prefetchable) [disabled] [size=128K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [48] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [60] MSI-X: Enable- Count=32 Masked-
		Vector table: BAR=0 offset=00008000
		PBA: BAR=0 offset=00008fe0
	Capabilities: [70] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
		DevCtl:	CorrErr- NonFatalErr- FatalErr- UnsupReq-
			RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 16GT/s, Width x4, ASPM not supported
			ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 16GT/s (ok), Width x4 (ok)
			TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range BC, TimeoutDis+, NROPrPrP-, LTR-
			 10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
			 EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
			 FRS-, TPHComp-, ExtTPHComp-
			 AtomicOpsCap: 32bit- 64bit- 128bitCAS-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
			 AtomicOpsCtl: ReqEn-
		LnkCtl2: Target Link Speed: 16GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		AERCap:	First Error Pointer: 00, ECRCGenCap- ECRCGenEn- ECRCChkCap- ECRCChkEn-
			MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
		HeaderLog: 00000000 00000000 00000000 00000000
	Capabilities: [180 v1] Alternative Routing-ID Interpretation (ARI)
		ARICap:	MFVC- ACS-, Next Function: 0
		ARICtl:	MFVC- ACS-, Function Group: 0
	Capabilities: [1c0 v1] Secondary PCI Express
		LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
		LaneErrStat: 0
	Capabilities: [3a0 v1] Data Link Feature <?>
	Capabilities: [3b0 v1] Physical Layer 16.0 GT/s <?>
	Capabilities: [400 v1] Lane Margining at the Receiver <?>

user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ 


Hi,

We need to check with our internal team.
Will update more info with you.

Thanks.

Hi,

Could you help to check the lspci -v log again?
Please check to help if there is any Kernel driver in use log shown under the Xilinx memory controller.

Thanks.

There is no Kernel driver in use for the Xilinx Memory Controller.

I would expect the following, “Kernel driver in use: picoevb-rdma”

Hi,

We have checked the dmesg error with our internal team and it should be fine.

[  226.002525] picoevb_rdma: module verification failed: signature and/or required key missing - tainting kernel

Since our kernel config doesn’t set CONFIG_MODULE_SIG_FORCE, the modules for which the key is unavailable are permitted, but the kernel will be marked as tainted.

Regarding this, the issue might come from the FPGA driver.
Since you are using a different FGPA on our list, could you check if your FGPA meets the description below?

HTG-K800 is a full-size x16 PCIe card. This will fit directly into the full- size PCIe connector on Jetson or a desktop PC. For more information, see: http://www.hitechglobal.com/Boards/Kintex-UltraScale.htm

This project supports the XCKU-60 FPGA, although this should be easy to change simply by changing the FPGA project properties and re-synthesizing the provided Vivado project.

Thanks.

Hi, @AastaLLL

I’m using a Xilinx VCK190 which has a x8 PCI Express Gen4 edge connector which would be compatible with the HTG-K800’s x8 PCI Express Gen3 edge connector.

Additionally, I’m not sure what “FPGA driver” you’re referring to but I have not built/inserted the Xilinx XDMA Driver on the Orin.

Hi, @AastaLLL

Any updates?

Thank you.

Hi,

Sorry for the late update.

Could you double-check the lspci -v output?
Suppose the FPGA will show as “Serial controller” like below:

0005:01:00.0 Serial controller: Xilinx Corporation Device 8022 (prog-if 01 [16450])
Subsystem: Xilinx Corporation Device 0007
Flags: bus master, fast devsel, latency 0, IRQ 68
Memory at 2b28000000 (32-bit, non-prefetchable) [size=1M]
Memory at 2b28100000 (32-bit, non-prefetchable) [size=64K]
Capabilities:
Kernel driver in use: xdma

But in your case, it seems to be the “Memory controller”?
Thank.s

@AastaLLL ,

I have 2 different FPGA designs that I’m testing. I’ve included the lspci -v results below:

0005:01:00.0 Memory controller: Xilinx Corporation Device b03f
	Subsystem: Xilinx Corporation Device 0007
	Flags: bus master, fast devsel, latency 0, IRQ 311
	Memory at 2b28000000 (64-bit, non-prefetchable) [size=64K]
	Memory at 2b28010000 (32-bit, non-prefetchable) [size=8K]
	Capabilities: <access denied>
	Kernel driver in use: xdma
	Kernel modules: xdma

0005:01:00.0 Memory controller: NVIDIA Corporation Device 8038
	Subsystem: NVIDIA Corporation Device 0002
	Flags: bus master, fast devsel, latency 0, IRQ 311
	Memory at 2b28000000 (64-bit, non-prefetchable) [size=64K]
	Memory at 2b28010000 (32-bit, non-prefetchable) [size=8K]
	Capabilities: <access denied>
	Kernel driver in use: xdma
	Kernel modules: xdma

The Vendor ID, Device ID, Subsystem Vendor ID, Subsystem ID, and Base Class is all configurable within the FPGA. It appears that the driver is expecting the following:

Vendor ID = 0x10DE (NVIDIA Corporation Device)
Device ID = 0x0001
Subsystem Vendor ID = 0x10DE (NVIDIA Corporation Device)
Subsystem ID = 0x0002
Base Class = “Memory Controller”
Class Code = 0x058000

Can you confirm that the driver is expecting/only works with these values? I’ve attempted to add my current hardware PCIe ID values to the driver code but have not been successful.

UPDATE BELOW
I made an FPGA image with the PCIe IDs shown above, which are what’s in the driver code, but it still does not show up as “kernel driver in use: picoevb-rdma”

I also noticed the picoevb-rdma module shows up in ‘lsmod’ but not ‘modinfo’.

lsmod, modinfo and dmesg errors shown below:

user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ lsmod
Module                  Size  Used by
picoevb_rdma           24576  0
xdma                   98304  0
nvidia_p2p             20480  1 picoevb_rdma
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ modinfo nvidia-p2p 
filename:       /lib/modules/5.10.120-tegra/kernel/drivers/nv-p2p/nvidia-p2p.ko
license:        GPL
author:         Preetham Chandru pchandru@nvidia.com
description:    Nvidia Tegra P2P Driver
depends:        
intree:         Y
name:           nvidia_p2p
vermagic:       5.10.120-tegra SMP preempt mod_unload modversions aarch64
sig_id:         PKCS#7
signer:         Build time autogenerated kernel key
sig_key:        57:E3:3F:D5:98:BE:84:51:01:91:7A:7A:8C:5D:36:7F:71:1B:34:FB
sig_hashalgo:   sha512
signature:      1C:F2:BC:31:A9:3E:24:91:C2:B3:C7:8C:68:18:D7:68:D7:3C:5C:16:
		4D:EA:0C:E7:B3:D8:84:7F:AE:93:ED:16:36:A2:80:F2:05:33:C0:19:
		1B:48:B6:6E:71:D1:1A:F7:7F:5D:10:2E:48:22:7D:D1:43:4E:7B:C5:
		88:B2:B3:84:6F:FB:F1:89:23:B8:4C:54:17:94:D6:D6:26:2E:CD:4E:
		82:B5:CF:A3:7C:F7:3C:08:E6:C8:21:5A:09:0F:7A:F2:50:2D:B7:17:
		F6:E9:CE:89:38:D7:55:27:42:73:21:93:FB:11:3A:01:A0:D2:73:19:
		94:15:25:6E:60:9F:1F:D4:E1:05:F9:F5:CA:75:5B:C4:A7:57:C6:D9:
		B5:EF:A6:AF:60:37:4A:6E:42:75:9E:35:85:06:A1:8D:A1:3A:A6:B2:
		CF:82:C8:60:6E:AA:C9:C8:29:FF:F6:8F:86:18:33:12:D3:72:4A:F0:
		24:44:46:D0:40:35:CE:F1:2C:F7:01:AF:06:FD:02:9D:96:91:5F:8E:
		24:1C:7D:2E:46:5C:44:61:25:AB:D8:5C:3E:76:D7:61:C0:5E:48:1C:
		83:3A:42:EE:46:98:A8:E7:43:93:DB:89:8C:D7:E4:EC:2C:A7:8B:18:
		EA:02:45:82:16:D1:02:C6:ED:D6:B3:DE:62:56:F7:E3:F5:78:03:2E:
		DB:AF:FC:EA:6F:A0:AD:8A:FE:95:48:22:AB:D6:82:CD:5E:CB:E0:DD:
		A7:A6:59:E4:4B:E1:05:5C:55:38:48:87:28:3E:FE:5C:BB:E5:14:E6:
		50:2F:FB:ED:91:5D:9F:57:AB:0B:E4:9A:ED:93:21:54:5D:4D:07:53:
		F8:6A:2E:87:DF:76:EF:EC:6E:4E:9A:49:71:D5:04:ED:33:D8:AC:A9:
		72:A0:32:2E:23:31:7F:E0:3A:8F:7A:F2:62:59:79:9E:9F:35:D8:08:
		ED:49:A6:B5:F5:58:C7:C6:41:EB:82:71:98:D9:1F:76:9F:A4:3E:66:
		C4:66:EC:CF:C8:0E:9E:D0:2B:A8:B1:06:08:1E:8D:AF:B8:32:FA:F5:
		A5:D4:10:26:09:6A:6D:8A:5C:43:FF:D2:3F:F8:96:44:C1:9C:48:67:
		F0:CA:E2:80:FF:F7:43:45:78:D1:6A:DB:5E:C7:E7:74:A8:A5:3F:EB:
		07:B9:FE:2D:53:15:68:FC:F6:9C:2F:BB:60:2B:70:F9:51:EA:1C:D0:
		5E:7B:EE:EE:AE:E4:0B:50:67:64:A7:C0:D1:1F:89:6D:90:53:80:B6:
		FB:40:2A:29:41:49:64:71:A2:FF:DA:A7:95:DF:44:6A:57:D2:96:CF:
		34:C8:2B:84:0B:3F:E2:DC:14:E7:A6:05
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ modinfo picoevb_rdma
modinfo: ERROR: Module picoevb_rdma not found.
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ modinfo ./picoevb-rdma.ko
filename:       /home/user/Downloads/jetson-rdma-picoevb-master/kernel-module/./picoevb-rdma.ko
license:        GPL v2
author:         NVIDIA
alias:          pci:v000010DEd00000001sv000010DEsd00000007bc*sc*i*
alias:          pci:v000010DEd00000001sv000010DEsd00000002bc*sc*i*
alias:          pci:v000010DEd00000001sv000010DEsd00000001bc*sc*i*
depends:        nvidia-p2p
name:           picoevb_rdma
vermagic:       5.10.120-tegra SMP preempt mod_unload modversions aarch64
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ 
user@ubuntu:~/Downloads/jetson-rdma-picoevb-master/kernel-module$ sudo dmesg | grep -i "pico"
[  231.827000] picoevb_rdma: module verification failed: signature and/or required key missing - tainting kernel
[  231.838747] picoevb-rdma 0005:01:00.0: Adding to iommu group 11
[  231.839353] picoevb-rdma 0005:01:00.0: enabling device (0000 -> 0002)
[  231.839494] picoevb-rdma 0005:01:00.0: pcim_iomap_regions(): -22
[  231.845938] picoevb-rdma: probe of 0005:01:00.0 failed with error -22

Hi,

Thanks for your feedback.
Please allow us to check this with our internal team and then get back to you.

Hi,

Thanks for your patience.

Have you programmed your FPGA card with the guidelines below?

Since it is failing to get the BAR resources mapped.

Thanks.

@AastaLLL

Yes I’ve created my FPGA design based off the HTG-K800 Vivado project provided in that GitHub project.

Can you please be more specific.

Would you mind trying this?

  1. WIthout inserting picordma driver, do sudo lspci -vv -s
  2. Now insert picordma
  3. sudo lspci -vv -s

Hi, @thromadka

user@user-desktop:~$ sudo lspci -vv -s 0005:01:00.0
[sudo] password for user: 
0005:01:00.0 Memory controller: NVIDIA Corporation Device 0001
	Subsystem: NVIDIA Corporation Device 0002
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 255
	Region 0: Memory at 2b28000000 (64-bit, non-prefetchable) [disabled] [size=64K]
	Region 2: Memory at 2b28010000 (32-bit, non-prefetchable) [disabled] [size=8K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [48] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [70] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
		DevCtl:	CorrErr- NonFatalErr- FatalErr- UnsupReq-
			RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 16GT/s, Width x4, ASPM not supported
			ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 16GT/s (ok), Width x4 (ok)
			TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range BC, TimeoutDis+, NROPrPrP-, LTR-
			 10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
			 EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
			 FRS-, TPHComp-, ExtTPHComp-
			 AtomicOpsCap: 32bit- 64bit- 128bitCAS-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
			 AtomicOpsCtl: ReqEn-
		LnkCtl2: Target Link Speed: 16GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		AERCap:	First Error Pointer: 00, ECRCGenCap- ECRCGenEn- ECRCChkCap- ECRCChkEn-
			MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
		HeaderLog: 00000000 00000000 00000000 00000000
	Capabilities: [1c0 v1] Secondary PCI Express
		LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
		LaneErrStat: 0
	Capabilities: [3a0 v1] Data Link Feature <?>
	Capabilities: [3b0 v1] Physical Layer 16.0 GT/s <?>
	Capabilities: [400 v1] Lane Margining at the Receiver <?>
user@user-desktop:~/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module$ sudo ./build-for-jetson-drive-igpu-native.sh 
make -C "/lib/modules/5.10.120-tegra/build" "M=$PWD" "modules"
make[1]: Entering directory '/usr/src/linux-headers-5.10.120-tegra-ubuntu20.04_aarch64/kernel-5.10'
  CC [M]  /home/user/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.o
  MODPOST /home/user/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module/Module.symvers
  CC [M]  /home/user/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.mod.o
  LD [M]  /home/user/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module/picoevb-rdma.ko
make[1]: Leaving directory '/usr/src/linux-headers-5.10.120-tegra-ubuntu20.04_aarch64/kernel-5.10'
user@user-desktop:~/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module$ sudo insmod /lib/modules/5.10.120-tegra/kernel/drivers/nv-p2p/nvidia-p2p.ko 
user@user-desktop:~/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module$ sudo insmod ./picoevb-rdma.ko
user@user-desktop:~/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module$ lsmod
Module                  Size  Used by
picoevb_rdma           24576  0
nvidia_p2p             20480  1 picoevb_rdma
user@user-desktop:~/Desktop/cason/nvidia_rmda/jetson-rdma-picoevb-master/kernel-module$ sudo lspci -vv -s 0005:01:00.0
0005:01:00.0 Memory controller: NVIDIA Corporation Device 0001
	Subsystem: NVIDIA Corporation Device 0002
	Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Interrupt: pin A routed to IRQ 68
	Region 0: Memory at 2b28000000 (64-bit, non-prefetchable) [size=64K]
	Region 2: Memory at 2b28010000 (32-bit, non-prefetchable) [size=8K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [48] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [70] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
		DevCtl:	CorrErr- NonFatalErr- FatalErr- UnsupReq-
			RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 256 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 16GT/s, Width x4, ASPM not supported
			ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 16GT/s (ok), Width x4 (ok)
			TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range BC, TimeoutDis+, NROPrPrP-, LTR-
			 10BitTagComp+, 10BitTagReq-, OBFF Not Supported, ExtFmt-, EETLPPrefix-
			 EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
			 FRS-, TPHComp-, ExtTPHComp-
			 AtomicOpsCap: 32bit- 64bit- 128bitCAS-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
			 AtomicOpsCtl: ReqEn-
		LnkCtl2: Target Link Speed: 16GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
			 EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		AERCap:	First Error Pointer: 00, ECRCGenCap- ECRCGenEn- ECRCChkCap- ECRCChkEn-
			MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
		HeaderLog: 00000000 00000000 00000000 00000000
	Capabilities: [1c0 v1] Secondary PCI Express
		LnkCtl3: LnkEquIntrruptEn-, PerformEqu-
		LaneErrStat: 0
	Capabilities: [3a0 v1] Data Link Feature <?>
	Capabilities: [3b0 v1] Physical Layer 16.0 GT/s <?>
	Capabilities: [400 v1] Lane Margining at the Receiver <?>

Hi,

Thanks for the reply.
We will discuss this internally and provide more info to you.

Thanks.

Hi,

We compared your log with our working case and found your memory region is BAR0 and BAR2.

Your case :

Region 0: Memory at 2b28000000 (64-bit, non-prefetchable) [disabled] [size=64K]
Region 2: Memory at 2b28010000 (32-bit, non-prefetchable) [disabled] [size=8K]

Our working case:

 Region 0: Memory at 2b28010000 (32-bit, non-prefetchable) [size=4K]
 Region 1: Memory at 2b28000000 (32-bit, non-prefetchable) [size=64K]

So please help to change as per below in picoevb-rdma.c driver file and try again to build and insert the driver.
https://github.com/NVIDIA/jetson-rdma-picoevb/blob/master/kernel-module/picoevb-rdma.c#L40

//#define BAR_DMA         1
#define BAR_DMA         2

Thanks.

Hi,

If the above change doesn’t work, please also try to update the BAR number as shown below.
Since we observed the BAR region address has changed for BAR_GPIO and DMA_BAR in your use case.

Our default setting: please comment out
//#define BAR_GPIO        0 //2b28010000
//#define BAR_DMA         1 //2b28000000
Customer board: please update as below.
#define BAR_GPIO        2 // 2b28010000
#define BAR_DMA         0 //2b28000000

Thanks.