Stuck at Initrd loading

Hello,nvidia experts

I am stuck at initrd during PXE v4 boot, and the logs indicate that something seems to have timed out. Need help.

                                    ▒▒2J▒▒001;▒▒1;00▒▒001H▒▒1H▒▒▒▒▒▒▒▒▒▒m▒m▒J▒0m▒04D▒▒▒▒▒▒EFI stub: ▒▒EFI stub: ▒▒Booting Linux▒▒ing ▒▒▒Boot▒▒...
        ▒▒Linux Kernel...
▒▒EFI stub: ▒▒EFI stub: ▒▒Loaded initrd from LINU▒▒Load▒▒X_EF▒▒ed i▒▒I_IN▒▒nitr▒▒ITRD▒▒d fr▒▒_MED▒▒om L▒▒IA_G▒▒INUX▒▒UID ▒▒_EFI▒▒MEDI▒▒_INI▒▒ce p▒▒TRD_▒▒ath
        EFI▒▒A_GU▒▒ stu▒▒ID d▒▒b: U▒▒evic▒▒sing▒▒e pa▒▒ DTB▒▒th
▒▒ fro▒▒EFI ▒▒m co▒▒stub▒▒nfig▒▒: Us▒▒urat▒▒ing ▒▒ion ▒▒DTB ▒▒tabl▒▒from▒▒e
E▒▒ con▒▒FI s▒▒figu▒▒tub:▒▒rati▒▒ Exi▒▒on t▒▒ting▒▒able▒▒ boo▒▒
EF▒▒t se▒▒I st▒▒rvic▒▒ub: ▒▒es..▒▒Exit▒▒.
▒▒ing boot services...
▒▒debugfs initialized
▒▒INFO: END TASK:MB▒▒
INFO: enter idle task.
INFO: END TASK:MB▒▒
▒▒ph =▒▒ter idle ta▒▒GPC ▒▒sk.
        ▒▒> logic map: 0=>0 1=>2 2=>1
wait_flush_done: flush timed out, mask=2, reg=a8024b18
wait_flush_done: flush timed out, mask=4, reg=a8024b18
wait_flush_done: flush timed out, mask=2, reg=a8024b0c
wait_flush_done: flush timed out, mask=4, reg=a8024b0c

Do I need to include the corresponding network card driver in my initrd?

Hi wpceswpces,

Are you using the devkit or custom board for Thor?

Have you referred to the following instruction for this use case?
Flashing Support for Jetson Thor — Configuring a PXE Boot Server for UEFI bootloader on Jetson

Hi,KevinFFF

i’m using two devkit for this test . One as the server, and the other as the client for booting. I’ve already gone through this document. The network card I’m using is not the one that comes with the devkit(RJ45), but one that’s connected via an M.2 E slot(the wifi slot,i replace it) . Do I need to add the driver(ko) for this network card in the initrd? Even after I added it(I decompressed the initrd using gunzip and confirmed that the module is included under /lib/modules/.../updates/....), it still failed. I think the network card node is definitely not eth0. I tried eth1 and eth2, but neither worked.It still doesn’t work even when I use its Predictable Network Interface Names.I want to know the cause of the blockage. From what I can see, it has already reached the kernel and initrd loading stages, so DHCP and TFTP should be fine.

It sounds like it is waiting for a kernel or filesystem image over the network. Your initrd does require all modules needed to reach that point, e.g., if the kernel or filesystem are on the remote server, then you should see a log message on the server which mentions the request (along with whether the request succeeded or was denied). If you lack that log from the server, then it implies the Jetson never asked. Never asking might be for boot software requesting a kernel, but it is unlikely an initrd would be loaded if there is no kernel. The odds are that a module for networking must exist in the initrd; if this is the case, and if that module is lacking, then no PXE request will occur for the filesystem (it is possible for the kernel to be loaded differently than the filesystem; the filesystem implies an additional requirement above and beyond data access…it has to also understand ext4 or anything to read the filesystem).

A lot depends on whether or not you see requests logged on the server. Note that the only moment when this truly matters is when loading the initrd and then when the kernel itself takes over reading (in the initrd) via network.

hello KevinFFF,linuxdev

I added earlycon to the kernel parameters and found that more logs are visible, but it gets stuck at the kernel panic here.The grubnetaa64.efi.signed, grub.cfg, Image, and initrd have all been sent to the boot endpoint.

● dnsmasq.service - dnsmasq - A lightweight DHCP and caching DNS server
     Loaded: loaded (/usr/lib/systemd/system/dnsmasq.service; enabled; preset: enabled)
     Active: active (running) since Thu 2025-11-13 09:06:02 CST; 17min ago
    Process: 1953 ExecStartPre=/usr/share/dnsmasq/systemd-helper checkconfig (code=exited, status=0/SUCCESS)
    Process: 1993 ExecStart=/usr/share/dnsmasq/systemd-helper exec (code=exited, status=0/SUCCESS)
    Process: 2033 ExecStartPost=/usr/share/dnsmasq/systemd-helper start-resolvconf (code=exited, status=0/SUCCESS)
   Main PID: 1998 (dnsmasq)
      Tasks: 1 (limit: 150286)
     Memory: 66.7M (peak: 67.2M)
        CPU: 6.326s
     CGroup: /system.slice/dnsmasq.service
             └─1998 /usr/sbin/dnsmasq -x /run/dnsmasq/dnsmasq.pid -u dnsmasq -r /run/dnsmasq/resolv.conf -7 /etc/dnsmasq.d,.dp>

Nov 13 09:15:14 localhost.localdomain dnsmasq-tftp[1998]: error 8 User aborted the transfer received from 192.168.137.55
Nov 13 09:15:14 localhost.localdomain dnsmasq-tftp[1998]: sent /var/ftpd/efi/grubnetaa64.efi.signed to 192.168.137.55
Nov 13 09:15:15 localhost.localdomain dnsmasq-tftp[1998]: sent /var/ftpd/efi/grubnetaa64.efi.signed to 192.168.137.55
Nov 13 09:15:15 localhost.localdomain dnsmasq-tftp[1998]: file /var/ftpd/grub/arm64-efi/command.lst not found for 192.168.137.>
Nov 13 09:15:15 localhost.localdomain dnsmasq-tftp[1998]: file /var/ftpd/grub/arm64-efi/fs.lst not found for 192.168.137.55
Nov 13 09:15:15 localhost.localdomain dnsmasq-tftp[1998]: file /var/ftpd/grub/arm64-efi/crypto.lst not found for 192.168.137.55
Nov 13 09:15:15 localhost.localdomain dnsmasq-tftp[1998]: file /var/ftpd/grub/arm64-efi/terminal.lst not found for 192.168.137>
Nov 13 09:15:15 localhost.localdomain dnsmasq-tftp[1998]: sent /var/ftpd/grub/grub.cfg to 192.168.137.55
Nov 13 09:15:36 localhost.localdomain dnsmasq-tftp[1998]: sent /var/ftpd/Image to 192.168.137.55
Nov 13 09:15:39 localhost.localdomain dnsmasq-tftp[1998]: sent /var/ftpd/initrd to 192.168.137.55

COM26 (USB 串行设备 (COM26))_2025-11-13-091458.log (115.1 KB)

[   19.454869] Ethernet interfaces: eth1ernet: mgbe3_0 (HW ver: 42) created with 4 DMA channels
[   24.697541] ERROR: initrd: ifconfig fail...
[   24.698669] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000000

I want to stay in initrd without mounting NFS. How can I modify grub.cfg? I want to check if the network card driver loads properly and whether the network interfaces are created.

Could you use the RJ45 port on the devkit to verify if the PXE boot is working?

I think so.

Hi,KevinFFF

The above is likely from the driver not being found. ifconfig with no result is what you’d see if the network was not configured; if instead there is an actual error, then it implies the hardware driver is not installed.

Knowing how the initrd is designed might be useful to you. When booting directly the bootloader will load the kernel and then begin its execution; the kernel image must be from some form of storage, e.g., it can be a binary image in a partition, or it could be a file in an ext4 filesystem. The only way the partition binary content works is if the bootloader knows how to read the drive, which will always be the case if it is a mainstream technology (there is no filesystem and so no filesystem driver is required for that case). As soon as you put the kernel into a file on a filesystem, then the bootloader must understand that as well (first the bootloader must access the hardware storage, then it must find the kernel in the logic of the filesystem, a second driver). Rather than put an infinite number of filesystems into the bootloader the initrd was invented. It is an adapter between boot stages.

The initrd is just a very simple filesystem type which the bootloaders will all understand. If a kernel is loaded, and if the initrd is present, then it is possible to put things like custom filesystem drivers into the initrd for the kernel to load during boot. Had the initrd not been there, but had instead been trying to load a filesystem module from a filesystem the kernel does not understand, then you’d get a failure. Your PXE boot is a similar case, it is loading an initrd, and the kernel is loaded, and now the kernel needs the driver for the network card. Had that driver been directly embedded in the kernel, then you wouldn’t need the driver as a module, but there are sometimes good reasons to not burden a kernel with all integrated (non-module) drivers. It seems that the NIC driver is missing from your initrd. This is why you’d have an error from ifconfig instead of complaining about the PXE server.

Have you changed anything about the kernel? If there is a module in the initrd for the NIC, and if the main kernel does not itself have the NIC driver, then a failure to load the module (regardless of cause) would imply you can’t use the NIC to read PXE. It also says your PXE server won’t see any log messages about attempting to access its content (if the Jetson wanted content, then even if the content fails to load the server would have logged the attempt). It very much looks like the driver is missing or failing to load, and if a kernel is modified incorrectly, then the previous modules will be invalidated and fail to load. This, or simply not having the module in the initrd, is probably what is going on.

Hi,linuxdev

thank you very much for the reply. i have modprobe the driver now and I think there’s still an issue with the system driver in my NFS system; it crashed. Here’s the log:

COM26 (USB 串行设备 (COM26))_2025-11-14-092935.log (218.1 KB)

Hi,KevinFFF

Can you help me see why it’s hanging here?

[   40.923035] NVRM: devm_reset_control_get failed, err: -2
[   40.930371] NVRM: mipi_cal devm_reset_control_get failed, err: -2
[   40.936685] ------------[ cut here ]------------



▒▒[   68.906084] nvidia 0000:01:00.0: Direct firmware load for nvidia/580.00/gsp_ga10x.bin failed with error -2
[   68.906239] NVRM: RmFetchGspRmImages: No firmware image found
[   68.907596] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x61:0x56:1893)
[   69.088247] nvidia 0000:01:00.0: Direct firmware load for nvidia/580.00/gsp_ga10x.bin failed with error -2
[   69.088396] NVRM: RmFetchGspRmImages: No firmware image found
[   69.096916] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[   69.276764] nvidia 0000:01:00.0: Direct firmware load for nvidia/580.00/gsp_ga10x.bin failed with error -2
[   69.276913] NVRM: RmFetchGspRmImages: No firmware image found
[   69.285434] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
▒▒INFO: END TASK:MB▒▒
INFO: enter idle task.

I’ve now switched to the Realtek network card that comes with the devkit to boot, and when using Samplefs for NFS, it also hangs.I don’t understand why there are the above errors. The contents in the lib/modules directory for both NFS and SampleRootfs are the same. Also, I don’t have a discrete GPU, so why is the GSP firmware for the GPU being loaded?

i found that the crash occurs in nvidia.ko.

root@wpces:/home/wpces/Downloads/Linux_for_Tegra/rootfs# grep -nr "devm_reset_control_get failed" *
grep: lib/modules/6.8.12-tegra/updates/opensrc-disp/nvidia.ko: binary file matches
grep: usr/lib/modules/6.8.12-tegra/updates/opensrc-disp/nvidia.ko: binary file matches

Can you help me with this?

For Thor, it seems we use nvgpu instead of nvidia.ko.

About this error, do you specify --openrm for apply_binaries.sh when you were setting up the BSP?

no,I didn’t specify it 0.0.

Can I use the Samplerootfs from r38.2.1?

Hi,KevinFFF

how about this error?

[   46.711004] l4tbr0: port 1(usb0) entered disabled state
[   46.714107] configfs-gadget.l4t gadget.0 usb0: entered allmulticast mode
[   46.720716] configfs-gadget.l4t gadget.0 usb0: entered promiscuous mode
[   46.753860] l4tbr0: port 2(usb1) entered blocking state
[   46.753958] l4tbr0: port 2(usb1) entered disabled state
[   46.754060] configfs-gadget.l4t gadget.0 usb1: entered allmulticast mode
[   46.757264] configfs-gadget.l4t gadget.0 usb1: entered promiscuous mode
[   46.781706] loop0: detected capacity change from 0 to 32768
[   47.570614] nv_platform 8808c00000.display: Adding to iommu group 60
[   47.571841] platform 8808c00000.display:nvdisplay-niso: Adding to iommu group 61
[   47.572499] NVRM: devm_reset_control_get failed, err: -2
[   47.580854] NVRM: mipi_cal devm_reset_control_get failed, err: -2
[   47.587161] ------------[ cut here ]------------
[   47.591689] Modules linked in: qrtr(E) bridge(E) stp(E) llc(E) usb_f_ncm(E) usb_f_mass_storage(E) usb_f_acm(E) u_serial(E) usb_f_rndis(E) u_ether(E) nvidia(OE+) governor_pod_scaling(OE) libcomposite(E) cfg80211(E) rfkill(E) snd_soc_tegra_controls(OE) snd_soc_tegra_utils(OE) snd_soc_tegra186_asrc(E) snd_soc_tegra210_admaif(E) snd_soc_tegra210_mixer(E) snd_soc_tegra186_arad(OE) snd_soc_tegra_pcm(E) snd_soc_tegra210_sfc(E) snd_soc_tegra210_ope(E) snd_soc_tegra210_mvc(E) snd_soc_tegra210_amx(E) snd_soc_tegra210_adx(E) snd_soc_tegra210_i2s(E) snd_soc_tegra210_ahub(E) tegra210_adma(E) spidev(E) nvvrs_pseq_rtc(OE) nvhost_nvcsi(OE) nvhost_vi5(OE) tegra_se(OE) tegra_se_kds(OE) nvhost_pva(OE) nvhost_capture(OE) crypto_engine(E) nvmap(OE) crct10dif_ce(E) sm3_ce(E) snd_soc_tegra_audio_graph_card(E) coresight_trbe(E) sm3(E) nvsciipc(OE) snd_hda_codec_hdmi(E) sha3_ce(E) ivc_cdev(OE) snd_soc_audio_graph_card(E) sha512_ce(E) coresight(E) arm_spe_pmu(E) sha512_arm64(E) tegra_capture_coe(OE) nvme(E) ina238(E)
[   47.591728]  snd_soc_simple_card_utils(E) tegra23x_psc(OE) nvpmodel_clk_cap(OE) tegra234_oc_event(OE) ina3221(E) tegra_cactmon_mc_all(OE) snd_hda_tegra(E) thermal_trip_event(OE) r8126(OE) snd_hda_codec(E) tegra_aconnect(E) nvidia_cspmu(E) snd_hda_core(E) at24(E) tegra_xudc(E) mttcan(OE) host1x_fence(OE) snd_soc_rt5640(E) snd_soc_rl6231(E) can_dev(E) lm90(E) ramoops(E) spi_tegra114(E) pwm_tegra_tachometer(OE) tegra_dce(OE) nvidia_vrs_pseq(OE) arm_cspmu_module(E) reed_solomon(E) tpm_ftpm_tee(E) camera_diagnostics(OE) nvhost_isp5(OE) tegra_capture_isp(OE) tegra_camera(OE) v4l2_dv_timings(E) host1x_nvhost(OE) tegra_drm(OE) tegra_wmark(OE) nvhwpm(OE) drm_display_helper(E) drm_dp_aux_bus(E) cec(E) drm_kms_helper(E) host1x(OE) tegra_camera_platform(OE) mc_utils(OE) capture_ivc(OE) v4l2_fwnode(E) v4l2_async(E) videobuf2_dma_contig(E) videobuf2_memops(E) videobuf2_v4l2(E) videodev(E) videobuf2_common(E) mc(E) camchar(OE) rtcpu_debug(OE) tegra_camera_rtcpu(OE) ivc_bus(OE) hsp_mailbox_client(OE) nvme_fabrics(E) nvme_core(E)
[   47.591765]  fuse(E) drm(E) nfnetlink(E) ip_tables(E) x_tables(E) ipv6(E) ngbe(OE) phy_tegra194_p2u pcie_tegra194 nvethernet(O) nvpps(O) pwm_fan pwm_tegra tegra_bpmp_thermal ufs_tegra(O) pcie_tegra264(O)
[   47.591780] Hardware name: NVIDIA NVIDIA Jetson AGX Thor Developer Kit/Jetson, BIOS 38.2.1-gcid-42061081 09/10/2025
[   47.591781] pstate: 21400009 (nzCv daif +PAN -UAO -TCO +DIT -SSBS BTYPE=--)
[   47.591787] lr : __of_reset_control_get+0x190/0x1d80x16c
[   47.591790] sp : ffff800086e0b5c0
[   47.591790] x29: ffff800086e0b5c0 x28: 0000000000000004 x27: ffff0000b15e8110
[   47.591793] x26: 0000000000000000 x25: 0000000000000000 x24: 0000000000000001
[   47.591795] x23: 0000000000000000 x22: ffff000088b73550 x21: 000000000000001f
[   47.591797] x20: ffff000088b73570 x19: ffff00008e958e00 x18: 0000000000000006
[   47.591798] x17: ffff000090bdb200 x16: ffffbb2113c1e800 x15: ffff800086e0b140
[   47.591800] x14: ffffffffffffffff x13: 0000000000000018 x12: 0101010101010101
[   47.591802] x11: 7f7f7f7f7f7f7f7f x10: ffffbf21172fe38d x9 : 0000000000000038
[   47.591804] x8 : 0101010101010101 x7 : 00000000736c6c65 x6 : 0000000000000080
[   47.591806] x5 : ffff800086e0b618 x4 : fffffbfffde272dc x3 : 0000000000000001
[   47.591808] x2 : 000000000000001f x1 : 000000000000001f x0 : 0000000000000000
[   47.591810] Call trace:
[   47.591811]  __reset_control_get_internal+0x68/0x16c
[   47.591814]  __of_reset_control_get+0x190/0x1d8
[   47.591817]  __reset_control_get+0x48/0x1cc
[   47.591819]  __devm_reset_control_get+0x78/0xd4
[   47.591822]  nvlink_core_init+0xefaf0/0xefd58 [nvidia]
[   47.591993]  platform_probe+0x68/0xe0
[   47.592004]  really_probe+0x150/0x2c8
[   47.592006]  __driver_probe_device+0x78/0x134
[   47.592008]  driver_probe_device+0x3c/0x164
[   47.592011]  __driver_attach+0x98/0x1c4
[   47.592013]  bus_for_each_dev+0x7c/0xf4
[   47.592017]  bus_add_driver+0xec/0x218
[   47.592019]  driver_register+0x5c/0x13c
[   47.592025]  nv_platform_register_driver+0x34/0x40 [nvidia]
[   47.592162]  init_module+0x174/0x5a0 [nvidia]
[   47.592298]  do_one_initcall+0x58/0x318
[   47.592307]  load_module+0x1f04/0x2000
[   47.592309]  init_module_from_file+0x88/0xd4
[   47.592312]  __arm64_sys_finit_module+0x148/0x330
[   47.592318]  el0_svc_common.constprop.0+0xd0/0xf0
[   47.592320]  do_el0_svc+0x1c/0x30
[   47.592323]  el0_svc+0x30/0xb8
[   47.592329]  el0t_64_sync+0x194/0x19830/0x13c
[   47.592330] ---[ end trace 0000000000000000 ]---
[   48.031995] NVRM: loading NVIDIA UNIX Open Kernel Module for aarch64  TempVersion  Release Build  (bugfix_main)  (buildbrain@5ce570c8-aabd-435b-a438-99bd3943cffd-jf1d-52rgf)  Wed Sep 10 12:34:47 PDT 2025
▒▒INFO: END TASK:MB▒▒
INFO: enter idle task.
INFO: END TASK:MB▒▒
▒▒ph =▒▒ter idle ta▒▒GPC ▒▒sk.
        ▒▒> logic map: 0=>0 1=>2 2=>1
▒▒[   48.126453] nvidia-modeset: Loading NVIDIA UNIX Open Kernel Mode Setting Driver for aarch64  TempVersion  Release Build  (bugfix_main)  (buildbrain@5ce570c8-aabd-435b-a438-99bd3943cffd-jf1d-52rgf)  Wed Sep 10 12:34:37 PDT 2025
[   48.138766] [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
[   49.615026] ngbe 0001:01:00.1: registered PHC device on eth1
[   49.633275] [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:01:00.0 on minor 1
[   49.633397] nvidia 0000:01:00.0: [drm] No compatible format found
[   49.633485] nvidia 0000:01:00.0: [drm] Cannot find any crtc or sizes
[   49.639353] [drm] [nvidia-drm] [GPU ID 0x00020000] Loading driver
[   49.758469] eth2: 0xffff800086e10000, 3c:6d:66:f9:58:60, IRQ 303
[   49.780555] r8126 0002:01:00.0 eth2: registered PHC device on eth2
[   49.780648] r8126 0002:01:00.0 eth2: reset PHC clock
[   49.802107] camrtc-coe tegra-capture-coe0: netdev event 14 dev mgbe0_0
[   49.819556] camrtc-coe tegra-capture-coe0: netdev event 1 dev mgbe0_0
[   49.819756] camrtc-coe tegra-capture-coe0: netdev event 4 dev mgbe0_0
[   49.839834] camrtc-coe tegra-capture-coe1: netdev event 14 dev mgbe1_0
[   49.857584] camrtc-coe tegra-capture-coe1: netdev event 1 dev mgbe1_0
[   49.857724] camrtc-coe tegra-capture-coe1: netdev event 4 dev mgbe1_0
[   49.878072] camrtc-coe tegra-capture-coe2: netdev event 14 dev mgbe2_0
[   49.894012] camrtc-coe tegra-capture-coe2: netdev event 1 dev mgbe2_0
[   49.894153] camrtc-coe tegra-capture-coe2: netdev event 4 dev mgbe2_0
[   49.915104] camrtc-coe tegra-capture-coe3: netdev event 14 dev mgbe3_0
[   49.915962] nvidia-modeset: WARNING: HW supports 8 heads. Limiting to 4 heads
[   49.931892] camrtc-coe tegra-capture-coe3: netdev event 1 dev mgbe3_0xff) is inconsistent with the number of heads (4)
[   49.932050] camrtc-coe tegra-capture-coe3: netdev event 4 dev mgbe3_0
[   49.989692] camrtc-coe tegra-capture-coe0: netdev event 4 dev mgbe0_0
[   49.991007] camrtc-coe tegra-capture-coe1: netdev event 4 dev mgbe1_0
[   49.992120] camrtc-coe tegra-capture-coe2: netdev event 4 dev mgbe2_0
[   50.010117] NVRM: rpcRmApiControl_dce: NVRM_RPC_DCE: Failed RM ctrl call cmd:0x731341 result 0xffff: Failure: Generic Error [   50.241492] [drm] Initialized nvidia-drm 0.0.0 20160202 for 8808c00000.display on minor 2
[   50.241617] [drm] [nvidia-drm] [GPU ID 0x00020000] Invalid framebuffer console info
[   50.469189] Console: switching to colour frame buffer device 240x67
[   50.476681] nv_platform 8808c00000.display: [drm] fb0: nvidia-drmdrmfb frame buffer device
▒▒GPC ph => logic map: 0=>0 1=>2 2=>1
▒▒INFO: END TASK:MB▒▒
INFO: enter idle task.
INFO: END TASK:MB▒▒
▒▒ph =▒▒ter idle ta▒▒GPC ▒▒sk.
        ▒▒> logic map: 0=>0 1=>2 2=>1
GPC ph => logic map: 0=>0 1=>2 2=>1
▒▒INFO: END TASK:MB▒▒
INFO: enter idle task.
INFO: END TASK:MB▒▒
▒▒ph =▒▒ter idle ta▒▒GPC ▒▒sk.
        ▒▒> logic map: 0=>0 1=>2 2=>1
GPC ph => logic map: 0=>0 1=>2 2=>1


The system has booted, but there is no serial console. Pressing Enter has no response, and I cannot log in.The monitor is also showing a black screen.Even after selecting the boot option, the system still crashes when the HDMI cable is unplugged.

Here is the log :

COM26 (USB 串行设备 (COM26))_2025-11-14-181523.log (291.6 KB)

I can see that the mount has been successfully established from the server side.

image

In addition to other errors I did see some “nvethernet a808d10000.ethernet” errors. Is this a developer’s kit? If not, then it needs a different device tree, but also, if you’ve changed the kernel itself, then it needs all new modules as well unless it was compiled with the correct matching configuration to the old kernel.

Incidentally, if the Jetson dropped into a bash shell, then it is very likely it is in the initrd and failed to find the next filesystem. You might be able to run “ifconfig” or “ip -s addr” in that shell. Should networking be up, then you might also be able to attempt to ping the PXE server. If networking is not up, then all else (other than failing to load modules which should be within the initrd and also valid for that kernel) is more or less just a side effect of failing to find the filesystem. --openrm was mentioned, and that could be part of incorrect modules, although it isn’t likely the full story.

Do you mean PXE boot is successful but you don’t get the serial console access?

Do you have other devices connected on your board?
If so, I would suggest you removing them all first.

[2025-11-14 18:16:36]  [   34.607616] Rootfs mounted over nfs
[2025-11-14 18:16:47]  [   34.613233] Switching from initrd to actual rootfs

From the log you shared, it has mounted the rootfs from nfs. Please also check if you’ve setup them on your server correctly.

Hi,KevinFFF

I am considering whether the crash is caused by a mismatch (r38.2.1、r38.2.2)between the Image and the ko version. I will try again.

It seems a known issue which should be fixed in upcoming JP7.1 release.

These 2 release should be fine. I’m curious if your board can boot if you flash the exact same BSP package to the NVMe rather than using PXE/NFS.

Hi,KevinFFF

I’ve replied above, it’s the BSP on the NVMe that is being used as NFS.Right now, I only have the power and Type-C debug serial cable plugged in, but it still crashes with this error. The serial console can print, but I can’t input. We urgently need to verify the feasibility of the connection. Could you provide a temporary patch?

[   42.151922] NVRM: devm_reset_control_get failed, err: -2
[   42.158432] NVRM: mipi_cal devm_reset_control_get failed, err: -2
[   42.164738] ------------[ cut here ]------------
[   42.169263] Modules linked in: qrtr bridge stp llc usb_f_ncm usb_f_mass_storage usb_f_acm u_serial usb_f_rndis u_ether nvidia(O+) snd_soc_tegra_controls(O) snd_soc_tegra_utils(O) governor_pod_scaling(O) libcomposite snd_soc_tegra210_admaif snd_soc_tegra186_arad(O) snd_soc_tegra210_ope snd_soc_tegra_pcm snd_soc_tegra210_mvc snd_soc_tegra210_amx snd_soc_tegra210_mixer snd_soc_tegra186_asrc snd_soc_tegra210_adx snd_soc_tegra210_i2s snd_soc_tegra210_sfc snd_soc_tegra210_ahub tegra210_adma nvvrs_pseq_rtc(O) spidev tegra_se(O) nvhost_vi5(O) tegra_se_kds(O) nvhost_nvcsi(O) crypto_engine nvhost_pva(O) nvhost_capture(O) nvmap(O) crct10dif_ce sm3_ce snd_soc_tegra_audio_graph_card sm3 coresight_trbe nvsciipc(O) snd_soc_audio_graph_card sha3_ce snd_hda_codec_hdmi nvidia_cspmu sha512_ce ivc_cdev(O) r8126(O) tegra_capture_coe(O) sha512_arm64 coresight snd_soc_simple_card_utils arm_spe_pmu ina238 tegra234_oc_event(O) nvpmodel_clk_cap(O) ina3221 nvme tegra_cactmon_mc_all(O) snd_hda_tegra snd_hda_codec snd_soc_rt56[   42.169303]  thermal_trip_event(O) snd_soc_rl6231 tegra23x_psc(O) cfg80211 tegra_xudc at24 lm90 host1x_fence(O) nvidia_vrs_pseq(O) tegra_aconnect mttcan(O) rfkill ramoops can_dev pwm_tegra_tachometer(O) tegra_dce(O) reed_solomon spi_tegra114 arm_cspmu_module tpm_ftpm_tee camera_diagnostics(O) nvhost_isp5(O) tegra_capture_isp(O) tegra_camera(O) v4l2_dv_timings host1x_nvhost(O) tegra_drm(O) tegra_wmark(O) nvhwpm(O) drm_display_helper drm_dp_aux_bus cec drm_kms_helper host1x(O) tegra_camera_platform(O) mc_utils(O) capture_ivc(O) v4l2_fwnode v4l2_async videobuf2_dma_contig videobuf2_memops videobuf2_v4l2 videodev videobuf2_common mc camchar(O) rtcpu_debug(O) tegra_camera_rtcpu(O) ivc_bus(O) hsp_mailbox_client(O) nvme_fabrics nvme_core fuse drm nfnetlink ip_tables x_tables ipv6 ngbe(OE) phy_tegra194_p2u pcie_tegra194 nvethernet(O) nvpps(O) pwm_fan pwm_tegra tegra_bpmp_thermal ufs_tegra(O) pcie_tegra264(O)
[   42.169348] CPU: 3 PID: 1454 Comm: modprobe Tainted: G           OE      6.8.12-tegra #1
[   42.169351] Hardware name: NVIDIA NVIDIA Jetson AGX Thor Developer Kit/Jetson, BIOS 38.2.1-gcid-42061081 09/10/2025
[   42.169352] pstate: 21400009 (nzCv daif +PAN -UAO -TCO +DIT -SSBS BTYPE=--)
[   42.169354] pc : __reset_control_get_internal+0x68/0x16c
[   42.169357] lr : __of_reset_control_get+0x190/0x1d8
[   42.169360] sp : ffff800087dfb5c0
[   42.169360] x29: ffff800087dfb5c0 x28: 0000000000000004 x27: ffff0000904a8110
[   42.169362] x26: 0000000000000000 x25: 0000000000000000 x24: 0000000000000001
[   42.169364] x23: 0000000000000000 x22: ffff000088b70750 x21: 000000000000001f
[   42.169365] x20: ffff000088b70770 x19: ffff000087229b40 x18: 0000000000000006
[   42.169367] x17: ffff000094f9cc00 x16: ffffb4c7bb59e800 x15: ffff800087dfb140
[   42.169369] x14: ffffffffffffffff x13: 0000000000000018 x12: 0101010101010101
[   42.169370] x11: 7f7f7f7f7f7f7f7f x10: ffffb8c7bec7e3c5 x9 : 0000000000000038
[   42.169372] x8 : 0101010101010101 x7 : 00000000736c6c65 x6 : 0000000000000080
[   42.169374] x5 : ffff800087dfb618 x4 : fffffbfffde272dc x3 : 0000000000000001
[   42.169376] x2 : 000000000000001f x1 : 000000000000001f x0 : 0000000000000000
[   42.169378] Call trace:
[   42.169379]  __reset_control_get_internal+0x68/0x16c
[   42.169382]  __of_reset_control_get+0x190/0x1d8
[   42.169384]  __reset_control_get+0x48/0x1cc
[   42.169387]  __devm_reset_control_get+0x78/0xd4
[   42.169389]  nvlink_core_init+0x2dcaf0/0x2dcd58 [nvidia]
[   42.169560]  platform_probe+0x68/0xe0
[   42.169567]  really_probe+0x150/0x2c8
[   42.169569]  __driver_probe_device+0x78/0x134
[   42.169572]  driver_probe_device+0x3c/0x164
[   42.169573]  __driver_attach+0x98/0x1c4
[   42.169576]  bus_for_each_dev+0x7c/0xf4
[   42.169579]  driver_attach+0x24/0x38
[   42.169580]  bus_add_driver+0xec/0x218
[   42.169583]  driver_register+0x5c/0x13c
[   42.169585]  __platform_driver_register+0x28/0x3c
[   42.169588]  nv_platform_register_driver+0x34/0x40 [nvidia]
[   42.169724]  init_module+0x174/0x5a0 [nvidia]
[   42.169858]  do_one_initcall+0x58/0x318
[   42.169867]  load_module+0x1f04/0x2000
[   42.169870]  init_module_from_file+0x88/0xd4
[   42.169872]  __arm64_sys_finit_module+0x148/0x330
[   42.169877]  el0_svc_common.constprop.0+0xd0/0xf0
[   42.169880]  do_el0_svc+0x1c/0x30
[   42.169883]  el0_svc+0x30/0xb8
[   42.169888]  el0t_64_sync+0x194/0x19830/0x13c
[   42.169890] ---[ end trace 0000000000000000 ]---
[   42.583774] NVRM: loading NVIDIA UNIX Open Kernel Module for aarch64  TempVersion  Release Build  (bugfix_main)  (buildbrain@5ce570c8-aabd-435b-a438-99bd3943cffd-jf1d-52rgf)  Wed Sep 10 12:34:47 PDT 2025
▒▒INFO: END TASK:MB▒▒
INFO: enter idle task.
INFO: END TASK:MB▒▒
▒▒ph =▒▒ter idle ta▒▒GPC ▒▒sk.
        ▒▒> logic map: 0=>0 1=>2 2=>1

Sorry that I can not find the exact patch fixing that issue.

It may be the early December.

Do you mean that one Thor booted from NVMe can work as expected but the NFS from it would cause those errors on another Thor booted from PXE?

Hi,KevinFFF

yes.the rootfs used for nfs is the same with NVME which flashed to the devkit.the same Image as NVME rootfs /boot/Image,and the same initrd except add one more ethernet ko . however the totally same initrd result in the same crashed error