Dont detect NVMe disk in Jetpack 6 in carrierboard Auvidea X230D

We are using any AGX Orin prod modules with carrierboards Auvidea X230D and Avermedia D315.
With Linux 35x have no problems.
But after reflash (with this manual) to Linux 36x have problems with NVMe Samsung 970EVOPlus in carrierboard Auvidea X230.
Error log:

[ 11.694776] nvme nvme0: pci function 0005:01:00.0
[ 11.694844] nvme 0005:01:00.0: enabling device (0000 -> 0002)
[ 11.694933] nvme nvme0: Removing after probe failure status: -19

After reflash back to Linux 35x have no problems.
Also we tested with another module and SSD - working well.
So module and SSD are good.

We dont find any usefull info about this error.

What can we try to resolve our NVMe problem?

Other logs attached.
dmesg.txt (72.3 KB)
log flash.txt (128.5 KB)
log normal.txt (2.9 KB)
log problem.txt (3.0 KB)

There is no obvious error here. Please enable some logs in nvme.ko driver and see which check got wrong and went into probe falure.

In the meantime, please check other kind of SSD too.

Thank for the infornation!
Also want to remeber - in last version on Linux 35 - no any problems with NVMe, so we thinking that in new Linux problem is with any drivers or other…
We try to turn on nvme logs, but they are empty

user@agxorin2:~$ sudo trace-cmd start -e nvme
user@agxorin2:~$ sudo cat /sys/kernel/debug/tracing/trace_pipe

After rescan pcei have same error
user@agxorin2:~$ echo 1 | sudo tee /sys/bus/pci/devices/0005:01:00.0/remove
1
user@agxorin2:~$ echo 1 | sudo tee /sys/bus/pci/rescan
1
user@agxorin2:~$ sudo dmesg | grep -i nvme

[   10.073830] nvme 0005:01:00.0: Adding to iommu group 56
[   10.074860] nvme nvme0: pci function 0005:01:00.0
[   10.074918] nvme 0005:01:00.0: enabling device (0000 -> 0002)
[   10.075008] nvme nvme0: Removing after probe failure status: -19
[  716.213321] nvme_core: unknown parameter 'debug' ignored
[  721.105568] nvme nvme0: pci function 0005:01:00.0
[  721.105732] nvme nvme0: Removing after probe failure status: -19
[ 1175.938430] nvme_core: unknown parameter 'debug' ignored
[ 1181.178199] nvme nvme0: pci function 0005:01:00.0
[ 1181.178360] nvme nvme0: Removing after probe failure status: -19
[ 1613.836136] nvme 0005:01:00.0: Adding to iommu group 56
[ 1613.837599] nvme nvme0: pci function 0005:01:00.0
[ 1613.837761] nvme nvme0: Removing after probe failure status: -19

Also we had try 2 types of SSD different series - with same error.
We have no other SSD for testing…

We found SSD Hynix – no problems!

user@agxorin2:~$ sudo nvme list
Node SN Model Namespace Usage Format FW Rev
——————— ——————– —————————————- ——— ————————– —————- ——–
/dev/nvme0n1 NY11N10681180211D SKHynix_HFM256GDHTNI-87A0B 1 256,06 GB / 256,06 GB 512 B + 0 B 11020C00

user@agxorin2:~$ sudo dmesg | grep -i nvme
[sudo] password for user:
[ 10.217164] nvme 0005:01:00.0: Adding to iommu group 56
[ 10.217517] nvme nvme0: pci function 0005:01:00.0
[ 10.217664] nvme 0005:01:00.0: enabling device (0000 → 0002)
[ 10.221024] nvme nvme0: missing or invalid SUBNQN field.
[ 10.223018] nvme nvme0: 8/0/0 default/read/poll queues
[ 10.224576] nvme0n1:

user@agxorin2:~$ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
loop0 7:0 0 16M 1 loop
mmcblk0 179:0 0 59,3G 0 disk
nvme0n1 259:0 0 238,5G 0 disk