Hi, I used the M.2 Key M slot to install a Samsung V-Nand SSD 970 Pro on my AGX Xavier (Developer kit, L4T release R32.2.1). I want to move data to/from the SSD to the GPU memory through DMA. So I found this project https://github.com/enfiskutensykkel/ssd-gpu-dma that provides an API for building …

Hi, The modification in device tree is good. You should be able to boot up successfully. With further investigation, we have confirm the project is not supported on Xavier. It is because PCIe P2P protocol is not supported on Xavier. And the API in nv-p2p.h is different between desktop GPUs and Jet…

Hi, Please, can you help me to solve my mc-err errors?

Hi, The project looks specific to x86 with desktop GPUs. May not work for Xavier. So the default GPU memory is not big enough for your usecase and you need to have extra memory for CUDA processing on Xavier?

Yes, the default GPU memory is not big enough for my usecase and I need to have extra memory for CUDA processing on Xavier. In fact, my usage consists in acquiring very high resolution images at a high speed, performing some CUDA processing and then saving the input images and the results. The def…

Hi @DaneLLL , Yes, the default GPU memory is not big enough for my usecase and I need to have extra memory for CUDA processing on Xavier. My project will be included in an embedded system, so I can’t use a x86 desktop with GPUs. I need to use an embedded board and Xavier AGX seems to be the good ch…

Hi, This method is not supported in existing L4T releases. We will check if we can support/implement it in future releases.

Thanks for your feedback @DaneLLL . But how can we completely desible the SMMU for PCIe controller-0? I modified my device tree by commenting the two instructions (shown in the comment #4 of https://devtalk.nvidia.com/default/topic/1043746/jetson-agx-xavier/pcie-smmu-issue/ ) in file /public_sources/…

Hi, Thanks for your feedback @DaneLLL . Indeed, I had seen that the kernel API in nv-p2p.h requires somes modifications for porting on Jetson (as specify in point 4.4 of the GPUDirect RDMA documentation at https://docs.nvidia.com/ cuda / GPUDirect-RDMA/index.html#porting-to-jetson ). I had made the…

Hi, Please check Xavier TRM: https://developer.nvidia.com/embedded/downloads#?search=trm It is a hardware limitation.

Hi @DaneLLL , I understand that direct access to the gpu memory is not going to be possible in my case. By inspecting the output of the “lspci -v” command, we can see that : 0000:01:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 (prog-if 02 [NVM Exp…

Hi, We have Xavier 16GB, 8GB, TX2 8GB, 4GB modules. The platforms are mainly designed for embedded usecases. Xavier 16GB is the module with maximum memory size. From the discussion, it seems like desktop GPUs are better for this usecase. Also there is existing implementation. Due to the limitation…

PCIe SMMU issues on PCIe-C0 with an NVMe SSD connected to the M.2 Key M slot

Robotics & Edge Computing Jetson Systems Jetson AGX Xavier

Topic		Replies	Views
pcie smmu issue Jetson AGX Xavier	7	5668	October 18, 2021
How to disable SMMU for PCIe Jetson Xavier NX pcie	4	1108	November 24, 2022
How to map kernel memory to user memory? Jetson TX2	47	9516	October 18, 2021
How to Carry out DMA transfer when sending data using PCIe from NVIDIA Root Port to a custom end point Jetson AGX Xavier pcie	16	3810	August 3, 2023
Jetson AGX xavier not able to do DMA operation through PCIE with INTEL FPGA/smmu issue Jetson AGX Xavier pcie	6	1543	February 12, 2023
What is the current status of PCIe DMA? Jetson TX1	21	8356	October 18, 2021
Operating DMA from external device on new OS versions Jetson AGX Xavier pcie	4	450	November 19, 2023
How to disable SMMU on Xavier? Jetson AGX Xavier pcie	2	1401	October 18, 2021
Receiving PCIe data from end point via bus mastering with SMMU disabled Jetson AGX Xavier pcie	2	589	March 13, 2024
Altera FPGA DMA to TX2 via PCIe problem Jetson TX2	18	3825	October 18, 2021

PCIe SMMU issues on PCIe-C0 with an NVMe SSD connected to the M.2 Key M slot

Related topics