Could you please try setting the environment variable NVSHMEM_DISABLE_CUDA_VMM=1? This disables automatic symmetric heap sizing, so you may also need to increase NVSHMEM_SYMMETRIC_SIZE. More information on these env vars is available here: Environment Variables — NVSHMEM 2.10.1 documentation
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
NVSHMEM on multi-node GPUs failed . My gpu is A5000 | 5 | 897 | April 1, 2024 | |
What is the setting to enable NVSHMEM on multi-node multi-GPU platform with IB | 7 | 95 | January 2, 2025 | |
Using unified memory causes system crash | 28 | 5862 | February 4, 2019 | |
cudaHostRegister crash or poor performance unknow error (30) in kernel for 64bit host operating syst | 23 | 5650 | May 8, 2012 | |
Bug in cudaMemsetAsync or in Nsight VS Edition when visualizing cudaMemsetAsync execution | 13 | 1393 | November 11, 2021 | |
malloc memory in kernel linked via in/out variable | 10 | 1934 | October 17, 2015 | |
NVSHMEM runtime error | 11 | 1848 | August 16, 2022 | |
Using Shared Memory in CUDA C/C++ | 36 | 1979 | October 8, 2020 | |
NVSHMEM isuues with nvshmem_TYPENAME_put | 6 | 564 | November 21, 2023 | |
Error when running NVSHMEM perftest | 3 | 121 | January 16, 2025 |