Could you please try setting the environment variable NVSHMEM_DISABLE_CUDA_VMM=1? This disables automatic symmetric heap sizing, so you may also need to increase NVSHMEM_SYMMETRIC_SIZE. More information on these env vars is available here: Environment Variables — NVSHMEM 2.10.1 documentation
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
NVSHMEM on multi-node GPUs failed . My gpu is A5000 | 5 | 757 | April 1, 2024 | |
Using unified memory causes system crash | 28 | 5796 | February 4, 2019 | |
cudaHostRegister crash or poor performance unknow error (30) in kernel for 64bit host operating syst | 23 | 5644 | May 8, 2012 | |
malloc memory in kernel linked via in/out variable | 10 | 1921 | October 17, 2015 | |
NVSHMEM runtime error | 11 | 1795 | August 16, 2022 | |
Using Shared Memory in CUDA C/C++ | 36 | 1929 | October 8, 2020 | |
NVSHMEM isuues with nvshmem_TYPENAME_put | 6 | 549 | November 21, 2023 | |
Error when running NVSHMEM perftest | 3 | 25 | January 16, 2025 | |
Unified virtual memory slowdown even without migration | 6 | 1465 | January 31, 2022 | |
Evaluating SMem Access Pattern and SMem Efficiency in NVVP | 23 | 1292 | November 29, 2018 |