MPI bootstrap version (20800) is not compatible

Accelerated Computing GPU-Accelerated Libraries
1

I’m trying to run CUDALibrarySamples/cuFFTMp/samples/r2c_c2r as:
mpirun -n 2 --oversubscribe ./cufftmp_r2c_c2r

But I get:
Hello from rank 0/2 using GPU 0
Hello from rank 1/2 using GPU 1
src/bootstrap/bootstrap_mpi.c:nvshmemi_bootstrap_plugin_init:101: MPI bootstrap version (20800) is not compatible with NVSHMEM version (1)src/bootstrap/bootstrap_mpi.c:nvshmemi_bootstrap_plugin_init:101: MPI bootstrap version (20800) is not compatible with NVSHMEM version (1)

This is with HPC SDK 23.1 on a node without Infiniband. And the MPI bundled with the SDK. Why would I get this version mismatch?

2

I have the same ploblem.

3

HPC SDK 23.1 packs with a newer version of NVSHMEM (2.8) which cuFFTMP is compatible with 2.6. See our document here