0: cudaMalloc: 4096 bytes requested; not enough memory: 700(an illegal memory access was encountered)

Hi Team,

I just updated my PGI community from 19.4 to 19.10, and I’m confused with some new mistakes.

0: cudaMalloc: 4096 bytes requested; not enough memory: 700(an illegal memory access was encountered)

I didnot change any code and the mistake I haven’t seen before. I even reduced the matrix size I used, but the error still exists. So I’m wondering what’s wrong with my compiler or with my code?

Thank you very much!

Now: PGI 19.10 + Open Mpi 4.0.1

nvidia-smi
Sun Jan 19 10:06:54 2020       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 430.50       Driver Version: 430.50       CUDA Version: 10.1     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  TITAN RTX           Off  | 00000000:01:00.0  On |                  N/A |
| 41%   40C    P8    25W / 280W |    321MiB / 24217MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   1  TITAN RTX           Off  | 00000000:05:00.0 Off |                  N/A |
| 41%   33C    P8    25W / 280W |      1MiB / 24220MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
+-----------------------------------------------------------------------------+

pgf90 --version
pgf90 19.10-0 LLVM 64-bit target on x86-64 Linux -tp haswell
PGI Compilers and Tools
Copyright (c) 2019, NVIDIA CORPORATION. All rights reserved.

nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Sun_Jul_28_19:07:16_PDT_2019
Cuda compilation tools, release 10.1, V10.1.243

I just fixed it by reinstall openmpi, thank you very much.