# Mpif90 and nfvortran compatibility issues

**URL:** <https://forums.developer.nvidia.com/t/mpif90-and-nfvortran-compatibility-issues/176908>\
**Category:** nvc, nvc++ and nvfortran\
**Created:** [May 3, 2021, 5:46pm UTC](https://forums.developer.nvidia.com/t/mpif90-and-nfvortran-compatibility-issues/176908 "2021-05-03T17:46:06Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![ajmaicke](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@ajmaicke](https://forums.developer.nvidia.com/u/ajmaicke)\
**Post date:** [May 3, 2021, 5:46pm UTC](https://forums.developer.nvidia.com/t/mpif90-and-nfvortran-compatibility-issues/176908/1 "2021-05-03T17:46:06Z")

</div>

Hello. I am very new to CUDA, especially with Fortran. I am also a novice with makefiles, generally borrowing from others. Hopefully I’m not making an embarrassingly simple mistake!

I am having an issue compiling a project that uses both CUDA and MPI. I am using the nvfortran compiler for CUDA and mpif90 for MPI. Basically, from my main program I want to “use CUDA\_module” and “use MPI\_module”. However, when compiling my main f90 file with mpif90 I get the error:

> mpif90 -O0 -Mbounds -traceback -cuda -c main.f90  
> ifort: command line warning #10006: ignoring unknown option ‘-Mbounds’  
> ifort: command line warning #10006: ignoring unknown option ‘-cuda’  
> main.f90(4): error #7013: This module file was not generated by any release of this compiler. [CUDAMOD]  
> use cudamod

I have seen the following threads which are similar:

> [@Compilation issues between Fortran with MPI and CUDA Fortran](https://forums.developer.nvidia.com/t/compilation-issues-between-fortran-with-mpi-and-cuda-fortran/169574/2):
>
> Assuming your mpif90 is using nvfortran, try linking with just: mpif90 -o test main.o subroutines.o -cuda The “-cuda” indicates to the compiler driver that you’re using CUDA Fortran and will include all needed CUDA runtime libraries including the CUDA Fortran runtime (which is where your undefined reference is coming from). Note the files with the “.cuf” extension imply the -cuda flag. But when linking just object files, the driver doesn’t know that you’re using CUDA Fortran unless “-cuda” i…

> [@Mpif90+pgf90 compilation problem](https://forums.developer.nvidia.com/t/mpif90-pgf90-compilation-problem/136102):
>
> Hello everyone, as the title shows, fortran write MPI parallel program, part of the program I rewritten into cudaFortran program running on the GPU, .cuf, then compile, use mpif90 to compile mpifortran program, pgf90 compile to compile cudafortran program, There is no problem compiling, but the link fails. I want to know how to implement MPI+cudafortran hashing. The procedure is as follows: !-------------------------------------------------------- program hello\_world include 'mpif.…

> [@PGF90-F-0004 - Old or Corrupt Module](https://forums.developer.nvidia.com/t/pgf90-f-0004-old-or-corrupt-module/135812):
>
> Hi, I have Intel compiled library with all the \*.mod files. I would like to make add-on some PGI cuda fortran libraries with \*.mod files produced by Intel Compiler. So I followed the steps as listed here: [Documentation Library](https://software.intel.com/en-us/node/694273) But I received the error : PGF90-F-0004 - Old or Corrupt Module Does anyone has the idea why and how to overcome this problem? Regards, Phoon

However the first two are at the linking stage, while I’m still compiling, and either way my -Mbounds and -cuda flags are being ignored anyways. I’m not sure if the last one is an issue since based on the table at

> **[Documentation |
      ARC NCAR](https://arc.ucar.edu/docs)**

it seems like mpif90 and nvfortran should be compatible. Note I am not at UCAR but using a different computing cluster, which may be why I do not see compatibility?

I am trying this with a very simple code that essentially just initializes MPI, then initializes a GPU, then prints a bunch of hello worlds before finalizing MPI. The codes are:

main.f90

> program mpicuda
> 
> ```
> use mpimod
> use cudamod
> 
> implicit none
> 
> integer :: i, rank
> 
> call mpiinit(rank)
> call usegpu(rank)
> 
> do i = 1,10
> print*,"Hello world ",i," from rank ",rank
> end do
> 
> call finilizempi()
> 
> ```
> 
> end program

mpimod.f90

> module mpimod
> 
> ```
> use MPI
> 
> contains
> 
> subroutine mpiinit(myrank)
> implicit none
> 
> integer, intent(out) :: myrank
> integer :: rank, ierr, num_procs
> 
> call MPI_INIT(ierr)
> call MPI_COMM_SIZE(MPI_COMM_WORLD, num_procs, ierr)
> call MPI_COMM_RANK(MPI_COMM_WORLD, rank ,ierr)
> myrank = rank
> 
> return
> end subroutine mpiinit
> 
> subroutine finalizempi()
> 
> implicit none
> integer :: ierr
> 
> call MPI_FINALIZE(ierr)
> 
> return
> 
> end subroutine finalizempi
> 
> ```
> 
> end module mpimod

cudamod.cuf

> module cudamod
> 
> ```
> use cudafor
> 
> implicit none
> 
> contains
> 
> subroutine usegpu(rank)
> 
> implicit none
> 
> integer, intent(in) :: rank
> integer :: istat, nblock, ngrid
> 
> ngrid = 32
> nblock = 32
> if (rank .eq. 0) then
> istat = cudaSetDevice(0)
> end if
> 
> call gpukern<<<ngrid, nblock>>>()
> 
> return
> 
> end subroutine usegpu
> 
> attributes(global) subroutine gpukern()
> implicit none
> integer :: i
> 
> i = (blockidx%x-1)*blockdim%x + threadidx%x
> 
> return
> end subroutine gpukern
> 
> ```
> 
> end module cudamod

Makefile

> EXE:=mpigpu.exe
> 
> FCCUDA:=/bin/nvfortran  
> FCMPI:=mpif90
> 
> # Debug Flags
> 
> FCFLAGS:=-O0 -Mbounds -traceback
> 
> FILES:= cudamod.o mpimod.o main.o
> 
> MODS:=$(wildcard \*.mod)
> 
> UNAME\_S:=$(shell uname -n)  
> RM:=rm -fv
> 
> .SUFFIXES: .o .f .f90 .cuf
> 
> all: ${EXE}
> 
> ${EXE}: ${FILES} ${MODS}  
> ${FCMPI} -cuda -o $@ ${FILES}
> 
> cudamod.o:  
> ${FCCUDA} ${FCFLAGS} -cuda -c cudamod.cuf
> 
> mpimod.o:  
> ${FCMPI} ${FCFLAGS} -cuda -c mpimod.f90
> 
> main.o:  
> ${FCMPI} ${FCFLAGS} -cuda -c main.f90
> 
> %.mod: %.f90  
> @echo “Some modules are out of date. Do clean and then recompile”  
> ${RM} $@ ${EXE}
> 
> .PHONY: clean
> 
> clean:  
> ${RM} \*.o  
> ${RM} \*.mod  
> ${RM} ${EXE}

It doesn’t seem like there should be an issue. I have also tried -fc=/bin/nvfortran in the makefile to get mpif90 to use the right compiler, but then I have a similar error output as in the third thread I linked above (NVFORTRAN-F-0004-Corrupt or Old Module file). Is it impossible to get a file compiled with mpif90 to ‘use’ one with nvfotran? What would be my alternative? Is my version of mpif90 out of date and so doesn’t recognize nvfotran? I have done something similar in C (mpixx + nvcc) with no issues getting them to compile and link, but there I think the usage of a header file resolves issues in compiling.

EDIT: Looks like some of the spacing in the makefile copied weird, but all the tabbing is fine in my file.

---

<div class="post-metadata">

**Author:** ![MatColgrove](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/matcolgrove/32/14047_2.png) [@MatColgrove](https://forums.developer.nvidia.com/u/MatColgrove)\
**Post date:** [May 3, 2021, 6:06pm UTC](https://forums.developer.nvidia.com/t/mpif90-and-nfvortran-compatibility-issues/176908/2 "2021-05-03T18:06:15Z")

</div>

> [@ajmaicke](#):
>
> mpif90 -O0 -Mbounds -traceback -cuda -c main.f90  
> **ifort:** command line warning #10006: ignoring unknown option ‘-Mbounds’  
> **ifort:** command line warning #10006: ignoring unknown option ‘-cuda’  
> main.f90(4): error #7013: This module file was not generated by any release of this compiler. [CUDAMOD]  
> use cudamod

Looks like the mpif90 driver you’re using is configured for use with Intel’s ifort compiler which doesn’t recognize these command line options. You need to use an MPI configured for use with nvfortran in order to use CUDA Fortran.

We ship OpenMPI with the compilers which you can use found under the “comm\_libs/mpi” directory of your compiler install. Or talk with the UCAR admins on which module you need to load.