hello, I’m building hpl 2.0 with pgi compiler suit running ACML 4.2
everything builds fine but when I run xhpl, xhpl does not fail but does not allocate memory for the xhpl process.
for example:
running problem size of 110000 on dual 64 gig memory nodes, I should be using about 38 Gig memory on each node.(this was the case with GCC)
when I try to run the xhpl with mvapich2 (built with pgi 8.0-3) the memory allocation is only 600MB.
however if the problem size is small say: 20000 it returns results.
Any hints is appreciated, here is the ldd output:
libacml.so => /opt/pgi/linux86-64/8.0-3/libso/libacml.so (0x00002b62ef188000)
libacml_mv.so => /opt/pgi/linux86-64/8.0-3/libso/libacml_mv.so (0x00002b62f3e62000)
/usr/local/ofed/mpi/pgi/mvapich2-1.0.3/lib/libmpich.so (0x00002b62f3fa9000)
librdmacm.so.1 => /usr/local/ofed/lib64/librdmacm.so.1 (0x00002b62f4358000)
libibverbs.so.1 => /usr/local/ofed/lib64/libibverbs.so.1 (0x00002b62f455d000)
libibumad.so.1 => /usr/local/ofed/lib64/libibumad.so.1 (0x00002b62f476a000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003527a00000)
librt.so.1 => /lib64/librt.so.1 (0x0000003528a00000)
libm.so.6 => /lib64/libm.so.6 (0x0000003527600000)
libc.so.6 => /lib64/libc.so.6 (0x0000003526e00000)
libpgftnrtl.so => /opt/pgi/linux86-64/8.0-3/libso/libpgftnrtl.so (0x00002b62f4971000)
libpgc.so => /opt/pgi/linux86-64/8.0-3/libso/libpgc.so (0x00002b62f4a9f000)
libdl.so.2 => /lib64/libdl.so.2 (0x0000003527200000)
libibcommon.so.1 => /usr/local/ofed/lib64/libibcommon.so.1 (0x00002b62f4be6000)
/lib64/ld-linux-x86-64.so.2 (0x0000003526a00000)