GPU Pro Tip: Track MPI Calls In The NVIDIA Visual Profiler

Originally published at: https://developer.nvidia.com/blog/gpu-pro-tip-track-mpi-calls-nvidia-visual-profiler/

Often when profiling GPU-accelerated applications that run on clusters, one needs to visualize MPI (Message Passing Interface) calls on the GPU timeline in the profiler. While tools like Vampir and Tau will allow programmers to see a big picture view of how a parallel application performs, sometimes all you need is a look at how MPI…

In the example code, the include statement is missing the include file name. Can you tell us what the actual filename is?

I've fixed this. Thanks!