best way to report memory consumption in CUDA?

Accelerated Computing CUDA CUDA Programming and Performance
1

What is the best way to report memory consumption in CUDA, if I want
it reported separately for the memory consumed on each GPU card, and
for the main memory consumption of each pthread on the CPU?

2

at runtime, you can use cudaMemGetInfo in your app.

// show memory usage of GPU

        size_t free_byte ;

        size_t total_byte ;

        cuda_status = cudaMemGetInfo( &free_byte, &total_byte ) ;

        if ( cudaSuccess != cuda_status ){

            printf("Error: cudaMemGetInfo fails, %s \n", cudaGetErrorString(cuda_status) );

            exit(1);

        }

double free_db = (double)free_byte ;

        double total_db = (double)total_byte ;

        double used_db = total_db - free_db ;

        printf("GPU memory usage: used = %f, free = %f MB, total = %f MB\n",

            used_db/1024.0/1024.0, free_db/1024.0/1024.0, total_db/1024.0/1024.0);