Can nvidia-smi output container level GPU utilization

Accelerated Computing CUDA CUDA Programming and Performance
1

If I run nvidia-smi --query-gpu inside a container on a GPU enabled host, will it output container level GPU utilization? I have only one GPU on my host.

Thanks

2

It will output the same information as if you had run it on the host. It will show the utilization of that GPU, but it is not restricted to showing only the utilization of that GPU by that container.

1 Like
4

Hi @Robert_Crovella :
Thanks so much for the quick response. So it is not possible right now to get the GPU utilization only for a single container?

Thanks a lot

5

You could do that just by ensuring that container is the only thing using that GPU. Other than that I am not aware of any way.

1 Like
6

Got it. Thanks so much @Robert_Crovella !