Can nvidia-smi output container level GPU utilization

If I run nvidia-smi --query-gpu inside a container on a GPU enabled host, will it output container level GPU utilization? I have only one GPU on my host.


It will output the same information as if you had run it on the host. It will show the utilization of that GPU, but it is not restricted to showing only the utilization of that GPU by that container.

1 Like

Hi @Robert_Crovella :
Thanks so much for the quick response. So it is not possible right now to get the GPU utilization only for a single container?

Thanks a lot

You could do that just by ensuring that container is the only thing using that GPU. Other than that I am not aware of any way.

1 Like

Got it. Thanks so much @Robert_Crovella !