Kubernetes Operator (k8s) setting CUDA_VISIBLE_DEVICES

My code that I am deploying to Kubernetes can currently only use 1 GPU. My hardware has 2. I’d like to be able to deploy and manage CUDA_VISIBLE_DEVICES from a kubernetes deployment. Does the Nvidia K8s operator do this?

Use NVIDIA_VISIBLE_DEVICES, see here

1 Like