Officially, current method will install tao api with gpu driver uninstalled.
And actually we have some ways to install tao api on non-bare-metal machines. That means using tao-api in case who does not want to uninstall gpu driver and other sw.
We propose to install k8s first then deploy tao api. It is a bit comprehensive and not mentioned in user guide yet. User can follow this guide to install k8s cluster with GPU support firstly: https://docs.nvidia.com/datacenter/cloud-native/kubernetes/install-k8s.html#option-2-installing-kubernetes-using-kubeadm . Then they could follow https://docs.nvidia.com/tao/tao-toolkit/text/tao_toolkit_api/api_deployment.html to install tao-toolkit-api