I’m also having the same issue in the following topic: How to Deploy TAO 4.0 (with AutoML) Support without Kubernetes?
I strongly believe there should be a standalone Dockerfile/Docker Image deployment for the whole TAO Toolkit API services. Having both Ansible and Kubernetes giving so much pain while troubleshooting the whole unnecessarily complex deployment process.