I’m having a hard time running Clara Deploy SDK and got stuck at “Wait until TRTIS is Ready” as it’s mentioned below while running as per the following https://ngc.nvidia.com/catalog/containers/nvidia:clara:ai-covid-19 link. And I kindly request you to look into it and let me know the resolution and what the problem via the content that is as follows:
Error response from daemon: network with name container-demo already exists
nvidia-docker run --name trtis --network container-demo -d --rm --shm-size=1g --ulimi
t memlock=-1 --ulimit stack=67108864 -p 8000:8000 -v /home/ubuntu/models/classificati
-py3 trtserver --model-store=/models
Wait until TRTIS 172.18.0.2 is ready…
You may observe in the above-posted screenshots that it got stuck while executing the following shell script at https://ngc.nvidia.com/catalog/containers/nvidia:clara:ai-covid-19
I did the above one soon after setting up with the reference pipeline using the following link https://ngc.nvidia.com/catalog/model-scripts/nvidia:clara:clara_ai_covid19_pipeline
Could you at least let me know where exactly I went wrong? Or Did I do anything in a different order? Or Didn’t store the files in the appropriate directories? I’m kinda confused here!
Or Do I have to do anything with the NVIDIA Triton Inference Server (Triton), formerly known as TensorRT Inference Server (TRTIS)?
And I was also following the Clara Deploy SDK Docs https://docs.nvidia.com/clara/deploy/index.html page while doing the above ones.
But I guess but I don’t know exactly if I’m correct in this regard that the problem is with the NVIDIA Triton Inference Server (Triton), formerly known as TensorRT Inference Server (TRTIS). Kindly please look into it and let me know ASAP.