Please provide the following information when requesting support.
Hardware - GPU: T4
Hardware - CPU: Unknown
Operating System: Amazon Linux2 (Docker container)
Riva Version: 1.8.0
I recently changed my model repository to use S3 instead of a local repo.
I run the riva-build
and riva-deploy
containers and upload all the files and folders to S3, however, when I go to run the Triton server, I get the following error:
terminate called after throwing an instance of 'std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >'
I am running Triton using
tritonserver --log-verbose=1 --log-info=true --log-warning=true --log-error=true --strict-model-config=false --model-control-mode=explicit "$LOAD_MODEL_STR" --model-repository "$MODEL_REPOSITORY"
And Riva container using
docker run -it --rm --gpus all --ulimit memlock=-1 --ulimit stack=67108864 --shm-size=64g \
-p 8000-8002:8000-8002 -p 50051:50051 \
riva-api:$RIVA_VERSION
Here’s a pastebin of the full logs: ============================= Riva Speech Skills =========================== - Pastebin.com
Any insight into why this might be happening?