How to run latest Supported Triton Inference Server 23.07 on docker

[AastaLLL]

Hi,

Please find more info in the comment below:

Installing Triton Server on Lenovo SE70 with Xavier NX

Hi, Thanks a lot for your patience. It turns out that the nvcr.io/nvidia/tritonserver container does work well on JetPack 5. Please see below for the testing. Server: tritonserver:24.02-py3-igpu $ git clone -b r24.02 https://github.com/triton-inference-server/server.git $ cd server/docs/examples/ $ ./fetch_models.sh $ sudo docker run -it --rm --runtime nvidia --network host -v ${PWD}/model_repository:/models nvcr.io/nvidia/tritonserver:24.02-py3-igpu tritonserver --model-repository=/models …

But please use the default CUDA 11.4 version instead of 12.2.
Thanks.