Correct way to use triton in jp 5.1.2?

[AastaLLL]

Hi,

Please check below for the info:

Installing Triton Server on Lenovo SE70 with Xavier NX

Hi, Thanks a lot for your patience. It turns out that the nvcr.io/nvidia/tritonserver container does work well on JetPack 5. Please see below for the testing. Server: tritonserver:24.02-py3-igpu $ git clone -b r24.02 https://github.com/triton-inference-server/server.git $ cd server/docs/examples/ $ ./fetch_models.sh $ sudo docker run -it --rm --runtime nvidia --network host -v ${PWD}/model_repository:/models nvcr.io/nvidia/tritonserver:24.02-py3-igpu tritonserver --model-repository=/models …

Thanks.