Getting error "/usr/local/bin/nvidia_entrypoint.sh: line 33: exec: trtserver: not found"

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Hi,

I’m trying to run the tensorrt inference server via the docker container. Based on my current NVIDIA driver compatibility, I’m running the nvcr.io/nvidia/tensorrt:18.08-py2 image.

However, when I try to start the server with the following command

nvidia-docker run --rm --shm-size=1g --ulimit memlock=-1 --ulimit stack=67108864 -p 8000:8000 -p 8001:8001 -p 8002:8002 -v /home/model_repository:/models nvcr.io/nvidia/tensorrt:18.08-py2 trtserver --model-store=/models

I get this error

/usr/local/bin/nvidia_entrypoint.sh: line 33: exec: trtserver: not found

Am I missing some configuration or setup options ? Any help would be really appreciated

Thanks

2

Hi, I encountered the same issue. Have you found the solution, please?

3

any solution on this?

I have a similar problem

(base) mona@ada:/data/FoundationPose/docker$ bash run_container.sh
foundationpose
access control disabled, clients can connect from any host

==========
== CUDA ==
==========

CUDA Version 12.1.0

Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

*************************
** DEPRECATION NOTICE! **
*************************
THIS IMAGE IS DEPRECATED and is scheduled for DELETION.
    https://gitlab.com/nvidia/container-images/cuda/blob/master/doc/support-policy.md

/opt/nvidia/nvidia_entrypoint.sh: line 67: exec: --: invalid option
exec: usage: exec [-cl] [-a name] [command [arguments ...]] [redirection ...]
(base) mona@ada:/data/FoundationPose/docker$ cat run_container.sh
docker rm -f foundationpose
CATGRASP_DIR=$(pwd)/../
xhost +  && docker run --gpus all --env NVIDIA_DISABLE_REQUIRE=1 -it --network=host --name foundationpose docker.io/shingarey/foundationpose_custom_cuda121:latest  --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -v /data:/data -v /mnt:/mnt -v /tmp/.X11-unix:/tmp/.X11-unix -v /tmp:/tmp  --ipc=host -e DISPLAY=${DISPLAY} -e GIT_INDEX_FILE foundationpose:latest bash
1 Like