Hello, I am trying to run the ./triton_backend_setup.sh command inside the deepstream:7.1-triton-multiarch container that I downloaded opened via the instructions on this link DeepStream | NVIDIA NGC
I began following the instructions in the readme inside the container and started by trying to run ./triton_backend_setup.sh command but I got the following error:
--2025-01-25 22:59:14-- https://boostorg.jfrog.io/artifactory/main/release/1.80.0/source/boost_1_80_0.tar.gz
Resolving boostorg.jfrog.io (boostorg.jfrog.io)... 3.95.117.170, 18.214.194.113, 18.232.172.199
Connecting to boostorg.jfrog.io (boostorg.jfrog.io)|3.95.117.170|:443... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https://landing.jfrog.com/reactivate-server/boostorg [following]
--2025-01-25 22:59:15-- https://landing.jfrog.com/reactivate-server/boostorg
Resolving landing.jfrog.com (landing.jfrog.com)... 18.214.194.113, 3.95.117.170, 18.232.172.199
Connecting to landing.jfrog.com (landing.jfrog.com)|18.214.194.113|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 11534 (11K) [text/html]
Saving to: '/tmp/triton_server_downloads/boost.tar.gz'
/tmp/triton_server_ 100%[==================>] 11.26K --.-KB/s in 0.001s
2025-01-25 22:59:15 (17.8 MB/s) - '/tmp/triton_server_downloads/boost.tar.gz' saved [11534/11534]
/tmp/triton_server_downloads /opt/nvidia/deepstream/deepstream-7.1/samples
gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now
The file is present within the container but I assume it may be corrupted if it is not in the correct gzip format. Does anyone know a way to either change the ./triton_backend_setup.sh file or fix this issue any other way? I am running on jetpack 6.1 Jetson orin nano. I have also tried running this command natively as well as within the deepstream:7.1-samples-multiarch container and have received the same issues. Also, is this a command I even need to run inside the triton container, or is the server already set up inside? The readme made it sound like this needed to be run before running any of the triton examples.
Here are the content of the ./triton_backend_setup.sh file:
set -e
TRITON_DOWNLOADS=/tmp/triton_server_downloads
TRITON_PKG_PATH=${TRITON_PKG_PATH:=https://github.com/triton-inference-server/server/releases/download/v2.49.0/tritonserver2.49.0-igpu.tar.gz}
TRITON_BACKEND_DIR=/opt/tritonserver/backends
DEEPSTREAM_LIB_DIR=/opt/nvidia/deepstream/deepstream/lib
TRITON_SERVER_BIN=/opt/tritonserver/bin
echo "Creating ${TRITON_DOWNLOADS} directory ..."
mkdir -p $TRITON_DOWNLOADS
echo "Installing Triton prerequisites ..."
if [ $EUID -ne 0 ]; then
echo "Must be run as root or sudo"
exit 1
fi
apt-get update && \
apt-get install -y --no-install-recommends libb64-dev libre2-dev libopenblas-dev
wget -O ${TRITON_DOWNLOADS}/boost.tar.gz https://boostorg.jfrog.io/artifactory/main/release/1.80.0/source/boost_1_80_0.tar.gz
pushd ${TRITON_DOWNLOADS}
tar xvf boost.tar.gz
cd boost_*/
./bootstrap.sh
./b2 install
popd
echo "Downloading ${TRITON_PKG_PATH} to ${TRITON_DOWNLOADS} ... "
wget -O $TRITON_DOWNLOADS/jetpack.tgz $TRITON_PKG_PATH
echo "Creating ${TRITON_BACKEND_DIR} directory ... "
mkdir -p ${TRITON_BACKEND_DIR}
echo "Creating ${TRITON_SERVER_BIN} directory ... "
mkdir -p ${TRITON_SERVER_BIN}
echo "Extracting the Triton library and backend binaries ..."
tar -xzf $TRITON_DOWNLOADS/jetpack.tgz -C $DEEPSTREAM_LIB_DIR --strip-components=2 tritonserver/lib/libtritonserver.so
tar -xzf $TRITON_DOWNLOADS/jetpack.tgz -C $TRITON_BACKEND_DIR --wildcards --strip-components=2 tritonserver/backends/*
tar -xzf $TRITON_DOWNLOADS/jetpack.tgz -C $TRITON_SERVER_BIN --strip-components=2 tritonserver/bin/tritonserver
chmod -R +r $TRITON_BACKEND_DIR
chmod +rx $TRITON_SERVER_BIN
ldconfig
echo "cleaning up ${TRITON_DOWNLOADS} directory ..."
rm -rf $TRITON_DOWNLOADS