How can i install Riva Quickstart on AGX Orin

[dcb0223]

Please provide the following information when requesting support.

Hardware - nvidia jetson AGX orin

Operating System: “Ubuntu 20.04.6 LTS”

Jetpack version : JP5.1.4

docker version:Docker version 20.10.17, build 100c701

I want to install Riva on my device, but most of the versions I tried failed. I would like to ask, what exactly did I do wrong?

Here are my operation steps:

1.install jetpack on AGX orin

2.download NGC 4.13.0

mkdir riva

unzip ngccli_arm64.zip -C riva

cd riva

ngc-cli/ngc config set

3.download and try riva_quickstart

sudo apt update && sudo apt install -y docker.io

ngc registry resource download-version nvidia/riva/riva_quickstart_arm64:2.24.0

cd riva_quickstart_arm64_v2.24.0/

sudo bash riva_init.sh

(You will have to wait for a long time here, and some versions may give an error.)

vim riva_start.sh

modify:

    #--gpus '"'$gpus_to_use'"' \
    --runtime=nvidia \

#docker exec $1 /bin/grpc_health_probe -addr=:$riva_speech_api_port $grpc_tls_args 2> /dev/null
docker exec $1 /bin/grpc_health_probe -addr=:$riva_speech_api_port $grpc_tls_args

sudo bash riva_start.sh

[carolyuu]

*** Please note that this reply is generated by LLM automatically ***

To provide support for installing Riva on your Jetson AGX Orin device, I’ll go through your steps and offer suggestions.

Hardware and Software Information

• Hardware: NVIDIA Jetson AGX Orin
• Operating System: Ubuntu 20.04 LTS
• Jetpack version: JP5.1.4
• Docker version: Docker version 20.10.17, build 100c701

Step-by-Step Analysis

1. Install Jetpack on AGX Orin: You’ve installed Jetpack on your device, which is a prerequisite for installing Riva.
2. Download NGC 4130 image: You’ve downloaded the NGC 4130 image, which is a container image for Riva.
3. Unzip and configure NGC: You’ve unzipped the NGC image and configured it using the ngc command.
4. Download and try Riva Quickstart: You’ve downloaded the Riva Quickstart package and attempted to install it.

Potential Issues and Suggestions

• Docker version: Your Docker version is 20.10.17, which is compatible with Riva. However, you may want to check if there are any known issues with this version and Riva.
• NGC image version: You’ve downloaded the NGC 4130 image, which is a relatively old version. You may want to try downloading a newer version of the NGC image to see if it resolves the issue.
• Riva Quickstart version: You’ve downloaded the Riva Quickstart package version 2.2.40. You may want to try downloading a newer version of the Riva Quickstart package to see if it resolves the issue.
• Installation script: You’ve modified the rivastart.sh script to use a different image version. This may be causing issues with the installation. You may want to try using the original script without modifications.
• Error messages: You haven’t provided any error messages that you’ve encountered during the installation process. Please provide the error messages so that I can help you troubleshoot the issue.

Comparison with Other Versions

• Jetpack version: You’re using Jetpack version JP5.1.4, which is a relatively old version. You may want to try updating to a newer version of Jetpack to see if it resolves the issue.
• Docker version: Your Docker version is compatible with Riva, but you may want to try updating to a newer version of Docker to see if it resolves the issue.

Conclusion

To resolve the issue, you may want to try the following:

• Download a newer version of the NGC image and Riva Quickstart package.
• Use the original rivastart.sh script without modifications.
• Provide error messages that you’ve encountered during the installation process.
• Update to a newer version of Jetpack and Docker.

If you’re still encountering issues, please provide more information about the error messages you’re seeing, and I’ll do my best to help you troubleshoot the issue.

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***