Launching Nvidia Riva Speech containers on Jetson Orin NX 16 GB

Robotics & Edge Computing Jetson Systems Jetson Orin NX
1

Hello!

I need help with launching Nvidia Riva Speech containers.
I’m working on Ubuntu 22 on an Nvidia Jetson Orin NX 16 GB.
I’m trying to set up NVIDIA Riva Speech AI locally, specifically the “Riva embedded (ARM64)” version, which is supposedly designed for Nvidia Jetson Orin.

Platform:
* System: Linux
* Distribution: Ubuntu 22.04 Jammy Jellyfish
* Release: 5.15.148-tegra
* Python: 3.10.12

Libraries:
* CUDA: 12.6.68
* CUDNN: 9.3.0.75
* TensorT: 10.3.0.30
* VPI: 3.2.4
* Vulkan: 1.3.204
* OpenCV: 4.10.0 with CUDA: YES

Hardware:

* Model: NVIDIA Jetson Orin NX Engineering Reference Developer Kit Super
* 699-level Part Number: 699-13767-0000-301 G.1
* P- Number: p3767-0000
* Module: NVIDIA Jetson Orin NX (16GB ram)
* Soc: tegra234
* LAT: 36.4.3
* Jetpack: 6.2

I’m following the installation instructions exactly:

The NVIDIA runtime is configured in Docker:

$ docker info | grep -i runtime
 Runtimes: io.containerd.runc.v2 nvidia runc
 Default Runtime: nvidia
  1. Run:
./riva_init.sh

Please enter API key for ngc.nvidia.com: "__Enter API key__"
Logging into NGC docker registry if necessary...
Pulling required docker images if necessary...
Note: This may take some time, depending on the speed of your Internet connection.
> Pulling Riva Speech Server images.
  > Image nvcr.io/nvidia/riva/riva-speech:2.19.0-l4t-aarch64 exists. Skipping.
Downloading models (RMIRs) from NGC...
...
+ echo 'Riva initialization complete. Run ./riva_start.sh to launch services.'
Riva initialization complete. Run ./riva_start.sh to launch services.
  1. The Docker image appears:
$ docker images
REPOSITORY                        TAG                         IMAGE ID       CREATED         SIZE
nvcr.io/nvidia/riva/riva-speech   2.17.0-l4t-aarch64          b511859d5f51   8 months ago    15.8GB
  1. When I run:
./riva_start.sh

I get one of two errors:

Error 1:

Error response from daemon: No such container: riva-speech
Waiting for Riva server to load all models...retrying in 10 seconds
09a19163c239bd59e858b7cb33d6ac3a867d219ea8981be752587ed773f7ba0e
docker: Error response from daemon: failed to set up container networking: driver failed programming external connectivity on endpoint riva-speech (69ccbfd618f0096523d42d783593f628bbd01b4f00d82f75bfa79cd506a9aeb0): Unable to enable DIRECT ACCESS FILTERING - DROP rule:  (iptables failed: iptables --wait -t raw -A PREROUTING -p tcp -d 172.17.0.2 --dport 8000 ! -i docker0 -j DROP: iptables v1.8.7 (legacy): can't initialize iptables table `raw': Table does not exist (do you need to insmod?)
Perhaps iptables or your kernel needs to be upgraded.
 (exit status 3))

Error 2:

Starting Riva Speech Services. This may take several minutes depending on the number of models deployed.
docker: Error response from daemon: Conflict. The container name "/riva-speech" is already in use by container "5e4dd5d6d66aceb3c44461d86bb4d57b8a68c48c48ef9306f518559fdaacb0e1". You have to remove (or rename) that container to be able to reuse that name.

Run 'docker run --help' for more information
Error response from daemon: container 5e4dd5d6d66aceb3c44461d86bb4d57b8a68c48c48ef9306f518559fdaacb0e1 is not running
Waiting for Riva server to load all models...retrying in 10 seconds
...
Error response from daemon: container 5e4dd5d6d66aceb3c44461d86bb4d57b8a68c48c48ef9306f518559fdaacb0e1 is not running
Waiting for Riva server to load all models...retrying in 10 seconds
Health ready check failed.
Check Riva logs with: docker logs riva-speech

I tried to run version 2.19 and 2.17 same result…

What could be causing this? Can you help?

3

Hi,

Could you check the below comment to see if it can solve your issue as well?

Thanks.

1 Like
4

This really helped! Riva server is up and running. Thank you!

5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.