Running Riva and TAO using SSH

m_m_kumaran · August 23, 2022, 4:09am

Please provide the following information when requesting support.

Hardware - GPU (A100/A30/T4/V100)
Operating System Ubuntu 20.04
Riva Version 2.4.0

How to run Riva and other services from images using SSH? is there any detailed manual available?

rvinobha · August 23, 2022, 9:33am

Hi @m_m_kumaran

Thanks for your interest in Riva,

I will check regarding this question with the team and provide an update

Thanks

m_m_kumaran · August 24, 2022, 2:52am

Thanks, As our company ventures into Nvidia and its tools, we are new to it and it will be really helpful.

rvinobha · September 19, 2022, 7:41pm

Hi @m_m_kumaran

Apologies for the delay in response,

I have checked with the team, currently the Riva is docker container based, so usage with SSH (not sure)

I can help more, can you please provide the use case/example for better understanding

Thanks

m_m_kumaran · September 20, 2022, 3:52am

hi,
Thanks and as we have 100 Nvidia GPU, we want to use ASR project to help in daily operation.

Thanks
Muthu

m_m_kumaran · September 20, 2022, 3:53am

I need a guidance on running RIVA services through docker such as any setup needed or steps to run and customise for our company,

hi,
Thanks and as we have 100 Nvidia GPU, we want to use ASR project to help in daily operation.

Thanks
Muthu

rvinobha · September 22, 2022, 6:48pm

Hi @m_m_kumaran

Currently we can communicate from external machines to riva server using gRPC
The default port used is 50051

Please find the below python notebook for an ASR example

github.com

nvidia-riva/tutorials/blob/stable/asr-python-basics.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-basics/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
    "\n",
    "# How do I use Riva ASR APIs with out-of-the-box models?\n",
    "\n",
    "This tutorial walks you through the basics of Riva Speech Skills ASR Services, specifically covering how to use Riva ASR APIs with out-of-the-box models."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## NVIDIA Riva Overview\n",
    "\n",
    "NVIDIA Riva is a GPU-accelerated SDK for building Speech AI applications that are customized for your use case and deliver real-time performance. <br/>\n",

This file has been truncated. show original

Please find complete github link (reference, installation)

I hope i provided some insights, if i am missing something, or my understanding is wrong/different, please let me know, i will provide more details and answers

Thanks

Topic		Replies	Views
Unable to download RIVA models during riva_init.sh Riva	2	913	October 21, 2022
Can we use Riva as a standalone package? Riva	9	797	November 28, 2022
Getting Error on command bash riva_init.sh Riva	10	1035	March 28, 2023
Is there an example of a node.js engine for ASR/TTS? Riva	2	767	February 27, 2023
Riva ASR Riva	3	568	October 26, 2022
Riva Virtual Assisstant launch error Riva	5	1076	February 3, 2022
RIVA ASR not working in ESXi8 environment Riva cuda , riva , esxi	5	704	May 11, 2023
Unable to start riva Riva	6	1621	March 12, 2022
What is the difference between Riva ASR w/wo NIM? Models nim	3	37	October 19, 2024
Building a Speech-Enabled AI Virtual Assistant with NVIDIA Riva on Amazon EC2 Technical Blog	2	626	July 31, 2024

Running Riva and TAO using SSH

Related topics