Running Riva and TAO using SSH

m_m_kumaran · August 23, 2022, 4:09am

Please provide the following information when requesting support.

Hardware - GPU (A100/A30/T4/V100)
Operating System Ubuntu 20.04
Riva Version 2.4.0

How to run Riva and other services from images using SSH? is there any detailed manual available?

rvinobha · August 23, 2022, 9:33am

Hi @m_m_kumaran

Thanks for your interest in Riva,

I will check regarding this question with the team and provide an update

Thanks

m_m_kumaran · August 24, 2022, 2:52am

Thanks, As our company ventures into Nvidia and its tools, we are new to it and it will be really helpful.

rvinobha · September 19, 2022, 7:41pm

Hi @m_m_kumaran

Apologies for the delay in response,

I have checked with the team, currently the Riva is docker container based, so usage with SSH (not sure)

I can help more, can you please provide the use case/example for better understanding

Thanks

m_m_kumaran · September 20, 2022, 3:52am

hi,
Thanks and as we have 100 Nvidia GPU, we want to use ASR project to help in daily operation.

Thanks
Muthu

m_m_kumaran · September 20, 2022, 3:53am

I need a guidance on running RIVA services through docker such as any setup needed or steps to run and customise for our company,

hi,
Thanks and as we have 100 Nvidia GPU, we want to use ASR project to help in daily operation.

Thanks
Muthu

rvinobha · September 22, 2022, 6:48pm

Hi @m_m_kumaran

Currently we can communicate from external machines to riva server using gRPC
The default port used is 50051

Please find the below python notebook for an ASR example

github.com

nvidia-riva/tutorials/blob/stable/asr-python-basics.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-basics/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
    "\n",
    "# How do I use Riva ASR APIs with out-of-the-box models?\n",
    "\n",
    "This tutorial walks you through the basics of Riva Speech Skills ASR Services, specifically covering how to use Riva ASR APIs with out-of-the-box models."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## NVIDIA Riva Overview\n",
    "\n",
    "NVIDIA Riva is a GPU-accelerated SDK for building Speech AI applications that are customized for your use case and deliver real-time performance. <br/>\n",

This file has been truncated. show original

Please find complete github link (reference, installation)

I hope i provided some insights, if i am missing something, or my understanding is wrong/different, please let me know, i will provide more details and answers

Thanks