Having problem when deploying Jarvis ASR service on AWS EKS I am been trying to deploy by Jarvis ASR service on AWS EKS by following the docs Sample Apps — NVIDIA Riva . The first thing that I noticed is that the doc is outdated… Also, have a couple of question In the section downloading and mo…

Hi @bjoish Thanks for bringing the doc issue to our attention. Could you please try the below latest API helm chart and let us know in case issue persist: helm fetch https://helm.ngc.nvidia.com/nvidia/jarvis/charts/jarvis-api-1.1.0-beta.tgz --username='$oauthtoken' --password=<YOUR API KEY> Than…

Hi Sunil and NVIDIA team, I tried above what you mentioned: and then I tried installing the helm chart: $ helm install --namespace jarvis jarvis . Error: template: jarvis-api/templates/modeldeploykey.yaml:1:12: executing “jarvis-api/templates/modeldeploykey.yaml” at <len .Values.modelRepoGenerat…

Hi @yuvraj1 Could you please re-validate the NGC_API_KEY, just to eliminate 401 error due any API key mismatch issue? Thanks

Hi @yuvraj1 Could you please try below command: helm fetch https://helm.ngc.nvidia.com/nvidia/jarvis/charts/jarvis-api-1.2.1-beta.tgz --username='$oauthtoken' --password=<YOUR API KEY helm install jarvis-api --set ngcCredentials.password=`echo -n $NGC_API_KEY | base64 -w0` --set ngcCredentials.em…

[image] SunilJB: helm install jarvis-api --set ngcCredentials.password=echo -n $NGC_API_KEY | base64 -w0 --set ngcCredentials.email=your_email@your_domain.com --set modelRepoGenerator.modelDeployKey=echo -n tlt_encode | base64 -w0`` Hi @SunilJB - I used the second command and its invalid: b…

[image] yuvraj1: base64: invalid option – w Please refer to below link in case it helps: base64: invalid option -- w opened 08:07PM - 09 Aug 16 UTC (UTC) closed 04:58AM - 10 Aug 16 UTC (UTC) …

Hi @SunilJB , thanks- I had to modify my command abit now I am seeing jarvis api pod pending $ kubectl get pods NAME READY STATUS RESTARTS AGE jarvis-api-1624949153-78c66db9c8-ck6hb 0/1 Pending 0 94s Describe the pod it says: Events: …

@SunilJB - I am having issues pulling this jarvis client container image: Error response from daemon: pull access denied for nvcr.io/nvidia/jarvis-speech-client , repository does not exist or may require ‘docker login’: denied: requested access to the resource is denied what is the issue and why? …

Hi @yuvraj1 You need to have 3 nodes in your cluster and those nodes need to have gpu. Also, make sure you have the gpu operator plugin installed Thanks

Do you need to add something like this to the spec? @SunilJB managedNodeGroups: - name: gpu-linux-workers instanceType: p3.2xlarge

Having problem when deploying jarvis ASR service on AWS EKS

AI & Data Science Deep Learning (Training & Inference) Riva

yuvraj1 June 29, 2021, 5:48am 10

Hi @SunilJB -

I used the second command and its invalid:

base64: invalid option – w

Topic		Replies	Views
Deploying Jarvis ASR Service on AWS EKS Helm Chart Issues Riva riva	2	613	June 29, 2021
Deploying Jarvis ASR Service on AWS EKS Helm Chart Issues TensorRT	4	466	June 28, 2021
Unable to Setup/Deploy ASR on AWS EKS Riva inception	3	1067	December 14, 2021
HELM: Error: INSTALLATION FAILED: template: riva-api/templates/modeldeploykey.yaml:1:12: Riva	3	1524	January 8, 2022
Jarvis Quick Start: Installation fails Riva riva	25	4611	March 28, 2023
Miss match riva k8s deployment documentation Riva	1	488	July 28, 2023
Riva Deployment Error following tutorial on AWS with EKS Riva riva , deployment-guides	1	115	September 25, 2024
Running Riva on AKS using Helm Chart Riva	0	85	August 2, 2024
How to deploy custom models to AWS EKS Riva	3	684	May 29, 2023
Jarvis Installation Issue: "Waiting for Jarvis server to load all models...retrying in 10 seconds" when running sudo bash jarvis_start.sh Riva riva	3	1704	July 8, 2021

Having problem when deploying jarvis ASR service on AWS EKS

Related topics