Trying to run jarvis

Description

Hi
I’m trying to start jarvis server with NeMo model . I am trying onlt ASR models.
I successfully completed the Build process according to Deploying Your Custom Model into Jarvis — NVIDIA Jarvis Speech Skills v1.0.0-b.2 documentation. I am using only pre trained model from NGC for asr.First i modify config.sh and then run jarvis_init.sh.Both are successfully completed.But when i am running jarvis_start.sh i am ended in + echo ‘Health ready check failed.’
Health ready check failed.

  • echo ‘Check Jarvis logs with: docker logs jarvis-speech’
    Check Jarvis logs with: docker logs jarvis-speech
  • exit 1

Log for jarvis-speech

docker logs jarvis-speech

==========================
== Jarvis Speech Skills ==

NVIDIA Release 20.11 (build 19933361)

Copyright © 2018-2020, NVIDIA CORPORATION. All rights reserved.

Various files include modifications © NVIDIA CORPORATION. All rights reserved.
NVIDIA modifications are covered by the license terms that apply to the underlying
project or file.

NOTE: Legacy NVIDIA Driver detected. Compatibility mode ENABLED.

Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:17:42.394441 76 metrics.cc:219] Collecting metrics for GPU 0: A100-SXM4-40GB
I0316 10:17:42.569791 76 pinned_memory_manager.cc:199] Pinned memory pool is created at ‘0x7f5ba2000000’ with size 268435456
I0316 10:17:42.571922 76 cuda_memory_manager.cc:99] CUDA memory pool is created on device 0 with size 1000000000
I0316 10:17:42.617245 76 model_repository_manager.cc:810] loading: jarvis-trt-quartznet:1
I0316 10:17:42.617367 76 model_repository_manager.cc:810] loading: jarvis-trt-jasper:1
I0316 10:17:42.617448 76 model_repository_manager.cc:810] loading: jarvis-trt-jarvis_punctuation-nn-bert-base-uncased:1
I0316 10:17:42.617541 76 model_repository_manager.cc:810] loading: jarvis_detokenize:1
I0316 10:17:42.617648 76 model_repository_manager.cc:810] loading: jarvis_punctuation_gen_output:1
I0316 10:17:42.617744 76 model_repository_manager.cc:810] loading: jarvis_punctuation_label_tokens_cap:1
I0316 10:17:42.617867 76 model_repository_manager.cc:810] loading: jarvis_punctuation_label_tokens_punct:1
I0316 10:17:42.617969 76 model_repository_manager.cc:810] loading: jarvis_punctuation_merge_labels:1
I0316 10:17:42.618075 76 model_repository_manager.cc:810] loading: jarvis_tokenizer:1
I0316 10:17:42.618217 76 model_repository_manager.cc:810] loading: jasper-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming:1
I0316 10:17:42.618361 76 model_repository_manager.cc:810] loading: jasper-asr-trt-ensemble-vad-streaming-feature-extractor-streaming:1
I0316 10:17:42.618506 76 model_repository_manager.cc:810] loading: jasper-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline:1
I0316 10:17:42.618645 76 model_repository_manager.cc:810] loading: jasper-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline:1
I0316 10:17:42.618771 76 model_repository_manager.cc:810] loading: jasper-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline:1
I0316 10:17:42.618899 76 model_repository_manager.cc:810] loading: jasper-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming:1
I0316 10:17:42.619019 76 model_repository_manager.cc:810] loading: quartznet-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming:1
I0316 10:17:42.619170 76 model_repository_manager.cc:810] loading: quartznet-asr-trt-ensemble-vad-streaming-feature-extractor-streaming:1
I0316 10:17:42.619298 76 model_repository_manager.cc:810] loading: quartznet-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming:1
I0316 10:17:42.628787 76 custom_backend.cc:198] Creating instance jarvis_detokenize_0_0_cpu on CPU using libtriton_jarvis_nlp_detokenizer.so
I0316 10:17:42.631374 76 custom_backend.cc:198] Creating instance jarvis_punctuation_gen_output_0_0_cpu on CPU using libtriton_jarvis_nlp_punctuation.so
I0316 10:17:42.632153 76 custom_backend.cc:198] Creating instance jarvis_punctuation_label_tokens_punct_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so
I0316 10:17:42.632609 76 custom_backend.cc:198] Creating instance jarvis_punctuation_label_tokens_cap_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so
I0316 10:17:42.633322 76 custom_backend.cc:198] Creating instance jarvis_tokenizer_0_0_cpu on CPU using libtriton_jarvis_nlp_tokenizer.so
I0316 10:17:42.633672 76 custom_backend.cc:198] Creating instance jasper-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_decoder_cpu.so
I0316 10:17:42.634353 76 custom_backend.cc:198] Creating instance jasper-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline_0_0_cpu on CPU using libtriton_jarvis_asr_decoder_cpu.so
I0316 10:17:42.634561 76 custom_backend.cc:198] Creating instance jasper-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline_0_0_cpu on CPU using libtriton_jarvis_asr_vad.so
I0316 10:17:42.634654 76 custom_backend.cc:198] Creating instance jasper-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_vad.so
I0316 10:17:42.634763 76 custom_backend.cc:198] Creating instance quartznet-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_decoder_cpu.so
I0316 10:17:42.635181 76 custom_backend.cc:198] Creating instance quartznet-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_vad.so
I0316 10:17:42.636621 76 custom_backend.cc:198] Creating instance jarvis_punctuation_merge_labels_0_0_cpu on CPU using libtriton_jarvis_nlp_labels.so
I0316 10:17:42.638784 76 custom_backend.cc:201] Creating instance jasper-asr-trt-ensemble-vad-streaming-feature-extractor-streaming_0_0_gpu0 on GPU 0 (8.0) using libtriton_jarvis_asr_features.so
I0316 10:17:42.638893 76 custom_backend.cc:201] Creating instance jasper-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline_0_0_gpu0 on GPU 0 (8.0) using libtriton_jarvis_asr_features.so
I0316 10:17:42.639099 76 custom_backend.cc:201] Creating instance quartznet-asr-trt-ensemble-vad-streaming-feature-extractor-streaming_0_0_gpu0 on GPU 0 (8.0) using libtriton_jarvis_asr_features.so
I0316 10:17:42.644346 76 model_repository_manager.cc:983] successfully loaded ‘jarvis_detokenize’ version 1
I0316 10:17:42.685363 76 model_repository_manager.cc:983] successfully loaded ‘jarvis_punctuation_merge_labels’ version 1
I0316 10:17:42.699455 76 model_repository_manager.cc:983] successfully loaded ‘jarvis_punctuation_label_tokens_cap’ version 1
I0316 10:17:42.758812 76 model_repository_manager.cc:983] successfully loaded ‘jarvis_punctuation_label_tokens_punct’ version 1
I0316 10:17:42.758823 76 model_repository_manager.cc:983] successfully loaded ‘jarvis_punctuation_gen_output’ version 1
I0316 10:17:42.774087 76 model_repository_manager.cc:983] successfully loaded ‘jasper-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline’ version 1
I0316 10:17:42.775556 76 model_repository_manager.cc:983] successfully loaded ‘jasper-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming’ version 1
I0316 10:17:42.779942 76 model_repository_manager.cc:983] successfully loaded ‘quartznet-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming’ version 1
I0316 10:17:42.812422 76 model_repository_manager.cc:983] successfully loaded ‘jarvis_tokenizer’ version 1
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:17:47.246180 76 model_repository_manager.cc:983] successfully loaded ‘jasper-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming’ version 1
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:17:47.711642 76 model_repository_manager.cc:983] successfully loaded ‘jasper-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline’ version 1
I0316 10:17:47.973334 76 model_repository_manager.cc:983] successfully loaded ‘quartznet-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming’ version 1
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:17:54.198836 76 model_repository_manager.cc:983] successfully loaded ‘jasper-asr-trt-ensemble-vad-streaming-feature-extractor-streaming’ version 1
I0316 10:17:54.198936 76 model_repository_manager.cc:983] successfully loaded ‘quartznet-asr-trt-ensemble-vad-streaming-feature-extractor-streaming’ version 1
I0316 10:17:54.199011 76 model_repository_manager.cc:983] successfully loaded ‘jasper-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline’ version 1
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:17:55.169379 76 plan_backend.cc:333] Creating instance jarvis-trt-quartznet_0_0_gpu0 on GPU 0 (8.0) using model.plan
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:17:55.546025 76 plan_backend.cc:666] Created instance jarvis-trt-quartznet_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0];
I0316 10:17:55.548244 76 model_repository_manager.cc:983] successfully loaded ‘jarvis-trt-quartznet’ version 1
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:17:56.925388 76 plan_backend.cc:333] Creating instance jarvis-trt-jarvis_punctuation-nn-bert-base-uncased_0_0_gpu0 on GPU 0 (8.0) using model.plan
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:17:58.276515 76 plan_backend.cc:666] Created instance jarvis-trt-jarvis_punctuation-nn-bert-base-uncased_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0];
I0316 10:17:58.299358 76 model_repository_manager.cc:983] successfully loaded ‘jarvis-trt-jarvis_punctuation-nn-bert-base-uncased’ version 1
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:18:02.187086 76 plan_backend.cc:333] Creating instance jarvis-trt-jasper_0_0_gpu0 on GPU 0 (8.0) using model.plan
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0316 10:18:05.855726 76 plan_backend.cc:666] Created instance jarvis-trt-jasper_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0];
I0316 10:18:05.876726 76 model_repository_manager.cc:983] successfully loaded ‘jarvis-trt-jasper’ version 1
I0316 10:18:05.877997 76 model_repository_manager.cc:810] loading: jarvis_punctuation:1
I0316 10:18:05.878138 76 model_repository_manager.cc:810] loading: jasper-asr-trt-ensemble-vad-streaming:1
I0316 10:18:05.878263 76 model_repository_manager.cc:810] loading: jasper-asr-trt-ensemble-vad-streaming-offline:1
I0316 10:18:05.878350 76 model_repository_manager.cc:983] successfully loaded ‘jarvis_punctuation’ version 1
I0316 10:18:05.878392 76 model_repository_manager.cc:810] loading: quartznet-asr-trt-ensemble-vad-streaming:1
I0316 10:18:05.878522 76 model_repository_manager.cc:983] successfully loaded ‘jasper-asr-trt-ensemble-vad-streaming’ version 1
I0316 10:18:05.878683 76 model_repository_manager.cc:983] successfully loaded ‘quartznet-asr-trt-ensemble-vad-streaming’ version 1
I0316 10:18:05.879043 76 model_repository_manager.cc:983] successfully loaded ‘jasper-asr-trt-ensemble-vad-streaming-offline’ version 1
I0316 10:18:05.879172 76 server.cc:141]
±--------±-------±-----+
| Backend | Config | Path |
±--------±-------±-----+
±--------±-------±-----+

I0316 10:18:05.879291 76 server.cc:184]
±--------------------------------------------------------------------------------------------±--------±-------+
| Model | Version | Status |
±--------------------------------------------------------------------------------------------±--------±-------+
| jarvis-trt-jarvis_punctuation-nn-bert-base-uncased | 1 | READY |
| jarvis-trt-jasper | 1 | READY |
| jarvis-trt-quartznet | 1 | READY |
| jarvis_detokenize | 1 | READY |
| jarvis_punctuation | 1 | READY |
| jarvis_punctuation_gen_output | 1 | READY |
| jarvis_punctuation_label_tokens_cap | 1 | READY |
| jarvis_punctuation_label_tokens_punct | 1 | READY |
| jarvis_punctuation_merge_labels | 1 | READY |
| jarvis_tokenizer | 1 | READY |
| jasper-asr-trt-ensemble-vad-streaming | 1 | READY |
| jasper-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming | 1 | READY |
| jasper-asr-trt-ensemble-vad-streaming-feature-extractor-streaming | 1 | READY |
| jasper-asr-trt-ensemble-vad-streaming-offline | 1 | READY |
| jasper-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline | 1 | READY |
| jasper-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline | 1 | READY |
| jasper-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline | 1 | READY |
| jasper-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming | 1 | READY |
| quartznet-asr-trt-ensemble-vad-streaming | 1 | READY |
| quartznet-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming | 1 | READY |
| quartznet-asr-trt-ensemble-vad-streaming-feature-extractor-streaming | 1 | READY |
| quartznet-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming | 1 | READY |
±--------------------------------------------------------------------------------------------±--------±-------+

I0316 10:18:05.879388 76 tritonserver.cc:1620]
±---------------------------------±---------------------------------------------------------------------------------------------------------------------------------------------------+
| Option | Value |
±---------------------------------±---------------------------------------------------------------------------------------------------------------------------------------------------+
| server_id | triton |
| server_version | 2.5.0 |
| server_extensions | classification sequence model_repository schedule_policy model_configuration system_shared_memory cuda_shared_memory binary_tensor_data statistics |
| model_repository_path[0] | /data/models |
| model_control_mode | MODE_NONE |
| strict_model_config | 1 |
| pinned_memory_pool_byte_size | 268435456 |
| cuda_memory_pool_byte_size{0} | 1000000000 |
| min_supported_compute_capability | 6.0 |
| strict_readiness | 1 |
| exit_timeout | 30 |
±---------------------------------±---------------------------------------------------------------------------------------------------------------------------------------------------+

I0316 10:18:05.881152 76 grpc_server.cc:3979] Started GRPCInferenceService at 0.0.0.0:8001
I0316 10:18:05.881430 76 http_server.cc:2717] Started HTTPService at 0.0.0.0:8000
I0316 10:18:05.922536 76 http_server.cc:2736] Started Metrics Service at 0.0.0.0:8002

Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second
Jarvis waiting for Triton server to load all models…retrying in 1 second

Environment

TensorRT Version:
GPU Type: A100
Nvidia Driver Version: 450.51.06
CUDA Version: 11.0
CUDNN Version:
Operating System + Version:
Python Version (if applicable):
TensorFlow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):

Hi @pavand ,

Just wanted to confirm, are you following below steps to load NeMo model:
https://docs.nvidia.com/deeplearning/jarvis/user-guide/docs/model-overview.html#nemo-to-jarvis

Thanks

@SunilJB : What i am trying to follow is a simple quick start guide for jarvis:
https://docs.nvidia.com/deeplearning/jarvis/user-guide/docs/quick-start-guide.html
where i am trying to run
1.ngc registry resource download-version nvidia/jarvis/jarvis_quickstart:1.0.0-b.2
2.cd jarvis_quickstart_v1.0.0-b.2
bash jarvis_init.sh
bash jarvis_start.sh
3.After second step i.e jarvis_start.sh , i am getting that Triton is trying to all models.
and at last it fails saying jarvis-failed .

@pavand
Could you please share the contents of the config.sh which you modified.

Thanks