Jarvis_start.sh times out

I’ve been receiving some similar output. Here is the output of docker logs jarvis-speech:

Jarvis waiting for Triton server to load all models…retrying in 1 second
I0421 16:34:06.496129 51 onnxruntime.cc:1728] TRITONBACKEND_Initialize: onnxruntime
I0421 16:34:06.496415 51 onnxruntime.cc:1738] Triton TRITONBACKEND API version: 1.0
I0421 16:34:06.496424 51 onnxruntime.cc:1744] ‘onnxruntime’ TRITONBACKEND API version: 1.0
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0421 16:34:07.851614 51 pinned_memory_manager.cc:205] Pinned memory pool is created at ‘0x2033f0000’ with size 268435456
I0421 16:34:07.852185 51 cuda_memory_manager.cc:103] CUDA memory pool is created on device 0 with size 1000000000
E0421 16:34:07.869046 51 model_repository_manager.cc:1682] failed to open text file for read /data/models/jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased/config.pbtxt: No such file or directory
E0421 16:34:07.872539 51 model_repository_manager.cc:1682] failed to open text file for read /data/models/jarvis_label_tokens_weather/config.pbtxt: No such file or directory
E0421 16:34:07.876931 51 model_repository_manager.cc:1160] Invalid argument: ensemble jarvis_intent_weather contains models that are not available: jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased, jarvis_label_tokens_weather
I0421 16:34:07.877045 51 model_repository_manager.cc:787] loading: jarvis-trt-jarvis_ner-nn-bert-base-uncased:1
I0421 16:34:07.977731 51 model_repository_manager.cc:787] loading: jarvis-trt-jarvis_punctuation-nn-bert-base-uncased:1
I0421 16:34:08.078528 51 model_repository_manager.cc:787] loading: jarvis-trt-jarvis_qa-nn-bert-base-uncased:1
I0421 16:34:08.179930 51 model_repository_manager.cc:787] loading: jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased:1
I0421 16:34:08.281365 51 model_repository_manager.cc:787] loading: jarvis-trt-jasper:1
I0421 16:34:08.382578 51 model_repository_manager.cc:787] loading: jarvis-trt-tacotron2_encoder:1
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0421 16:34:08.484958 51 model_repository_manager.cc:787] loading: jarvis-trt-waveglow:1
I0421 16:34:08.587122 51 model_repository_manager.cc:787] loading: jarvis_detokenize:1
I0421 16:34:08.689370 51 model_repository_manager.cc:787] loading: jarvis_ner_label_tokens:1
I0421 16:34:08.693862 51 custom_backend.cc:198] Creating instance jarvis_detokenize_0_0_cpu on CPU using libtriton_jarvis_nlp_detokenizer.so
I0421 16:34:08.714426 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_detokenize’ version 1
I0421 16:34:08.790664 51 model_repository_manager.cc:787] loading: jarvis_punctuation_gen_output:1
I0421 16:34:08.790749 51 custom_backend.cc:198] Creating instance jarvis_ner_label_tokens_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so
I0421 16:34:08.800779 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_ner_label_tokens’ version 1
I0421 16:34:08.891157 51 model_repository_manager.cc:787] loading: jarvis_punctuation_label_tokens_cap:1
I0421 16:34:08.891214 51 custom_backend.cc:198] Creating instance jarvis_punctuation_gen_output_0_0_cpu on CPU using libtriton_jarvis_nlp_punctuation.so
I0421 16:34:08.898853 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_punctuation_gen_output’ version 1
I0421 16:34:08.991919 51 model_repository_manager.cc:787] loading: jarvis_punctuation_label_tokens_punct:1
I0421 16:34:08.991972 51 custom_backend.cc:198] Creating instance jarvis_punctuation_label_tokens_cap_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so
I0421 16:34:08.992487 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_punctuation_label_tokens_cap’ version 1
I0421 16:34:09.093418 51 model_repository_manager.cc:787] loading: jarvis_punctuation_merge_labels:1
I0421 16:34:09.093488 51 custom_backend.cc:198] Creating instance jarvis_punctuation_label_tokens_punct_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so
I0421 16:34:09.094028 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_punctuation_label_tokens_punct’ version 1
I0421 16:34:09.193947 51 model_repository_manager.cc:787] loading: jarvis_qa_postprocessor:1
I0421 16:34:09.194125 51 custom_backend.cc:198] Creating instance jarvis_punctuation_merge_labels_0_0_cpu on CPU using libtriton_jarvis_nlp_labels.so
I0421 16:34:09.204057 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_punctuation_merge_labels’ version 1
I0421 16:34:09.294694 51 model_repository_manager.cc:787] loading: jarvis_qa_preprocessor:1
I0421 16:34:09.294842 51 custom_backend.cc:198] Creating instance jarvis_qa_postprocessor_0_0_cpu on CPU using libtriton_jarvis_nlp_qa.so
I0421 16:34:09.333444 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_qa_postprocessor’ version 1
I0421 16:34:09.395174 51 model_repository_manager.cc:787] loading: jarvis_tokenizer:1
I0421 16:34:09.395389 51 custom_backend.cc:198] Creating instance jarvis_qa_preprocessor_0_0_cpu on CPU using libtriton_jarvis_nlp_tokenizer.so
Jarvis waiting for Triton server to load all models…retrying in 1 second
I0421 16:34:09.462604 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_qa_preprocessor’ version 1
I0421 16:34:09.495644 51 model_repository_manager.cc:787] loading: jasper-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming:1
I0421 16:34:09.495692 51 custom_backend.cc:198] Creating instance jarvis_tokenizer_0_0_cpu on CPU using libtriton_jarvis_nlp_tokenizer.so
I0421 16:34:09.518993 51 model_repository_manager.cc:960] successfully loaded ‘jarvis_tokenizer’ version 1
I0421 16:34:09.597203 51 model_repository_manager.cc:787] loading: jasper-asr-trt-ensemble-vad-streaming-feature-extractor-streaming:1
I0421 16:34:09.597267 51 custom_backend.cc:198] Creating instance jasper-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_decoder_cpu.so
I0421 16:34:09.698796 51 model_repository_manager.cc:787] loading: jasper-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline:1
I0421 16:34:09.698820 51 custom_backend.cc:201] Creating instance jasper-asr-trt-ensemble-vad-streaming-feature-extractor-streaming_0_0_gpu0 on GPU 0 (6.1) using libtriton_jarvis_asr_features.so
/opt/jarvis/bin/start-jarvis: line 4: 51 Segmentation fault tritonserver --log-verbose=0 --strict-model-config=true $model_repos --cuda-memory-pool-byte-size=0:1000000000
Triton server died before reaching ready state. Terminating Jarvis startup.
Check Triton logs with: docker logs
kill: usage: kill [-s sigspec | -n signum | -sigspec] pid | jobspec … or kill -l [sigspec]`