========================== == Jarvis Speech Skills == ========================== NVIDIA Release 21.05 (build 23858942) Copyright (c) 2018-2021, NVIDIA CORPORATION. All rights reserved. Various files include modifications (c) NVIDIA CORPORATION. All rights reserved. NVIDIA modifications are covered by the license terms that apply to the underlying project or file. NOTE: Legacy NVIDIA Driver detected. Compatibility mode ENABLED. > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:20.958516 71 metrics.cc:228] Collecting metrics for GPU 0: Tesla V100-SXM2-16GB > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:21.360134 71 pinned_memory_manager.cc:206] Pinned memory pool is created at '0x7f853c000000' with size 268435456 I0618 17:31:21.361619 71 cuda_memory_manager.cc:103] CUDA memory pool is created on device 0 with size 1000000000 I0618 17:31:21.442537 71 model_repository_manager.cc:1066] loading: citrinet-1024-asr-trt-ensemble-vad-streaming-feature-extractor-streaming:1 I0618 17:31:21.543038 71 model_repository_manager.cc:1066] loading: citrinet-1024-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming:1 I0618 17:31:21.543521 71 custom_backend.cc:201] Creating instance citrinet-1024-asr-trt-ensemble-vad-streaming-feature-extractor-streaming_0_0_gpu0 on GPU 0 (7.0) using libtriton_jarvis_asr_features.so I0618 17:31:21.643447 71 model_repository_manager.cc:1066] loading: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline:1 I0618 17:31:21.643848 71 custom_backend.cc:198] Creating instance citrinet-1024-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_decoder_cpu.so I0618 17:31:21.743991 71 model_repository_manager.cc:1066] loading: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline:1 I0618 17:31:21.744343 71 custom_backend.cc:198] Creating instance citrinet-1024-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline_0_0_cpu on CPU using libtriton_jarvis_asr_decoder_cpu.so I0618 17:31:21.844499 71 model_repository_manager.cc:1066] loading: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline:1 I0618 17:31:21.844996 71 custom_backend.cc:201] Creating instance citrinet-1024-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline_0_0_gpu0 on GPU 0 (7.0) using libtriton_jarvis_asr_features.so I0618 17:31:21.944993 71 model_repository_manager.cc:1066] loading: citrinet-1024-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming:1 I0618 17:31:21.945274 71 custom_backend.cc:198] Creating instance citrinet-1024-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline_0_0_cpu on CPU using libtriton_jarvis_asr_vad.so I0618 17:31:22.045467 71 model_repository_manager.cc:1066] loading: jarvis-trt-citrinet-1024:1 I0618 17:31:22.045822 71 custom_backend.cc:198] Creating instance citrinet-1024-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_vad.so I0618 17:31:22.050342 71 model_repository_manager.cc:1240] successfully loaded 'citrinet-1024-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline' version 1 I0618 17:31:22.132696 71 model_repository_manager.cc:1240] successfully loaded 'citrinet-1024-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming' version 1 I0618 17:31:22.145894 71 model_repository_manager.cc:1066] loading: jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased:1 > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:22.246354 71 model_repository_manager.cc:1066] loading: jarvis-trt-jarvis_ner-nn-bert-base-uncased:1 I0618 17:31:22.346777 71 model_repository_manager.cc:1066] loading: jarvis-trt-jarvis_punctuation-nn-bert-base-uncased:1 I0618 17:31:22.447190 71 model_repository_manager.cc:1066] loading: jarvis-trt-jarvis_qa-nn-bert-base-uncased:1 I0618 17:31:22.547590 71 model_repository_manager.cc:1066] loading: jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased:1 I0618 17:31:22.648030 71 model_repository_manager.cc:1066] loading: jarvis-trt-tacotron2_encoder:1 I0618 17:31:22.748589 71 model_repository_manager.cc:1066] loading: jarvis-trt-waveglow:1 I0618 17:31:22.849042 71 model_repository_manager.cc:1066] loading: jarvis_detokenize:1 I0618 17:31:22.949463 71 model_repository_manager.cc:1066] loading: jarvis_label_tokens_weather:1 I0618 17:31:22.949787 71 custom_backend.cc:198] Creating instance jarvis_detokenize_0_0_cpu on CPU using libtriton_jarvis_nlp_detokenizer.so I0618 17:31:23.049988 71 model_repository_manager.cc:1066] loading: jarvis_ner_label_tokens:1 I0618 17:31:23.050363 71 custom_backend.cc:198] Creating instance jarvis_label_tokens_weather_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so I0618 17:31:23.150380 71 model_repository_manager.cc:1066] loading: jarvis_punctuation_gen_output:1 I0618 17:31:23.150762 71 custom_backend.cc:198] Creating instance jarvis_ner_label_tokens_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:23.250769 71 model_repository_manager.cc:1066] loading: jarvis_punctuation_label_tokens_cap:1 I0618 17:31:23.251241 71 custom_backend.cc:198] Creating instance jarvis_punctuation_gen_output_0_0_cpu on CPU using libtriton_jarvis_nlp_punctuation.so I0618 17:31:23.351381 71 model_repository_manager.cc:1066] loading: jarvis_punctuation_label_tokens_punct:1 I0618 17:31:23.351743 71 custom_backend.cc:198] Creating instance jarvis_punctuation_label_tokens_cap_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so I0618 17:31:23.451784 71 model_repository_manager.cc:1066] loading: jarvis_punctuation_merge_labels:1 I0618 17:31:23.452213 71 custom_backend.cc:198] Creating instance jarvis_punctuation_label_tokens_punct_0_0_cpu on CPU using libtriton_jarvis_nlp_seqlabel.so I0618 17:31:23.453082 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_detokenize' version 1 I0618 17:31:23.552195 71 model_repository_manager.cc:1066] loading: jarvis_qa_postprocessor:1 I0618 17:31:23.552511 71 custom_backend.cc:198] Creating instance jarvis_punctuation_merge_labels_0_0_cpu on CPU using libtriton_jarvis_nlp_labels.so I0618 17:31:23.652523 71 model_repository_manager.cc:1066] loading: jarvis_qa_preprocessor:1 I0618 17:31:23.652942 71 custom_backend.cc:198] Creating instance jarvis_qa_postprocessor_0_0_cpu on CPU using libtriton_jarvis_nlp_qa.so I0618 17:31:23.689752 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_punctuation_label_tokens_cap' version 1 I0618 17:31:23.689751 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_punctuation_label_tokens_punct' version 1 I0618 17:31:23.689755 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_ner_label_tokens' version 1 I0618 17:31:23.753018 71 model_repository_manager.cc:1066] loading: jarvis_tokenizer:1 I0618 17:31:23.753373 71 custom_backend.cc:198] Creating instance jarvis_qa_preprocessor_0_0_cpu on CPU using libtriton_jarvis_nlp_tokenizer.so I0618 17:31:23.853445 71 model_repository_manager.cc:1066] loading: tacotron2_decoder_postnet:1 I0618 17:31:23.853790 71 custom_backend.cc:198] Creating instance jarvis_tokenizer_0_0_cpu on CPU using libtriton_jarvis_nlp_tokenizer.so I0618 17:31:23.884975 71 model_repository_manager.cc:1240] successfully loaded 'citrinet-1024-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming' version 1 I0618 17:31:23.925534 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_label_tokens_weather' version 1 I0618 17:31:23.953833 71 model_repository_manager.cc:1066] loading: tts_preprocessor:1 I0618 17:31:24.019116 71 model_repository_manager.cc:1240] successfully loaded 'citrinet-1024-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline' version 1 I0618 17:31:24.054231 71 model_repository_manager.cc:1066] loading: waveglow_denoiser:1 I0618 17:31:24.054719 71 custom_backend.cc:201] Creating instance tts_preprocessor_0_0_gpu0 on GPU 0 (7.0) using libtriton_jarvis_tts_preprocessor.so I0618 17:31:24.155390 71 custom_backend.cc:201] Creating instance waveglow_denoiser_0_0_gpu0 on GPU 0 (7.0) using libtriton_jarvis_tts_denoiser.so > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:25.191340 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_punctuation_gen_output' version 1 I0618 17:31:25.209662 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_punctuation_merge_labels' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:25.264038 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_tokenizer' version 1 I0618 17:31:25.547414 71 model_repository_manager.cc:1240] successfully loaded 'tts_preprocessor' version 1 I0618 17:31:25.807091 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_qa_postprocessor' version 1 I0618 17:31:25.858771 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_qa_preprocessor' version 1 I0618 17:31:25.931103 71 tacotron-decoder-postnet.cc:873] TRITONBACKEND_ModelInitialize: tacotron2_decoder_postnet (version 1) I0618 17:31:25.989888 71 tacotron-decoder-postnet.cc:767] model configuration: { "name": "tacotron2_decoder_postnet", "platform": "", "backend": "jarvis_tts_taco_postnet", "version_policy": { "latest": { "num_versions": 1 } }, "max_batch_size": 8, "input": [ { "name": "input_decoder", "data_type": "TYPE_FP32", "format": "FORMAT_NONE", "dims": [ 1, 400, 512 ], "is_shape_tensor": false, "allow_ragged_batch": false }, { "name": "input_processed_decoder", "data_type": "TYPE_FP32", "format": "FORMAT_NONE", "dims": [ 400, 128, 1, 1 ], "is_shape_tensor": false, "allow_ragged_batch": false }, { "name": "input_num_characters", "data_type": "TYPE_INT32", "format": "FORMAT_NONE", "dims": [ 1 ], "is_shape_tensor": false, "allow_ragged_batch": false } ], "output": [ { "name": "spectrogram_chunk", "data_type": "TYPE_FP32", "dims": [ 1, 80, 80 ], "label_filename": "", "is_shape_tensor": false }, { "name": "z", "data_type": "TYPE_FP32", "dims": [ 8, 2656, 1 ], "label_filename": "", "is_shape_tensor": false }, { "name": "num_valid_samples", "data_type": "TYPE_INT32", "dims": [ 1 ], "label_filename": "", "is_shape_tensor": false }, { "name": "end_flag", "data_type": "TYPE_INT32", "dims": [ 1 ], "label_filename": "", "is_shape_tensor": false } ], "batch_input": [], "batch_output": [], "optimization": { "priority": "PRIORITY_DEFAULT", "input_pinned_memory": { "enable": true }, "output_pinned_memory": { "enable": true }, "gather_kernel_buffer_threshold": 0, "eager_batching": false }, "sequence_batching": { "oldest": { "max_candidate_sequences": 8, "preferred_batch_size": [ 8 ], "max_queue_delay_microseconds": 100 }, "max_sequence_idle_microseconds": 60000000, "control_input": [ { "name": "START", "control": [ { "kind": "CONTROL_SEQUENCE_START", "int32_false_true": [ 0, 1 ], "fp32_false_true": [], "data_type": "TYPE_INVALID" } ] }, { "name": "READY", "control": [ { "kind": "CONTROL_SEQUENCE_READY", "int32_false_true": [ 0, 1 ], "fp32_false_true": [], "data_type": "TYPE_INVALID" } ] }, { "name": "END", "control": [ { "kind": "CONTROL_SEQUENCE_END", "int32_false_true": [ 0, 1 ], "fp32_false_true": [], "data_type": "TYPE_INVALID" } ] }, { "name": "CORRID", "control": [ { "kind": "CONTROL_SEQUENCE_CORRID", "int32_false_true": [], "fp32_false_true": [], "data_type": "TYPE_UINT64" } ] } ] }, "instance_group": [ { "name": "tacotron2_decoder_postnet_0", "kind": "KIND_GPU", "count": 1, "gpus": [ 0 ], "profile": [] } ], "default_model_filename": "", "cc_model_filenames": {}, "metric_tags": {}, "parameters": { "num_samples_per_frame": { "string_value": "256" }, "z_dim0": { "string_value": "8" }, "z_dim1": { "string_value": "2656" }, "encoding_dimension": { "string_value": "512" }, "num_mels": { "string_value": "80" }, "tacotron_decoder_engine": { "string_value": "/data/models/tacotron2_decoder_postnet/1/model.plan" }, "max_execution_batch_size": { "string_value": "8" }, "max_input_length": { "string_value": "400" }, "chunk_length": { "string_value": "80" }, "attention_dimension": { "string_value": "128" } }, "model_warmup": [], "model_transaction_policy": { "decoupled": true } } I0618 17:31:25.990135 71 tacotron-decoder-postnet.cc:927] TRITONBACKEND_ModelInstanceInitialize: tacotron2_decoder_postnet_0 (device 0) > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:46.998106 71 model_repository_manager.cc:1240] successfully loaded 'citrinet-1024-asr-trt-ensemble-vad-streaming-feature-extractor-streaming' version 1 I0618 17:31:46.998139 71 model_repository_manager.cc:1240] successfully loaded 'citrinet-1024-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:48.223421 71 plan_backend.cc:384] Creating instance jarvis-trt-tacotron2_encoder_0_0_gpu0 on GPU 0 (7.0) using model.plan I0618 17:31:48.477384 71 model_repository_manager.cc:1240] successfully loaded 'waveglow_denoiser' version 1 I0618 17:31:48.482550 71 plan_backend.cc:772] Created instance jarvis-trt-tacotron2_encoder_0_0_gpu0 on GPU 0 with stream priority 0 I0618 17:31:48.486618 71 model_repository_manager.cc:1240] successfully loaded 'jarvis-trt-tacotron2_encoder' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:50.087811 71 plan_backend.cc:384] Creating instance jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased_0_0_gpu0 on GPU 0 (7.0) using model.plan > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:51.540006 71 model_repository_manager.cc:1240] successfully loaded 'tacotron2_decoder_postnet' version 1 I0618 17:31:51.756297 71 plan_backend.cc:768] Created instance jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0]; I0618 17:31:51.763747 71 model_repository_manager.cc:1240] successfully loaded 'jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:53.374778 71 plan_backend.cc:384] Creating instance jarvis-trt-jarvis_ner-nn-bert-base-uncased_0_0_gpu0 on GPU 0 (7.0) using model.plan > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:55.071306 71 plan_backend.cc:768] Created instance jarvis-trt-jarvis_ner-nn-bert-base-uncased_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0]; I0618 17:31:55.079304 71 model_repository_manager.cc:1240] successfully loaded 'jarvis-trt-jarvis_ner-nn-bert-base-uncased' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:57.074058 71 plan_backend.cc:384] Creating instance jarvis-trt-citrinet-1024_0_0_gpu0 on GPU 0 (7.0) using model.plan > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:31:59.068815 71 plan_backend.cc:768] Created instance jarvis-trt-citrinet-1024_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0]; I0618 17:31:59.079314 71 model_repository_manager.cc:1240] successfully loaded 'jarvis-trt-citrinet-1024' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:00.694953 71 plan_backend.cc:384] Creating instance jarvis-trt-jarvis_punctuation-nn-bert-base-uncased_0_0_gpu0 on GPU 0 (7.0) using model.plan > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:02.403521 71 plan_backend.cc:768] Created instance jarvis-trt-jarvis_punctuation-nn-bert-base-uncased_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0]; I0618 17:32:02.412781 71 model_repository_manager.cc:1240] successfully loaded 'jarvis-trt-jarvis_punctuation-nn-bert-base-uncased' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:04.020694 71 plan_backend.cc:384] Creating instance jarvis-trt-jarvis_qa-nn-bert-base-uncased_0_0_gpu0 on GPU 0 (7.0) using model.plan > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:05.717441 71 plan_backend.cc:768] Created instance jarvis-trt-jarvis_qa-nn-bert-base-uncased_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0]; I0618 17:32:05.727105 71 model_repository_manager.cc:1240] successfully loaded 'jarvis-trt-jarvis_qa-nn-bert-base-uncased' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:07.350760 71 plan_backend.cc:384] Creating instance jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased_0_0_gpu0 on GPU 0 (7.0) using model.plan > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:09.061301 71 plan_backend.cc:768] Created instance jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0]; I0618 17:32:09.071128 71 model_repository_manager.cc:1240] successfully loaded 'jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:10.432795 71 plan_backend.cc:384] Creating instance jarvis-trt-waveglow_0_0_gpu0 on GPU 0 (7.0) using model.plan > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:11.766249 71 plan_backend.cc:768] Created instance jarvis-trt-waveglow_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0]; > Jarvis waiting for Triton server to load all models...retrying in 1 second I0618 17:32:11.785112 71 model_repository_manager.cc:1240] successfully loaded 'jarvis-trt-waveglow' version 1 I0618 17:32:11.787129 71 model_repository_manager.cc:1066] loading: citrinet-1024-asr-trt-ensemble-vad-streaming:1 I0618 17:32:11.887514 71 model_repository_manager.cc:1066] loading: citrinet-1024-asr-trt-ensemble-vad-streaming-offline:1 I0618 17:32:11.987937 71 model_repository_manager.cc:1066] loading: jarvis_intent_weather:1 I0618 17:32:12.088352 71 model_repository_manager.cc:1066] loading: jarvis_ner:1 I0618 17:32:12.188823 71 model_repository_manager.cc:1066] loading: jarvis_punctuation:1 I0618 17:32:12.289321 71 model_repository_manager.cc:1066] loading: jarvis_qa:1 I0618 17:32:12.389789 71 model_repository_manager.cc:1066] loading: jarvis_text_classification_domain:1 I0618 17:32:12.490204 71 model_repository_manager.cc:1066] loading: tacotron2_ensemble:1 I0618 17:32:12.490854 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_text_classification_domain' version 1 I0618 17:32:12.590571 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_ner' version 1 I0618 17:32:12.590611 71 model_repository_manager.cc:1240] successfully loaded 'citrinet-1024-asr-trt-ensemble-vad-streaming' version 1 I0618 17:32:12.590630 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_punctuation' version 1 I0618 17:32:12.590806 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_qa' version 1I0618 17:32:12.590802 71 model_repository_manager.cc:1240] successfully loaded 'jarvis_intent_weather' version 1 I0618 17:32:12.590961 71 model_repository_manager.cc:1240] successfully loaded 'tacotron2_ensemble' version 1 I0618 17:32:12.591040 71 model_repository_manager.cc:1240] successfully loaded 'citrinet-1024-asr-trt-ensemble-vad-streaming-offline' version 1 I0618 17:32:12.591229 71 server.cc:504] +------------------+------+ | Repository Agent | Path | +------------------+------+ +------------------+------+ I0618 17:32:12.591300 71 server.cc:543] +-------------------------+-----------------------------------------------------------------------------------------+--------+ | Backend | Path | Config | +-------------------------+-----------------------------------------------------------------------------------------+--------+ | tensorrt | | {} | | jarvis_tts_taco_postnet | /opt/tritonserver/backends/jarvis_tts_taco_postnet/libtriton_jarvis_tts_taco_postnet.so | {} | +-------------------------+-----------------------------------------------------------------------------------------+--------+ I0618 17:32:12.591571 71 server.cc:586] +----------------------------------------------------------------------------------------------------+---------+--------+ | Model | Version | Status | +----------------------------------------------------------------------------------------------------+---------+--------+ | citrinet-1024-asr-trt-ensemble-vad-streaming | 1 | READY | | citrinet-1024-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming | 1 | READY | | citrinet-1024-asr-trt-ensemble-vad-streaming-feature-extractor-streaming | 1 | READY | | citrinet-1024-asr-trt-ensemble-vad-streaming-offline | 1 | READY | | citrinet-1024-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline | 1 | READY | | citrinet-1024-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline | 1 | READY | | citrinet-1024-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline | 1 | READY | | citrinet-1024-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming | 1 | READY | | jarvis-trt-citrinet-1024 | 1 | READY | | jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased | 1 | READY | | jarvis-trt-jarvis_ner-nn-bert-base-uncased | 1 | READY | | jarvis-trt-jarvis_punctuation-nn-bert-base-uncased | 1 | READY | | jarvis-trt-jarvis_qa-nn-bert-base-uncased | 1 | READY | | jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased | 1 | READY | | jarvis-trt-tacotron2_encoder | 1 | READY | | jarvis-trt-waveglow | 1 | READY | | jarvis_detokenize | 1 | READY | | jarvis_intent_weather | 1 | READY | | jarvis_label_tokens_weather | 1 | READY | | jarvis_ner | 1 | READY | | jarvis_ner_label_tokens | 1 | READY | | jarvis_punctuation | 1 | READY | | jarvis_punctuation_gen_output | 1 | READY | | jarvis_punctuation_label_tokens_cap | 1 | READY | | jarvis_punctuation_label_tokens_punct | 1 | READY | | jarvis_punctuation_merge_labels | 1 | READY | | jarvis_qa | 1 | READY | | jarvis_qa_postprocessor | 1 | READY | | jarvis_qa_preprocessor | 1 | READY | | jarvis_text_classification_domain | 1 | READY | | jarvis_tokenizer | 1 | READY | | tacotron2_decoder_postnet | 1 | READY | | tacotron2_ensemble | 1 | READY | | tts_preprocessor | 1 | READY | | waveglow_denoiser | 1 | READY | +----------------------------------------------------------------------------------------------------+---------+--------+ I0618 17:32:12.591705 71 tritonserver.cc:1658] +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Option | Value | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | server_id | triton | | server_version | 2.9.0 | | server_extensions | classification sequence model_repository model_repository(unload_dependents) schedule_policy model_configuration system_shared_memory cuda_shared_memory binary_tensor_data statistics | | model_repository_path[0] | /data/models | | model_control_mode | MODE_NONE | | strict_model_config | 1 | | pinned_memory_pool_byte_size | 268435456 | | cuda_memory_pool_byte_size{0} | 1000000000 | | min_supported_compute_capability | 6.0 | | strict_readiness | 1 | | exit_timeout | 30 | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ I0618 17:32:12.607338 71 grpc_server.cc:4028] Started GRPCInferenceService at 0.0.0.0:8001 I0618 17:32:12.609734 71 http_server.cc:2761] Started HTTPService at 0.0.0.0:8000 I0618 17:32:12.651997 71 http_server.cc:2780] Started Metrics Service at 0.0.0.0:8002 > Triton server is ready... I0618 17:32:12.830011 386 grpc_health.cc:42] JarvisHealthService initialized with server: localhost:8001 I0618 17:32:12.831027 386 grpc_jarvis_asr.cc:132] Setting uri for ASRServiceImpl I0618 17:32:12.831033 386 grpc_jarvis_asr.cc:133] Initializing different models I0618 17:32:12.839339 386 model_registry.cc:52] JarvisModelRegistry initialized with server: localhost:8001 I0618 17:32:12.844985 386 model_registry.cc:81] Server Name: triton, Server version: 2.9.0 I0618 17:32:12.845505 386 model_registry.cc:102] Our model repository has a total of: 35 models I0618 17:32:12.845523 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming, Model version: 1 I0618 17:32:12.854607 386 model_registry.cc:120] 'Successfully registering citrinet-1024-asr-trt-ensemble-vad-streaming' I0618 17:32:12.854672 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming, Model version: 1 I0618 17:32:12.856101 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-feature-extractor-streaming, Model version: 1 I0618 17:32:12.857206 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline, Model version: 1 I0618 17:32:12.858228 386 model_registry.cc:120] 'Successfully registering citrinet-1024-asr-trt-ensemble-vad-streaming-offline' I0618 17:32:12.858279 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline, Model version: 1 I0618 17:32:12.859402 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline, Model version: 1 I0618 17:32:12.860458 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline, Model version: 1 I0618 17:32:12.861310 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming, Model version: 1 I0618 17:32:12.862169 386 model_registry.cc:107] Model names: jarvis-trt-citrinet-1024, Model version: 1 I0618 17:32:12.862884 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased, Model version: 1 I0618 17:32:12.863663 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_ner-nn-bert-base-uncased, Model version: 1 I0618 17:32:12.864393 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_punctuation-nn-bert-base-uncased, Model version: 1 I0618 17:32:12.865139 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_qa-nn-bert-base-uncased, Model version: 1 I0618 17:32:12.865866 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased, Model version: 1 I0618 17:32:12.866592 386 model_registry.cc:107] Model names: jarvis-trt-tacotron2_encoder, Model version: 1 I0618 17:32:12.867372 386 model_registry.cc:107] Model names: jarvis-trt-waveglow, Model version: 1 I0618 17:32:12.868175 386 model_registry.cc:107] Model names: jarvis_detokenize, Model version: 1 I0618 17:32:12.868911 386 model_registry.cc:107] Model names: jarvis_intent_weather, Model version: 1 I0618 17:32:12.869846 386 model_registry.cc:107] Model names: jarvis_label_tokens_weather, Model version: 1 I0618 17:32:12.870528 386 model_registry.cc:107] Model names: jarvis_ner, Model version: 1 I0618 17:32:12.871457 386 model_registry.cc:107] Model names: jarvis_ner_label_tokens, Model version: 1 I0618 17:32:12.872136 386 model_registry.cc:107] Model names: jarvis_punctuation, Model version: 1 I0618 17:32:12.873073 386 model_registry.cc:107] Model names: jarvis_punctuation_gen_output, Model version: 1 I0618 17:32:12.873816 386 model_registry.cc:107] Model names: jarvis_punctuation_label_tokens_cap, Model version: 1 I0618 17:32:12.874522 386 model_registry.cc:107] Model names: jarvis_punctuation_label_tokens_punct, Model version: 1 I0618 17:32:12.875236 386 model_registry.cc:107] Model names: jarvis_punctuation_merge_labels, Model version: 1 I0618 17:32:12.875913 386 model_registry.cc:107] Model names: jarvis_qa, Model version: 1 I0618 17:32:12.876807 386 model_registry.cc:107] Model names: jarvis_qa_postprocessor, Model version: 1 I0618 17:32:12.877573 386 model_registry.cc:107] Model names: jarvis_qa_preprocessor, Model version: 1 I0618 17:32:12.878379 386 model_registry.cc:107] Model names: jarvis_text_classification_domain, Model version: 1 I0618 17:32:12.879142 386 model_registry.cc:107] Model names: jarvis_tokenizer, Model version: 1 I0618 17:32:12.879906 386 model_registry.cc:107] Model names: tacotron2_decoder_postnet, Model version: 1 I0618 17:32:12.880930 386 model_registry.cc:107] Model names: tacotron2_ensemble, Model version: 1 I0618 17:32:12.881801 386 model_registry.cc:107] Model names: tts_preprocessor, Model version: 1 I0618 17:32:12.882700 386 model_registry.cc:107] Model names: waveglow_denoiser, Model version: 1 I0618 17:32:12.883615 386 model_registry.cc:125] Successfully registered: 2 models. I0618 17:32:12.883649 386 client.cc:54] JarvisNLPClient initialized with server: localhost:8001 I0618 17:32:12.884186 386 client.cc:70] Our model repository has: 35 models. W0618 17:32:12.885175 386 client.cc:94] Registration of 'citrinet-1024-asr-trt-ensemble-vad-streaming' failed with unknown service type W0618 17:32:12.888291 386 client.cc:94] Registration of 'citrinet-1024-asr-trt-ensemble-vad-streaming-offline' failed with unknown service type I0618 17:32:12.899186 386 client.cc:88] Registering 'jarvis_intent_weather' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:12.900760 386 client.cc:88] Registering 'jarvis_ner' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:12.902319 386 client.cc:88] Registering 'jarvis_punctuation' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/TransformText' I0618 17:32:12.905829 386 client.cc:88] Registering 'jarvis_qa' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:12.908111 386 client.cc:88] Registering 'jarvis_text_classification_domain' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyText' W0618 17:32:12.910733 386 client.cc:94] Registration of 'tacotron2_ensemble' failed with unknown service type I0618 17:32:12.912786 386 grpc_jarvis_asr.cc:161] Seeding RNG used for correlation id with time: 1624037532 I0618 17:32:12.967700 386 client.cc:54] JarvisNLPClient initialized with server: localhost:8001 I0618 17:32:12.968537 386 client.cc:70] Our model repository has: 35 models. W0618 17:32:12.969875 386 client.cc:94] Registration of 'citrinet-1024-asr-trt-ensemble-vad-streaming' failed with unknown service type W0618 17:32:12.972998 386 client.cc:94] Registration of 'citrinet-1024-asr-trt-ensemble-vad-streaming-offline' failed with unknown service type I0618 17:32:12.983837 386 client.cc:88] Registering 'jarvis_intent_weather' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:12.985388 386 client.cc:88] Registering 'jarvis_ner' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:12.986958 386 client.cc:88] Registering 'jarvis_punctuation' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/TransformText' I0618 17:32:12.990433 386 client.cc:88] Registering 'jarvis_qa' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:12.992683 386 client.cc:88] Registering 'jarvis_text_classification_domain' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyText' W0618 17:32:12.995280 386 client.cc:94] Registration of 'tacotron2_ensemble' failed with unknown service type I0618 17:32:12.997045 386 grpc_jarvis_nlp.cc:175] CoreNLPService GRPC service started I0618 17:32:12.997067 386 client.cc:54] JarvisNLPClient initialized with server: localhost:8001 I0618 17:32:12.997581 386 client.cc:70] Our model repository has: 35 models. W0618 17:32:12.998575 386 client.cc:94] Registration of 'citrinet-1024-asr-trt-ensemble-vad-streaming' failed with unknown service type W0618 17:32:13.001653 386 client.cc:94] Registration of 'citrinet-1024-asr-trt-ensemble-vad-streaming-offline' failed with unknown service type I0618 17:32:13.012749 386 client.cc:88] Registering 'jarvis_intent_weather' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:13.014374 386 client.cc:88] Registering 'jarvis_ner' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:13.016010 386 client.cc:88] Registering 'jarvis_punctuation' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/TransformText' I0618 17:32:13.019621 386 client.cc:88] Registering 'jarvis_qa' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyTokens' I0618 17:32:13.021922 386 client.cc:88] Registering 'jarvis_text_classification_domain' with service '/nvidia.jarvis.nlp.JarvisCoreNLP/ClassifyText' W0618 17:32:13.024720 386 client.cc:94] Registration of 'tacotron2_ensemble' failed with unknown service type I0618 17:32:13.026590 386 model_registry.cc:52] JarvisModelRegistry initialized with server: localhost:8001 I0618 17:32:13.027191 386 model_registry.cc:81] Server Name: triton, Server version: 2.9.0 I0618 17:32:13.027710 386 model_registry.cc:102] Our model repository has a total of: 35 models I0618 17:32:13.027729 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming, Model version: 1 I0618 17:32:13.028813 386 model_registry.cc:120] 'Successfully registering citrinet-1024-asr-trt-ensemble-vad-streaming' I0618 17:32:13.028875 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming, Model version: 1 I0618 17:32:13.030006 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-feature-extractor-streaming, Model version: 1 I0618 17:32:13.031129 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline, Model version: 1 I0618 17:32:13.032191 386 model_registry.cc:120] 'Successfully registering citrinet-1024-asr-trt-ensemble-vad-streaming-offline' I0618 17:32:13.032243 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline, Model version: 1 I0618 17:32:13.033368 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline, Model version: 1 I0618 17:32:13.034466 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline, Model version: 1 I0618 17:32:13.035383 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming, Model version: 1 I0618 17:32:13.036294 386 model_registry.cc:107] Model names: jarvis-trt-citrinet-1024, Model version: 1 I0618 17:32:13.037128 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.038000 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_ner-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.038779 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_punctuation-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.039606 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_qa-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.040342 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.041075 386 model_registry.cc:107] Model names: jarvis-trt-tacotron2_encoder, Model version: 1 I0618 17:32:13.041836 386 model_registry.cc:107] Model names: jarvis-trt-waveglow, Model version: 1 I0618 17:32:13.042661 386 model_registry.cc:107] Model names: jarvis_detokenize, Model version: 1 I0618 17:32:13.043699 386 model_registry.cc:107] Model names: jarvis_intent_weather, Model version: 1 I0618 17:32:13.044765 386 model_registry.cc:120] 'Successfully registering jarvis_intent_weather' I0618 17:32:13.044824 386 model_registry.cc:107] Model names: jarvis_label_tokens_weather, Model version: 1 I0618 17:32:13.045545 386 model_registry.cc:107] Model names: jarvis_ner, Model version: 1 I0618 17:32:13.046454 386 model_registry.cc:120] 'Successfully registering jarvis_ner' I0618 17:32:13.046511 386 model_registry.cc:107] Model names: jarvis_ner_label_tokens, Model version: 1 I0618 17:32:13.047250 386 model_registry.cc:107] Model names: jarvis_punctuation, Model version: 1 I0618 17:32:13.048175 386 model_registry.cc:120] 'Successfully registering jarvis_punctuation' I0618 17:32:13.048234 386 model_registry.cc:107] Model names: jarvis_punctuation_gen_output, Model version: 1 I0618 17:32:13.048980 386 model_registry.cc:107] Model names: jarvis_punctuation_label_tokens_cap, Model version: 1 I0618 17:32:13.049708 386 model_registry.cc:107] Model names: jarvis_punctuation_label_tokens_punct, Model version: 1 I0618 17:32:13.050428 386 model_registry.cc:107] Model names: jarvis_punctuation_merge_labels, Model version: 1 I0618 17:32:13.051157 386 model_registry.cc:107] Model names: jarvis_qa, Model version: 1 I0618 17:32:13.052067 386 model_registry.cc:120] 'Successfully registering jarvis_qa' I0618 17:32:13.052114 386 model_registry.cc:107] Model names: jarvis_qa_postprocessor, Model version: 1 I0618 17:32:13.052883 386 model_registry.cc:107] Model names: jarvis_qa_preprocessor, Model version: 1 I0618 17:32:13.053701 386 model_registry.cc:107] Model names: jarvis_text_classification_domain, Model version: 1 I0618 17:32:13.054436 386 model_registry.cc:120] 'Successfully registering jarvis_text_classification_domain' I0618 17:32:13.054471 386 model_registry.cc:107] Model names: jarvis_tokenizer, Model version: 1 I0618 17:32:13.055449 386 model_registry.cc:107] Model names: tacotron2_decoder_postnet, Model version: 1 I0618 17:32:13.056663 386 model_registry.cc:107] Model names: tacotron2_ensemble, Model version: 1 I0618 17:32:13.057551 386 model_registry.cc:120] 'Successfully registering tacotron2_ensemble' I0618 17:32:13.057600 386 model_registry.cc:107] Model names: tts_preprocessor, Model version: 1 I0618 17:32:13.058492 386 model_registry.cc:107] Model names: waveglow_denoiser, Model version: 1 I0618 17:32:13.059465 386 model_registry.cc:125] Successfully registered: 8 models. I0618 17:32:13.059535 386 grpc_jarvis_nlp.cc:184] NLPService GRPC service started I0618 17:32:13.059556 386 grpc_jarvis_tts.cc:57] Setting uri for TTSServiceImpl I0618 17:32:13.059562 386 grpc_jarvis_tts.cc:58] Initializing models I0618 17:32:13.059576 386 model_registry.cc:52] JarvisModelRegistry initialized with server: localhost:8001 I0618 17:32:13.060196 386 model_registry.cc:81] Server Name: triton, Server version: 2.9.0 I0618 17:32:13.060817 386 model_registry.cc:102] Our model repository has a total of: 35 models I0618 17:32:13.060838 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming, Model version: 1 I0618 17:32:13.062386 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-ctc-decoder-cpu-streaming, Model version: 1 I0618 17:32:13.063719 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-feature-extractor-streaming, Model version: 1 I0618 17:32:13.065024 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline, Model version: 1 I0618 17:32:13.066215 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-ctc-decoder-cpu-streaming-offline, Model version: 1 I0618 17:32:13.067781 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-feature-extractor-streaming-offline, Model version: 1 I0618 17:32:13.069101 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-offline-voice-activity-detector-ctc-streaming-offline, Model version: 1 I0618 17:32:13.070010 386 model_registry.cc:107] Model names: citrinet-1024-asr-trt-ensemble-vad-streaming-voice-activity-detector-ctc-streaming, Model version: 1 I0618 17:32:13.070924 386 model_registry.cc:107] Model names: jarvis-trt-citrinet-1024, Model version: 1 I0618 17:32:13.071651 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_intent_weather-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.072399 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_ner-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.073132 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_punctuation-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.073881 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_qa-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.074613 386 model_registry.cc:107] Model names: jarvis-trt-jarvis_text_classification_domain-nn-bert-base-uncased, Model version: 1 I0618 17:32:13.075526 386 model_registry.cc:107] Model names: jarvis-trt-tacotron2_encoder, Model version: 1 I0618 17:32:13.076280 386 model_registry.cc:107] Model names: jarvis-trt-waveglow, Model version: 1 I0618 17:32:13.077088 386 model_registry.cc:107] Model names: jarvis_detokenize, Model version: 1 I0618 17:32:13.077965 386 model_registry.cc:107] Model names: jarvis_intent_weather, Model version: 1 I0618 17:32:13.078955 386 model_registry.cc:107] Model names: jarvis_label_tokens_weather, Model version: 1 I0618 17:32:13.079777 386 model_registry.cc:107] Model names: jarvis_ner, Model version: 1 I0618 17:32:13.080771 386 model_registry.cc:107] Model names: jarvis_ner_label_tokens, Model version: 1 I0618 17:32:13.081501 386 model_registry.cc:107] Model names: jarvis_punctuation, Model version: 1 I0618 17:32:13.082432 386 model_registry.cc:107] Model names: jarvis_punctuation_gen_output, Model version: 1 I0618 17:32:13.083199 386 model_registry.cc:107] Model names: jarvis_punctuation_label_tokens_cap, Model version: 1 I0618 17:32:13.083900 386 model_registry.cc:107] Model names: jarvis_punctuation_label_tokens_punct, Model version: 1 I0618 17:32:13.084601 386 model_registry.cc:107] Model names: jarvis_punctuation_merge_labels, Model version: 1 I0618 17:32:13.085279 386 model_registry.cc:107] Model names: jarvis_qa, Model version: 1 I0618 17:32:13.086176 386 model_registry.cc:107] Model names: jarvis_qa_postprocessor, Model version: 1 I0618 17:32:13.086975 386 model_registry.cc:107] Model names: jarvis_qa_preprocessor, Model version: 1 I0618 17:32:13.087785 386 model_registry.cc:107] Model names: jarvis_text_classification_domain, Model version: 1 I0618 17:32:13.088524 386 model_registry.cc:107] Model names: jarvis_tokenizer, Model version: 1 I0618 17:32:13.089290 386 model_registry.cc:107] Model names: tacotron2_decoder_postnet, Model version: 1 I0618 17:32:13.090291 386 model_registry.cc:107] Model names: tacotron2_ensemble, Model version: 1 I0618 17:32:13.091197 386 model_registry.cc:120] 'Successfully registering tacotron2_ensemble' I0618 17:32:13.091248 386 model_registry.cc:107] Model names: tts_preprocessor, Model version: 1 I0618 17:32:13.092130 386 model_registry.cc:107] Model names: waveglow_denoiser, Model version: 1 I0618 17:32:13.093039 386 model_registry.cc:125] Successfully registered: 1 models. I0618 17:32:13.093081 386 grpc_jarvis_tts.cc:68] Seeding RNG used for correlation id with time: 1624037533 I0618 17:32:13.093443 386 jarvis_server.cc:68] NLP Service connected to Triton at localhost:8001 I0618 17:32:13.093462 386 jarvis_server.cc:70] ASR Service connected to Triton at localhost:8001 I0618 17:32:13.093470 386 jarvis_server.cc:72] TTS Service connected to Triton at localhost:8001 I0618 17:32:13.093474 386 jarvis_server.cc:73] Jarvis Conversational AI Server listening on 0.0.0.0:50051