========================== == Jarvis Speech Skills == ========================== NVIDIA Release 20.11 (build 20304504) Copyright (c) 2018-2020, NVIDIA CORPORATION. All rights reserved. Various files include modifications (c) NVIDIA CORPORATION. All rights reserved. NVIDIA modifications are covered by the license terms that apply to the underlying project or file. NOTE: Legacy NVIDIA Driver detected. Compatibility mode ENABLED. NOTE: The SHMEM allocation limit is set to the default of 64MB. This may be insufficient for the inference server. NVIDIA recommends the use of the following flags: nvidia-docker run --shm-size=1g --ulimit memlock=-1 --ulimit stack=67108864 ... > Jarvis waiting for Triton server to load all models...retrying in 1 second I0315 03:35:07.708446 62 metrics.cc:219] Collecting metrics for GPU 0: Tesla V100-DGXS-32GB I0315 03:35:07.894878 62 pinned_memory_manager.cc:199] Pinned memory pool is created at '0x7f71ac000000' with size 268435456 I0315 03:35:07.895787 62 cuda_memory_manager.cc:99] CUDA memory pool is created on device 0 with size 1000000000 I0315 03:35:07.905246 62 model_repository_manager.cc:810] loading: jarvis-asr-feature-extractor-streaming:1 I0315 03:35:07.905454 62 model_repository_manager.cc:810] loading: jarvis-asr-ctc-decoder-cpu-streaming:1 I0315 03:35:07.905584 62 model_repository_manager.cc:810] loading: jarvis-asr-voice-activity-detector-ctc-streaming:1 I0315 03:35:07.905690 62 model_repository_manager.cc:810] loading: jarvis-trt-jarvis-asr-am-streaming:1 I0315 03:35:07.909818 62 custom_backend.cc:198] Creating instance jarvis-asr-ctc-decoder-cpu-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_decoder_cpu.so I0315 03:35:07.910113 62 custom_backend.cc:198] Creating instance jarvis-asr-voice-activity-detector-ctc-streaming_0_0_cpu on CPU using libtriton_jarvis_asr_vad.so I0315 03:35:07.910657 62 custom_backend.cc:201] Creating instance jarvis-asr-feature-extractor-streaming_0_0_gpu0 on GPU 0 (7.0) using libtriton_jarvis_asr_features.so I0315 03:35:08.269979 62 model_repository_manager.cc:983] successfully loaded 'jarvis-asr-voice-activity-detector-ctc-streaming' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second I0315 03:35:08.755218 62 model_repository_manager.cc:983] successfully loaded 'jarvis-asr-ctc-decoder-cpu-streaming' version 1 > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second > Jarvis waiting for Triton server to load all models...retrying in 1 second I0315 03:35:24.334288 62 model_repository_manager.cc:983] successfully loaded 'jarvis-asr-feature-extractor-streaming' version 1 I0315 03:35:24.744343 62 plan_backend.cc:333] Creating instance jarvis-trt-jarvis-asr-am-streaming_0_0_gpu0 on GPU 0 (7.0) using model.plan > Jarvis waiting for Triton server to load all models...retrying in 1 second I0315 03:35:25.297461 62 plan_backend.cc:666] Created instance jarvis-trt-jarvis-asr-am-streaming_0_0_gpu0 on GPU 0 with stream priority 0 and optimization profile default[0]; I0315 03:35:25.299980 62 model_repository_manager.cc:983] successfully loaded 'jarvis-trt-jarvis-asr-am-streaming' version 1 I0315 03:35:25.300648 62 model_repository_manager.cc:810] loading: jarvis-asr:1 I0315 03:35:25.301056 62 model_repository_manager.cc:983] successfully loaded 'jarvis-asr' version 1 I0315 03:35:25.301165 62 server.cc:141] +---------+--------+------+ | Backend | Config | Path | +---------+--------+------+ +---------+--------+------+ I0315 03:35:25.301247 62 server.cc:184] +--------------------------------------------------+---------+--------+ | Model | Version | Status | +--------------------------------------------------+---------+--------+ | jarvis-asr | 1 | READY | | jarvis-asr-ctc-decoder-cpu-streaming | 1 | READY | | jarvis-asr-feature-extractor-streaming | 1 | READY | | jarvis-asr-voice-activity-detector-ctc-streaming | 1 | READY | | jarvis-trt-jarvis-asr-am-streaming | 1 | READY | +--------------------------------------------------+---------+--------+ I0315 03:35:25.301389 62 tritonserver.cc:1620] +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ | Option | Value | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ | server_id | triton | | server_version | 2.5.0 | | server_extensions | classification sequence model_repository schedule_policy model_configuration system_shared_memory cuda_shared_memory binary_tensor_data statistics | | model_repository_path[0] | /data/models | | model_control_mode | MODE_NONE | | strict_model_config | 1 | | pinned_memory_pool_byte_size | 268435456 | | cuda_memory_pool_byte_size{0} | 1000000000 | | min_supported_compute_capability | 6.0 | | strict_readiness | 1 | | exit_timeout | 30 | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+ I0315 03:35:25.302723 62 grpc_server.cc:3979] Started GRPCInferenceService at 0.0.0.0:8001 I0315 03:35:25.303113 62 http_server.cc:2717] Started HTTPService at 0.0.0.0:8000 I0315 03:35:25.344462 62 http_server.cc:2736] Started Metrics Service at 0.0.0.0:8002 > Triton server is ready... I0315 03:35:26.051120 152 grpc_health.cc:42] JarvisHealthService initialized with server: localhost:8001 I0315 03:35:26.051198 152 grpc_jarvis_asr.cc:130] Setting uri for ASRServiceImpl I0315 03:35:26.051213 152 grpc_jarvis_asr.cc:131] Initializing different models I0315 03:35:26.052152 152 model_registry.cc:52] JarvisModelRegistry initialized with server: localhost:8001 I0315 03:35:26.054396 152 model_registry.cc:81] Server Name: triton, Server version: 2.5.0 I0315 03:35:26.054862 152 model_registry.cc:102] Our model repository has a total of: 5 models I0315 03:35:26.054877 152 model_registry.cc:107] Model names: jarvis-asr, Model version: 1 I0315 03:35:26.061367 152 model_registry.cc:120] 'Successfully registering jarvis-asr' I0315 03:35:26.061522 152 model_registry.cc:107] Model names: jarvis-asr-ctc-decoder-cpu-streaming, Model version: 1 I0315 03:35:26.064981 152 model_registry.cc:107] Model names: jarvis-asr-feature-extractor-streaming, Model version: 1 I0315 03:35:26.066570 152 model_registry.cc:107] Model names: jarvis-asr-voice-activity-detector-ctc-streaming, Model version: 1 I0315 03:35:26.068712 152 model_registry.cc:107] Model names: jarvis-trt-jarvis-asr-am-streaming, Model version: 1 I0315 03:35:26.069623 152 model_registry.cc:125] Successfully registered: 1 models. I0315 03:35:26.069653 152 client.cc:54] JarvisNLPClient initialized with server: localhost:8001 I0315 03:35:26.070003 152 client.cc:70] Our model repository has: 5 models. W0315 03:35:26.071571 152 client.cc:94] Registration of 'jarvis-asr' failed with unknown service type I0315 03:35:26.078838 152 grpc_jarvis_asr.cc:153] Seeding RNG used for correlation id with time: 1615779326 I0315 03:35:26.079305 152 jarvis_server.cc:70] ASR Service connected to Triton at localhost:8001 I0315 03:35:26.079324 152 jarvis_server.cc:73] Jarvis Conversational AI Server listening on 0.0.0.0:50051 I0315 03:37:10.538106 157 grpc_jarvis_asr.cc:308] ASRService.Recognize called. I0315 03:37:10.538230 157 jarvis_asr_stream.cc:209] Detected format: encoding = 1 numchannels = 1 samplerate = 16000 bitspersample = 16 I0315 03:37:10.538272 157 grpc_jarvis_asr.cc:353] ASRService.Recognize performing streaming recognition with sequence id: 604672747 E0315 03:37:10.538424 157 grpc_jarvis_asr.cc:278] Unavailable model requested. Lang: en-US, Streaming: 1, Type: offline, VAD: 1 I0315 03:42:06.435739 300 grpc_jarvis_asr.cc:308] ASRService.Recognize called. I0315 03:42:06.435832 300 jarvis_asr_stream.cc:209] Detected format: encoding = 1 numchannels = 1 samplerate = 16000 bitspersample = 16 I0315 03:42:06.435868 300 grpc_jarvis_asr.cc:353] ASRService.Recognize performing streaming recognition with sequence id: 126101021 E0315 03:42:06.436151 300 grpc_jarvis_asr.cc:278] Unavailable model requested. Lang: en-US, Streaming: 1, Type: offline, VAD: 1