I1124 04:50:38.289428 91 tritonserver.cc:2123] +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Option | Value | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | server_id | triton | | server_version | 2.21.0 | | server_extensions | classification sequence model_repository model_repository(unload_dependents) schedule_policy model_configuration system_shared_memory cuda_shared_memory binary_tensor_data statistics trace | | model_repository_path[0] | /data/models | | model_control_mode | MODE_NONE | | strict_model_config | 1 | | rate_limit | OFF | | pinned_memory_pool_byte_size | 268435456 | | cuda_memory_pool_byte_size{0} | 1000000000 | | response_cache_byte_size | 0 | | min_supported_compute_capability | 6.0 | | strict_readiness | 1 | | exit_timeout | 30 | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ I1124 04:50:38.305978 91 grpc_server.cc:4544] Started GRPCInferenceService at 0.0.0.0:8001 I1124 04:50:38.309735 91 http_server.cc:3242] Started HTTPService at 0.0.0.0:8000 I1124 04:50:38.352418 91 http_server.cc:180] Started Metrics Service at 0.0.0.0:8002 > Triton server is ready... I1124 04:50:38.472173 317 riva_server.cc:120] Using Insecure Server Credentials I1124 04:50:38.512604 317 model_registry.cc:110] Successfully registered: citrinet-1024-en-US-asr-offline for ASR I1124 04:50:38.518527 317 model_registry.cc:110] Successfully registered: citrinet-1024-en-US-asr-streaming for ASR I1124 04:50:38.523890 317 model_registry.cc:110] Successfully registered: citrinet-512-fil-PH-asr-online for ASR I1124 04:50:38.568559 317 model_registry.cc:110] Successfully registered: riva-punctuation-en-US for NLP W1124 04:50:38.763687 317 grpc_riva_asr.cc:157] citrinet-512-fil-PH-asr-online has no configured wfst normalizer model I1124 04:50:38.786638 317 riva_server.cc:160] Riva Conversational AI Server listening on 0.0.0.0:50051 W1124 04:50:38.786667 317 stats_reporter.cc:41] No API key provided. Stats reporting disabled. I1124 05:13:19.795485 324 grpc_riva_asr.cc:484] ASRService.Recognize called. I1124 05:13:19.795672 324 riva_asr_stream.cc:214] Detected format: encoding = 1 numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:13:19.795751 324 grpc_riva_asr.cc:550] ASRService.Recognize performing streaming recognition with sequence id: 862981858 I1124 05:13:19.795871 324 grpc_riva_asr.cc:580] Using model citrinet-1024-en-US-asr-offline for inference I1124 05:13:19.795989 324 grpc_riva_asr.cc:595] Model sample rate= 16000 for inference I1124 05:13:19.809917 2225 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:13:20.065984 324 grpc_riva_asr.cc:664] ASRService.Recognize returning OK I1124 05:13:50.061062 2223 grpc_riva_asr.cc:484] ASRService.Recognize called. I1124 05:13:50.061288 2223 riva_asr_stream.cc:214] Detected format: encoding = 1 numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:13:50.061313 2223 grpc_riva_asr.cc:550] ASRService.Recognize performing streaming recognition with sequence id: 1582017459 I1124 05:13:50.061419 2223 grpc_riva_asr.cc:580] Using model citrinet-1024-en-US-asr-offline for inference I1124 05:13:50.061492 2223 grpc_riva_asr.cc:595] Model sample rate= 16000 for inference I1124 05:13:50.074626 2280 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:13:50.164626 2223 grpc_riva_asr.cc:664] ASRService.Recognize returning OK I1124 05:15:05.781386 2223 grpc_riva_asr.cc:484] ASRService.Recognize called. I1124 05:15:05.781504 2223 riva_asr_stream.cc:214] Detected format: encoding = 1 numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:15:05.781523 2223 grpc_riva_asr.cc:550] ASRService.Recognize performing streaming recognition with sequence id: 2018428182 I1124 05:15:05.781630 2223 grpc_riva_asr.cc:580] Using model citrinet-1024-en-US-asr-offline for inference I1124 05:15:05.781720 2223 grpc_riva_asr.cc:595] Model sample rate= 16000 for inference I1124 05:15:05.796568 2388 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:15:05.886387 2223 grpc_riva_asr.cc:664] ASRService.Recognize returning OK I1124 05:15:11.469319 2223 grpc_riva_asr.cc:484] ASRService.Recognize called. I1124 05:15:11.469446 2223 riva_asr_stream.cc:214] Detected format: encoding = 1 numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:15:11.469463 2223 grpc_riva_asr.cc:550] ASRService.Recognize performing streaming recognition with sequence id: 668432847 I1124 05:15:11.469693 2223 grpc_riva_asr.cc:580] Using model citrinet-1024-en-US-asr-offline for inference I1124 05:15:11.469774 2223 grpc_riva_asr.cc:595] Model sample rate= 16000 for inference I1124 05:15:11.483649 2405 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:15:11.522004 2223 grpc_riva_asr.cc:268] max_alternative is greater than max_transcripts supported by server I1124 05:15:11.522032 2223 grpc_riva_asr.cc:664] ASRService.Recognize returning OK I1124 05:23:22.434952 2223 grpc_riva_asr.cc:892] ASRService.StreamingRecognize called. I1124 05:23:22.435032 2223 grpc_riva_asr.cc:919] ASRService.StreamingRecognize performing streaming recognition with sequence id: 1974184040 I1124 05:23:22.435184 2223 grpc_riva_asr.cc:976] Using model citrinet-1024-en-US-asr-streaming for inference I1124 05:23:22.435356 2223 grpc_riva_asr.cc:992] Model sample rate= 16000 for inference I1124 05:23:23.547719 2223 riva_asr_stream.cc:214] Detected format: encoding = 1 RAW numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:23:23.548274 3094 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:23:29.227906 3094 grpc_riva_asr.cc:701] Send silence buffer for EOS I1124 05:23:29.455349 2223 grpc_riva_asr.cc:1093] ASRService.StreamingRecognize returning OK I1124 05:39:29.126405 324 grpc_riva_asr.cc:892] ASRService.StreamingRecognize called. I1124 05:39:29.126683 324 grpc_riva_asr.cc:919] ASRService.StreamingRecognize performing streaming recognition with sequence id: 109966203 I1124 05:39:29.126832 324 grpc_riva_asr.cc:976] Using model citrinet-1024-en-US-asr-streaming for inference I1124 05:39:29.127079 324 grpc_riva_asr.cc:992] Model sample rate= 16000 for inference I1124 05:39:31.026723 324 riva_asr_stream.cc:214] Detected format: encoding = 1 RAW numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:39:31.027220 4456 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:39:34.846841 4456 grpc_riva_asr.cc:701] Send silence buffer for EOS I1124 05:39:34.896685 324 grpc_riva_asr.cc:1093] ASRService.StreamingRecognize returning OK I1124 05:53:38.805635 324 grpc_riva_asr.cc:892] ASRService.StreamingRecognize called. I1124 05:53:38.805894 324 grpc_riva_asr.cc:919] ASRService.StreamingRecognize performing streaming recognition with sequence id: 906549764 I1124 05:53:38.806087 324 grpc_riva_asr.cc:976] Using model citrinet-1024-en-US-asr-streaming for inference I1124 05:53:38.806174 324 grpc_riva_asr.cc:992] Model sample rate= 16000 for inference I1124 05:53:39.805259 324 riva_asr_stream.cc:214] Detected format: encoding = 1 RAW numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:53:39.805716 5642 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:53:46.525418 5642 grpc_riva_asr.cc:701] Send silence buffer for EOS I1124 05:53:46.590281 324 grpc_riva_asr.cc:1093] ASRService.StreamingRecognize returning OK I1124 05:54:22.390076 2223 grpc_riva_asr.cc:892] ASRService.StreamingRecognize called. I1124 05:54:22.390228 2223 grpc_riva_asr.cc:919] ASRService.StreamingRecognize performing streaming recognition with sequence id: 10959045 I1124 05:54:22.390376 2223 grpc_riva_asr.cc:976] Using model citrinet-1024-en-US-asr-streaming for inference I1124 05:54:22.390516 2223 grpc_riva_asr.cc:992] Model sample rate= 16000 for inference I1124 05:54:23.255537 2223 riva_asr_stream.cc:214] Detected format: encoding = 1 RAW numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:54:23.256086 5708 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:54:28.975642 5708 grpc_riva_asr.cc:701] Send silence buffer for EOS I1124 05:54:29.041854 2223 grpc_riva_asr.cc:1093] ASRService.StreamingRecognize returning OK I1124 05:55:00.721640 2223 grpc_riva_asr.cc:892] ASRService.StreamingRecognize called. I1124 05:55:00.721717 2223 grpc_riva_asr.cc:919] ASRService.StreamingRecognize performing streaming recognition with sequence id: 416950529 I1124 05:55:00.722002 2223 grpc_riva_asr.cc:976] Using model citrinet-1024-en-US-asr-streaming for inference I1124 05:55:00.722093 2223 grpc_riva_asr.cc:992] Model sample rate= 16000 for inference I1124 05:55:01.065706 2223 riva_asr_stream.cc:214] Detected format: encoding = 1 RAW numchannels = 1 samplerate = 8000 bitspersample = 16 I1124 05:55:01.067091 5767 grpc_riva_asr.cc:709] Creating resampler, audio file sample rate=8000 model sample_rate=16000 I1124 05:55:06.345842 5767 grpc_riva_asr.cc:701] Send silence buffer for EOS I1124 05:55:06.408830 2223 grpc_riva_asr.cc:1093] ASRService.StreamingRecognize returning OK