I1207 15:57:12.458218 72 model_repository_manager.cc:1240] successfully loaded 'riva-trt-riva-asr-am-streaming-offline' version 1 E1207 15:57:12.458286 72 model_repository_manager.cc:1431] Invalid argument: ensemble 'riva-asr' depends on 'riva-asr-voice-activity-detector-ctc-streaming-offline' which has no loaded version I1207 15:57:12.458362 72 server.cc:504] +------------------+------+ | Repository Agent | Path | +------------------+------+ +------------------+------+ I1207 15:57:12.458437 72 server.cc:543] +-------------+-----------------------------------------------------------------+--------+ | Backend | Path | Config | +-------------+-----------------------------------------------------------------+--------+ | tensorrt | | {} | | onnxruntime | /opt/tritonserver/backends/onnxruntime/libtriton_onnxruntime.so | {} | +-------------+-----------------------------------------------------------------+--------+ I1207 15:57:12.458603 72 server.cc:586] +--------------------------------------------------------+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | Model | Version | Status +--------------------------------------------------------+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | riva-asr-ctc-decoder-cpu-streaming-offline | 1 | UNAVAILABLE: Invalid argument: unable to find 'libtriton_riva_asr_decoder_cpu.so' for model 'riva-asr-ctc-decoder-cpu-stream, searched: /data/models/riva-asr-ctc-decoder-cpu-streaming-offline/1, /data/models/riva-asr-ctc-decoder-cpu-streaming-offline, /opt/tritonserver/backends/riva_asr_decoder_cpu | riva-asr-feature-extractor-streaming-offline | 1 | UNAVAILABLE: Invalid argument: unable to find 'libtriton_riva_asr_features.so' for model 'riva-asr-feature-extractor-streami searched: /data/models/riva-asr-feature-extractor-streaming-offline/1, /data/models/riva-asr-feature-extractor-streaming-offline, /opt/tritonserver/backends/riva_asr_features | riva-asr-voice-activity-detector-ctc-streaming-offline | 1 | UNAVAILABLE: Invalid argument: unable to find 'libtriton_riva_asr_vad.so' for model 'riva-asr-voice-activity-detector-ctc-stine', searched: /data/models/riva-asr-voice-activity-detector-ctc-streaming-offline/1, /data/models/riva-asr-voice-activity-detector-ctc-streaming-offline, /opt/tritonserver/backends/riva_asr_v | riva-trt-riva-asr-am-streaming-offline | 1 | READY +--------------------------------------------------------+---------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ I1207 15:57:12.458777 72 tritonserver.cc:1658] +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Option | Value | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | server_id | triton | | server_version | 2.9.0 | | server_extensions | classification sequence model_repository model_repository(unload_dependents) schedule_policy model_configuration system_shared_memory cuda_shared_memory binata statistics | | model_repository_path[0] | /data/models | | model_control_mode | MODE_NONE | | strict_model_config | 1 | | pinned_memory_pool_byte_size | 268435456 | | cuda_memory_pool_byte_size{0} | 1000000000 | | min_supported_compute_capability | 6.0 | | strict_readiness | 1 | | exit_timeout | 30 | +----------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ I1207 15:57:12.458791 72 server.cc:234] Waiting for in-flight requests to complete. I1207 15:57:12.458801 72 model_repository_manager.cc:1099] unloading: riva-trt-riva-asr-am-streaming-offline:1 I1207 15:57:12.506621 72 server.cc:249] Timeout 30: Found 1 live models and 0 in-flight non-inference requests I1207 15:57:12.522134 72 model_repository_manager.cc:1223] successfully unloaded 'riva-trt-riva-asr-am-streaming-offline' version 1 > Riva waiting for Triton server to load all models...retrying in 1 second I1207 15:57:13.506751 72 server.cc:249] Timeout 29: Found 0 live models and 0 in-flight non-inference requests error: creating server: Internal - failed to load all models