Riva waiting for Triton server to load all models...retrying in 1 second

AI & Data Science Deep Learning (Training & Inference) Riva
1

Please provide the following information when requesting support.

Hardware - GPU RTX 3060
Hardware - CPU
Operating System
Riva Version 2.9.0

I run this command
riva-build speech_recognition -f
/servicemaker-dev/asr_bn.rmir /servicemaker-dev/conformer_ctc_med_bn1.riva
–offline
–name=conformer-bn-BD-asr-offline
–featurizer.use_utterance_norm_params=False
–featurizer.precalc_norm_time_steps=0
–featurizer.precalc_norm_params=False
–ms_per_timestep=40
–endpointing.start_history=200
–endpointing.residue_blanks_at_start=-2
–nn.fp16_needs_obey_precision_pass
–chunk_size=4.8
–left_padding_size=1.6
–right_padding_size=1.6
–max_batch_size=16
–featurizer.max_batch_size=512
–featurizer.max_execution_batch_size=512
–decoder_type=flashlight
–decoding_language_model_binary=/servicemaker-dev/v4_lm_4gram_p0011.binary
–decoding_vocab=/servicemaker-dev/bn_lexicon.txt
–flashlight_decoder.lm_weight=0.2
–flashlight_decoder.word_insertion_score=0.2
–flashlight_decoder.beam_threshold=20.
–language_code=bn-BD && riva-deploy -f /servicemaker-dev/asr_bn.rmir /data/models

after deployment when i tried to access that deployed model to transcribe it throws this error

riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second
riva_1 | > Riva waiting for Triton server to load all models…retrying in 1 second

and then

riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6
riva_1 | [Trie] Trie label number reached limit: 6

how to resolve it?

2

Hi @shihab2

Thanks for your interest in Riva

Apologies you are facing issue

Request to kindly share

  1. the complete log output of docker logs riva-speech
  2. the config.sh used after riva-deploy, or the method used for starting the riva

Thanks

3

Well, the issue has been solved. I changed my lexicon.txt file and it worked for me.