Please provide the following information when requesting support.
Hardware - GPU (T4)
Hardware - CPU
Operating System- Linux
Riva Version: 2.16.0
How to reproduce the issue ? (This is for errors. Please share the command and the detailed log here)
kubectl logs -f triton0-78f4fb98cd-dbk7m -c riva-model-init
2024-08-02 13:50:51
Downloading nvidia/riva/rmir_asr_conformer_en_us_str_thr:2.16.0…
CLI_VERSION: Latest - 3.46.0 available (current: 3.26.0). Please update by using the command ‘ngc version upgrade’
Getting files to download…
━━ • … • Remaining: 0… • … • Elapsed: 0… • Total: 1 - Completed: 1 - Failed: 0
… …
Download status: COMPLETED
Downloaded local path model: /data/rmir/rmir_asr_conformer_en_us_str_thr_v2.16.0
Total files downloaded: 1
Total transferred: 929.76 MB
Started at: 2024-08-02 13:51:01
Completed at: 2024-08-02 13:51:14
Duration taken: 12s
/opt/riva
2024-08-02 13:51:17,088 [INFO] Writing Riva model repository to ‘/data/models/rmir_asr_conformer_en_us_str_thr_2.16.0’…
2024-08-02 13:51:17,088 [INFO] The riva model repo target directory is /data/models/rmir_asr_conformer_en_us_str_thr_2.16.0
2024-08-02 13:52:02,119 [INFO] Using obey-precision pass with fp16 TRT
2024-08-02 13:52:02,157 [INFO] Extract_binaries for nn → /data/models/rmir_asr_conformer_en_us_str_thr_2.16.0/riva-trt-conformer-en-US-asr-streaming-throughput-am-streaming/1
2024-08-02 13:52:02,157 [INFO] extracting {‘onnx’: (‘nemo.collections.asr.models.ctc_bpe_models.EncDecCTCModelBPE’, ‘model_graph.onnx’)} → /data/models/rmir_asr_conformer_en_us_str_thr_2.16.0/riva-trt-conformer-en-US-asr-streaming-throughput-am-streaming/1
2024-08-02 13:52:05,269 [ERROR] Failed decryption. Please provide decryption key on the command line. model.rmir:ENCRYPTION_KEY
I’ve followed all instructions to deploy helm chart on aks, But when i install riva-api, my riva-model-init container in titron pod fails with the above error