Failed to download Riva ASR Conformer-XL Offline model

  • Hardware - GPU A40
  • Hardware - CPU Intel(R) Xeon(R) Gold 6354 CPU @ 3.00GHz
  • Operating System - Ubuntu 20.04.5 LTS
  • Riva Version - 2.11.0
  • NVidia driver version: 525.105.17
  • CUDA version: 12.0
  • Docker version: 23.0.1

I’m trying to install a latest version of Riva quickstart, but for some reason I can’t download the Riva ASR Conformer-XL Offline model:

Directory rmir_asr_conformer_xl_en_us_str_v2.12.0 already exists, skipping. Use '--force' option to override.
  > Downloading nvidia/riva/rmir_asr_conformer_xl_en_us_ofl:2.12.0...
CLI_VERSION: Latest - 3.24.0 available (current: 3.22.0). Please update by using the command 'ngc version upgrade'

Downloaded 0 B in 1s, Download speed: 0 B/s
/data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0.zip not found, skipping.
[Errno 2] No such file or directory: '/data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0.zip'
Downloaded 0 B in 2s, Download speed: 0 B/s
---------------------------------------------------------------------------------
   Transfer id: rmir_asr_conformer_xl_en_us_ofl_v2.12.0
   Download status: Failed
   Downloaded local path: /data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0
   Total files downloaded: 0
   Total downloaded size: 0 B
   Started at: 2023-07-11 07:34:49.266307
   Completed at: 2023-07-11 07:34:51.269805
   Duration taken: 2s
---------------------------------------------------------------------------------
  > Attempt 1 out of 3 failed
  > Trying again...
 > Cleaning up partial download  rmir_asr_conformer_xl_en_us_ofl_v2.12.0
Downloaded 0 B in 1s, Download speed: 0 B/s
/data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0.zip not found, skipping.
[Errno 2] No such file or directory: '/data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0.zip'
Downloaded 0 B in 2s, Download speed: 0 B/s
---------------------------------------------------------------------------------
   Transfer id: rmir_asr_conformer_xl_en_us_ofl_v2.12.0
   Download status: Failed
   Downloaded local path: /data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0
   Total files downloaded: 0
   Total downloaded size: 0 B
   Started at: 2023-07-11 07:34:54.564527
   Completed at: 2023-07-11 07:34:56.568204
   Duration taken: 2s
---------------------------------------------------------------------------------
  > Attempt 2 out of 3 failed
  > Trying again...
 > Cleaning up partial download  rmir_asr_conformer_xl_en_us_ofl_v2.12.0
Downloaded 0 B in 1s, Download speed: 0 B/s
/data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0.zip not found, skipping.
[Errno 2] No such file or directory: '/data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0.zip'
Downloaded 0 B in 2s, Download speed: 0 B/s
---------------------------------------------------------------------------------
   Transfer id: rmir_asr_conformer_xl_en_us_ofl_v2.12.0
   Download status: Failed
   Downloaded local path: /data/artifacts/rmir_asr_conformer_xl_en_us_ofl_v2.12.0
   Total files downloaded: 0
   Total downloaded size: 0 B
   Started at: 2023-07-11 07:34:59.726980
   Completed at: 2023-07-11 07:35:01.730535
   Duration taken: 2s
---------------------------------------------------------------------------------
  > Attempt 3 out of 3 failed
Error occurred downloading 'nvidia/riva/rmir_asr_conformer_xl_en_us_ofl:2.12.0'. Exiting.
Error in downloading models.

I also tried to download it with ngccli, but the result is the same:

$ ngc registry model download-version "nvidia/riva/rmir_asr_conformer_xl_en_us_ofl:2.12.0"
Downloaded 0 B in 1s, Download speed: 0 B/s
rmir_asr_conformer_xl_en_us_ofl_v2.12.0.zip not found, skipping.
[Errno 2] No such file or directory: 'rmir_asr_conformer_xl_en_us_ofl_v2.12.0.zip'
Downloaded 0 B in 2s, Download speed: 0 B/s
--------------------------------------------------------------------------------
   Transfer id: rmir_asr_conformer_xl_en_us_ofl_v2.12.0
   Download status: Failed
   Downloaded local path: rmir_asr_conformer_xl_en_us_ofl_v2.12.0
   Total files downloaded: 0
   Total downloaded size: 0 B
   Started at: 2023-07-11 07:40:07.375096
   Completed at: 2023-07-11 07:40:09.378544
   Duration taken: 2s
--------------------------------------------------------------------------------

It happens only with the “nvidia/riva/rmir_asr_conformer_xl_en_us_ofl:2.12.0”, because the “nvidia/riva/rmir_asr_conformer_xl_en_us_str:2.12.0” was downloaded without any issues.

How can I fix this issue?

Thanks in advance!

Hi @vbilous

Thanks for reporting this issue,
I tried to reproduce from my end, it happens in 2.12.0 too,
I will report to the Engineering and provide updates from them

Thanks