Addressing Memory Issues with Nvidia Riva ASR

I am trying to run some local tests with the Nvidia Riva platform for ASR.
My equipment is as follows:

❯ neofetch --backend 

rodrigo@rodrigo-MSI-MORTAR 
-------------------------- 
OS: Ubuntu 22.04.3 LTS x86_64 
Host: MS-7C94 1.0 
Kernel: 6.2.0-36-generic 
Uptime: 17 hours, 19 mins 
Packages: 3094 (dpkg), 6 (flatpak), 36 (snap) 
Shell: zsh 5.8.1 
Resolution: 4384x2466, 3840x2160 
DE: GNOME 42.9 
WM: Mutter 
WM Theme: Adwaita 
Theme: Fluent-round-Dark [GTK2/3] 
Icons: Papirus-Dark [GTK2/3] 
Terminal: gnome-terminal 
CPU: AMD Ryzen 9 5900X (24) @ 3.700GHz 
GPU: NVIDIA GeForce RTX 3070 Ti 
Memory: 13113MiB / 32007MiB 

But when trying to start the Nvidia Riva service, I am receiving an out of memory error (attached log file log.txt (225.6 KB) ). What are the minimum requirements? I have searched but have not found anything about memory.

I find it strange that I have memory issues just to run the ASR model in one language, especially since models like Whisper have much lower memory requirements, which I’ve been able to run without any issues. This leads me to think that the error may be related to something else, but the log does not say anything. What could it be?
config.txt (17.5 KB)

It was a problem with requirements (I think), on AWS I was able to deploy it without any issues using the same steps here are the minimum requirements: Support Matrix — NVIDIA Riva
Although it says that it requires 5GB, ASR does not work on my 8GB GPU.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.