Error using riva build (KeyError: 'g2p')

AI & Data Science Deep Learning (Training & Inference) Riva
#1

Hardware - GPU: RTX3070 Notebook
Hardware - CPU: Intel i7 12700H
Operating System: Ubuntu 20.04
Riva Version: 2.7.0

I’m trying to use a multi-speak pre-trained Spanish model from NeMo on Riva.

I launch an interactive session inside the Riva ServiceMaker image, with these lines:

docker run --gpus all -it --rm
-v /home/nigel/Downloads/files/modelos_riva:/servicemaker-dev
-v /home/nigel/Downloads/files/modelos_riva/repo_riva:/data
–entrypoint=“/bin/bash”
nvcr.io/nvidia/riva/riva-speech:2.7.0-servicemaker

When executing the following lines inside the Riva ServiceMaker docker:

riva-build speech_synthesis
/servicemaker-dev/tts_es_fastpitch_rmir
/servicemaker-dev/tts_es_fastpitch.riva

It returns the following error:

Traceback (most recent call last):
File “/usr/local/bin/riva-build”, line 8, in
sys.exit(build())
File “/usr/local/lib/python3.8/dist-packages/servicemaker/cli/build.py”, line 97, in build
pipeline_config.init_from(nm.get_config())
File “/usr/local/lib/python3.8/dist-packages/servicemaker/pipelines/tts.py”, line 228, in init_from
tt_config = src_config[‘text_tokenizer’][‘g2p’]
KeyError: ‘g2p’

How can I solve that?

#2

Hi @nharo

Thanks for your interest in Riva

Apologies it is showing error,

Let us try to reproduce the issue from our end

Could you please share with us the NGC link from which you downloaded the spanish model

Thanks

#3

Hello, I downloaded it from here:

#4

Hi @nharo

Apologies for the delay

There were some issue with the nemo2riva conversion with earlier version, can you try the nemo2riva conversion using the below suggested method and let us know if it helps solve your issue

Build the Docker

git clone https://github.com/NVIDIA/NeMo.git -b r1.15.0 
cd  NeMo
DOCKER_BUILDKIT=1 nvidia-docker build . -t nemo15

Start the Container (Before starting make sure to add the nemo model and nemo2riva-2.8.1-py3-none-any.whl wheel file from quickstart into the volume i.e <nemo_github_folder> of below command )

docker run --gpus all -it --rm -v <nemo_github_folder>:/NeMo --shm-size=8g \
-p 8888:8888 -p 6006:6006 --ulimit memlock=-1 --ulimit \
stack=67108864 --device=/dev/snd nemo15

Then do the conversion

pip install nemo2riva-2.8.1-py3-none-any.whl

nemo2riva --key tlt_encode --out /NeMo/tts_es_fastpitch_multispeaker.riva /NeMo/tts_es_fastpitch_multispeaker.nemo

And let us know using this riva model does cause trouble with riva-deploy and riva-build command,

Thanks