Converting nemo encoder-decoder rnnt model to onnx


I am trying to convert nemo_asr.models.EncDecRNNTBPEModel to onnx with nemo.export(). I want to convert onnx model to tensorrt after that. The problem is that nemo.export() generates 2 different .onnx files for encoder and decoder. Separately I can convert them to trt format, but it can cause some difficulties in future. So, I want to have one model file, not 2. Will be grateful for any help.

I just do

import nemo.collections.asr as nemo_asr
asr_model = nemo_asr.models.EncDecRNNTBPEModel.from_pretrained(“nvidia/stt_ru_conformer_transducer_large”)


Hi @liamstartips

Thanks for your interest in Riva

The Issue seems to be related to Nemo

Please raise your question/query in the below Github link