I tried to riva_build a model with fp32. But riva_start.sh will not work, citing
| riva-trt-asr-conformer_en_us-offline-flashlight-am-streaming-offline | 1 | UNAVAILABLE: Unavailable: unable to find ‘/data/models/riva-trt-asr-conformer_en_us-offline-flashlight-am-streaming-offline/1/model.plan’ for model instance 'riva-trt-asr-conformer_en_us-offline-flashlight- |
I usually follow the route of riva_quickstart, with riva_init.sh then riva_start.sh.
It works for most models except when I add the nn.use_trt_fp32 flag. Then there is just no model.plan in the models dir. Is there other settings that are required for this –nn.use_trt_fp32 flag?