I already covered this Error in a post.
The “riva-trt-conformer-en-US-asr-streaming-am-streaming” is broken.
Ryan Leary is aware of the issue. Something breaks the Triton all together. Cant get ASR working and going from NeMo to RIVA-Triton is not exactly a cake walk.