How to deploy QuartzNet ASR in triton inference server?

AI & Data Science Deep Learning (Training & Inference) Triton Inference Server - archived

luisyin November 16, 2020, 10:39am 1

I learned from this link that QuartzNet can be deployed into triton. But that link is for embeded device. I don’t have such device now so I can’t run the container.Can anyone share information about how to deploy QuartzNet in triton? Really appreciate if someone could share the python script inside the container.

Topic		Replies	Views
Deploy LPRnet sequence Classifier on Triton Inference Server Triton Inference Server - archived	0	758	July 21, 2021
Triton inference server on jetson xavier Jetson Xavier NX inference-server-triton	3	2016	October 18, 2021
Can Triton be pre-installed on the Jetson platform? Jetson Xavier NX inference-server-triton	4	787	January 26, 2022
Support for Triton Inference Server on Jetson NX Jetson Xavier NX cuda , jetson-inference , inference-server-triton , jetson , deepstream61	2	880	November 2, 2022
How to Run Triton Inference Server on Jetson Xavier NX Triton Inference Server - archived inference-server-triton	0	613	May 31, 2021
How to encrypt model in triton server General Topics and Other SDKs inference-server-triton	0	808	April 23, 2022
Triton inference on AGX orin Jetson AGX Orin jetson-inference	2	564	December 26, 2023
Implementation of Triton Inference server on EC2 ubuntu instance TensorRT tensorrt , cuda , inference-server-triton , deepstream	2	662	December 7, 2023
Triton and Kubernetes Computer Vision & Image Processing	0	336	December 7, 2022
Triton inference server General Topics and Other SDKs inference-server-triton	0	614	April 25, 2022

How to deploy QuartzNet ASR in triton inference server?

Related topics