Triton Server Integration with DeepStream

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Hi Nvidia Team,

I have run the Yolov3 model(trained on my Custom Dataset) on Jetson Nano using DeepStream with 4 Cameras. Next, I want to Integrate Triton Server with DeepStream for the same model.
So, my doubts are:
1.) How to do the Integration, what all I need to do extra?
2.) Can I serve the TRT models with the triton Server integrated with DeepStream?

• Hardware Platform (Jetson / GPU) : Jetson Nano
• DeepStream Version : 5.1
• JetPack Version (valid for Jetson only) : 4.5
• TensorRT Version : 7.1.3

Thanks

2

Looking forward to your reply.

4

Please refer to Gst-nvinferserver — DeepStream 6.1.1 Release documentation