Simplifying AI Inference in Production with NVIDIA Triton

Technical Blogs & Events Technical Blog
1

Originally published at: https://developer.nvidia.com/blog/simplifying-ai-inference-in-production-with-triton/

AI machine learning is unlocking breakthrough applications in fields such as online product recommendations, image classification, chatbots, forecasting, and manufacturing quality inspection. There are two parts to AI: training and inference. Inference is the production phase of AI. The trained model and associated code are deployed in the data center or public cloud, or at…

2

Is it possible to use Triton server for real-time object detection and recognition from video?
Or TensorRT or something else is more suitable?

3

have you looked at NVIDIA DeepStream SDK? Triton & TensorRT are integrated in it and DeepStream has a variety of features for real time object detection from video streams.

1 Like
4

Thank you @shankarc !
I missed a notification in my inbox. Yeah, we are converting everything to deepstream now.