We are excited to bring support for the parallel multiple models in DeepStream. We have published the parallel multiple models sample application on GitHub ( GitHub - NVIDIA-AI-IOT/deepstream_parallel_inference_app: A project demonstrating how to use nvmetamux to run multiple models in parallel. ). On…

Parallel Inference example in DeepStream

Topic		Replies	Views
Single source and multi inference models in parallel DeepStream SDK	13	1421	October 12, 2021
Parallel Inference with different streamux for each pgie DeepStream SDK python , deepstream61	6	1230	December 2, 2022
Running separate models for each stream in parallel in DeepStream DeepStream SDK	5	879	October 12, 2021
Deepstream Parallel Inference for Deepstream 6.4 DeepStream SDK ubuntu , jetson-inference , gstreamer , deepstream	4	89	March 10, 2025
Deepstream parallel app inference DeepStream SDK	3	490	May 6, 2023
Parallel Execution of Multiple Detection Models in DeepStream for Pose and YOLO Detection DeepStream SDK	5	335	February 9, 2024
How to do Parallel inferencing with deepstream python Isaac Sim	0	308	February 3, 2023
Deepstream-parallel-inference support for deepstream-6.2/deepstream-6.3 DeepStream SDK	14	707	October 12, 2023
Deepstream-app sample app use multiple PGIEs DeepStream SDK deepstream	6	443	April 1, 2024
DeepStream Parallel Inferencing pipeline DeepStream SDK jetson-inference	4	527	August 25, 2023