Online update deepstream plugin

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Please provide complete information as applicable to your setup.

**• Hardware Platform (Jetson / GPU) Xavier
**• DeepStream Version: 3.0
**• JetPack Version (valid for Jetson only) 4.1.1
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
**• Issue Type( questions, new requirements, bugs) questions

Hi

  1. Does the plugins of deepstream can be replaced online? (e.g. yolov3 model to openpose model)
  2. Or, the plugins must be replaced offline, and re-compiling system again?
  3. When Xavier required to change its model and related plugins, could it get new model and related plugin from triton server run on another server?
3

please refer to https://docs.nvidia.com/metropolis/deepstream/dev-guide/index.html#page/DeepStream_Development_Guide/deepstream_Onthefly_model_update.html#

Assumptions

1.New model must have same network parameter configuration as of previous model (e.g. network resolution, network architecture, number of classes)

2.Engine file or cache file of new model to be provided by developer

3.Other primary gie configuration parameters like group-threshold, bbox color, gpu-id, nvbuf-memory-type etc. updated parameters if provided in the override file, will not have any effect after model switch.