# How to run in run time source addition and deletion with deepstream app?

**URL:** <https://forums.developer.nvidia.com/t/how-to-run-in-run-time-source-addition-and-deletion-with-deepstream-app/107931>\
**Category:** DeepStream SDK\
**Created:** [November 24, 2019, 9:55am UTC](https://forums.developer.nvidia.com/t/how-to-run-in-run-time-source-addition-and-deletion-with-deepstream-app/107931 "2019-11-24T09:55:57Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![faravikhantanmoy](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@faravikhantanmoy](https://forums.developer.nvidia.com/u/faravikhantanmoy)\
**Post date:** [November 24, 2019, 9:55am UTC](https://forums.developer.nvidia.com/t/how-to-run-in-run-time-source-addition-and-deletion-with-deepstream-app/107931/1 "2019-11-24T09:55:57Z")

</div>

Hi,  
I’ve download this file: [https://github.com/NVIDIA-AI-IOT/deepstream\_reference\_apps/tree/master/runtime\_source\_add\_delete](https://github.com/NVIDIA-AI-IOT/deepstream_reference_apps/tree/master/runtime_source_add_delete), and how to use it?  
In read me file, I’ve got some information. Which is I’ve done. For example:  
I’ve edit **dstest\_pgie\_config.txt**  **dstest\_sgie1\_config.txt**  **dstest\_sgie2\_config.txt**  **dstest\_sgie3\_config.txt** with replace in model-file, proto-file, model-engine-file, labelfile-path, int8-calib-file and mean file from my deepstream\_SDK\_4.0.1 sample folder → model folder and so on. In make file I just paste in **export DS\_SDK\_ROOT=“my deepstream download folder path, where I’ve run deepstream”,** then **make** the runtime\_source\_add\_delete/ path.

and, when I’ve run the error is:

```auto
Using winsys: x11 
Creating LL OSD context new
0:00:03.246931180 15245 0x558b469790 ERROR nvinfer gstnvinfer.cpp:511:gst_nvinfer_logger:<secondary-nvinference-engine3> NvDsInferContext[UID 4]:log(): The engine plan file is generated on an incompatible device, expecting compute 5.3 got compute 7.2, please rebuild.
0:00:03.247023943 15245 0x558b469790 WARN nvinfer gstnvinfer.cpp:515:gst_nvinfer_logger:<secondary-nvinference-engine3> NvDsInferContext[UID 4]:useEngineFile(): Failed to create engine from file
0:00:03.247052902 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<secondary-nvinference-engine3> NvDsInferContext[UID 4]:initialize(): Trying to create engine from model files
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
0:03:03.471224249 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<secondary-nvinference-engine3> NvDsInferContext[UID 4]:generateTRTModel(): Storing the serialized cuda engine to file at /home/imran/Music/deepstream_sdk_v4.0.1_jetson/samples/models/Secondary_VehicleTypes/resnet18.caffemodel_b8_fp16.engine
0:03:04.600602793 15245 0x558b469790 ERROR nvinfer gstnvinfer.cpp:511:gst_nvinfer_logger:<secondary-nvinference-engine1> NvDsInferContext[UID 2]:log(): The engine plan file is generated on an incompatible device, expecting compute 5.3 got compute 7.2, please rebuild.
0:03:04.600664045 15245 0x558b469790 WARN nvinfer gstnvinfer.cpp:515:gst_nvinfer_logger:<secondary-nvinference-engine1> NvDsInferContext[UID 2]:useEngineFile(): Failed to create engine from file
0:03:04.600690868 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<secondary-nvinference-engine1> NvDsInferContext[UID 2]:initialize(): Trying to create engine from model files
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
0:05:58.455754877 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<secondary-nvinference-engine1> NvDsInferContext[UID 2]:generateTRTModel(): Storing the serialized cuda engine to file at /home/imran/Music/deepstream_sdk_v4.0.1_jetson/samples/models/Secondary_CarColor/resnet18.caffemodel_b8_fp16.engine
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-4.0/lib/libnvds_mot_klt.so
gstnvtracker: Optional NvMOT_RemoveStreams not implemented
gstnvtracker: Batch processing is OFF
0:05:59.398136687 15245 0x558b469790 WARN nvinfer gstnvinfer.cpp:515:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]:checkEngineParams(): Requested Max Batch Size is less than engine batch size
0:05:59.399024426 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]:initialize(): Trying to create engine from model files
0:07:56.746493709 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]:generateTRTModel(): Storing the serialized cuda engine to file at /home/imran/Music/deepstream_sdk_v4.0.1_jetson/samples/models/Primary_Detector/resnet10.caffemodel_b8_fp16.engine
Now playing: /home/imran/Music/deepstream_sdk_v4.0.1_jetson/samples/configs/deepstream-app/source8_1080p_dec_infer-resnet_tracker_tiled_display_fp16_nano_one.txt
Creating LL OSD context new
0:07:57.150407549 15245 0x558b469790 ERROR nvinfer gstnvinfer.cpp:511:gst_nvinfer_logger:<secondary-nvinference-engine3> NvDsInferContext[UID 4]:log(): The engine plan file is generated on an incompatible device, expecting compute 5.3 got compute 7.2, please rebuild.
0:07:57.150469478 15245 0x558b469790 WARN nvinfer gstnvinfer.cpp:515:gst_nvinfer_logger:<secondary-nvinference-engine3> NvDsInferContext[UID 4]:useEngineFile(): Failed to create engine from file
0:07:57.150500000 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<secondary-nvinference-engine3> NvDsInferContext[UID 4]:initialize(): Trying to create engine from model files
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
0:10:39.067284394 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<secondary-nvinference-engine3> NvDsInferContext[UID 4]:generateTRTModel(): Storing the serialized cuda engine to file at /home/imran/Music/deepstream_sdk_v4.0.1_jetson/samples/models/Secondary_VehicleTypes/resnet18.caffemodel_b8_fp16.engine
0:10:40.383069952 15245 0x558b469790 ERROR nvinfer gstnvinfer.cpp:511:gst_nvinfer_logger:<secondary-nvinference-engine1> NvDsInferContext[UID 2]:log(): The engine plan file is generated on an incompatible device, expecting compute 5.3 got compute 7.2, please rebuild.
0:10:40.383129485 15245 0x558b469790 WARN nvinfer gstnvinfer.cpp:515:gst_nvinfer_logger:<secondary-nvinference-engine1> NvDsInferContext[UID 2]:useEngineFile(): Failed to create engine from file
0:10:40.383158236 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<secondary-nvinference-engine1> NvDsInferContext[UID 2]:initialize(): Trying to create engine from model files
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
0:13:34.892677974 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<secondary-nvinference-engine1> NvDsInferContext[UID 2]:generateTRTModel(): Storing the serialized cuda engine to file at /home/imran/Music/deepstream_sdk_v4.0.1_jetson/samples/models/Secondary_CarColor/resnet18.caffemodel_b8_fp16.engine
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-4.0/lib/libnvds_mot_klt.so
gstnvtracker: Optional NvMOT_RemoveStreams not implemented
gstnvtracker: Batch processing is OFF
0:13:35.850531309 15245 0x558b469790 WARN nvinfer gstnvinfer.cpp:515:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]:checkEngineParams(): Requested Max Batch Size is less than engine batch size
0:13:35.851395761 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]:initialize(): Trying to create engine from model files
0:15:31.785105642 15245 0x558b469790 INFO nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]:generateTRTModel(): Storing the serialized cuda engine to file at /home/imran/Music/deepstream_sdk_v4.0.1_jetson/samples/models/Primary_Detector/resnet10.caffemodel_b8_fp16.engine
Failed to set pipeline to playing. Exiting.

```

And now, what should I do? Please help me.

By the way in Deepstream\_SDK\_4.0.1 folder → sample folder → models folder → (Secondary\_VehicleTypes and Secondary\_CarColor) folder have not **.engine** file. .enginfe file for this two folder I’ve copy-paste from old version deepstream\_SDK\_4.0

Thank you.

---

<div class="post-metadata">

**Author:** ![faravikhantanmoy](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@faravikhantanmoy](https://forums.developer.nvidia.com/u/faravikhantanmoy)\
**Post date:** [November 24, 2019, 7:31pm UTC](https://forums.developer.nvidia.com/t/how-to-run-in-run-time-source-addition-and-deletion-with-deepstream-app/107931/2 "2019-11-24T19:31:21Z")

</div>

I’ve solved the upper problem. when I’m run **$ ./deepstream-test-rt-src-add-del** then, the error is, in my terminal:

```auto
Using winsys: x11 
Creating LL OSD context new
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-4.0/lib/libnvds_nvdcf.so
gstnvtracker: Optional NvMOT_RemoveStreams not implemented
gstnvtracker: Batch processing is ON
[NvDCF] Initialized
Now playing: /home/imran/Music/deepstream_sdk_v4.0.1_jetson/samples/configs/deepstream-app/source8_1080p_dec_infer-resnet_tracker_tiled_display_fp16_nano_one.txt
Creating LL OSD context new
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-4.0/lib/libnvds_nvdcf.so
gstnvtracker: Optional NvMOT_RemoveStreams not implemented
gstnvtracker: Batch processing is ON

```

---

<div class="post-metadata">

**Author:** ![bcao](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/bcao/32/14043_2.png) [@bcao](https://forums.developer.nvidia.com/u/bcao)\
**Post date:** [November 25, 2019, 7:40am UTC](https://forums.developer.nvidia.com/t/how-to-run-in-run-time-source-addition-and-deletion-with-deepstream-app/107931/3 "2019-11-25T07:40:52Z")

</div>

Currently NvMOT\_RemoveStreams is not implemented.  
refer this  
[https://docs.nvidia.com/metropolis/deepstream/dev-guide/DeepStream\_Development\_Guide/baggage/group\_\_ee\_\_NvMOTracker.html#ga83a4b20b5c03f96780651ea5b6ea9386](https://docs.nvidia.com/metropolis/deepstream/dev-guide/DeepStream_Development_Guide/baggage/group __ee__ NvMOTracker.html#ga83a4b20b5c03f96780651ea5b6ea9386)

---

<div class="post-metadata">

**Author:** ![faravikhantanmoy](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@faravikhantanmoy](https://forums.developer.nvidia.com/u/faravikhantanmoy)\
**Post date:** [November 25, 2019, 3:43pm UTC](https://forums.developer.nvidia.com/t/how-to-run-in-run-time-source-addition-and-deletion-with-deepstream-app/107931/4 "2019-11-25T15:43:54Z")

</div>

Thanks bcao for replay.

I read the article which is you are given me. So what should I do for run time source addition and deletion in the deepstream app? should I add the given below in run\_time\_source\_add\_del.c file?

```auto
void NvMOT_RemoveStreams	(	NvMOTContextHandle contextHandle,
NvMOTStreamId streamIdMask 
)

```

---

<div class="post-metadata">

**Author:** ![CJR](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/cjr/32/14047_2.png) [@CJR](https://forums.developer.nvidia.com/u/CJR)\
**Post date:** [November 26, 2019, 8:16am UTC](https://forums.developer.nvidia.com/t/how-to-run-in-run-time-source-addition-and-deletion-with-deepstream-app/107931/5 "2019-11-26T08:16:09Z")

</div>

You don’t need to implement it. It’s optional.

[https://devtalk.nvidia.com/default/topic/1062677/deepstream-sdk/whats-means-in-nvtracker-/post/5384130/#5384130](https://devtalk.nvidia.com/default/topic/1062677/deepstream-sdk/whats-means-in-nvtracker-/post/5384130/#5384130)

---

<div class="post-metadata">

**Author:** ![TomNVIDIA](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/tomnvidia/32/14181_2.png) [@TomNVIDIA](https://forums.developer.nvidia.com/u/TomNVIDIA)\
**Post date:** [October 12, 2021, 4:18pm UTC](https://forums.developer.nvidia.com/t/how-to-run-in-run-time-source-addition-and-deletion-with-deepstream-app/107931/6 "2021-10-12T16:18:51Z")

</div>