How to track and re-identificate human across multicamera scenario using RTSP

petertechnologiesplt · February 27, 2025, 1:37pm

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) : Jetson Orin Nano
• DeepStream Version: 7.1
• JetPack Version (valid for Jetson only): 6.2
• TensorRT Version: 10.3.0.30
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

Hi Everyone,

Do you want to tracking object separately between two cameras? Or you want to tracking object across cameras?
I wanna track object across the cameras. Is it possible using deepstream and is there any examples available that i could use as reference?

Best Regards,
Seb

cihn · February 27, 2025, 1:54pm

Nvidia has examples of multiple cameras tracking targets, I can’t remember the specific URL

petertechnologiesplt · February 27, 2025, 1:58pm

hi @cihn,

Are you referring to the below url?

github.com/NVIDIA-AI-IOT/deepstream_reference_apps

deepstream-tracker-3d/README.md

master

#  Single-View 3D Tracking in DeepStream

## Introduction
This sample application demonstrates the single-view 3D tracking with DeepStream SDK. Given the [camera matrix and human model](configs/camInfo.yml) of a static camera, this application estimates and keeps tracking of object states in the 3D physical world. It can recover the complete bounding box, foot location and body convex hulls precisely from partial occlusions. For algorithm and setup details, please refer to [DeepStream Single View 3D Tracking Documentation](https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_plugin_gst-nvtracker.html#single-view-3d-tracking-alpha).

## Prerequisites
This sample application can be run on both x86 and Jetson platforms inside DeepStream container. Check [here](https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_docker_containers.html#prerequisites) for DeepStream container setup.
1. Download the latest DeepStream container image from NGC (e.g., DS 7.1 in the example below)
    ```bash
    export DS_IMG_NAME="nvcr.io/nvidia/deepstream:7.1-triton-multiarch"
    docker pull $DS_IMG_NAME
    ```

2. Git clone the current `deepstream_reference_apps` repository to the host machine, and enter single-view 3D tracking directory inside the repository.
    ```bash
    git clone https://github.com/NVIDIA-AI-IOT/deepstream_reference_apps.git
    cd deepstream_reference_apps/deepstream-tracker-3d
    ```

3. Download NVIDIA pretrained `PeopleNet` for detection from [NGC](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tao/models/peoplenet/files?version=deployable_quantized_onnx_v2.6.3(e.g., PeopleNet v2.6.3 in the example below).

This file has been truncated. show original

Best regards

cihn · February 27, 2025, 2:23pm

Not this one, I’m talking about the example of “multiple cameras tracking the same target”. I’ll see if I can find the relevant URL tomorrow.

petertechnologiesplt · February 27, 2025, 2:48pm

Hi @cihn,

Much appreciated. Thanks

Best regards
Seb

junshengy · February 28, 2025, 2:43am

@petertechnologiesplt

Are you looking for something related to Multi-Camera Tracking? I guess MTMC(Multi-Target Multi-Camera ) is what you need.

https://docs.nvidia.com/mms/text/MDX_Multi_Camera_Tracking_App.html#overview

petertechnologiesplt · February 28, 2025, 5:44am

Hi @junshengy,

Thanks you so much for your reply and sharing. I am looking for a Jetson Nano based examples.
The MDX_Multi_camera Tracking_App requires :-

Hardware Recommendations

RAM: 120GB

CPU: 18 cores

GPU: A100, L40, L4, A6000, H100 etc.

Storage: 512GB (SSD)

Which i don’t have. Please advice.

Best Regards
Seb

junshengy · February 28, 2025, 6:15am

You can ask questions about MTMC on jetson under this topic. I don’t know much about it.
Currently only GPU is supported, probably for accuracy reasons

Topic		Replies	Views
How to track and re-identificate people in multicamera scenario using RTSP DeepStream SDK deepstream	6	58	September 24, 2024
RE-identification in multiple camera system Metropolis Microservices for Jetson	13	749	May 7, 2024
MTMC microservice for Jetson Metropolis Microservices for Jetson	12	638	February 19, 2025
Object Tracking using Deepstream Python SDK DeepStream SDK	8	2801	October 12, 2021
Implementing Real-Time, Multi-Camera Pipelines with NVIDIA Jetson Technical Blog	7	1499	July 9, 2024
Multicamera detection issues in deepstream 7.0 with jetson DeepStream SDK deepstream	3	47	February 11, 2025
Deepstream overview for newbies DeepStream SDK	10	676	October 2, 2021
Object detection on multipole streams Jetson Xavier NX	15	816	September 20, 2023
How to run mitigating-occlusions-in-visual-perception-using-single-view-3d-tracking? DeepStream SDK jetson , deepstream	13	25	September 12, 2024
Deep Stream - Dual Model Support DeepStream SDK	6	465	October 12, 2021

How to track and re-identificate human across multicamera scenario using RTSP

Hardware Recommendations

Related topics