VPI DCF tracker for Orin NX

Autonomous Machines Jetson & Embedded Systems Jetson Orin NX
1

Hi,
I’ve already seen that question, though without a solution…

I’m looking for example code for VPI DCF tracker. This is what I’ve found:
https://docs.nvidia.com/vpi/algo_dcf_tracker.html
https://docs.nvidia.com/vpi/group__VPI__DCFTracker.html
At the second link I see “high-level pseudo-code of the processing flow”, not a sample application.
Where could I find a working application for VPI DCF tracker?
Is it possible to run that code without GStreamer and DeepStream?

My system is the following:
Hardware Platform - Jetson Orin NX or Orin AGX
JetPack Version 6.0
CUDA-12.2
VPI-3
Issue Type: looking for a sample code for VPI DCF tracker on Jetson.

If it’s a problem to run VPI DCF tracker on Jetson, could it be possible to run it on Linux Ubuntu 22.04 (glibc 2.35) on GeForce 2080TI with the latest driver installed? CUDA version is 12.3.

Thanks a lot.

1 Like
2

Hello @fastvideo,

We don’ t know if there is a sample application for VPI CDF, at least nothing easy to find.

That being said, programming an custom application using VPI without GStreamer and Deepstream should be possible.

May we ask a couple of questions to understand a bit better your current situation?

  1. What programming language are you planning to use?
  2. what is your use case?
  3. How are you going to be feeding video into the application?

Please let us know your thoughts.

Also, please do not hesitate to reach out if you require further assistance, we would be glad to help.

regards,
Andrew

3

Thanks for your feedback.
As we see that pseudocode and API, so it looks like it should be a sample application somewhere…

  1. We are writing the software on C++.
  2. We need a real time tracker for camera application. SCRT from OpenCV is good, but slow.
  3. We are working with USB/PCIe/GigE machine vision cameras, so we acquire raw frames from a camera driver and import them to GPU for processing.
    Regards,
    Fyodor
5

Hi,

We don’t have a DCF tracker sample right now.
But will check if we can provide one.

Have you tried the sample in the VPI document?
Suppose it should be compilable and runable after some modification.

DCF supports the PVA and CUDA backend.
PVA is only available on Jetson but CUDA backend should work on desktop GPU.

Thanks.

7

Thanks for your reply.
Unfortunately there is no sample application for DCF tracker in the VPI document. I can see just a pseudo code there.
There is a sample application for KLT tracker, but this is a different algorithm.

8

Hi,

We are checking this internally to see if we can share one.
Will provide more info to you later.

Thanks.

9

Thanks for your reply, I’m waiting for your info.
By the way, we’ve tested temporal denoiser on VPI, it’s working well.
I hope to run DCF on VPI as well.
Thanks for your help.

10

Hi,

Thanks for the update.
Will provide more info to you later.

Thanks.

11

It’s not a problem if you need more time to prepare that info. This is not urgent, but it’s highly desirable.
Thanks for your efforts and for your help.

12

Hi,

Thanks for your reminder.

Our internal team is actively working on the sample.
Will share more info with you if we get any updates.

Thanks.

14

I’m waiting for your feedback. How are you doing?

15

DCF Tracker sample got released with JetPack 6.1 / VPI 3.2.4, you can refer to VPI Documentation. Seems like it also works fine for Jetpack 6.0, you just need to get assets/pedestrians_bboxes.txt from VPI 3.2.4 sources to run the example.

16

Thank you so much! I will try that asap.

17

Thank you very much for releasing your DCF Tracker sample application. I’ve tested it with Jetson Orin (Jetpack 6.1) and on Linux Ubuntu 22.04, and in both cases the results were the same.

  1. If the camera is fixed and the object is moving, then DCF Tracker is doing a good job and tracking is working well.
  2. If the camera is slowly moving and the object is fixed, then DCF Tracker just can’t work.

For comparison I’ve used CSRT tracker from OpenCV and it can track the object in the same situations without any issues for both cases. Could you please check your latest release of DCF Tracker in the situation with slowly moving camera and fixed object?

Actually this is the case with other trackers like KLT: they are able to track objects just in the case with fixed camera.

18

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.