Deepstream-test2 returns partial frames list of track

Hardware Platform : GPU
DeepStream Version 6.3

TensorRT Version 8.6.1.6
NVIDIA GPU Driver Version 535.146.02

When running deepstream-test2 (python) with the default config file and no modifications, I noticed that I am only getting partial results. Specifically, the frames list of each track contains only the first three frames.
Can you provide insights or suggestions on why this might be happening?

How did you run it? Can you provide the command line and detailed error log?

Also which GPU are you using and whether you have a monitor ?

Hello,

My GPU: NVIDIA GeForce RTX 3070

I ran:
python3 deepstream_test_2.py <my_clip>

Upon observation, I notice that there is no error, and everything appears to be functioning correctly.
However, when I observe four pedestrians walking for approximately one minute, I observe that only the first three bounding boxes of each track are present in the output.

I would appreciate your guidance on how to obtain the complete set of bounding boxes for each tracked pedestrian.
If there are any settings or configurations that need adjustment, please provide instructions on how to address this issue.

Thank you for your prompt attention to this matter.

Best regards,
Amir

The output:
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 2
*0 INPUT kFLOAT input_1 3x224x224 *
*1 OUTPUT kFLOAT predictions/Softmax 6x1x1 *

INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 2
*0 INPUT kFLOAT input_1 3x224x224 *
*1 OUTPUT kFLOAT predictions/Softmax 20x1x1 *

INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 2
*0 INPUT kFLOAT input_1 3x224x224 *
*1 OUTPUT kFLOAT predictions/Softmax 12x1x1 *

gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
[NvMultiObjectTracker] Initialized
*Creating Pipeline *

*Creating Source *

*Creating H264Parser *

*Creating Decoder *

*Creating EGLSink *

*Playing file /mnt/video-db/Test_Videos/NotConstantFPS/Short/ABIA-Escalator1_S1.avi *
*Adding elements to Pipeline *

*Linking elements in the Pipeline *

*Starting pipeline *

Frame Number=0 Number of Objects=0 Vehicle_count=0 Person_count=0
streamId= 0
surfaceStreamID= 0
Frame Number=1 Number of Objects=0 Vehicle_count=0 Person_count=0
streamId= 0
surfaceStreamID= 0
Frame Number=2 Number of Objects=0 Vehicle_count=0 Person_count=0
streamId= 0
surfaceStreamID= 0
Frame Number=3 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
numobj= 3
uniqueId= 0
classId= 2
objLabel= Person
frameNum: 0
tBbox.left: 1653.0693359375
tBbox.width: 120.945556640625
tBbox.top: 472.7581787109375
tBbox.right: 286.55621337890625
confidence: 1.0
age: 1
frameNum: 1
tBbox.left: 1654.6241455078125
tBbox.width: 120.38873291015625
tBbox.top: 466.0554504394531
tBbox.right: 290.51348876953125
confidence: 0.903741180896759
age: 2
frameNum: 2
tBbox.left: 1658.116943359375
tBbox.width: 121.8167724609375
tBbox.top: 460.907958984375
tBbox.right: 284.2696228027344
confidence: 0.7915024161338806
age: 3
numobj= 3
uniqueId= 1
classId= 2
objLabel= Person
frameNum: 0
tBbox.left: 1240.6007080078125
tBbox.width: 143.51998901367188
tBbox.top: 607.5460205078125
tBbox.right: 308.93621826171875
confidence: 1.0
age: 1
frameNum: 1
tBbox.left: 1247.601318359375
tBbox.width: 135.25204467773438
tBbox.top: 632.09423828125
tBbox.right: 280.7585754394531
confidence: 0.9064123034477234
age: 2
frameNum: 2
tBbox.left: 1250.189453125
tBbox.width: 133.256103515625
tBbox.top: 631.6926879882812
tBbox.right: 280.4739074707031
confidence: 0.7988146543502808
age: 3
numobj= 3
uniqueId= 2
classId= 2
objLabel= Person
frameNum: 0
tBbox.left: 1584.93310546875
tBbox.width: 50.120361328125
tBbox.top: 94.63676452636719
tBbox.right: 113.76005554199219
confidence: 1.0
age: 1
frameNum: 1
tBbox.left: 1585.00439453125
tBbox.width: 49.99090576171875
tBbox.top: 94.74036407470703
tBbox.right: 113.58354949951172
confidence: 0.946975588798523
age: 2
frameNum: 2
tBbox.left: 1590.3056640625
tBbox.width: 46.89532470703125
tBbox.top: 94.89263916015625
tBbox.right: 110.53397369384766
confidence: 0.9286273717880249
age: 3
numobj= 3
uniqueId= 3
classId= 2
objLabel= Person
frameNum: 0
tBbox.left: 1524.3753662109375
tBbox.width: 44.5693359375
tBbox.top: 95.95864868164062
tBbox.right: 107.1131820678711
confidence: 1.0
age: 1
frameNum: 1
tBbox.left: 1524.490234375
tBbox.width: 44.646697998046875
tBbox.top: 95.87523651123047
tBbox.right: 107.1480712890625
confidence: 0.9225800633430481
age: 2
frameNum: 2
tBbox.left: 1524.4886474609375
tBbox.width: 44.370758056640625
tBbox.top: 96.14335632324219
tBbox.right: 106.9726333618164
confidence: 0.8891088366508484
age: 3
Frame Number=4 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=5 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=6 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=7 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=8 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=9 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=10 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=11 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=12 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=13 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=14 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=15 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=16 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=17 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=18 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=19 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=20 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=21 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=22 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=23 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=24 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=25 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=26 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=27 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=28 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=29 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=30 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=31 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=32 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=33 Number of Objects=4 Vehicle_count=0 Person_count=4

Best regards,
Amir

Is this your test stream? Can you share it? I’m not sure if you need to change the configuration file.

By the way, we use sample_720p.h264 as the test stream, only 48s

nv.zip (33.8 MB)

Hi,

Attched zip with the clip

Best regards,
Amir

Can you share your code where you get the information of objects?

We will look into this issue and will be back once there is any progress.

I ran deepstream_test_2.py with the default config file and no modifications.
The output is printed to the screen automatically like the output attached above.

Best regards,
Amir

Do you mean that at about 1 minute, the two people on the right are missing bboxes?
Here are my results, not really sure what your problem is

I’m experiencing an issue with the printed output where only the first three frames of each object are being displayed, despite the fact that in the movie, each bbox appears in many more than 3 frames.
The output:

Frame Number=0 Number of Objects=0 Vehicle_count=0 Person_count=0
streamId= 0
surfaceStreamID= 0
Frame Number=1 Number of Objects=0 Vehicle_count=0 Person_count=0
streamId= 0
surfaceStreamID= 0
Frame Number=2 Number of Objects=0 Vehicle_count=0 Person_count=0
streamId= 0
surfaceStreamID= 0
Frame Number=3 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
numobj= 3
uniqueId= 0
classId= 2
objLabel= Person
frameNum: 0
tBbox.left: 1653.0693359375
tBbox.width: 120.945556640625
tBbox.top: 472.7581787109375
tBbox.right: 286.55621337890625
confidence: 1.0
age: 1
frameNum: 1
tBbox.left: 1654.6241455078125
tBbox.width: 120.38873291015625
tBbox.top: 466.0554504394531
tBbox.right: 290.51348876953125
confidence: 0.903741180896759
age: 2
frameNum: 2
tBbox.left: 1658.116943359375
tBbox.width: 121.8167724609375
tBbox.top: 460.907958984375
tBbox.right: 284.2696228027344
confidence: 0.7915024161338806
age: 3
numobj= 3
uniqueId= 1
classId= 2
objLabel= Person
frameNum: 0
tBbox.left: 1240.6007080078125
tBbox.width: 143.51998901367188
tBbox.top: 607.5460205078125
tBbox.right: 308.93621826171875
confidence: 1.0
age: 1
frameNum: 1
tBbox.left: 1247.601318359375
tBbox.width: 135.25204467773438
tBbox.top: 632.09423828125
tBbox.right: 280.7585754394531
confidence: 0.9064123034477234
age: 2
frameNum: 2
tBbox.left: 1250.189453125
tBbox.width: 133.256103515625
tBbox.top: 631.6926879882812
tBbox.right: 280.4739074707031
confidence: 0.7988146543502808
age: 3
numobj= 3
uniqueId= 2
classId= 2
objLabel= Person
frameNum: 0
tBbox.left: 1584.93310546875
tBbox.width: 50.120361328125
tBbox.top: 94.63676452636719
tBbox.right: 113.76005554199219
confidence: 1.0
age: 1
frameNum: 1
tBbox.left: 1585.00439453125
tBbox.width: 49.99090576171875
tBbox.top: 94.74036407470703
tBbox.right: 113.58354949951172
confidence: 0.946975588798523
age: 2
frameNum: 2
tBbox.left: 1590.3056640625
tBbox.width: 46.89532470703125
tBbox.top: 94.89263916015625
tBbox.right: 110.53397369384766
confidence: 0.9286273717880249
age: 3
numobj= 3
uniqueId= 3
classId= 2
objLabel= Person
frameNum: 0
tBbox.left: 1524.3753662109375
tBbox.width: 44.5693359375
tBbox.top: 95.95864868164062
tBbox.right: 107.1131820678711
confidence: 1.0
age: 1
frameNum: 1
tBbox.left: 1524.490234375
tBbox.width: 44.646697998046875
tBbox.top: 95.87523651123047
tBbox.right: 107.1480712890625
confidence: 0.9225800633430481
age: 2
frameNum: 2
tBbox.left: 1524.4886474609375
tBbox.width: 44.370758056640625
tBbox.top: 96.14335632324219
tBbox.right: 106.9726333618164
confidence: 0.8891088366508484
age: 3
Frame Number=4 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=5 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=6 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=7 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=8 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=9 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=10 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=11 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=12 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=13 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=14 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=15 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=16 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=17 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=18 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=19 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=20 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=21 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=22 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=23 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0
surfaceStreamID= 0
Frame Number=24 Number of Objects=4 Vehicle_count=0 Person_count=4
streamId= 0

Best regards,
Amir