Can't display bounding boxes overlay

[theAILlabArchitect]

Hi,
I am using the latest version of JPS, which is 2.0.1, on the Orin AGX devkit with 64 GB and L4T 36.4. I am customizing JPS (AINVR) for License Plate Recognition (LPR), including vehicle detection, license plate detection (LPD), and Optical Character Recognition (OCR).

As a first step, I am running the YOLOv8 example without making any modifications to the DeepStream Docker. While I can see detections within the Region of Interest (ROI) or tripwire counts, I am unable to see the bounding box overlay. I have confirmed that different classes are detected using the Redis Message Broker.

I tried searching for solutions online and found a reply suggesting I use the ‘-t’ option. However, this did not resolve the issue, as nothing appeared. Can you help me figure out why the bounding box overlay isn’t showing?

Thanks,

[kesong]

Can you share how you view the video? On VST webUI or the output RTSP of DeepStream?

[theAILlabArchitect]

Hey Kevin thanks for replying, I’ll add several debug things that might be helpful to investigate:

1. as you asked here is the vst output with overlays:
   

2. the modified vst_config, its under “/opt/nvidia/jetson/services/vst/config”
   vst_config.txt (7.3 KB)

3. “Detection events from DeepStream are outputted by the MessageBroker to the Redis test stream. The latest event can be viewed using the following command:”
   sudo docker exec -it redis redis-cli/xinfo STREAM test`:

20. 1. “1739866830848-0”
    2. 1. “message”
       2. “{\n "version" : "4.0",\n "id" : "18446",\n "@timestamp" : "2025-02-18T08:20:30.802Z",\n "sensorId" : "vid",\n "objects" : [\n "3001|77.6279|459.375|207.753|770.627|person|#|||||||0",\n "3004|0|601.514|150.031|807.055|person|#|||||||0",\n "2998|401.23|472.862|437.251|577.155|person|#|||||||0",\n "3029|489.171|481.46|533.799|611.728|person|#|||||||0",\n "3018|445.052|480.415|469.041|545.75|person|#|||||||0",\n "3055|1334.73|497.992|1634.03|614.86|car|#|||||||0",\n "3032|694.261|483.113|914.806|641.855|car|#|||||||0",\n "3053|842.186|493.497|952.928|577.449|car|#|||||||0",\n "3049|617.029|489.761|705.868|558.676|car|#|||||||0",\n "3054|571.307|469.911|610.627|505.14|car|#|||||||0"\n ]\n}”
          deepstream_outputs.txt (406.4 KB)

4. updated the deepstream command under (compose_agx_yolov8s.yaml):
   command: sh -c ‘deepstream-test5-app -t -c /ds-config-files/yolov8s/yolov8s-ds-config_agx.txt 2>&1 | grep --line-buffered . | tee -a /log/deepstream.log’

In the previous version, the DeepStream output was accessible via localhost:8554 or 8555, and we could feed it to VST by adding ‘overlay’ to the name. However, these details seems to be removed from the documentation. Can you let me know how to access the DeepStream output now?

let me know if you need other outputs from my side,
Thanks!

[kesong]

I can see the bbox on the object with default JPS 2.0.1 release by: rtsp://localhost:8555/ds-test

“-t” enables display the label on the video.

You can check below config in: ai_nvr/config/deepstream/yolov8s/yolov8s-ds-config_agx.txt

[sink3]
enable=1
#Type - 1=FakeSink 2=EglSink 3=File 4=RTSPStreaming 5=Overlay
type=4
#1=h264 2=h265
codec=1
#encoder type 0=Hardware 1=Software
enc-type=0
sync=0
bitrate=4000000
#H264 Profile - 0=Baseline 2=Main 4=High
#H265 Profile - 0=Main 1=Main10
profile=0
# set below properties in case of RTSPStreaming
rtsp-port=8555
udp-port=5401

[theAILlabArchitect]

Thanks, this works, and I can see the stream with the detection bounding boxes overlayed on an additional stream. However, this is more of a workaround and doesn’t utilize the existing features, like displaying ROI or the tripwire (see the screenshot below). I tried changing the sink type to “overlay” and “EglSink,” but that didn’t work. Can you help me enable the overlay feature on the original stream instead of seeing the stream with an additional RTSP feed?

[kesong]

VST can’t support display Bbox in JPS 2.0.1.