VLM Summarization and AINVR Emdx Analytics Error

Hi,

I’m currently testing the VLM Summarization feature of the JPS for live streams but having a problem while making summarization call to the API. It works fine for the video files but getting the following error for the live streams coming from Nvstreamer:

curl -X POST "http://localhost:19000/summarize" \
-H "accept: application/json" \
-H "Content-Type: application/json" \
-d '{"stream": true, "stream_id": "sample_qHD", "model": "vila-1.5", "chunk_duration": 15, "from_timestamp": "2024-01-23T21:33:00.000Z", "to_timestamp": "2024-01-23T21:35:00.000Z"}'

I don’t even understand why summarization functionality tries to make a call to FOV and Histogram endpoints but I also tested AI-NVR’s ROI and Tripwire analytics to isolate the issue. When I connect to the live stream from the VST screen and try to add either one of the analytics, I get the following error on the UI:

By the way, I’m able to add new streams and get the list of streams from the summarization backend via:

curl -X GET "http://localhost:19000/live-stream" -H "accept: application/json"

curl -X POST "http://localhost:19000/live-stream" -H "accept: application/json" -H "Content-Type: application/json" -d '{ "liveStreamUrl": "rtsp://172.17.0.1:31555/nvstream/opt/store/nvstreamer_videos/sample_qHD.mp4", "description": "test"}'

Any idea why would this happen? Thanks in advance!

As a side note, this solution actually fixed the error on the UI side: Set ROI Tripview failed - #3 by kesong.

However, I’m still having the same error on the summarization backend:

The VLM Summarization isn’t ready for streaming video. Can you test it with local file?

1 Like

@kesong thank you for clarifying this. I already have tested the local file version, it works well.