We can only support the alert event though the summarize API currently.
python3 via_client_cli.py summarize --id de0e04bc-b007-4967-9cad-28f48a02c126 --model vila-1.5 \
--chunk-duration 10 --summary-duration 60 \
--prompt "You are a warehouse monitoring system. Describe the events in this warehouse and look for any anomalies. Start and end each sentence with a time stamp." \
--caption-summarization-prompt "Summarize similar captions that are sequential to one another, while maintaining the details of each caption, in the format start_time:end_time:caption. The output should be bullet points in the format start_time:end_time: detailed_event_description." \
--summary-aggregation-prompt "Aggregate captions in the format start_time:end_time:caption based on whether captions are related to one another or create a continuous scene. The output should only be bullet points in the format start_time:end_time: detailed_event_description. " \
--alert "safety-issues:workers not wearing safety equipment" \
--enable-chat --stream
I tested with the command above, but I got an error.
Here is the command:
python via_client_cli.py summarize --id c16e5a96-0e2c-4927-b42e-43838109b38e --model nvila --chunk-duration 10 --summary-duration 60 --prompt "Identify the behavior of vehicles changing from one lane to another in the traffic video, driving over white or yellow solid lines during the process. Focus on the lane-changing process, including the periods before, during, and after the lane change. Please provide the vehicle's characteristic information (including the vehicle's color, license plate number, and other features) and the time when the event occurred." --alert "A vehicle changes from one lane to another, driving over a white or yellow solid line during the process" --enable-chat --stream
Here is the error:
Failed to parse alert 'A vehicle changes from one lane to another, driving over a white or yellow solid line during the process'
Currently, we only support the method of adding alert events through the python_client.
We will release some alert-related APIs in the next version. Please stay tuned for our updates. Thanks.