VSS blueprint 2.2.0 - ERROR Failed to load VIA stream handler - Failed to generate TRT-LLM engine

Accelerated Computing Intelligent Video Analytics Visual AI Agent
, ,
7

There is currently a bug with downloading the VILA 1.5 VLM from NGC. As a workaround, we recommend either:

  1. Use NVILA (documentation for helm chart)
  2. Download the model on the host machine using the latest NGC CLI and then mount in the VSS container / pod

The Launchable has been updated to use NVILA.

1 Like