Running Video Search and Summarization Blueprint on Jetson Devices

I would like to run the Video Search and Summarization (VSS) project remotely on my Jetson AGX Orin device (64GB). While reviewing the code, I came across a docker-compose file under the remote_vlm_deployment directory, which pulls the VSS Engine from the NGC catalog. However, it appears that the VSS Engine is built for the amd64 architecture.

I would like to know if there is a Dockerfile available that would allow me to build a Jetson-compatible (aarch64) version of the VSS Engine. I would greatly appreciate your assistance with this.

Currently, we cannot support deploying VSS on the Jetson platform. We will consider this feature in future versions. Thanks

2 Likes

Hello,

Is there any way to run VSS on all Jetson platforms?

Thank you.

We will provide support in the upcoming version. Please stay tuned for our updates. Thanks

Is there any Update regarding running VSS on Jetson Devices , Can we see the NanoLLM package as a jetson version of VSS ?

We will consider supporting VSS on the Jetson in future versions. At the beginning, the support will be carried out on Thor first.