VILA-1.5-13b-AWQ inference issue on Jetson AGX Orin via tinychat

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
1

I’m trying to run vila1.5-13B-AWQ on jetson agx orin and have used the following link as a setup guide to setup the environment:

When i try to infer the attached error pops up, what could be the reason?

image
image1840×804 188 KB

4

Hi,

There is one example in our legacy tutorial below:

You can also try our new tutorial below for VLM:

Thanks.