error.txt (39.5 KB)
I was run this code:
jetson-containers run $(autotag nano_llm)
python3 -m nano_llm.agents.video_query --api=mlc
–model Efficient-Large-Model/VILA1.5-3b
–max-context-len 256
–max-new-tokens 32
–video-input /dev/video0
–video-output webrtc://@:8554/output
–nanodb /data/nanodb/coco/2017
Hi @highpkols, seeing as you are on Orin Nano and it just abruptly quit like that, my guess is that it is running out of memory - if you haven’t already, you might want to try disabling ZRAM, mounting SWAP, and disabling the desktop UI: jetson-containers/docs/setup.md at master · dusty-nv/jetson-containers · GitHub
Also, were you able to run VILA1.5-3b in just the terminal-based nano_llm.chat or nano_llm.vision.example programs?
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.
