Please provide the following information when requesting support.
Hi I’m trying to install Llamaspeak to Jetson Orin Nano developer kit and it crashes everytime on tart computing and quantization part…Anybody knows the solution for this issue. I tried install Ollama it works, but text-generation-webui and Llamaspeak will crash during install. Thanks
I’m using Jetson Orin nano boot drive is 512G micro sd and 1T nvme ram installed, tested docker on it. firmware upgraded to Jetpack 6.2. Original power supply and heat fan from Nividia.
Hardware - Jetson Orin Nano
Hardware - GPU
Operating System
Jetpack6.x
TLT Version (if relevant)
How to reproduce the issue ? (This is for errors. Please share the command and the detailed log here)
Do you monitor the system when running the llamaspeak?
Based on the log, It looks like the CPU and GPU are not in use and the memory usage is also low.