Can't get LLM Text Gen to work ...github.com/oobabooga -- missing cuda pytorch? perhaps

Robotics & Edge Computing Jetson & Embedded Systems Jetson Nano
5

Hi,

For Orin Nano 8GB, please try the below memory optimization first:

After that, you can try to build the text-generaton-webui container for JetPack 6.2.

Thanks.