Can jetson nano run LLM?

Can jetson nano run LLM? Such as llama, or quantized llama. Has anyone tried it?
thanks!

Hi,

You can give it a try.
But Nano has quite limited resources, it may not be able to deploy a complicated model.
Thanks.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.