Edge Devices

Can we fully deploy llm models on edge devices without loosing precision and performance?

Hi,

To deploy the LLM model, we recommend the Orin series (AGX Orin/Orin NX/Orin Nano) and Thor.

Thanks.