Can ı fine-tune an LLM model that has 7B parameters by using Jetson Orin Nano Super?

Autonomous Machines Jetson & Embedded Systems Jetson Orin Nano
1

Can ı fine-tune an LLM model that has 7B parameters by using Jetson Orin Nano Super?

3

Hi,

For inference, we recommend using the model with weights less than 4B on an 8GB Jetson device.
But for training, as it needs more resources, it’s more recommended to do it on a desktop GPU.

Thanks.