Llama-3.1-70b-instruct

AI & Data Science NVIDIA NIM Models
,
1

For Llama 3.1 how do I convert the model_weights to a .nemo format.
I see utlities such as megatron_lm_ckpt_to_nemo however I have tried using them and I have been unsuccessful since these utilities require a checkpoint file.

2

Hi @msethi2 – .nemo files are basically just tar files that contain the model_weights folder and the model_config.yaml file. So if you download the nemo weights (i.e. from here Llama 3.1 70B | NVIDIA NGC) then you can just point to the downloaded directory as if it were a single .nemo file and get the same result.

3

Thank you for clarifying.