NeMo Framework Installation

Hello all,

I am new to using Docker images. I want to give it a try because it appears simpler/easier to use with the entire Nemo framework in one image. I can simplify the installation process compared to just using pip install

I have downloaded the Nemo docker image for v24.12. My questions I think are simple for anyone with experience working with Docker.

  1. Now that i have the actual image, how do I run it? I know I need to use docker run and some other arguments but I guess this leads into the next question.
  2. MY development IDE will be VS Code with the python extension installed. I am most familiar with this environment. I am assuming that the docker image contains all of the Nemo libraries that I need. How do I reference my imports to these libraries that are in the docker image?

Hello,

  1. There is an example of launching the docker container in this tutorial: NeMo/tutorials/llm/llama-3/nemo2-sft-peft at main · NVIDIA/NeMo · GitHub that may be helpful.
  2. Yes, the container has all the dependencies needed. I understand that its possible to launch the container from a terminal and attach to it using VSCode Attach to a running container.

Thank you for the resource. I will be reviewing it.

In the meantime, I am running the NeMo under a SLURM cluster it is not immediately clear to me if using the docker image is the best approach. Do I need to install the docker image on each node of the cluster?

Or is it better to install NeMo using pip? Just looking for the simplest way to get NeMo running on the SLURM. I don’t need the latest and greatest version right now. Doing some pre-development stuff. But I do want to work with NeMo v2.0