Is it possible to run nim in offline

AI & Data Science NVIDIA NIM Models
1

I want to download the NIM docker image from nvcr.io on online(enabling the internet) and create a container using the image in offline(disabling the internet), I’ve a A100 GPU cluster, is it possible to do that, if so how can I achieve this.

thank you :)

2

Hi @cOde_RabBIT – check out the “Serving models from local assets” section of the documentation here: Getting Started - NVIDIA Docs. It goes over how you can download the container and assets and then deploy it offline.

3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.