Hey @andyq – you’ll need to sign up for an NVIDIA AI Enterprise account to pull NIMs. You can sign up for a free trial by going to NVIDIA NIM | llama3-8b and clicking the “Run Anywhere with NIM” button
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| NIM nim/meta/llama3-8b-instruct - no API key is detected | 2 | 769 | July 23, 2024 | |
| NIM API key not Found | 4 | 569 | September 21, 2024 | |
| /opt/nim/start-server.sh: line 61: 32 Killed python3 -m vllm_nvext.entrypoints.openai.api_server | 0 | 263 | July 9, 2024 | |
| NVIDIA NIM Container with CUDA out of Memory Problem | 2 | 512 | September 20, 2024 | |
| NIM embedding model downloads but fails with auth error on startup | 29 | 665 | April 10, 2025 | |
| A Simple Guide to Deploying Generative AI with NVIDIA NIM | 9 | 726 | September 8, 2024 | |
| Unable to Run NIM on H100 GPU Due to Profile Compatibility Issue Despite Sufficient GPU Resources | 1 | 198 | November 12, 2024 | |
| Model says there is a compatible profile but fails on data type | 4 | 661 | August 21, 2024 | |
| RTX 4090 shows as "non-free GPU" when running NIM model in docker | 8 | 1992 | October 21, 2024 | |
| How to fix 0 compatible profiles? Where to get compatible profiles? | 4 | 476 | November 26, 2024 |