I have it up and running with a front end chatbox that is sending messages and getting responses. It seems like everything documented is really focused on Docker running locally. I would be interested in finding docs to get access to more of the utilities in this NIM using openshift.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| NIM with llama-3-8b models stuck without any error | 0 | 92 | November 15, 2024 | |
| Can I use models like Llama-3-8B-Instruct-Coder with NIM? | 1 | 54 | September 20, 2024 | |
| NIM Llama3 8B Instruct - Running container with "CUDA_ERROR_NO_DEVICE" | 0 | 16 | March 14, 2025 | |
| Multi-LoRA with LLAMA 3 NIM is not listed in API | 2 | 85 | August 21, 2024 | |
| NIM - Llama 3 8B Instruct - Results were very weirdn | 1 | 308 | August 27, 2024 | |
| NIM does not support llama-3.1-8b-instruct and llama-3.1-70b-instruct on GH200 On-Prem deployment | 1 | 162 | November 7, 2024 | |
| Issues while starting NIM container in A10 VM | 4 | 127 | September 4, 2024 | |
| Reusing a stored model (llama-3.1-8b-instruct) with a proper profile | 0 | 129 | October 30, 2024 | |
| NIM - Llama3-8b-Instruct - GPU resource usage is very high | 0 | 16 | March 12, 2025 | |
| Running NIM llama-3_1-8b-instruct fails in On-Prem deployment | 6 | 219 | February 24, 2025 |