When i try to use NIM to deploy my custom model (mistral 24B), but the model output it’s very different, I think it hasn’t convert my model in the right way, and I would like to check, when I run the docker it comes up the example, is this example for correction the model or not?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Container image (nim) construction guide for models where a nim doesn't exist? | 2 | 157 | November 29, 2024 | |
| A Simple Guide to Deploying Generative AI with NVIDIA NIM | 9 | 812 | September 8, 2024 | |
| What image do I need to run the "nvidia/llama/mistral-7b-int4-chat:1.2" model? | 6 | 171 | July 25, 2024 | |
| Misral 및 Mixral 모델을 위한 새로운 NVIDIA NIM을 통해 AI 프로젝트 지원 | 1 | 12 | July 26, 2024 | |
| Cannot deploy deepseek NIM | 1 | 51 | June 26, 2025 | |
| Example-hybrid-rag | 7 | 112 | June 2, 2025 | |
| Issue accessing NIM Containers using Keys | 5 | 68 | July 2, 2025 | |
| Nvidia nim으로 생성형 ai를 배포하기 위한 빠른 가이드 | 1 | 136 | June 5, 2024 | |
| Livestream Thursday, July 17 : Simplify Deployment for a World of LLMs with NVIDIA NIM | 0 | 46 | July 14, 2025 | |
| NIM embedding model downloads but fails with auth error on startup | 29 | 834 | April 10, 2025 |
