At present, NVIDIA GPUs are a pre-requisite for running LLM NIMs and Text Embedding NIMs:
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| I have an issue when installing NVIDIA NIM on laptop | 9 | 829 | June 14, 2025 | |
| Livestream Thursday, July 17 : Simplify Deployment for a World of LLMs with NVIDIA NIM | 0 | 43 | July 14, 2025 | |
| A Simple Guide to Deploying Generative AI with NVIDIA NIM | 9 | 802 | September 8, 2024 | |
| How can I use NIMs in a self-hosted environment to perform inference with the LLaMA2-70B model on an L40s GPU? | 0 | 118 | June 20, 2024 | |
| Access large models (405B) with NIM after using all credits for the build.nvidia.com endpoints | 3 | 233 | August 29, 2024 | |
| How to Create a Custom NIM-Compliant Container Image for Self Hosting? | 3 | 173 | February 26, 2025 | |
| Access to NVIDIA NIM Now Available Free to Developer Program Members | 8 | 447 | February 26, 2025 | |
| Container image (nim) construction guide for models where a nim doesn't exist? | 2 | 154 | November 29, 2024 | |
| Aunch NVIDIA NIM (llama3-8b-instruct) for LLMs locally | 3 | 132 | November 8, 2024 | |
| Dockerfiles of NIM Containers | 1 | 119 | October 30, 2024 |