Can I run Build an Enterprise RAG pipeline Blueprint by NVIDIA | NVIDIA NIM on server with GH200 ?
According to minimal requirements this blueprint needs is 4xH100, I believe its for minimum memory requirements which GH200 should have. I also saw that NIM was not supported on GH200 platforms on August 2024 (NIM support for GH200?) is it supported now?
gicior01
1
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| New NVIDIA AI Blueprint: Build a Customizable RAG Pipeline | 1 | 25 | January 30, 2025 | |
| NIM support for GH200? | 2 | 107 | August 21, 2024 | |
| Blueprint RAG v2.0.0 | 1 | 35 | April 24, 2025 | |
| NIM does not support llama-3.1-8b-instruct and llama-3.1-70b-instruct on GH200 On-Prem deployment | 1 | 189 | November 7, 2024 | |
| Unable to Run NIM on H100 GPU Due to Profile Compatibility Issue Despite Sufficient GPU Resources | 1 | 188 | November 12, 2024 | |
| Does nvidia H200 support IsaacSim? | 3 | 38 | April 3, 2025 | |
| Managing AI Inference Pipelines on Kubernetes with NVIDIA NIM Operator | 5 | 123 | April 11, 2025 | |
| How to fix 0 compatible profiles? Where to get compatible profiles? | 4 | 460 | November 26, 2024 | |
| NIM to Triton Server Pipeline | 0 | 51 | February 27, 2025 | |
| Is it possible to run Evo2-40B on an A100 GPU? | 0 | 108 | March 1, 2025 |