What is the AZURE VM instance that I have to select for Meta/Llama3-8b-instruct model as there is very limited availability the NV series doesn’t work and for NC T4 I am getting memory errors
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| NIM does not support llama-3.1-8b-instruct and llama-3.1-70b-instruct on GH200 On-Prem deployment | 1 | 93 | November 7, 2024 | |
| Aunch NVIDIA NIM (llama3-8b-instruct) for LLMs locally | 3 | 71 | November 8, 2024 | |
| Profiles doesnt match machine even though specs are correct | 0 | 18 | November 29, 2024 | |
| Issues while starting NIM container in A10 VM | 4 | 85 | September 4, 2024 | |
| NIM - Llama 3 8B Instruct - Results were very weirdn | 1 | 259 | August 27, 2024 | |
| Can I use models like Llama-3-8B-Instruct-Coder with NIM? | 1 | 44 | September 20, 2024 | |
| Unable to run TensorRT LLM on azure vm | 1 | 291 | February 28, 2024 | |
| Recommend Compute for running a TensorRT-LLM using LLama2 13B & 70B model | 2 | 995 | November 15, 2023 | |
| RuntimeError: NCCL Error 3: internal error - please report this issue to the NCCL developers | 0 | 862 | April 5, 2024 | |
| Azure N-Series Ubuntu VM - NVIDIA failing at boot | 2 | 1135 | August 30, 2022 |