Topic	Replies	Views	Activity
Unable to Run NIM on H100 GPU Due to Profile Compatibility Issue Despite Sufficient GPU Resources Models nim , llama-31-8b-instruct , llama	1	344	November 12, 2024
NIM does not support llama-3.1-8b-instruct and llama-3.1-70b-instruct on GH200 On-Prem deployment Models nim , llama-31-8b-instruct , llama	1	379	November 7, 2024
Reusing a stored model (llama-3.1-8b-instruct) with a proper profile Models nim , llama-31-8b-instruct , llama	0	235	October 30, 2024
LoRA swapping inference Llama-3.1-8b-instruct \| Exception: lora format could not be determined Models nim , llama3-8b-instruct , llama-31-8b-instruct , llama	4	320	October 22, 2024
Running Ollama / llama3.1 on Jetson AGX Xavier 16gb is it possible? how-to? Jetson AGX Xavier generative_ai , llama-31-8b-instruct	8	3128	October 19, 2024
NIM API key not Found Models nim , llama-31-8b-instruct , llama	4	1009	September 21, 2024
API connect Models nim , llama-31-8b-instruct , llama	1	437	September 20, 2024
Problem with installation of Llama 3.1 8b NIM Models nim , llama3-8b-instruct , llama-31-8b-instruct , llama	1	684	September 4, 2024
Fail to evaluate LLM efficiency using nemo evaluator General cuda , docker , python , inference-server-triton , kubernetes , nim , llama-31-8b-instruct , llama	0	56	August 28, 2024
OpenAI Compatible API does not work Models llama-31-8b-instruct , llama-31-70b-instruct	6	967	August 26, 2024
Llama3.1-8b error on startup in k8s Models llama-31-8b-instruct	6	418	August 13, 2024

llama-31-8b-instruct