Nvidia / llama-3.1-nemotron-70b-instruct openai api is not working

ullahimran914 · October 17, 2024, 7:23am

i try the nvidia / llama-3.1-nemotron-70b-instruct model with openai api key and its taking long time with no response.

tony3t3t · November 10, 2024, 3:20pm

Same with me. Last night it was working but this morning waiting for a long time with no response. I use Nvidia API.

Topic		Replies	Views
OpenAI Compatible API does not work Models llama-31-8b-instruct , llama-31-70b-instruct	6	785	August 26, 2024
Result of nvidia nims in openai SDK and API inconsistent NVIDIA Nemotron nim , llama-31-405b-instruct , llama	0	94	January 7, 2025
Llama 3.1 nemotron 70b instruct API access not working correctly NVIDIA Nemotron llama , nemotron	2	90	December 5, 2025
Open AI Endpoint NVIDIA Nemotron	0	300	April 28, 2024
Supercharging Llama 3.1 across NVIDIA Platforms Technical Blog	14	366	September 17, 2024
Optimizing Inference on Large Language Models with NVIDIA TensorRT-LLM, Now Publicly Available Technical Blog	8	1994	January 25, 2024
"404 Page Not Found" Error When api used as openai Models	3	949	February 22, 2026
Turbocharging Meta Llama 3 Performance with NVIDIA TensorRT-LLM and NVIDIA Triton Inference Server Technical Blog	62	4384	August 28, 2024
The model llama3 does not exist calling from ChatNVIDIA langchain class NVIDIA Nemotron	2	625	May 6, 2024
Not connect to endpoint https://integrate.api.nvidia.com/v1 Access/Accounts nim , llama	1	1180	February 17, 2025