ChatNVIDIA - HTTPError: 404 Client Error: Not Found

AI & Data Science NVIDIA NIM Models
1

Hello,

I am working through the: Talk to your data in your native language dlc course.

And am getting a 404 error:

HTTPError: 404 Client Error: Not Found for url: https://api.nvcf.nvidia.com/v2/nvcf/pexec/functions/2fddadfb-7e76-4c8a-9b82-f7d3fab94471

Can anyone see what I am doing wrong?

I’m a novice. And it’s probably something very simple. But I can’t see it.

I have copied in my code, below - most of which is identical to the example here:

#START

from langchain_nvidia_ai_endpoints import ChatNVIDIA

pload = {
“model”:“ai-llama2-70b”,
“nvidia_api_key”:“nvapi–DxNl51yzZb3PZohpA0n5Jwoetf5W3T32TKBWb04nZcDj2ZhgE7_jMGTObYJCi-v”,
“temperature”:0.2,
“top_p”:0.7,
“max_tokens”:1024,
}

llm = ChatNVIDIA(**pload)

LLAMA_PROMPT_TEMPLATE = (
“[INST] <>”
“{system_prompt}”
“<>”
“[/INST] {context} [INST] {question} [/INST]”
)
system_prompt = “You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Please ensure that your responses are positive in nature.”
context=“”
question=‘What is the fastest land animal?’
prompt = LLAMA_PROMPT_TEMPLATE.format(system_prompt=system_prompt, context=context, question=question)

for val in llm.stream(prompt):
tokens_generated += 1
print(val, end=“”, flush=True)

#END
2

Hi,

The model is meta/llama2-70b not ai-llama2-70b
You exposed your key, you will need to change it.

3

Thanks Tom

I tried that, but got the following error……

Noting: the Python code worked just fine, but not the code for Langchain. I am guessing it’s something fundamental in my setting?

ValueError: Unknown model name meta/llama2-70b specified.
Available models are:
ai-mistral-7b-instruct-v2 - d7618e99-db93-4465-af4d-330213a7f51f
ai-starcoder2-15b - d9cfe8a2-44df-44a0-ba51-3fc4a202c11c
ai-parakeet-ctc-0_6b-asr - d8dd4e9b-fbf5-4fb0-9dba-8cf436c8d965
ai-codellama-70b - f6b06895-d073-4714-8bb2-26c09e9f6597
ai-proteinmpnn - 77598af7-e712-44a2-8e91-d3522725740c
ai-sdxl-turbo - f886140c-424e-4c82-a841-99e23f9ae35d
ai-starcoder2-7b - dd7b01e7-732d-4da5-8e8d-315f79165a23
ai-seallm-7b - e71e675e-a53d-4f2b-a441-e1287bd17dc8
ai-palmyra-med-70b - aab71274-5281-4941-b0b8-20f339d1fc7e
ai-google-paligemma - a70e7356-c643-41b3-9a7e-b89ea1e7dea1
ai-parakeet-ctc-1_1b-asr-inworld - ac04dbc6-29f9-4be5-bf32-010f01c4669b
ai-nemotron-4-340b-reward - c53ee0e9-bad9-4e09-b365-52c9d6b71254
ai-solar-10_7b-instruct - fb60b849-1282-42a4-b790-977d88db3550
ai-nv-dinov2 - 9446dad0-ff4f-46d1-89f4-726e113cfca0
ai-mistral-nemo-minitron-8b-base - e02d472d-11d1-419c-a487-29239eadf5c0
ai-fuyu-8b - e598bfc1-b058-41af-869d-556d3c7e1b48
ai-mistral-nemo-12b-instruct - f8c05193-d2e2-4f0f-bb4d-7ad70070002b
ai-usdsearch - 1e006b75-c292-4cde-8201-ffaab26c5a88
ai-stable-diffusion-xl - c1b63bb0-448b-4e53-b2a7-fb0b3723cbe2
ai-parabricks-fq2bam - bb6bb23e-9861-4aa5-9ef9-1ec69bbc8e9c
ai-mistral-7b-instruct-v03 - cd89bd68-13e3-47a9-861e-9a62e6e14b05
ai-llama-3_1-8b-instruct - e62a4350-2218-4cf5-9262-112432d239f8
ai-neva-22b - bc205f8e-1740-40df-8d32-c4321763498a
ai-parabricks-deepvariant - 8a9b3cdd-4eab-4c0f-aaaf-fcfad7d060c1
ai-llama3-70b - a88f115a-4a47-4381-ad62-ca25dc33dc1b
ai-sea-lion-7b-instruct - 02f84bf4-c1a1-489b-a9de-ac3e8dcdec14
ai-retail-object-detection - c0b05e1d-3847-467a-80d5-85e3e5b05f17
ai-diffdock - f3dda972-561a-4772-8c09-873594b6fb72
ai-phi-3-medium-4k-instruct - 971a7ad5-009e-47a1-941a-22b74d742304
ai-maisi - b1116c0d-9b6a-4384-a69f-4370742464e8
ai-mixtral-8x22b-instruct - 710c92d0-7c98-46d6-b5ae-07e84bcaa5d3
ai-palmyra-med-70b-32k - d6faa974-3591-49a4-963d-97221d074b2e
ai-visual-changenet - 60eb6443-f7fa-464b-8a38-60b41db269f4
ai-nv-rerankqa-mistral-4b-v3 - 98b83903-f595-48c4-b727-b69067b7c069
ai-dracarys-llama-3_1-70b-instruct - d27bf72f-ff2f-4443-95b4-5f06f85f72e5
ai-embed-qa-4 - 09c64e32-2b65-4892-a285-2f585408d118
ai-nv-grounding-dino - 50128865-af25-4a3f-b175-d75ce3c72bd9
ai-nvclip - 3072eebf-b0f0-4318-a5b8-5a45cd035b95
ai-rakutenai-7b-instruct - 760ad50f-7829-403d-a549-b1e97a44a9bb
ai-google-deplot - 784a8ca4-ea7d-4c93-bb46-ec027c3fae47
ai-gemma-7b - a13e3bed-ca42-48f8-b3f1-fbc47b9675f9
ai-phi-3-small-8k-instruct - 5affddf9-9f6a-44f5-baa7-8bc7ab5dc398
ai-phi-3-medium-128k-instruct - 2975892e-2acd-49a5-8c4b-b76baf352bed
ai-codestral-22b-instruct-v01 - 9a10b012-e6df-46fd-83b2-700dcbc75814
ai-vila - 1c8df143-2303-419b-8b28-b4dd82cfe113
ai-a2x-service - 945ed566-a023-4677-9a49-61ede107fd5a
ai-mixtral-8x7b-instruct - a1e53ece-bff4-44d1-8b13-c009e5bf47f6
ai-nvidia-cuopt - b0ac1378-3d00-43cb-a8d9-0f0c37ef36c0
ai-stable-video-diffusion - 8cd594f1-6a4d-4f8f-82b4-d1bf89adae98
ai-phi-3-mini - 4a58c6cb-a9b4-4014-99de-3e704d4ae687
ai-nv-embedqa-e5-v5 - 303d34cf-7ebf-41ee-a1d8-e07e8ba2d4e7
ai-phi-3-mini-4k - ad974453-80d4-46df-a02d-6f7dae20c010
ai-stable-diffusion-3-medium - 1a89a4d9-bbf6-432c-95ca-4ab78fb02f28
ai-phi-3_5-vision-instruct - 2fed4405-db0f-46ff-8e98-dfeadbb29e38
ai-gemma-2-9b-it - 1136f83f-7706-49f3-970b-67499c26724e
ai-mixtral-8x22b - 39655fc1-9ebc-4b24-963e-6915ea6680de
ai-chatqa-1-5-70b - 46594287-38b9-481c-a37f-baa02f2d3ba1
ai-llama-3-taiwan-70b-instruct - 9572a08b-4cc1-4bd6-91e0-acb7fdb5c45d
ai-bria-2_3 - 71e99191-2549-4662-b7f9-cb8a3cbe46c9
ai-llama2-70b - 2fddadfb-7e76-4c8a-9b82-f7d3fab94471
ai-shieldgemma-9b - 84bf3350-8aad-4f77-88a8-394fc07e466b
ai-esm2-650m - 9e8155ab-97fc-487d-b325-02186064a14c
ai-ocdrnet - 5ab7a112-a78f-4218-9612-e02a0fffcc03
ai-microsoft-florence-2 - 94d86bf9-a844-4696-be8c-5703114867ec
ai-ai-weather-forecasting - 9cec444c-db1c-4525-9c6f-f40e4a5b11ce
ai-gemma-2-27b-it - 6369bc8b-727e-4591-b274-908ac3c80c59
ai-microsoft-kosmos-2 - 6018fed7-f227-48dc-99bc-3fd4264d5037
ai-rfdiffusion - e469fc55-91c0-460d-a444-15d9921ac277
ai-mistral-large - 767b5b9a-3f9d-4c1d-86e8-fa861988cee7
ai-mamba-codestral-7b-v01 - a7556920-615e-4298-ac1a-12dbf1f84dd0
ai-recurrentgemma-2b - 2f495340-a99f-4b4b-89bd-1beb003dd896
ai-megatron-1b-nmt - 647147c1-9c23-496c-8304-2e29e7574510
ai-parakeet-ctc-1_1b-asr - 1598d209-5e27-4d3c-8079-4751568b1081
ai-fastpitch-hifigan-tts - 0149dedb-2be8-4195-b9a0-e57e0e14f972
ai-arctic-embed-l - 1528a0ad-205a-46ac-a783-94e2372586a9
ai-arctic - 7408b6b5-09e7-4ae5-a3fe-2db063e4e609
ai-llama3-8b - a5a3ad64-ec2c-4bfc-8ef7-5636f26630fe
ai-nv-embed-v1 - 4c134d37-17f9-4fc6-9f84-1f3a8a03c52c
ai-llama-3_1-405b-instruct - 0de0002c-98f6-422d-8bfc-2716e52f99d2
ai-phi-3-small-128k-instruct - 2ae1bc0b-a204-42fc-9edc-bd5f7fb2340d
ai-breeze-7b-instruct - 14919f3d-8dc9-4d19-a6da-6dbf99360156
ai-parakeet-ctc-riva - 22164014-a6cc-4a6f-b048-f3a303e745bb
ai-moflow-generate - 8d93d27e-f6ef-4549-b915-2b205fa7152c
ai-phi-3-vision-128k-instruct - 20f2537e-8593-4eb9-ad40-60eee3bbaa55
ai-palmyra-fin-70b-32k - 316490c6-f1ed-41f9-9da8-3fa9e885653b
ai-llama-3-swallow-70b-instruct-v01 - 0967cb57-a94c-4483-91a6-c797d1fdb4a7
ai-molmim-generate - 72be0b68-179f-412c-ac03-9a481f78cb9f
ai-rakutenai-7b-chat - 3cc0a374-0ab9-43f6-8283-ef1340306c4a
ai-codegemma-7b - 7dfc10a8-3cc4-448e-97c1-2213308dc222
ai-usdcode-llama3-70b-instruct - 98890e70-72a2-4ff4-9f51-f359862d2cdb
ai-jamba-1_5-large-instruct - 6497fc2b-7ff8-4019-8946-123dccbfc863
ai-nemotron-4-340b-instruct - b0fcd392-e905-4ab4-8eb9-aeae95c30b37
ai-bge-m3 - 6acccd83-8f46-42b2-a191-529be72bb8de
ai-jamba-1_5-mini-instruct - 06d6c08c-0214-4b64-85b7-a55ffdb870e4
ai-nemotron-mini-4b-instruct - 6fea1bef-f7ac-427e-8764-bb9e42bb8f60
ai-gemma-2b - 04174188-f742-4069-9e72-d77c2b77d3cb
ai-rerank-qa-mistral-4b - 0bf77f50-5c35-4488-8e7a-f49bb1974af6
ai-phi-3_5-moe - e6cab982-62f4-481e-9a7a-3dedb87dbd01
ai-chatqa-1-5-8b - 3c7d7cee-90ba-433c-97fc-a092864c7ccf
ai-consistory - 58676e2d-1e7c-4361-9540-943e155c02ed
ai-yi-large - 23bd454d-b225-49a3-8118-582a62fc51b8
ai-mistral-large-2-instruct - 7fadd4de-e22a-48e4-90e9-f02ef14a74b9
ai-dbrx-instruct - 3d6c2ff8-8bfc-4d10-8fd0-b7337288e869
ai-radtts-hifigan-tts - 5e607c81-7aa6-44ce-a11d-9e08f0a3fe49
ai-granite-8b-code-instruct - af7b6f03-f615-4c5f-86c6-388bd35cede0
ai-phi-3_5-mini - 84e82bac-4e46-4be3-9ac9-5f82ce0bab83
ai-codegemma-1-1-7b - e2d298c5-204e-4213-b921-9f492cc9011b
ai-chatglm3-6b - 14a5cd57-c018-47fe-bcad-8ef24329e512
ai-granite-34b-code-instruct - 4df48b4f-e3c5-4ade-82c7-c06b65e25d18
ai-esmfold - a68c59e0-47a6-4a50-bf64-6d88766d56bf
ai-deepseek-coder-6_7b-instruct - e503b15c-62b0-4d69-b532-a88f0bfa2656
ai-vista-3d - 72311276-923f-4478-a506-d5b80914728a
ai-mathstral-7b-v01 - 7095e542-ca86-4503-864f-67dd423ecc53
ai-gemma-2-2b-it - b24f0b9b-17f0-4fbf-bbd6-1d01394652cf
ai-baichuan2-13b-chat - e34accba-5d27-4960-84e2-e4f9f8777e4f
ai-nv-embedqa-mistral-7b-v2 - 6caf65cf-1c3a-4823-89a5-21b821640d99
ai-llama-3_1-70b-instruct - 8f723982-f99d-4978-a0cb-1334163e0e07

5

Hi @hazel1 – try updating the langchain-nvidia-ai-endpoints library to the latest version

6

That was it. Thank you Neal. I was stuck on that for ages :-)

1 Like
7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.