RAG example cannot run with nvolveqa_40k embeddings

Accelerated Computing NGC GPU Cloud
1

Hi, I am trying to run this following repo’s example:

It was working fine until yesterday, however, the model embeddings cannot be found. I have tried on a new virtual environment and it results following error as well (the embeddings cannot be found):

ValueError: Unknown model name nvolveqa_40k specified. Available models are: ai-rerank-qa-mistral-4b - 0bf77f50-5c35-4488-8e7a-f49bb1974af6 ai-phi-3-vision-128k-instruct - 20f2537e-8593-4eb9-ad40-60eee3bbaa55 ai-phi-3-small-128k-instruct - 2ae1bc0b-a204-42fc-9edc-bd5f7fb2340d ai-embed-qa-4 - 09c64e32-2b65-4892-a285-2f585408d118 ai-vista-3d - 72311276-923f-4478-a506-d5b80914728a ai-arctic-embed-l - 1528a0ad-205a-46ac-a783-94e2372586a9 ai-phi-3-small-8k-instruct - 5affddf9-9f6a-44f5-baa7-8bc7ab5dc398 ai-mixtral-8x22b - 39655fc1-9ebc-4b24-963e-6915ea6680de ai-llama2-70b - 2fddadfb-7e76-4c8a-9b82-f7d3fab94471 ai-phi-3-medium-4k-instruct - 971a7ad5-009e-47a1-941a-22b74d742304 ai-mixtral-8x22b-instruct - 710c92d0-7c98-46d6-b5ae-07e84bcaa5d3 ai-molmim-generate - 72be0b68-179f-412c-ac03-9a481f78cb9f ai-arctic - 7408b6b5-09e7-4ae5-a3fe-2db063e4e609 ai-gemma-7b - a13e3bed-ca42-48f8-b3f1-fbc47b9675f9 ai-sea-lion-7b-instruct - 02f84bf4-c1a1-489b-a9de-ac3e8dcdec14 ai-stable-video-diffusion - 8cd594f1-6a4d-4f8f-82b4-d1bf89adae98 ai-neva-22b - bc205f8e-1740-40df-8d32-c4321763498a ai-dbrx-instruct - 3d6c2ff8-8bfc-4d10-8fd0-b7337288e869 ai-llama3-70b - a88f115a-4a47-4381-ad62-ca25dc33dc1b ai-mistral-7b-instruct-v2 - d7618e99-db93-4465-af4d-330213a7f51f ai-esmfold - a68c59e0-47a6-4a50-bf64-6d88766d56bf ai-stable-diffusion-xl - c1b63bb0-448b-4e53-b2a7-fb0b3723cbe2 ai-google-paligemma - a70e7356-c643-41b3-9a7e-b89ea1e7dea1 ai-mixtral-8x7b-instruct - a1e53ece-bff4-44d1-8b13-c009e5bf47f6 ai-recurrentgemma-2b - 2f495340-a99f-4b4b-89bd-1beb003dd896 ai-phi-3-mini - 4a58c6cb-a9b4-4014-99de-3e704d4ae687 ai-mistral-large - 767b5b9a-3f9d-4c1d-86e8-fa861988cee7 ai-ai-weather-forecasting - 9cec444c-db1c-4525-9c6f-f40e4a5b11ce ai-google-deplot - 784a8ca4-ea7d-4c93-bb46-ec027c3fae47 ai-example - 80a5d6c6-7658-49c5-b2b0-105bfb210282 ai-parakeet-ctc-riva - 22164014-a6cc-4a6f-b048-f3a303e745bb ai-llama3-8b - a5a3ad64-ec2c-4bfc-8ef7-5636f26630fe ai-nvidia-cuopt - b0ac1378-3d00-43cb-a8d9-0f0c37ef36c0 ai-diffdock - f3dda972-561a-4772-8c09-873594b6fb72 ai-gemma-2b - 04174188-f742-4069-9e72-d77c2b77d3cb ai-codellama-70b - f6b06895-d073-4714-8bb2-26c09e9f6597 ai-microsoft-kosmos-2 - 6018fed7-f227-48dc-99bc-3fd4264d5037 ai-fuyu-8b - e598bfc1-b058-41af-869d-556d3c7e1b48 ai-seallm-7b - e71e675e-a53d-4f2b-a441-e1287bd17dc8 ai-codegemma-7b - 7dfc10a8-3cc4-448e-97c1-2213308dc222 ai-sdxl-turbo - f886140c-424e-4c82-a841-99e23f9ae35d ai-phi-3-mini-4k - ad974453-80d4-46df-a02d-6f7dae20c010

The model API that i am using is

Please assist. Thanks

2

Update, the latest error i got is

Exception: [401] Unknown Error {'timestamp': '2024-05-27T01:43:25.029+00:00', 'path': '/v2/nvcf/functions', 'status': 401, 'error': 'Unauthorized', 'requestId': 'd2360345-1860488'}

Is there a problem with the NVIDIA NGC’s API?

3

I believe it is a problem with the AI Foundation Models and Endpoint services API. I have the same issue with my RAG example.

4

Ya, its an API problem with the Endpoint. I have tried also using the embed-qa-4 model and it results the same error as well.

5

Have you sorted a workaround on this one? I saw the issue request on github. I’ll tried a few different embedding models but all report the same error.

6

Haven’t yet, i also tested on different models but still has the same problem as before. My error as shown below:

ValueError: Unknown model name nvolveqa_40k specified.