I’m using the latest NVIDIA AI workbench. I’ve cloned workbench-example-hybrid-rag. I haven’t had with success with Local, Cloud or Microsevices. This has been going on for some time now, so that is why I have uninstalled AI workbench and reinstalled. I’m going to put three seperate Topics. One for each local, cloud and Microservices. This one is for Local. This is the issue I get with local.
Do you have permission to that model on huggingface mistral-7b-instruct-v0.1? It is a gated model.
Yes, I have access. I’ve tried several different models.
Getting a 403, which implies either you haven’t put the hugging face keys in the project config or you don’t have access
Thanks Joe173. I requested access several times. When I go to HF I can see that the gated approvals are there, so i will keep working. I was finally able to get the non-gated to work.
Just tried on my end and mistral seems to work for me, sometimes it may take some time to propagate the permission to your key? Let me know if you are still running into issues.