Nemo and OCI

AI & Data Science NVIDIA NeMo
1

Hi all,

while trying to run one of the example using OCI Generative ai as provider I get stucked at this error:

nemoguardrails.actions.llm.utils.LLMCallException: LLM Call Exception: model_id is required to derive the provider, please provide the provider explicitly or specify the model_id to derive the provider.

I can’t figure out what’s wrong, here follows my config file:

models:

Here’s the program am trying to run:
from nemoguardrails import RailsConfig
from nemoguardrails import LLMRails

config = RailsConfig.from_path(“./config”)

rails = LLMRails(config)

response = rails.generate(messages=[{
“role”: “user”,
“content”: “Hello!”
}])
print(response)

Anyone knows what am doing wrong ?

2

I solved it, by using this config:

3

Thanks for sharing your fix!

4

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.