Wondering if is there a way to configure the OneClick AWS deployment to use external LLM endpoint rather than self hosting it?
I know the regular deployment supports this by removing the dependencies in the helm chart: Using External Endpoints — Video Search and Summarization Agent
We’ll confirm this as soon as possible.
Thanks @yuweiw!
I am thinking of fetching the helm chart locally from the catalog and removing the llm subchart, along with adjusting the values.yml and top charts.
And then in the config.yml for the one click aws deployment, pointing the below to the local modified helm chart…
vss_chart:
repo:
name: ‘nvidia-blueprint’
url: ‘https://helm.ngc.nvidia.com/nvidia/blueprint’
chart: ‘nvidia-blueprint-vss’ # repo should be removed/commented-out when using local charts
version: ‘2.1.0’
Not sure if there is anything else I need to do specifically for the AWS deployment.
Yes, These are correct steps.
- Download the helm chart from catalog
- Customize as per your requirements.
- Remove repo(name and url) from the config.yml before deployment.
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.