
- Provider–the user-friendly name and type of the LLM provider.
- Models–the LLM you are using (for example, gpt-4o or claude-sonnet-5).
- Status–the status of the LLM provider: Active or Inactive.
- API Key–a masked representation of the API key obtained from the LLM provider. The API key cannot be edited after the provider is registered. To update an API key, delete the provider and re-add it.
You must have a system role of Administrator to add, edit, or delete providers. Providers are account-level, so a Workspace Administrator cannot add, edit, or delete them. Non-administrators can view this page but cannot make any changes.
Add a Provider
For each provider, obtain your API key from that provider’s developer console before registering.
1
Click + Add Provider. An Add LLM Provider dialog appears.
2
In Step 1: Details, enter the following information about the provider:
- Name–enter a friendly name for the provider.
- Provider–select a provider from the list, or select Custom for an OpenAI-compatible provider that is not listed. When possible, the Base URL is filled in for the selected provider.
- Override Base URL–select this to use your own address (such as a company proxy) instead of the provider default. This option is not available for all providers.
- Base URL–enter the base endpoint for the provider, for example, https://proxy.example.com/v1. This field is editable only when Override Base URL is selected, or if the provider allows a custom URL. Otherwise, it displays the provider default. See Base URL Requirements.
- API Key–enter the provider’s API key.
3
In Step 2: Select Models, add the LLM models to use for the provider:
- Click + Add Model and select a model from the list, or type the name of a model that is not in the list.
- The dialog displays Cost per 1M tokens for the model: Input, Output, Cache read, and Cache write. Selecting a model from the list fills in its costs. You can edit the costs if desired. For a model you enter yourself, Input and Output start at 0 and Cache read and Cache write start blank.
- Click Add to add the model.
- Repeat to add additional models.
Costs are estimates of the AI provider’s charges, not CData billing. Connect AI uses them for spend estimates, project costing, and budget-limit checks.
4
When you are finished adding models, click Add to close the dialog. The LLM provider appears on the LLM Providers page with a status of Active. The provider’s Edit page shows estimated cost information for each of its models.
Base URL Requirements
Unless you select Override Base URL, Connect AI uses the default base URL for the provider:
For other providers, the default is the Base URL that the dialog fills in when you select the provider.
If you override the base URL, or use an Azure OpenAI or Custom provider, follow these rules:
- OpenAI and Anthropic–include the version path, for example, https://proxy.example.com/v1.
- Cohere–use the host only.
- Google Gemini–end the URL before
/v1beta. - For all providers, do not include a query string, fragment, or user name and password. The exception is Azure OpenAI, which uses
?api-version=.