Skip to main content
The LLM Providers page contains a list of available LLM providers, models, and the API keys the gateway uses to reach them. LLM Gateway supports the following external providers: Anthropic, Azure OpenAI, Cohere, Custom OpenAI-compatible providers, Google Gemini, and OpenAI.
LLM Gateway Providers
Each provider displays the following information:
  • Provider—the user-friendly name and type of the LLM provider.
  • Models—the LLM you are using (for example, gpt-4o or claude-sonnet-5).
  • Status—the status of the LLM provider: Active or Inactive.
  • API Key—a masked representation of the API key obtained from the LLM provider. The API key cannot be edited after the provider is registered. To update an API key, delete the provider and re-add it.
Each provider also contains edit and delete icons. On the edit page of the provider, you can edit the provider’s Name and add or delete Models. Click Save Changes when finished. Click the delete icon to remove the provider.

​
Add a Provider

For each provider, obtain your API key from that provider’s developer console before registering.
To register a new LLM provider, do the following:
1
Click + Add Provider. An Add LLM Provider dialog appears.
2
Enter the following information about the provider (Step 1):
  • Name—enter a friendly name for the provider.
  • Provider—select a supported provider type.
  • Base URL—(Azure OpenAI only) enter the base endpoint for the provider, for example, https://my-endpoint.example.com/v1.
  • API Key—enter the provider’s API key.
3
Add the LLM models to use for the provider (Step 2). Click + Add Model and enter the model name. Repeat to add additional models.
4
When you are finished adding models, click Add. The LLM provider appears on the LLM Providers page with a status of Active.
Last modified on October 1, 2026