OpenAI SDK - CData

Prerequisites

Before you can configure the OpenAI SDK to use the Connect AI LLM Gateway, you must register a provider, create a routing rule, create a project, and issue a virtual key. See LLM Gateway for details.

A Connect AI Personal Access Token (PAT) is not accepted by the LLM Gateway. Only a virtual key authenticates requests.

Install the SDK

Python
JavaScript

pip install openai

npm install openai

Send a Request

Set base_url (Python) or baseURL (JavaScript) to the Connect AI LLM Gateway endpoint and pass your virtual key as api_key or apiKey. The gateway selects the provider and model based on your project’s routing rule.

Python
JavaScript

from openai import OpenAI

client = OpenAI(
    base_url="https://cloud.cdata.com/gateway/v1",
    api_key="<your-virtual-key>",
)

response = client.chat.completions.create(
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://cloud.cdata.com/gateway/v1",
  apiKey: "<your-virtual-key>",
});

const response = await client.chat.completions.create({
  messages: [{ role: "user", content: "Hello" }],
});

console.log(response.choices[0].message.content);

Configure with Environment Variables

As an alternative to passing connection details in code, you can set environment variables. The OpenAI SDK reads these automatically.

macOS / Linux
Windows (PowerShell)

export OPENAI_BASE_URL="https://cloud.cdata.com/gateway/v1"
export OPENAI_API_KEY="<your-virtual-key>"

$env:OPENAI_BASE_URL = "https://cloud.cdata.com/gateway/v1"
$env:OPENAI_API_KEY = "<your-virtual-key>"

With environment variables set, you can instantiate the client without explicit arguments:

Python
JavaScript

from openai import OpenAI

client = OpenAI()  # reads OPENAI_BASE_URL and OPENAI_API_KEY from env

response = client.chat.completions.create(
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

import OpenAI from "openai";

const client = new OpenAI(); // reads OPENAI_BASE_URL and OPENAI_API_KEY from env

const response = await client.chat.completions.create({
  messages: [{ role: "user", content: "Hello" }],
});

console.log(response.choices[0].message.content);

Last modified on October 2, 2026