Skip to main content

Add the credential

Open Settings > Model Providers, click Add Model Provider and select OpenAI. Give the row a name, pick the organization, team or project it belongs to, and fill in: Save the row. Every virtual key whose scope can see the row can now dispatch to it, unless the key restricts its providers. See Virtual keys.
The OpenAI model provider drawer with OPENAI_API_KEY filled in and OPENAI_BASE_URL empty

The OpenAI row: name, scope, the two credential fields and the routing handle.

With a base URL set, the gateway treats the row as an OpenAI-compatible endpoint and sends the key as Authorization: Bearer.

Model names

Write openai/<model>, for example openai/gpt-5-mini, openai/gpt-5 or openai/text-embedding-3-small. A bare gpt-5-mini also resolves to OpenAI when the key reaches an OpenAI row: the gateway infers OpenAI for names that start with gpt-, o1-, o3-, o4-, chatgpt-, text-embedding-, whisper- and tts-.

Send a request

Endpoints

Prompt caching happens on OpenAI’s side. The cached token counts come back in usage and on the trace. See Cache control.
Last modified on September 6, 2026