OpenAI-compatible endpoints

The gateway exposes OpenAI-style HTTP endpoints so existing OpenAI client libraries can talk to your local gateway without a custom SDK. Requests are routed to your configured default AI adapter.

How to use it

Configure a default AI adapter in your gateway config.
Enable the OpenAI-compatible endpoints and set an auth_token.
Point your OpenAI client at the gateway base URL.
Send Chat Completions or Responses requests as you normally would.

In practice, you use this when you want:

Drop-in OpenAI client compatibility while running a different backend.
One HTTP ingress path that routes to your configured adapter.

Example: Chat Completions (curl)

curl http://127.0.0.1:19790/v1/chat/completions \
  -H "Authorization: Bearer replace-me" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "any-string",
    "messages": [
      { "role": "user", "content": "Hello from a client" }
    ]
  }'

Example: Responses (curl)

curl http://127.0.0.1:19790/v1/responses \
  -H "Authorization: Bearer replace-me" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "any-string",
    "input": "Hello from a client"
  }'

Example: OpenAI SDKs (base URL override)

Point the client at the gateway and use your auth_token as the API key. JavaScript:

import OpenAI from "openai";

const client = new OpenAI({
  apiKey: "replace-me",
  baseURL: "http://127.0.0.1:19790/v1"
});

const res = await client.chat.completions.create({
  model: "any-string",
  messages: [{ role: "user", content: "hello" }]
});

Python:

from openai import OpenAI

client = OpenAI(
  api_key="replace-me",
  base_url="http://127.0.0.1:19790/v1"
)

res = client.chat.completions.create(
  model="any-string",
  messages=[{"role": "user", "content": "hello"}],
)

Why they exist

Compatibility: reuse OpenAI client libraries, CLI tools, and SDKs.
Single adapter path: the same safety rules, session storage, and logging apply regardless of how the request arrives.

Safety + redaction

If enabled in config, the gateway prepends safety system prompts before dispatching to the adapter, and applies output redaction before returning the response.

Start

Core

Ingress

Channels

AI

Runtime

Ops

Credits

How to use it

Example: Chat Completions (curl)

Example: Responses (curl)

Example: OpenAI SDKs (base URL override)

Why they exist

Safety + redaction

​How to use it

​Example: Chat Completions (curl)

​Example: Responses (curl)

​Example: OpenAI SDKs (base URL override)

​Why they exist

​Safety + redaction

How to use it

Example: Chat Completions (curl)

Example: Responses (curl)

Example: OpenAI SDKs (base URL override)

Why they exist

Safety + redaction