AI Gateways
AI Gateways
AI Gateway Concepts
AI Gateway concepts
An AI Gateway stores a reusable inference configuration. Pass the gateway’s ID or slug in the request’s …
Models and Gateway Names
Models and gateway names
The model field of /v1/chat/completions selects what runs the request. It accepts three kinds of value:
Value …
Using an AI Gateway
Using an AI Gateway
Create a gateway in the dashboard or with the API, then call it through the OpenAI-compatible chat/completions endpoint …
Using AI Gateways via SDKs
Using AI Gateways via SDKs
The inference endpoint follows the OpenAI chat completions shape, so existing OpenAI-compatible SDKs work by …
Taking an AI Gateway to Production
Taking an AI Gateway to production
Start with a conservative configuration: clear system instructions, a model that supports the required …