AI Gateway

Send your applications’ and coding agents’ model traffic through Altrum, so every request is governed.

This is in development. Details may change before it is available.

The AI Gateway is one address for every model call your organization makes. Your applications, SDKs and coding agents point at Altrum instead of at the model provider, and keep working as before. Altrum sends each request on to your provider, and on the way:

• checks it against your guardrails, before the model and on the answer,
• checks the key, the models it may use, its budget and rate limits,
• routes it to the right provider credential, and to a fallback if the provider fails,
• connects your MCP tools, prompts and cache,
• records what happened, with its cost, in the request log.

Start without registering anything

You can use the AI Gateway as soon as your organization is set up, before you register any AI system. Add your provider credentials, create a key, and send requests. Organization guardrails govern that traffic. When you later register the AI system that traffic belongs to, attach the key to it, and the AI system’s assessment and guardrails take over.

Where you manage it

Place	What you manage there
AI Gateway in the sidebar	Provider credentials, organization and personal keys, organization budget and rate limit, model access and routing, organization guardrails, MCP servers, prompts, cache, content logging, OpenTelemetry export, and the request log for the whole organization.
An AI system’s AI Gateway tab	That AI system’s keys, budget and rate limit, models, routing, cache and logging choices, MCP tools, and its own request log.

What it supports

Area	Supported
Request formats	OpenAI chat completions and Responses, Anthropic messages, Google Gemini. See Endpoints.
Model providers	OpenAI, Anthropic, Bedrock, Google Gemini, Google Vertex AI and Azure (Azure OpenAI and Azure AI Foundry), with your own credentials. See Provider credentials.
Clients	The OpenAI, Anthropic and Google SDKs, Claude Code, Codex CLI, Gemini CLI, Cursor and Claude Desktop. See SDKs and Coding agents.
Streaming	Yes, for every request format.

Who can do what

Owners and admins manage the AI Gateway. When an admin allows it, any member can create a personal key for their own coding agent. Every member can see the request log, without request content. See Virtual keys.