Bifrost
Fast open-source gateway in Go with budgets, virtual keys and an MCP gateway.
A self-hosted gateway that puts many providers behind one OpenAI-compatible API, with provider fallback, load balancing, semantic caching, virtual keys and budgets. It can also front MCP tool servers, and exports traces over OpenTelemetry. An enterprise edition adds governance such as SSO and audit logs.
- Vendor
- Maxim AI
- Category
- AI gateways
- Pricing
- Freemium
- Open source
- Yes
- License
- Apache 2.0
- Platforms
- Self-hosted, Docker, Linux, macOS, Windows
- Launched
- 2025
- Website
- getmaxim.ai/bifrost
Features
- OpenAI-compatible API
- Fallbacks
- Virtual keys & budgets
- MCP gateway
Best for
- High volume / low cost
- Enterprise
More ai gateways
- OpenRouter — OpenRouter. One API for hundreds of models.
- LiteLLM — BerriAI. Open-source, self-hosted gateway to 100+ LLM APIs in the OpenAI format.
- Portkey — Portkey. Production AI gateway with routing, guardrails, budgets and observability.
- Cloudflare AI Gateway — Cloudflare. Edge gateway for caching, rate-limiting and observing AI API calls.
- Vercel AI Gateway — Vercel. One endpoint for hundreds of models, with no markup on tokens.
- Azure API Management AI gateway — Microsoft. AI gateway policies built into Azure API Management.
- Kong AI Gateway — Kong. AI plugins that turn the Kong API gateway into a multi-LLM gateway.
- Apigee AI gateway — Google Cloud. AI gateway policies in Google Cloud’s Apigee API platform.