Cloudflare AI Gateway
Edge gateway for caching, rate-limiting and observing AI API calls.
A managed gateway on Cloudflare’s network that sits in front of model providers to add caching, rate limiting, retries and model fallbacks, plus analytics and logging. Closed source and not self-hostable; a free tier covers basic use.
- Vendor
- Cloudflare
- Category
- AI gateways
- Pricing
- Freemium
- Open source
- No
- Platforms
- API
- Launched
- 2023
- Website
- developers.cloudflare.com/ai-gateway
Features
- Edge caching
- Rate limiting
- Fallbacks
- Analytics & logs
Best for
- High volume / low cost
- Enterprise
More ai gateways
- OpenRouter — OpenRouter. One API for hundreds of models.
- LiteLLM — BerriAI. Open-source, self-hosted gateway to 100+ LLM APIs in the OpenAI format.
- Portkey — Portkey. Production AI gateway with routing, guardrails, budgets and observability.
- Vercel AI Gateway — Vercel. One endpoint for hundreds of models, with no markup on tokens.
- Azure API Management AI gateway — Microsoft. AI gateway policies built into Azure API Management.
- Kong AI Gateway — Kong. AI plugins that turn the Kong API gateway into a multi-LLM gateway.
- Apigee AI gateway — Google Cloud. AI gateway policies in Google Cloud’s Apigee API platform.
- Bifrost — Maxim AI. Fast open-source gateway in Go with budgets, virtual keys and an MCP gateway.