Cloudflare AI Gateway is a control layer for AI application traffic, with analytics, caching, rate limiting, routing and fallback.
What it does
- Control and observe calls to models and providers
- Apply caching and rate limiting to AI traffic
- Route and fall back between providers
How it works
- AI traffic flows through the Cloudflare network
- Caching, rate and routing policies are configured at the layer
- Centralized usage and performance metrics
Integrations
- Connects to models and providers through a common interface
- Runs at the Cloudflare network edge
Strengths
- Analytics and observability of AI traffic
- Edge caching and rate limiting
- Routing and fallback between providers
Points of attention
- Requires Cloudflare infrastructure or account
- The extra layer adds a dependency point
- Features vary by integrated provider