Vercel AI Gateway is a Vercel gateway to connect applications to different AI models and providers through a unified interface, with routing, centralized billing, fallback and observability.
What it does
- Centralize calls to models and providers through one interface
- Track usage, costs and performance of calls
- Centralize billing, observability, routing and provider fallback
How it works
- The application uses the gateway as its single call endpoint
- Centralized metrics and logs for requests
- Configurable routing and fallback policies
Integrations
- Connects to models and providers through a common API
- Manages keys and settings per environment
Strengths
- Unified interface for multiple providers
- Centralized observability of calls
- Centralized routing, fallback and billing
Points of attention
- Integration and available features vary by model and provider
- The extra layer adds a dependency point
- Provider data policies apply to usage