--- description: Explore AI Gateway features including caching, rate limiting, guardrails, dynamic routing, and data loss prevention. title: Features image: https://developers.cloudflare.com/og-docs.png --- [Skip to content](#main-content) > Documentation Index > Fetch the complete documentation index at: https://developers.cloudflare.com/ai-gateway/llms.txt > Use this file to discover all available pages before exploring further. # Features Last updated Aug 25, 2026|Copy as Markdown|[View as Markdown](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/index.md)|[Agent setup](https://66f4ea29.previews.developers.cloudflare.com/agent-setup/) AI Gateway provides a comprehensive set of features to help you build, deploy, and manage AI applications with confidence. From performance optimization to security and observability, these features work together to create a robust AI infrastructure. ## Core Features ### Performance & Cost Optimization [Caching](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/caching/) Serve identical requests directly from Cloudflare's global cache, reducing latency by up to 90% and significantly cutting costs by avoiding repeated API calls to AI providers. **Key benefits:** * Reduced response times for repeated queries * Lower API costs through cache hits * Configurable TTL and per-request cache control * Works across all supported AI providers Use Caching [Spend Limits](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/spend-limits/) Set cost-based budgets that track cumulative dollar spend across requests. Scope limits by model, provider, or custom metadata dimensions like user, team, or application. **Key benefits:** * Per-provider or per-model budgets * Per-user or per-team budgets using [custom metadata](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/observability/custom-metadata/) * Configurable time windows (daily, weekly, monthly) * Automatic request blocking when budget is exceeded Use Spend Limits [Rate Limiting](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/rate-limiting/) Control application scaling and protect against abuse with flexible rate limiting options. Set limits based on requests per time window with sliding or fixed window techniques. **Key benefits:** * Prevent API quota exhaustion * Control costs and usage patterns * Configurable per gateway or per request * Multiple rate limiting techniques available Use Rate Limiting [Dynamic Routing](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/dynamic-routing/) Create sophisticated request routing flows without code changes. Route requests based on user segments, geography, content analysis, or A/B testing requirements through a visual interface. **Key benefits:** * Visual flow-based configuration * User-based and geographic routing * A/B testing and fractional traffic splitting * Context-aware routing based on request content * Dynamic rate limiting with automatic fallbacks Use Dynamic Routing ### Security & Safety [Guardrails](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/guardrails/) Deploy AI applications safely with real-time content moderation. Automatically detect and block harmful content in both user prompts and model responses across all providers. **Key benefits:** * Consistent moderation across all AI providers * Real-time prompt and response evaluation * Configurable content categories and actions * Compliance and audit capabilities * Enhanced user safety and trust Use Guardrails [Data Loss Prevention (DLP)](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/dlp/) Protect your organization from inadvertent exposure of sensitive data through AI interactions. Scan prompts and responses for PII, financial data, and other sensitive information. **Key benefits:** * Real-time scanning of AI prompts and responses * Detection of PII, financial, healthcare, and custom data patterns * Configurable actions: flag or block sensitive content * Integration with Cloudflare's enterprise DLP solution * Compliance support for GDPR, HIPAA, and PCI DSS Use Data Loss Prevention (DLP) [Authentication](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/configuration/authentication/) Secure your AI Gateway with token-based authentication. Control access to your gateways and protect against unauthorized usage. **Key benefits:** * Token-based access control * Configurable per gateway * Integration with Cloudflare's security infrastructure * Audit trail for access attempts Use Authentication [Bring Your Own Keys (BYOK)](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/configuration/bring-your-own-keys/) Securely store and manage AI provider API keys in Cloudflare's encrypted infrastructure. Remove hardcoded keys from your applications while maintaining full control. **Key benefits:** * Encrypted key storage at rest and in transit * Centralized key management across providers * Easy key rotation without code changes * Support for 20+ AI providers * Enhanced security and compliance Use Bring Your Own Keys (BYOK) ### Observability & Analytics [Analytics](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/observability/analytics/) Gain deep insights into your AI application usage with comprehensive analytics. Track requests, tokens, costs, errors, and performance across all providers. **Key benefits:** * Real-time usage metrics and trends * Cost tracking and estimation across providers * Error monitoring and troubleshooting * Cache hit rates and performance insights * GraphQL API for custom dashboards Use Analytics [Logging](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/observability/logging/) Capture detailed logs of all AI requests and responses for debugging, compliance, and analysis. Configure log retention and export options. **Key benefits:** * Complete request/response logging * Configurable log retention policies * Export capabilities via Logpush * Custom metadata support * Compliance and audit support Use Logging [Custom Metadata](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/observability/custom-metadata/) Enrich your logs and analytics with custom metadata. Tag requests with user IDs, team information, or any custom data for enhanced filtering and analysis. **Key benefits:** * Enhanced request tracking and filtering * User and team-based analytics * Custom business logic integration * Improved debugging and troubleshooting Use Custom Metadata ### Advanced Configuration [Custom Costs](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/configuration/custom-costs/) Override default pricing with your negotiated rates or custom cost models. Apply custom costs at the request level for accurate cost tracking. **Key benefits:** * Accurate cost tracking with negotiated rates * Per-request cost customization * Better budget planning and forecasting * Support for enterprise pricing agreements Use Custom Costs ## Feature Comparison by Use Case | Use Case | Recommended Features | | -------------------------- | -------------------------------------------------- | | **Cost Optimization** | Caching, Spend Limits, Rate Limiting, Custom Costs | | **High Availability** | Fallbacks using Dynamic Routing | | **Security & Compliance** | Guardrails, DLP, Authentication, BYOK, Logging | | **Performance Monitoring** | Analytics, Logging, Custom Metadata | | **A/B Testing** | Dynamic Routing, Custom Metadata, Analytics | ## Getting Started with Features 1. **Start with the basics**: Enable [Caching](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/caching/) and [Analytics](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/observability/analytics/) for immediate benefits 2. **Add reliability**: Configure Fallbacks and Rate Limiting using [Dynamic routing](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/dynamic-routing/) 3. **Enhance security**: Implement [Guardrails](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/guardrails/), [DLP](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/features/dlp/), and [Authentication](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/configuration/authentication/) --- _All features work seamlessly together and across all 20+ supported AI providers. Get started with [AI Gateway](https://66f4ea29.previews.developers.cloudflare.com/ai-gateway/get-started/) to begin using these features in your applications._ Was this helpful? YesNo ## On this page [![](https://66f4ea29.previews.developers.cloudflare.com/_astro/logo.te5VL_aD.svg)Docs](https://66f4ea29.previews.developers.cloudflare.com/) ```json {"@context":"https://schema.org","@type":"WebPage","@id":"https://developers.cloudflare.com/ai-gateway/features/#page","headline":"Features ยท Cloudflare AI Gateway docs","description":"Explore AI Gateway features including caching, rate limiting, guardrails, dynamic routing, and data loss prevention.","url":"https://developers.cloudflare.com/ai-gateway/features/","inLanguage":"en","image":"https://developers.cloudflare.com/og-docs.png","dateModified":"2026-08-25","publisher":{"@type":"Organization","name":"Cloudflare","description":"One platform for your apps, agents, and workforce. Build, secure, and scale without managing infrastructure","url":"https://www.cloudflare.com/","sameAs":["https://github.com/cloudflare","https://www.linkedin.com/company/cloudflare","https://x.com/cloudflare"],"logo":{"@type":"ImageObject","url":"https://developers.cloudflare.com/logo.svg"},"address":{"@type":"PostalAddress","streetAddress":"101 Townsend St","addressLocality":"San Francisco","addressRegion":"CA","postalCode":"94107","addressCountry":"US"},"contactPoint":[{"@type":"ContactPoint","contactType":"Customer Support","url":"https://support.cloudflare.com/","availableLanguage":["English"]},{"@type":"ContactPoint","contactType":"Sales","url":"https://www.cloudflare.com/contact/","availableLanguage":["English"]}]},"isPartOf":{"@type":"WebSite","@id":"https://developers.cloudflare.com/#website","name":"Cloudflare Docs","url":"https://developers.cloudflare.com/"}} ```