跳到正文- Source: Vercel AI Gateway docs (overview, model fallbacks, budgets)
- Source: Portkey AI Gateway docs (fallbacks, retries, simple and semantic cache)
- Source: OpenRouter provider routing and model fallbacks docs
- Source: OpenRouter FAQ (fees, BYOK, free-model limits)
- Source: LiteLLM security update, suspected supply-chain incident (March 2026)
- Source: LiteLLM Router docs (routing, retries, fallbacks, cooldowns)
- Source: LiteLLM proxy (AI Gateway) docs: overview, virtual keys, caching
- Source: LiteLLM GitHub repository README
- Source: LiteLLM docs: getting started, input params, proxy config.yaml
- Source: LiteLLM docs: budgets and rate limits (proxy users, teams, keys)
- Source: Kong AI Semantic Cache plugin docs
- Source: Kong AI Gateway docs and AI Proxy Advanced plugin
- Source: Envoy AI Gateway v1.0 release notes (now Agent Router)
- Source: Cloudflare AI Gateway docs (features, caching, request handling)
- Source: Azure API Management llm-semantic-cache-lookup policy reference
- LLM Gateways
- LiteLLM