跳到正文- Source: RouterBench, a benchmark for multi-LLM routing (Hu et al., 2024)
- Source: RouteLLM, an open-source framework for cost-effective LLM routing (LMSYS blog)
- Source: RouteLLM (Ong et al. 2024)
- Source: Portkey AI Gateway docs (fallbacks, retries, simple and semantic cache)
- Source: OpenRouter provider routing and model fallbacks docs
- Source: OpenRouter Auto Router docs
- Source: LiteLLM Router docs (routing, retries, fallbacks, cooldowns)
- Source: Kong AI Gateway docs and AI Proxy Advanced plugin
- Source: Hybrid LLM, cost-efficient and quality-aware query routing (Ding et al., ICLR 2024)
- Model Selection
- Model Routing and Fallbacks
- LiteLLM
- Cost and Latency Optimization