跳到正文- Source: vCache, verified semantic prompt caching (Schroeder et al., 2025)
- Source: The early bird catches the leak, timing side channels in LLM serving (Song et al., 2024)
- Source: RedisVL SemanticCache user guide
- Source: Redis LangCache docs (overview and API/SDK examples)
- Source: OpenAI Prompt Caching Guide
- Source: MeanCache, user-centric semantic caching (Gill et al., 2024)
- Source: Kong AI Semantic Cache plugin docs
- Source: GPTCache, an open-source semantic cache for LLM applications (Fu & Feng, 2023)
- Source: GPTCache usage documentation
- Source: GPT Semantic Cache (Regmi & Pun, 2024)
- Source: Gemini API Context Caching and Pricing Docs
- Source: Category-aware semantic caching for heterogeneous LLM workloads (Wang et al., 2025)
- Source: Azure API Management llm-semantic-cache-lookup policy reference
- Source: Anthropic Prompt Caching Docs
- Source: Advancing semantic caching with domain-specific embeddings and synthetic data (Gill et al., 2025)
- Semantic Caching
- Prompt Caching
- Cost and Latency Optimization