#Moe
- Source: vLLM Expert Parallel Deployment docs
- Source: Unsloth Faster MoE training docs
- Source: The Llama 4 herd (Meta AI blog)
- Source: Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
- Source: Qwen3 Technical Report and launch blog
- Source: Performant local mixture-of-experts CPU inference with GPU acceleration in llama.cpp
- Source: Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
- Source: Mixture of Experts Explained (Hugging Face blog)
- Source: Mixtral of Experts
- Source: gpt-oss-120b & gpt-oss-20b Model Card (arXiv)
- Source: DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
- Source: DeepSeek-V3/R1 Inference System Overview
- Source: DeepSeek-V3 Technical Report
- Mixture of Experts (MoE)