Source: Qwen2.5-72B-Instruct config.json

Model configuration file used as a worked example for KV cache sizing.

Contents

Summary

The architecture hyperparameters of a typical 70B-class GQA model, which are exactly the inputs needed for KV cache math.

Key claims

  • 80 hidden layers, hidden size 8192, 64 attention heads (head dim 128), 8 key-value heads (GQA, 8 query heads per KV head).
  • BF16 weights; max_position_embeddings 32768.

Feeds

KV cache

Suggest changes →