Source: Merola & Singh 2025: Late Chunking vs Contextual Retrieval

ECIR 2025 workshop paper reproducing late chunking and contextual retrieval: contextual retrieval wins slightly on relevance but costs far more compute; late chunking is model-dependent.

Contents

Summary

An independent reproduction that compares two ways to give chunks document context: late chunking (embed the whole document, pool per chunk) and LLM-written contextual retrieval (with rank fusion and reranking), on NFCorpus and MS MARCO with several open embedding models on a single 24 GB GPU.

Key claims

  • Contextual retrieval preserved semantic coherence better; late chunking was more efficient but lost some relevance and completeness.
  • NFCorpus subset, Jina-V3: contextual rank fusion nDCG@5 0.317 vs late chunking 0.309; nDCG@10 0.308 vs 0.294.
  • Contextualization alone gave small gains over uncontextualized fixed chunks (nDCG@5 0.303 to 0.312); adding rank fusion and reranking reached 0.317.
  • Late chunking is model-dependent: roughly neutral for Stella-V5 and Jina-V3, slightly positive for Jina-V2, sharply negative for BGE-M3 (nDCG@5 0.246 to 0.070); on MS MARCO with Stella-V5 it dropped nDCG@5 from 0.630 to 0.503.
  • Contextualizing long documents needed up to about 20 GB VRAM, forcing the authors to use a 20% subset.
  • Note: the paper’s late-chunking numbers for Jina-V3 differ between two of its tables.

Feeds

Contextual retrieval

Suggest changes →