Apr 22, 2026·Formal Sciences·260423.0011
Coverage, Not Averages: Semantic Stratification for Trustworthy Retrieval Evaluation
Andrew Klearman, Radu Revutchi, Rohin Garg, Rishav Chakravarti +2 more
This paper proposes semantic stratification, a structured evaluation framework for retrieval systems that organizes documents into entity-based clusters and systematically generates queries to ensure comprehensive coverage. It addresses hidden biases in current heuristic evaluation approaches and provides formal guarantees for more trustworthy retrieval assessment.