Skip to main content
Article
Exact expected average precision of the random baseline for system evaluation
The Prague Bulletin of Mathematical Linguistics (2015)
  • Yves Bestgen, UniversitĂ© Catholique de Louvain
Abstract
Average precision (AP) is one of the most widely used metrics in information retrieval and natural language processing research. It is usually thought that the expected AP of a system that ranks documents randomly is equal to the proportion of relevant documents in the col- lection. This paper shows that this value is only approximate, and provides a procedure for efficiently computing the exact value. An analysis of the difference between the approximate and the exact value shows that the discrepancy is large when the collection contains few docu- ments, but becomes very small when it contains at least 600 documents.
Keywords
  • Average precision,
  • Collocation evaluation,
  • association measure
Publication Date
2015
Citation Information
Yves Bestgen. "Exact expected average precision of the random baseline for system evaluation" The Prague Bulletin of Mathematical Linguistics Vol. 103 (2015)
Available at: http://works.bepress.com/yvesbestgen/10/