Exact expected average precision of the random baseline for system evaluationThe Prague Bulletin of Mathematical Linguistics (2015)
AbstractAverage precision (AP) is one of the most widely used metrics in information retrieval and natural language processing research. It is usually thought that the expected AP of a system that ranks documents randomly is equal to the proportion of relevant documents in the col- lection. This paper shows that this value is only approximate, and provides a procedure for efficiently computing the exact value. An analysis of the difference between the approximate and the exact value shows that the discrepancy is large when the collection contains few docu- ments, but becomes very small when it contains at least 600 documents.
- Average precision,
- Collocation evaluation,
- association measure
Citation InformationYves Bestgen. "Exact expected average precision of the random baseline for system evaluation" The Prague Bulletin of Mathematical Linguistics Vol. 103 (2015)
Available at: http://works.bepress.com/yvesbestgen/10/