Skip to main content
A Coherent Measurement of Web-Search Relevance
IEEE Transactions on Systems, Man, and Cybernetics
  • William Mahoney, University of Nebraska at Omaha
  • Peter Hospodka, University of Nebraska at Omaha
  • William Sousan, University of Nebraska at Omaha
  • Ryan Nickell, University of Nebraska at Omaha
  • Qiuming Zhu, University of Nebraska at Omaha
Document Type
Publication Date
We present a metric for quantitatively assessing the quality of Web searches. The relevance-of-searching-on-target index measures how relevant a search result is with respect to the searcher's interest and intention. The measurement is established on the basis of the cognitive characteristics of common user's online Web-browsing behavior and processes. We evaluated the accuracy of the index function with respect to a set of surveys conducted on several groups of our college students. While the index is primarily intended to be used to compare the Web-search results and tell which is more relevant, it can be extended to other applications. For example, it can be used to evaluate the techniques that people apply to improve the Web-search quality (including the quality of search engines), as well as other factors such as the expressiveness of search queries and the effectiveness of result-filtering processes.

© 2009 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Citation Information
William Mahoney, Peter Hospodka, William Sousan, Ryan Nickell, et al.. "A Coherent Measurement of Web-Search Relevance" IEEE Transactions on Systems, Man, and Cybernetics Vol. 39 Iss. 6 (2009) p. 1176 - 1187
Available at: