Skip to main content
Article
Comprehensive Evaluation of Association Measures for Fault Localization
Proceedings of the IEEE International Conference on Software Maintenance (ICSM)
  • Lucia LUCIA, Singapore Management University
  • David LO, Singapore Management University
  • Lingxiao JIANG, Singapore Management University
  • Aditya Budi, Singapore Management University
Publication Type
Conference Proceeding Article
Version
submittedVersion
Publication Date
9-2010
Abstract

In statistics and data mining communities, there have been many measures proposed to gauge the strength of association between two variables of interest, such as odds ratio, confidence, Yule-Y, Yule-Q, Kappa, and gini index. These association measures have been used in various domains, for example, to evaluate whether a particular medical practice is associated positively to a cure of a disease or whether a particular marketing strategy is associated positively to an increase in revenue, etc. This paper models the problem of locating faults as association between the execution or non-execution of particular program elements with failures. There have been special measures, termed as suspiciousness measures, proposed for the task. Two state-of-the-art measures are Tarantula and Ochiai, which are different from many other statistical measures. To the best of our knowledge, there is no study that comprehensively investigates the effectiveness of various association measures in localizing faults. This paper fills in the gap by evaluating 20 wellknown association measures and compares their effectiveness in fault localization tasks with Tarantula and Ochiai. Evaluation on the Siemens programs show that a number of association measures perform statistically comparable as Tarantula and Ochiai.

Keywords
  • Association measures,
  • Fault location,
  • Debugging,
  • Data mining,
  • Statistical analysis,
  • Variables of interest
ISBN
9781424486281
Identifier
10.1109/ICSM.2010.5609542
Publisher
IEEE
City or Country
Timisoara, Romania
Creative Commons License
Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International
Comments

To cite the data package, please use the following citation:

Lucia, Lo, D., Lingxiao, J., & Budi, A. (2010). Data from: Comprehensive evaluation of association measures for fault localization. InK Repository at Singapore Management University. http://ink.library.smu.edu.sg/sis_research/1330

Additional URL
http://dx.doi.org/10.1109/ICSM.2010.5609542
Citation Information
Lucia, David Lo, Jiang Lingxiao, Aditya Budi. 2010. "Comprehensive Evaluation of Association Measures for Fault Localization." In Proceedings of IEEE International Conference on Software Maintenance (ICSM), September 12-18, Timisoara, Romania.. New York: IEEE. doi: 10.1109/ICSM.2010.5609542