Skip to main content
Article
Learning feature dependencies for noise correction in biomedical prediction
11th SIAM International Conference on Data Mining 2011: Mesa, Arizona, USA, 28-30 April 2011: Proceedings
  • Ghim-Eng YAP, Institute for Infocomm Research, Singapore
  • Ah-Hwee TAN, Nanyang Technological University
  • Hwee Hwa PANG, Singapore Management University
Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
4-2011
Abstract

The presence of noise or errors in the stated feature values of biomedical data can lead to incorrect prediction. We introduce a Bayesian Network-based Noise Correction framework named BN-NC. After data preprocessing, a Bayesian Network (BN) is learned to capture the feature dependencies. Using the BN to predict each feature in turn, BN-NC estimates a feature's error rate as the deviation between its predicted and stated values in the training data, and allocates the appropriate uncertainty to its subsequent findings during prediction. BN-NC automatically generates a probabilistic rule to explain BN prediction on the class variable using the feature values in its Markov blanket, and this is reapplied as necessary to explain the noise correction on those features. Using three real-life benchmark biomedical data sets (on HIV-1 drug resistance prediction and leukemia subtype classification), we demonstrate that BN-NC (1) accurately detects the errors in biomedical feature values, (2) automatically corrects for the errors to maintain higher prediction accuracy over competing methods including Decision Trees, Naive Bayes and Support Vector Machines, and (3) generates probabilistic rules that concisely explain the prediction and noise correction decisions. In addition to achieving more robust biomedical prediction in the presence of feature noise, by highlighting erroneous features and explaining their corrections, BN-NC provides medical researchers with high utility insights to biomedical data not found in other methods.

ISBN
9781617829802
Identifier
10.1137/1.9781611972818.7
Publisher
SIAM
City or Country
Philadelphia, PA
Copyright Owner and License
Authors
Creative Commons License
Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International
Additional URL
http://doi.org/10.1137/1.9781611972818.7
Citation Information
Ghim-Eng YAP, Ah-Hwee TAN and Hwee Hwa PANG. "Learning feature dependencies for noise correction in biomedical prediction" 11th SIAM International Conference on Data Mining 2011: Mesa, Arizona, USA, 28-30 April 2011: Proceedings (2011) p. 71 - 82
Available at: http://works.bepress.com/hweehwa-pang/46/