Skip to main content
Article
R2: a useful measure of model performance when predicting a dichotomous outcome
Quantitative Health Sciences Publications and Presentations
  • Arlene S. Ash, University of Massachusetts Medical School
  • Michael Shwartz, Boston University
UMMS Affiliation
Department of Quantitative Health Sciences
Publication Date
3-10-1999
Document Type
Article
Subjects
*Hospital Mortality; Humans; Mathematical Computing; *Models, Statistical; Odds Ratio; Predictive Value of Tests; ROC Curve; Risk Assessment; Severity of Illness Index
Abstract

R2 has been criticized as a measure of model performance when predicting a dichotomous outcome, both because its value is often low and because it is sensitive to the prevalence of the event of interest. The C statistic is more widely used to measure model performance in a 0/1 setting. We use a simple parametric family of models to illustrate the potential usefulness of models with low R2 values, to clarify the effect of prevalence on both C and R2, and to demonstrate how R2 captures information not picked up by C. We also show that C is subject to a 'random mixing' problem that does not affect R2. Finally, we report both R2 and C values for different risk-adjustment models in situations with different prevalences and show the relationship between the measures and decile death rates, thereby providing a context for interpreting R2 values in a 0/1 setting.

Rights and Permissions
Citation: Stat Med. 1999 Feb 28;18(4):375-84. Link to article on publisher's site
PubMed ID
10070680
Related Resources
Link to Article in PubMed
Citation Information
Arlene S. Ash and Michael Shwartz. "R2: a useful measure of model performance when predicting a dichotomous outcome" Vol. 18 Iss. 4 (1999) ISSN: 0277-6715 (Linking)
Available at: http://works.bepress.com/arlene_ash/71/