Skip to main content
Article
The importance of measuring competency-based outcomes: standard evaluation measures are not surrogates for clinical performance of internal medicine residents
Quantitative Health Sciences Publications and Presentations
  • Lisa L. Willett, University of Alabama
  • Gustavo R. Heudebert, University of Alabama
  • Katri P. Palonen, University of Alabama
  • F. Stanford Massie, University of Alabama
  • Catarina I. Kiefe, University of Massachusetts Medical School
  • Jeroan J. Allison, University of Massachusetts Medical School
  • Joshua Richman, University of Alabama
  • Thomas K. Houston, University of Alabama
UMMS Affiliation
Department of Quantitative Health Sciences
Date
3-31-2009
Document Type
Article
Abstract
BACKGROUND: Despite recent emphasis on educational outcomes, program directors still rely on standard evaluation techniques such as tests of knowledge and subjective ratings. PURPOSES: To assess the correlation of standard internal medicine (IM) residency evaluation scores (attending global evaluations, In-Training examination, and Mini-Clinical Examination Exercise) with documented performance of preventive measures for continuity clinic patients. METHODS: Cross-sectional study of 132 IM residents attending an IM teaching clinic, July 2000 to June 2003, comparing standard evaluations with chart audit. RESULTS: Mean resident performance ranged from 53% (SD = 24) through 89% (SD = 20) across the 6 preventive measures abstracted from 1,102 patient charts. We found weak and mostly not significant correlations between standard measures and performance of preventive services. CONCLUSIONS: Standard measures are not adequate surrogates for measuring clinical outcomes. This supports the Accreditation Council for Graduate Medical Education's recommendations to incorporate novel Toolbox measures, like chart audit, into residency evaluations.
Rights and Permissions
Citation: Teach Learn Med. 2009 Apr-Jun;21(2):87-93. Link to article on publisher's site
Related Resources
Link to Article in PubMed
Citation Information
Lisa L. Willett, Gustavo R. Heudebert, Katri P. Palonen, F. Stanford Massie, et al.. "The importance of measuring competency-based outcomes: standard evaluation measures are not surrogates for clinical performance of internal medicine residents" Vol. 21 Iss. 2 (2009) ISSN: 1040-1334 (Linking)
Available at: http://works.bepress.com/jeroan_allison/73/