Skip to main content
profile image
Selected Works of Daniel Dinsmore
Article
What are confidence judgments made of? Students' explanations for their confidence ratings and what that means for calibration ☆
Learning and Instruction (2013)
  • Daniel L. Dinsmore, University of North Florida
  • Meghan M. Parkinson, University of North Florida
Link
Abstract
Although calibration has been widely studied, questions remain about how best to capture confidence ratings, how to calculate continuous variable calibration indices, and on what exactly students base their reported confidence ratings. Undergraduates in a research methods class completed a prior knowledge assessment, two sets of readings and posttest questions, and rated their confidence in their responses to each posttest item. Students also wrote open-ended responses explaining why they marked their confidence as they did. Students provided confidence ratings on a 100-mm line for one of the passages and through magnitude scaling for the other counterbalanced passage. Calibration was calculated using a rho coefficient and yielded acceptable measures of calibration. No within-subject differences were found between 100-mm line responses and magnitude scaling responses, p = 0.54. Open-ended responses revealed that students base their confidence ratings on prior knowledge, characteristics of the text, characteristics of the item, guessing, and combinations of these categories. Future studies including calibration should carefully consider implicit assumptions about students' sources of confidence and how those sources theoretically relate to calibration. (Contains 3 tables and 5 figures.)
Keywords
  • Measurement,
  • Undergraduate Students,
  • Confidence Testing,
  • Value Judgment,
  • Responses,
  • Rating Scales,
  • Scaling,
  • Pretests Posttests,
  • Prior Learning,
  • Guessing (Tests),
  • Test Items
Disciplines
Publication Date
April 1, 2013
DOI
10.1016/j.learninstruc.2012.06.001
Citation Information
Daniel L. Dinsmore and Meghan M. Parkinson. "What are confidence judgments made of? Students' explanations for their confidence ratings and what that means for calibration ☆" Learning and Instruction Vol. 24 (2013) p. 4 - 14
Available at: http://works.bepress.com/daniel-dinsmore/31/