Skip to main content
Investigating Factors That Influence Item Performance on ACS Exams
Journal of Chemical Education
  • Jacob Schroeder, Clemson University
  • Kristen L. Murphy, University of Wisconsin - Milwaukee
  • Thomas Holme, Iowa State University
Document Type
Publication Version
Published Version
Publication Date
General chemistry tests from the Examinations Institute of the Division of Chemical Education of the American Chemical Society have been analyzed to identify factors that may influence how individual test items perform. In this paper, issues of item order (position within a set of items that comprise a test) and answer order (position of correct answer relative to incorrect distractors) are discussed. Answer order is identified as potentially important, particularly for conceptually based items. When the correct answer appears earlier among the answer choices, there is some greater propensity for student performance to be better. Item-order effects are also possible, particularly when students encounter several challenging items consecutively. Performance on the next item may be lower than expected, possibly because of cognitive-load effects.

Reprinted (adapted) with permission from J. Chem. Educ., 2012, 89 (3), pp 346–350. Copyright 2012 American Chemical Society.

Copyright Owner
American Chemical Society
File Format
Citation Information
Jacob Schroeder, Kristen L. Murphy and Thomas Holme. "Investigating Factors That Influence Item Performance on ACS Exams" Journal of Chemical Education Vol. 89 Iss. 3 (2012) p. 346 - 350
Available at: