Skip to main content
Article
Item Selection Counts: A Comparison of Empirical Key and Rational Scale Validities in Theory-Based and Non-Theory-Based Item Pools
Journal of Applied Psychology
  • Roni Reiter-Palmon, University of Nebraska at Omaha
Document Type
Article
Publication Date
2-1-2000
Disciplines
Abstract

Little explicit attention has been given to the impact of item pools on the validities and cross-validities of different background data scoring approaches. This study tests the idea that pools of items theoretically related to the performance of interest will outperform pools of items with no hypothesized relationship with the criterion. Validities and cross-validities of rational scales and empirical keys created from theory- and non-theory-based item pools were compared for 3 criteria. When size of the item pools was held constant, theory-based empirical keys (correlational and vertical percent) and rational scales showed larger validities and cross-validities than non-theory-based empirical keys (correlational and vertical percent) and showed minimal shrinkage in cross-validities. Even when item pool for the non-theory-based keys was expanded to include all items in the instrument, the theory-based keys showed comparable or slightly better validities and cross-validities for 2 of the 3 criteria, including college GPA, which was separated from the predictors by 4 years.

Comments

© 2000 American Psychological Association.

This article may not exactly replicate the final version published in the APA journal. It is not the copy of record. The final version can be found at http://psycnet.apa.org/journals/apl/85/1/143/.

Citation Information
Roni Reiter-Palmon and. "Item Selection Counts: A Comparison of Empirical Key and Rational Scale Validities in Theory-Based and Non-Theory-Based Item Pools" Journal of Applied Psychology Vol. 85 Iss. 1 (2000) p. 143 - 151
Available at: http://works.bepress.com/roni_reiter-palmon/60/