Skip to main content
Article
On the use of rotated context questionnaires in conjunction with multilevel item response models
Large-scale Assessments in Education (2013)
  • Raymond Adams, ACER
  • Petra Lietz, ACER
  • Alla Berezner, ACER
Abstract

Background: While rotated test booklets have been employed in large-scale assessments to increase the content coverage of the assessments, rotation has not yet been applied to the context questionnaires administered to respondents.

Methods: This paper describes the development of a methodology that uses rotated context questionnaires in conjunction with multilevel item response models and plausible values. In order to examine the impact of this methodology on the continuity of the results, PISA 2006 data for nine heterogeneous countries were rescaled after having been restructured to simulate the outcomes of the use of different rotated context questionnaire designs.

Results: Results revealed negligible differences when means, standard deviations, percentiles, and correlations were estimated using plausible values drawn with multilevel item response models that adopted different approaches to questionnaire rotation.

Conclusions: The results of the analyses support the use of rotated contextual questionnaires for respondents in order to extend the methodology currently used in large-scale sample surveys.

Keywords
  • Multilevel item response models,
  • Questionnaire design,
  • Assessment,
  • Methodology,
  • PISA,
  • Sample surveys
Publication Date
September, 2013
Citation Information
Raymond Adams, Petra Lietz and Alla Berezner. "On the use of rotated context questionnaires in conjunction with multilevel item response models" Large-scale Assessments in Education Vol. 1 Iss. 5 (2013)
Available at: http://works.bepress.com/ray_adams/38/