Skip to main content
Presentation
Effects of item positions on their difficulty and discrimination: a study in PISA Science data across test language and countriesitle
Paper presented at the 72nd Annual Meeting of the Psychometric Society (2007)
  • Luc T Le, Australian Council for Educational Research (ACER)
  • Van Nguyen, Australian Council for Educational Research (ACER)
Abstract
This study was based on a four-cluster rotation design of 13 linked test booklets from PISA 2006 science data. It investigated effects of item positions on their difficulty and discrimination parameter estimates obtained from one and two parameter IRT Partial Credit models. The analyses were done separately for 57 test language groups from 53 countries with a total of about 340,000 students. The results revealed that for all of the test language groups the items tended to become more difficult when they were located later in the test. However, a high linear relationship between the item difficulty estimates by the four cluster locations was found. Moreover, open-ended items seemed to show more change than items in other formats. There were small variations in the cluster locations for the item point-biserial discrimination and the item discrimination parameter from the two-parameter Partial Credit model across the test language groups.
Keywords
  • Difficulty level,
  • Item response theory,
  • Science tests,
  • Test construction,
  • Test items,
  • Secondary education,
  • Languages,
  • Geographic regions,
  • International studies
Publication Date
July, 2007
Location
Tokyo
Citation Information
Luc T Le and Van Nguyen. "Effects of item positions on their difficulty and discrimination: a study in PISA Science data across test language and countriesitle" Paper presented at the 72nd Annual Meeting of the Psychometric Society (2007)
Available at: http://works.bepress.com/van-nguyen/4/