Assessing the Comparability of School Scores Across Test Forms That Are Not Parallel

AR Fitzpatrick,GM Lee,FR Gao
DOI: https://doi.org/10.1207/s15324818ame1403_5
2001-01-01
Applied Measurement in Education
Abstract:Generalizability theory was used to assess the variation in school scores across very short test forms that measured pupils' mathematics skills in Grades 4 and 8. The forms had been linked, but the short forms were not parallel in content or in their psychometric properties. In each grade, cutscores were set, and the analyses were conducted in terms of both scale scores and percentages at or above the cutscore. Large school-by-form interactions were found especially in Grade 8, where the lack of parallelism impaired the equating between forms as well as the dependability of school scores. The findings differed somewhat by school size and score metric. All results demonstrated both the lack of comparability in school scores across short, nonparallel test forms and the importance of taking error into account when school scores are interpreted
What problem does this paper attempt to address?