Establishing Comparability Across Writing Tasks With Picture Prompts of Three Alternate Tests

Jiuliang Li
DOI: https://doi.org/10.1080/15434303.2017.1405422
IF: 2.143
2017-12-08
Language Assessment Quarterly
Abstract:In language testing programs, different test forms are often used to administer the same test. Demonstrating the comparability of these forms is essential to avoid criticisms of potential test unfairness. However, studies with this objective are scarce. This study aims to investigate the extent to which the picture-prompt writing tasks of three alternate tests are parallel. Nighty-five learners of English as a foreign language (EFL) were invited to perform the three tasks. The performance data from the different test forms were analyzed by using multifaceted Rasch measurement (MFRM). Two checklists were used to compare the tasks qualitatively in content. The results generally support the argument that the three writing tasks are parallel; however, some raters showed reservations in their agreement regarding several checklist statements related to some aspects of task comparability. Implications are discussed with reference to test fairness and the design of parallel test tasks.
linguistics,psychology, educational
What problem does this paper attempt to address?