A Validation Framework for the National English Proficiency Scale of China

Zhengcai ZHU
DOI: https://doi.org/10.3969/j.issn.1005-8427.2016.08.002
2016-01-01
Abstract:This study attempts to establish an appropriate framework to validate the newly developed National English Proficiency Scale of China (NEPS), which is a scale of the English language learners’proficiency in Mainland China. Given the long history and broad scope of the term“validation”, the study defines in the first place the conception of validation within the context of validating a language proficiency scale other than a test. Distinctions between a validation study of a scale and that of a testing program are identified and explicitly stated. Three categories of validity evidence encompassing interrelated facets are employed to construct a theoretical framework for validating the NEPS in current study:(a) construct validity and fair validity addressing the fundamental validity issue from the perspective of science and ethics, efficiency and fairness;(b)decision validity, a higher level validity index, dictating the ultimate value of a psychological scale as a useful measurement instrument for decision making; and (c) teaching backwash validity and social impact validity explicating the relationship between the NEPS and English language teaching, and a broader societal impact the NEPS exerts in China. Along with the three categories, immediate validity and delay validity are considered in this proposed validation framework to collect validity evidence over time, both during the development of the NEPS and after its formal launching. The study further elaborates on the specific methods used for collecting multiple sources of validity evidence pertaining to each stage of the NEPS development.
What problem does this paper attempt to address?