Abstract:Using item response theory (IRT) and exploratory and confirmatory factor analysis (EFA and CFA) approaches, this study constructed and validated a scale for Chinese college English-major students to self-assess their feedback knowledge repertoire in English-as-a-foreign-language (EFL) academic writing. It included two sub-studies: Study 1 – scale construction and Study 2 – scale validation. Study 1 was conducted within the IRT framework, which included the following six major steps: a) the preparation of item specifications following Yu and Liu’s (2021) conceptual framework; b) the preparation of the scale item pool; c) the field testing of scale items with Chinese college English-major students; d) the EFA analysis (to explore the factorial structure); e) the calculation of item function values; and f) the selection of items for the final scale. Study 2 was conducted within the IRT, EFA, and CFA frameworks, which included the following five major steps: a) the expert evaluation of the item appropriateness for construct interpretations of the final scale items (validity); b) the administration of the final scale to Chinese college English-major students; c) the EFA and CFA analyses (validity), d) the calculation of alpha coefficients (reliability), and e) the calculation of item, scale, and subscale information function values (reliability). The final 40-item scale was validated to have sound psychometric qualities for measuring Chinese English-major students’ feedback knowledge repertoire in EFL academic writing. Implications for EFL and English L1 researchers, and Chinese EFL teachers and their graduate students are discussed.

Factor analysis of English speaking ability descriptors and their scaling:An empirical study

A Preliminary Study on Self-constructionals Scales (scs)of Chinese-Version

Creating a unified scale of language ability in China

Chinese Version of the Responses to Positive Affect Questionnaire: Testing the Factor Structure, Reliability, and Validity in A College Student Sample

The factor structure of Chinese personality terms.

Developing Common Listening Ability Scales for Chinese Learners of English

Constructing and validating a self-assessment scale for Chinese college English-major students’ feedback knowledge repertoire in EFL academic writing: Item response theory and factor analysis approaches

Development and Validation of a Diagnostic Rating Scale for EFL Writing in China

Several Problems about Developing a Descriptor Pool of China Common Framework for English Proficiency Scale

Diagnosing Writing Ability Using China’s Standards of English Language Ability: Application of Cognitive Diagnosis Models

Evaluating System Quality of E-Learning Programs: A Study Based on Factor Analysis

The student engagement scale: evidence of psychometric validity in Chinese and English language subjects from grade 4 to grade 6 in China

Development and validation of scales for speaking self-efficacy: Constructs, sources, and relations

STUDENTS' COMPREHENSIVE ACHIEVEMENT BASED ON FACTOR ANALYSIS AND CLUSTERING ANALYSIS

The Factorial and Construct Validity of the Chinese Self-Directed Learning Readiness Scale for Students

Measurement of engagement in the foreign language classroom and its effect on language achievement: the case of Chinese college EFL students

A Validation Study for a Short-Version Scale to Assess 21st Century Skills in Flipped EFL Classrooms

Establishing an Operational Model of Rating Scale Construction for English Writing Assessment

English Language Teachers’ Perceived Classroom Assessment Knowledge and Practice: Developing and Validating a Scale

The development and validation of an L2 student digital multimodal composing competence scale

Review on the validity of China’s Standards of English Language Ability