Abstract:This study set out to investigate intellectual domains as well as the use of measurement and validation methods in language assessment research and second language acquisition (SLA) published in English in peer-reviewed journals. Using Scopus, we created two datasets: (i) a dataset of core journals consisting of 1,561 articles published in four language assessment journals, and (ii) a dataset of general journals consisting of 3,175 articles on language assessment published in the top journals of SLA and applied linguistics. We applied document co-citation analysis to detect thematically distinct research clusters. Next, we coded citing papers in each cluster based on an analytical framework for measurement and validation. We found that the focus of the core journals was more exclusively on reading and listening comprehension assessment (primary), facets of speaking and writing performance such as raters and validation (secondary), as well as feedback, corpus linguistics, and washback (tertiary). By contrast, the primary focus of assessment research in the general journals was on vocabulary, oral proficiency, essay writing, grammar, and reading. The secondary focus was on affective schemata, awareness, memory, language proficiency, explicit vs. implicit language knowledge, language or semantic awareness, and semantic complexity. With the exception of language proficiency, this second area of focus was absent in the core journals. It was further found that the majority of citing publications in the two datasets did not carry out inference-based validation on their instruments before using them. More research is needed to determine what motivates authors to select and investigate a topic, how thoroughly they cite past research, and what internal (within a field) and external (between fields) factors lead to the sustainability of a Research Topic in language assessment.

A Systematic Review of Item Response Theory in Language Assessment: Implications for the Dimensionality of Language Ability

Applying Unidimensional and Multidimensional Item Response Theory Models in Testlet-Based Reading Assessment

Reading is a Multidimensional Construct at Child-L2-english-literacy Onset, but Comprises Fewer Dimensions over Time: Evidence from Multidimensional IRT Analysis

The Dimensionality of Language Ability in School-Age Children

Item Response Theory -- A Statistical Framework for Educational and Psychological Measurement

A Comparative Study of Item Response Theory Models for Mixed Discrete-Continuous Responses

Implicit assessment of language learning during practice as accurate as explicit testing

Application of Bi-factor MIRT and Higher-order CDM Models to an In-house EFL Listening Test for Diagnostic Purposes

Assessing Second Language Listening over the Past Twenty Years: A Review Within the Socio-Cognitive Framework

Item response theory in high-stakes pharmacy assessments

Multidimensional Computerized Adaptive Testing for Classifying Examinees With Within-Dimensionality

Cognitive Diagnosis in Language Assessment: A Thematic Review

Examining Differential Item Functioning In A Computer-Based English Proficiency Test

Measurement invariance of language brokering extent and attitudes in linguistic minority adolescents: Item response theory analyses.

An Extensive Knowledge Mapping Review of Measurement and Validity in Language Assessment and SLA Research

How does item wording affect participants' responses in Likert scale? Evidence from IRT analysis

Review of recent empirical research (2011–2018) on language assessment in China

Variational Item Response Theory: Fast, Accurate, and Expressive

Psychometric Properties of the Internet Self-Efficacy Scale: an Application of Item Response Theory

Investigating Directional Invariance in an Item Response Tree Model for Extreme Response Style and Trait-Based Unfolding Responses

Multi-faceted Rasch measurement and bias patterns in EFL writing performance assessment