Abstract:Videoconferencing offers new opportunities for language testers to assess speaking ability in low-stakes diagnostic tests. To be considered a trusted testing tool in language testing, a test should be examined employing appropriate validation processes (Chapelle, C.A., Jamieson, J., & Hegelheimer, V. (2003). Validation of a web-based ESL test. Language Testing, 20, 409–439.). While developing a speaking test, language testers need to gather evidence to build a validity argument with theoretical rationales. These rationales should be based on test purpose and validation considerations that affect decision making on test design and validation (Chapelle, C. (2001). Computer applications in second language acquisition: Foundations for teaching, testing, and research. Cambridge: Cambridge University Press.). To obtain theoretical soundness in validation, spec-driven test development (Davidson, F., & Lynch, B. (2002). Testcraft: A teacher's guide to writing and using language test specifications. New Haven, CT and London: Yale University Press.) was applied to speaking test development. Experimental tests were carried out with 40 test takers using face-to-face and videoconferenced oral interviews. Findings indicated no significant difference in performance between test modes, neither overall nor across analytic scoring features. Findings from qualitative data also evidenced the comparability of the videoconferenced and face-to-face interviews in terms of comfort, computer familiarity, environment, non-verbal linguistic cues, interests, speaking opportunity, and topic/situation effects with little interviewer effect. Data taken from test spec evolution, test scores, post interview, and observations were analyzed to build a validity argument using Bachman and Palmer's (1996. Language testing in practice. Oxford: Oxford University Press.) usefulness analysis table. The collected evidence suggests that the videoconferenced interview was comparable to the face-to-face interview with respect to reliability, construct validity, authenticity, interactiveness, impact, and practicality.

The Influence of the Visual Input on the Construct Validity of L2 Listening Tests——A literature review of the research abroad in the past twenty years

Assessing Second Language Listening over the Past Twenty Years: A Review Within the Socio-Cognitive Framework

Validation of a videoconferenced speaking test

The Effects of Visual Input and Text Types on the Listening Comprehension of EFL Students in China

Bridging Local Needs and National Standards: Use of Standards-Based Individualized Feedback of an In-House EFL Listening Test in China

Development and Validation of A Computer Adaptive Efl Test

Review of recent empirical research (2011–2018) on language assessment in China

Diagnosing listening and reading skills in the Chinese EFL context: Performance stability and variability across modalities and performance levels

Assessing Language Testing: A Corpus-Based Approach

THE DEVELOPMENT OF VALIDITY AND VALIDATION IN LANGUAGE TESTING

Test-Takers’ Perceptions of the Inclusion of Different English Accent Varieties in the IELTS Listening Tests

The Application of Input-output Hypothesis in English Listening Teaching

Research on the learning/teaching of L2 listening: A bibliometric review and its implications

THE IMPACT OF THE ENGLISH LISTENING TEST IN THE HIGH-STAKES NATIONAL ENTRANCE EXAMINATION ON JUNIOR HIGH SCHOOL STUDENTS AND TEACHERS

A Meta-Analysis of the Reliability of Second Language Listening Tests (1991–2022)

A research on a student-centred teaching model in an ICT-based English audio-video speaking class

What two decades of research into L2 listening in System tells us: Looking back for looking forward

A scoping review of the literature on content and language integrated learning assessment

Input Enhancement on Foreign Language Vocabulary Acquisition: Current Status and Future Prospect

A Study on the Effectiveness of the iTEST Paperless Testing System in English Listening Course

The development of the Language-Independent Speech in Noise and Reverberation test (LISiNaR) and evaluation in listeners with English as a second language