Abstract:Videoconferencing offers new opportunities for language testers to assess speaking ability in low-stakes diagnostic tests. To be considered a trusted testing tool in language testing, a test should be examined employing appropriate validation processes (Chapelle, C.A., Jamieson, J., & Hegelheimer, V. (2003). Validation of a web-based ESL test. Language Testing, 20, 409–439.). While developing a speaking test, language testers need to gather evidence to build a validity argument with theoretical rationales. These rationales should be based on test purpose and validation considerations that affect decision making on test design and validation (Chapelle, C. (2001). Computer applications in second language acquisition: Foundations for teaching, testing, and research. Cambridge: Cambridge University Press.). To obtain theoretical soundness in validation, spec-driven test development (Davidson, F., & Lynch, B. (2002). Testcraft: A teacher's guide to writing and using language test specifications. New Haven, CT and London: Yale University Press.) was applied to speaking test development. Experimental tests were carried out with 40 test takers using face-to-face and videoconferenced oral interviews. Findings indicated no significant difference in performance between test modes, neither overall nor across analytic scoring features. Findings from qualitative data also evidenced the comparability of the videoconferenced and face-to-face interviews in terms of comfort, computer familiarity, environment, non-verbal linguistic cues, interests, speaking opportunity, and topic/situation effects with little interviewer effect. Data taken from test spec evolution, test scores, post interview, and observations were analyzed to build a validity argument using Bachman and Palmer's (1996. Language testing in practice. Oxford: Oxford University Press.) usefulness analysis table. The collected evidence suggests that the videoconferenced interview was comparable to the face-to-face interview with respect to reliability, construct validity, authenticity, interactiveness, impact, and practicality.

Using digital video to measure the professional vision of elementary classroom management: Test validation and methodological challenges

Designing a video-stimulated questionnaire about teachers’ adaptive expertise in interdisciplinary mathematics and science teaching

Measuring classroom management expertise (CME) of teachers: A video-based assessment approach and statistical results

Validation of a videoconferenced speaking test

Promoting Professional Vision of Classroom Management Through Different Analytic Perspectives in Video-Based Learning Environments

Measuring pre-service teachers' decision-making in classroom management: A video-based assessment approach

Signaling cues and focused prompts for professional vision support: The interplay of instructional design and situational interest in preservice teachers’ video analysis

Attentive or Not? Toward a Machine Learning Approach to Assessing Students’ Visible Engagement in Classroom Instruction

Teacher professional knowledge and classroom management: on the relation of general pedagogical knowledge (GPK) and classroom management expertise (CME)

Exploring the Gap Between Evidence and Judgement: Using video vignettes for practice-based assessment of physiotherapy undergraduates

Video viewing in teacher education and professional development: A literature review

Assessing Teachers’ Classroom Management Competency: A Case Study of the Classroom Assessment Scoring System–Secondary

Between authenticity and cognitive demand: Finding a balance in designing a video-based simulation in the context of mathematics teacher education

Classroom chronicles: through the eyeglasses of teachers at varying experience levels

Measuring Classroom Management in Secondary Settings: Ongoing Validation of the Direct Behavior Rating-Classroom Management

Professional Vision and the Compensatory Effect of a Minimal Instructional Intervention: A Quasi-Experimental Eye-Tracking Study With Novice and Expert Teachers

Where experience makes a difference: teachers' judgment accuracy and diagnostic reasoning regarding student learning characteristics

A microanalysis of expert-student dialogue videos: Supporting preparation and learning for clinical competence assessment

Improving Teachers’ Professional Vision Through a Video-based Reflection Program: A Case Study in Mexican Primary Schools

Converging on quality: Examining multiple measures of teaching effectiveness

Exploring student teachers’ professional vision of inclusive classrooms in primary education