Abstract:We focus on data collection designs for the automated analysis of teacher-student interactions in live classrooms with the goal of identifying instructional activities (e.g., lecturing, discussion) and assessing the quality of dialogic instruction (e.g., analysis of questions). Our designs were motivated by multiple technical requirements and constraints. Most importantly, teachers could be individually micfied but their audio needed to be of excellent quality for automatic speech recognition (ASR) and spoken utterance segmentation. Individual students could not be micfied but classroom audio quality only needed to be sufficient to detect student spoken utterances. Visual information could only be recorded if students could not be identified. Design 1 used an omnidirectional laptop microphone to record both teacher and classroom audio and was quickly deemed unsuitable. In Designs 2 and 3, teachers wore a wireless Samson AirLine 77 vocal headset system, which is a unidirectional microphone with a cardioid pickup pattern. In Design 2, classroom audio was recorded with dual first- generation Microsoft Kinects placed at the front corners of the class. Design 3 used a Crown PZM-30D pressure zone microphone mounted on the blackboard to record classroom audio. Designs 2 and 3 were tested by recording audio in 38 live middle school classrooms from six U.S. schools while trained human coders simultaneously performed live coding of classroom discourse. Qualitative and quantitative analyses revealed that Design 3 was suitable for three of our core tasks: (1) ASR on teacher speech (word recognition rate of 66% and word overlap rate of 69% using Google Speech ASR engine); (2) teacher utterance segmentation (F-measure of 97%); and (3) student utterance segmentation (F-measure of 66%). Ideas to incorporate video and skeletal tracking with dual second-generation Kinects to produce Design 4 are discussed.

Extending Record and Playback Technologies to Support Cooperative Learning

Using Distributed Cognition Theory to Analyze Collaborative Computer Science Learning

Facilitating teaching CPS and technology-based content with learning management systems

Smart Classroom: Enhancing Collaborative Learning Using Pervasive Computing Technology

Collaborative Lecturing by Human and Computer Tutors

Classroom eXperience: from automated multimedia capture to personalized learning

Using Web Conferencing to Foster Learning Partnerships in a Team-Based Learning Computer Science Classroom

A First Step in Using Machine Learning Methods to Enhance Interaction Analysis for Embodied Learning Environments

Collaborative Kinesthetic English Learning With Recognition Technology

Enhancing Collaborative Group Processes to Promote Academic Literacy and Content Learning for Diverse Learners Through Video Reflection

Novel Framework for Mobile Collaborative learning (MCL)to substantiate pedagogical activities

Ermdclime: Enabling Real-time Multimedia Discussion for Collaborative Learning in Mobile Environment

Supporting Online Synchronous Education for Software Engineering Via Web-based Operation Record and Replay.

Learning, or Not Learning, Through Multimedia

An Online Education Approach Using Web Operation Record and Replay Techniques

RIMES: Embedding Interactive Multimedia Exercises in Lecture Videos

Information technology enhanced learning in distance and conventional education

Multimodal Capture of Teacher-Student Interactions for Automated Dialogic Analysis in Live Classrooms

A mobile technology‐based cooperative learning platform for undergraduate biology courses in common college classrooms

Tagging and Linking Lecture Audio Recordings: Goals and Practice

Developing and Assessing MATLAB Exercises for Active Concept Learning