Abstract:A mixed design was created using text and game-like multimedia to instruct in the content of physics. The study assessed which variables predicted learning gains after a 1-h lesson on the electric field. The three manipulated variables were: (1) level of embodiment; (2) level of active generativity; and (3) presence of story narrative. Two types of tests were administered: (1) a traditional text-based physics test answered with a keyboard; and (2) a more embodied, transfer test using the Wacom large tablet where learners could use gestures (long swipes) to create vectors and answers. The 166 participants were randomly assigned to four conditions: (1) symbols and text; (2) low embodied; (3) high embodied/active; or (4) high embodied/active with narrative. The last two conditions were active because the on-screen content could be manipulated with gross body gestures gathered via the Kinect sensor. Results demonstrated that the three groups that included embodiment learned significantly more than the symbols and text group on the traditional keyboard post-test. When knowledge was assessed with the Wacom tablet format that facilitated gestures, the two active gesture-based groups scored significantly higher. In addition, engagement scores were significantly higher for the two active embodied groups. The Wacom results suggest test sensitivity issues; the more embodied test revealed greater gains in learning for the more embodied conditions. We recommend that as more embodied learning comes to the fore, more sensitive tests that incorporate gesture be used to accurately assess learning. The predicted differences in engagement and learning for the condition with the graphically rich story narrative were not supported. We hypothesize that a narrative effect for motivation and learning may be difficult to uncover in a lab experiment where participants are primarily motivated by course credit. Several design principles for mediated and embodied science education are proposed.

Gesture analysis for physics education researchers

Embodied science and mixed reality: How gesture and motion capture affect physics education

Teachers' Gestures and How They Matter

Gestures can help children learn mathematics: how researchers can work with teachers to make gesture studies applicable to classrooms

GestureLens: Visual Analysis of Gestures in Presentation Videos

Hand Gesture and Mathematics Learning: Lessons From an Avatar

User-Defined Gestures for Gestural Interaction: Extending from Hands to Other Body Parts

Exploring Individual Differences: A Case for Measuring Children's Spontaneous Gesture Production as a Predictor of Learning From Gesture Instruction

Learners' Spontaneous Gesture Before a Math Lesson Predicts the Efficacy of Seeing Versus Doing Gesture During the Lesson

Student visual attention during group instruction phases in collaborative geometry problem solving

Embodied Geometric Reasoning with a Robot: The Impact of Robot Gestures on Student Reasoning about Geometrical Conjectures

Gesture–speech physics in fluent speech and rhythmic upper limb movements

Embodied physics: Utilizing dance resources for learning and engagement in STEM

Learning Stories Through Gesture: Gesture’s Effects on Child and Adult Narrative Comprehension

3D Gestural Interaction: The State of the Field

Gestures, systemic functional linguistics and mathematics education

The Dynamics of Students' Behaviors and Reasoning during Collaborative Physics Tutorial Sessions

Gesture reveals spatial analogies during complex relational reasoning

Semiotic mediation of gestures in the teaching of early algebra: the case of the equal sign

Uso de gestos-como recurso-mediador-por un profesor de bachillerato para enfrentar un desaf{í}o did{á}ctico no previsto por {é}l

The study of gesture in cognitive linguistics: How it could inform and inspire other research in cognitive science