Abstract:A mixed design was created using text and game-like multimedia to instruct in the content of physics. The study assessed which variables predicted learning gains after a 1-h lesson on the electric field. The three manipulated variables were: (1) level of embodiment; (2) level of active generativity; and (3) presence of story narrative. Two types of tests were administered: (1) a traditional text-based physics test answered with a keyboard; and (2) a more embodied, transfer test using the Wacom large tablet where learners could use gestures (long swipes) to create vectors and answers. The 166 participants were randomly assigned to four conditions: (1) symbols and text; (2) low embodied; (3) high embodied/active; or (4) high embodied/active with narrative. The last two conditions were active because the on-screen content could be manipulated with gross body gestures gathered via the Kinect sensor. Results demonstrated that the three groups that included embodiment learned significantly more than the symbols and text group on the traditional keyboard post-test. When knowledge was assessed with the Wacom tablet format that facilitated gestures, the two active gesture-based groups scored significantly higher. In addition, engagement scores were significantly higher for the two active embodied groups. The Wacom results suggest test sensitivity issues; the more embodied test revealed greater gains in learning for the more embodied conditions. We recommend that as more embodied learning comes to the fore, more sensitive tests that incorporate gesture be used to accurately assess learning. The predicted differences in engagement and learning for the condition with the graphically rich story narrative were not supported. We hypothesize that a narrative effect for motivation and learning may be difficult to uncover in a lab experiment where participants are primarily motivated by course credit. Several design principles for mediated and embodied science education are proposed.

Embodied Geometric Reasoning with a Robot: The Impact of Robot Gestures on Student Reasoning about Geometrical Conjectures

Embodied geometric reasoning: Dynamic gestures during intuition, insight, and proof.

Hand Gesture and Mathematics Learning: Lessons From an Avatar

Visualizing Robot Intent for Object Handovers with Augmented Reality

Interactive Robot Learning of Gestures, Language and Affordances

Investigating the role of educational robotics in formal mathematics education: the case of geometry for 15-year-old students

Perceptions of Quantitative and Affective Meaning from Humanoid Robot Hand Gestures

THE EMERGENCE OF PROPORTIONAL REASONING FROM EMBODIED INTERACTION WITH A TABLET APPLICATION: AN EYE-TRACKING STUDY

Closed Loop Interactive Embodied Reasoning for Robot Manipulation

Gestures can help children learn mathematics: how researchers can work with teachers to make gesture studies applicable to classrooms

Embodied science and mixed reality: How gesture and motion capture affect physics education

Hands-On Robotics: Enabling Communication Through Direct Gesture Control

Cooperative gestures for industry: Exploring the efficacy of robot hand configurations in expression of instructional gestures for human–robot interaction

Gesture reveals spatial analogies during complex relational reasoning

Integrating Representational Gestures into Automatically Generated Embodied Explanations and its Effects on Understanding and Interaction Quality

Student visual attention during group instruction phases in collaborative geometry problem solving

The Future of Embodied Design for Mathematics Teaching and Learning

Multivariate evaluation of interactive robot systems

Biomimetic learning of hand gestures in a humanoid robot

Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene

Enhancing Interpretability and Interactivity in Robot Manipulation: A Neurosymbolic Approach