Abstract:A mixed design was created using text and game-like multimedia to instruct in the content of physics. The study assessed which variables predicted learning gains after a 1-h lesson on the electric field. The three manipulated variables were: (1) level of embodiment; (2) level of active generativity; and (3) presence of story narrative. Two types of tests were administered: (1) a traditional text-based physics test answered with a keyboard; and (2) a more embodied, transfer test using the Wacom large tablet where learners could use gestures (long swipes) to create vectors and answers. The 166 participants were randomly assigned to four conditions: (1) symbols and text; (2) low embodied; (3) high embodied/active; or (4) high embodied/active with narrative. The last two conditions were active because the on-screen content could be manipulated with gross body gestures gathered via the Kinect sensor. Results demonstrated that the three groups that included embodiment learned significantly more than the symbols and text group on the traditional keyboard post-test. When knowledge was assessed with the Wacom tablet format that facilitated gestures, the two active gesture-based groups scored significantly higher. In addition, engagement scores were significantly higher for the two active embodied groups. The Wacom results suggest test sensitivity issues; the more embodied test revealed greater gains in learning for the more embodied conditions. We recommend that as more embodied learning comes to the fore, more sensitive tests that incorporate gesture be used to accurately assess learning. The predicted differences in engagement and learning for the condition with the graphically rich story narrative were not supported. We hypothesize that a narrative effect for motivation and learning may be difficult to uncover in a lab experiment where participants are primarily motivated by course credit. Several design principles for mediated and embodied science education are proposed.

Using conceptual blending to describe emergent meaning in wave propagation

How to Blend Concepts in Diffusion Models

Making Sense of How Students Make Sense of Mechanical Waves

Narratives of Blended Experience

Towards the QFT on Curved Spacetime Limit of QGR. II: A Concrete Implementation

VisibleSound: Perceiving Environmental Sound with 4D Form

DesignFusion: Integrating Generative Models for Conceptual Design Enrichment

Analyzing students collaboratively solving spherical unit vector problems in upper level E and M through a lens of shared resources

COMPARATIVE SEMANTICS: AN INTRODUCTION TO CONCEPTUAL BLENDING THEORY

Blending physical knowledge with mathematical form in physics problem solving

Investigating Conceptual Blending of a Diffusion Model for Improving Nonword-to-Image Generation

Visual Conceptual Blending with Large-scale Language and Vision Models

A multimodal approach to coding discourse: Collaboration, distributed cognition, and geometric reasoning

Realizing Vygotsky's program concerning language and thought: tracking knowing (ideas, conceptions, beliefs) in real time

Multiple Conceptual Coherences in the Speed Tutorial: Micro-processes of Local Stability

CompositingVis: Exploring Interactions for Creating Composite Visualizations in Immersive Environments

Shape-shifting: How boundary objects affect meaning-making across visual, verbal, and embodied modes

Immersive WYSIWYG (what You See is What You Get) Volume Visualization

Immersive virtual reality (VR) for digital media making: transmediation is key

Embodied science and mixed reality: How gesture and motion capture affect physics education