Abstract:Introduction: This study investigates the multifaceted nature of motor learning in a complex bimanual task by examining the interplay between mental representation structures, biomechanics, tactile pressure, and performance. We developed a novel maze game requiring participants to maneuver a rolling sphere through a maze, exemplifying complex sequential coordination of vision and haptic control using both hands. A key component of this study is the introduction of cognitive primitives, fundamental units of cognitive and motor actions that represent specific movement patterns and strategies. Methods: Participants were divided into two groups based on initial performance: poor performers (PPG) and good performers (GPG). The experimental setup employed motion capture and innovative tactile sensors to capture a detailed multimodal picture of the interaction process. Our primary aims were to (1) assess the effects of daily practice on task performance, biomechanics, and tactile pressure, (2) examine the relationship between changes in mental representation structures and skill performance, and (3) explore the interplay between biomechanics, tactile pressure, and cognitive representation in motor learning. Results: Performance analysis showed that motor skills improved with practice, with the GPG outperforming the PPG in maze navigation efficiency. Biomechanical analysis revealed that the GPG demonstrated superior movement strategies, as indicated by higher peak velocities and fewer velocity peaks during task execution. Tactile feedback analysis showed that GPG participants applied more precise and focused pressure with their right-hand thumb, suggesting enhanced motor control. Cognitively, both groups refined their mental representation structures over time, but the GPG exhibited a more structured and sophisticated cognitive mapping of the task post-practice. Discussion: The findings highlight the intertwined nature of biomechanical control, tactile feedback, and cognitive processing in motor skill acquisition. The results support established theories, such as the cognitive action architecture approach, emphasizing the role of mental representation in planning and executing motor actions. The integration of cognitive primitives in our analysis provides a theoretical framework that connects observable behaviors to underlying cognitive strategies, enhancing the understanding of motor learning across various contexts. Our study underscores the necessity of a holistic approach to motor learning research, recognizing the complex interaction between cognitive and motor processes in skill acquisition.

Towards the design of augmented feedforward and feedback for sensorimotor learning of motor skills

Sensori-Motor Learning with Movement Sonification: Perspectives from Recent Interdisciplinary Studies

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

A system for efficient motor learning using multimodal augmented feedback

Gamified Motor Learning Through High-Fidelity Sensor Technology

An environment for motor skill transfer based on wearable haptic communication

De Novo Sensorimotor Learning Through Reuse of Movement Components

A design science exploration of a visual-spatial learning system with feedback

Communicating Inferred Goals with Passive Augmented Reality and Active Haptic Feedback

Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance Systems

Comparative analysis of motor skill acquisition in a novel bimanual task: the role of mental representation and sensorimotor feedback

Exploring the bases for a mixed reality stroke rehabilitation system, Part II: design of interactive feedback for upper limb rehabilitation

Measuring and monitoring skill learning in closed-loop myoelectric hand prostheses using speed-accuracy tradeoffs

Keep Calm and Do Not Carry-Forward: Toward Sensor-Data Driven AI Agent to Enhance Human Learning

Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis

Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke

Ongoing tracking of engagement in motor learning

An Augmented Reality Environment to Provide Visual Feedback to Amputees During sEMG Data Acquisitions

User Training with Error Augmentation for Electromyogram-based Gesture Classification

Experiments with a Social Learning Model