Abstract:Motor learning is based on motor perception and emergent perceptual-motor representations. A lot of behavioral research is related to single perceptual modalities but during last two decades the contribution of multimodal perception on motor behavior was discovered more and more. A growing number of studies indicates an enhanced impact of multimodal stimuli on motor perception, motor control and motor learning in terms of better precision and higher reliability of the related actions. Behavioral research is supported by neurophysiological data, revealing that multisensory integration supports motor control and learning. But the overwhelming part of both research lines is dedicated to basic research. Besides research in the domains of music, dance and motor rehabilitation, there is almost no evidence for enhanced effectiveness of multisensory information on learning of gross motor skills. To reduce this gap, movement sonification is used here in applied research on motor learning in sports. Based on the current knowledge on the multimodal organization of the perceptual system, we generate additional real-time movement information being suitable for integration with perceptual feedback streams of visual and proprioceptive modality. With ongoing training, synchronously processed auditory information should be initially integrated into the emerging internal models, enhancing the efficacy of motor learning. This is achieved by a direct mapping of kinematic and dynamic motion parameters to electronic sounds, resulting in continuous auditory and convergent audiovisual or audio-proprioceptive stimulus arrays. In sharp contrast to other approaches using acoustic information as error-feedback in motor learning settings, we try to generate additional movement information suitable for acceleration and enhancement of adequate sensorimotor representations and processible below the level of consciousness. In the experimental setting, participants were asked to learn a closed motor skill (technique acquisition of indoor rowing). One group was treated with visual information and two groups with audiovisual information (sonification vs. natural sounds). For all three groups learning became evident and remained stable. Participants treated with additional movement sonification showed better performance compared to both other groups. Results indicate that movement sonification enhances motor learning of a complex gross motor skill-even exceeding usually expected acoustic rhythmic effects on motor learning.

The effects of auditory consequences on visuomotor adaptation and motor memory

Learning from the Physical Consequences of Our Actions Improves Motor Memory

Memories of Motor Adaptation Do Not Necessarily Decay with Behavioral Unlearning.

Implicit audiomotor adaptation

Reinforcement feedback impairs locomotor adaptation and retention

The perils of learning to move while speaking: One-sided interference between speech and visuomotor adaptation

Interference underlies attenuation upon relearning in sensorimotor adaptation

Variable Neural Contributions to Explicit and Implicit Learning During Visuomotor Adaptation

Taking aim at the perceptual side of motor learning: Exploring how explicit and implicit learning encode perceptual error information through depth vision

Facilitation of motor adaptation using multiple gait rehabilitation interventions

Serial engagement of distinct motor learning mechanisms to alter walking after stroke

Movement Sonification: Effects on Motor Learning beyond Rhythmic Adjustments

Reward enhances motor adaptation learning in acute stroke patients

Audiomotor prediction errors drive speech adaptation even in the absence of overt movement

Neurophysiological evidence of sensory prediction errors driving speech sensorimotor adaptation

Short-Term Modulation of Online Monocular Visuomotor Function

Sensorimotor Adaptation to Formant-Shifted Auditory Feedback Is Predicted by Language-Specific Factors in L1 and L2 Speech Production

Minimal impact of chronic proprioceptive loss on implicit sensorimotor adaptation and perceived movement outcome

Effects of Concussion on the Relative Contributions of Sensorimotor Memories during Adaptation to Unpredictable Spring-Like Loads

Sensorimotor Knowledge From Task-Irrelevant Feedback Contributes To Motor Learning

Motion state-dependent motor learning based on explicit visual feedback is quickly recalled, but is less stable than adaptation to physical perturbations