Abstract:Motor learning is based on motor perception and emergent perceptual-motor representations. A lot of behavioral research is related to single perceptual modalities but during last two decades the contribution of multimodal perception on motor behavior was discovered more and more. A growing number of studies indicates an enhanced impact of multimodal stimuli on motor perception, motor control and motor learning in terms of better precision and higher reliability of the related actions. Behavioral research is supported by neurophysiological data, revealing that multisensory integration supports motor control and learning. But the overwhelming part of both research lines is dedicated to basic research. Besides research in the domains of music, dance and motor rehabilitation, there is almost no evidence for enhanced effectiveness of multisensory information on learning of gross motor skills. To reduce this gap, movement sonification is used here in applied research on motor learning in sports. Based on the current knowledge on the multimodal organization of the perceptual system, we generate additional real-time movement information being suitable for integration with perceptual feedback streams of visual and proprioceptive modality. With ongoing training, synchronously processed auditory information should be initially integrated into the emerging internal models, enhancing the efficacy of motor learning. This is achieved by a direct mapping of kinematic and dynamic motion parameters to electronic sounds, resulting in continuous auditory and convergent audiovisual or audio-proprioceptive stimulus arrays. In sharp contrast to other approaches using acoustic information as error-feedback in motor learning settings, we try to generate additional movement information suitable for acceleration and enhancement of adequate sensorimotor representations and processible below the level of consciousness. In the experimental setting, participants were asked to learn a closed motor skill (technique acquisition of indoor rowing). One group was treated with visual information and two groups with audiovisual information (sonification vs. natural sounds). For all three groups learning became evident and remained stable. Participants treated with additional movement sonification showed better performance compared to both other groups. Results indicate that movement sonification enhances motor learning of a complex gross motor skill-even exceeding usually expected acoustic rhythmic effects on motor learning.

Can rhythm be touched? An evaluation of rhythmic sketch performance with augmented multimodal feedback

Tactile Apparent Movement As A Modality For Lower Limb Haptic Feedback

Experimental evaluation of haptic enabled interactive motor skill training system

Evaluating tactile feedback in addition to kinesthetic feedback for haptic shape rendering: a pilot study

Development And Evaluation Of A Multimodal Sensor Motor Learning Assessment

Assessing the Impact of Force Feedback in Musical Knobs on Performance and User Experience

Studying Rhythm Processing in Speech Through the Lens of Auditory-Motor Synchronization

Bimanual Coordination Learning with Different Augmented Feedback Modalities and Information Types

The contribution of auditory imagery and visual rhythm perception to sensorimotor synchronization with external and imagined rhythm.

Feedback Type May Change the EMG Pattern and Kinematics During Robot Supported Upper Limb Reaching Task

PalmBeat: A Kinesthetic Way to Feel Groove With Music.

The effects of tactile aids in video games for children's rhythmic coordination training: An fNIRS study

Rhythm perception is shared between audio and haptics

The Effects of Motionless Interventions Based on Visual-Auditory Instructions With Sonification on Learning a Rhythmic Motor Skill

Design and Research of Multimodal Fusion Feedback Device Based on Virtual Interactive System

An electromyogram-based tapping gesture model with differentiated vibration feedback by low-fidelity actuators

Movement Sonification: Effects on Motor Learning beyond Rhythmic Adjustments

Tactile Melodies: A Desk-Mounted Haptics for Perceiving Musical Experiences

Affective Haptics and Multimodal Experiments Research

Learning expressive percussion performance under different visual feedback conditions

Musinger: Communication of Music over a Distance with Wearable Haptic Display and Touch Sensitive Surface