Abstract:Background: Prosthetic hand users have to rely extensively on visual feedback, which seems to lead to a high conscious burden for the users, in order to manipulate their prosthetic devices. Indirect methods (electro-cutaneous, vibrotactile, auditory cues) have been used to convey information from the artificial limb to the amputee, but the usability and advantages of these feedback methods were explored mainly by looking at the performance results, not taking into account measurements of the user's mental effort, attention, and emotions. The main objective of this study was to explore the feasibility of using psycho-physiological measurements to assess cognitive effort when manipulating a robot hand with and without the usage of a sensory substitution system based on auditory feedback, and how these psycho-physiological recordings relate to temporal and grasping performance in a static setting. Methods: 10 male subjects (26+/-years old), participated in this study and were asked to come for 2 consecutive days. On the first day the experiment objective, tasks, and experiment setting was explained. Then, they completed a 30 minutes guided training. On the second day each subject was tested in 3 different modalities: Auditory Feedback only control (AF), Visual Feedback only control (VF), and Audiovisual Feedback control (AVF). For each modality they were asked to perform 10 trials. At the end of each test, the subject had to answer the NASA TLX questionnaire. Also, during the test the subject's EEG, ECG, electro-dermal activity (EDA), and respiration rate were measured. Results: The results show that a higher mental effort is needed when the subjects rely only on their vision, and that this effort seems to be reduced when auditory feedback is added to the human-machine interaction (multimodal feedback). Furthermore, better temporal performance and better grasping performance was obtained in the audiovisual modality. Conclusions: The performance improvements when using auditory cues, along with vision (multimodal feedback), can be attributed to a reduced attentional demand during the task, which can be attributed to a visual "pop-out" or enhance effect. Also, the NASA TLX, the EEG's Alpha and Beta band, and the Heart Rate could be used to further evaluate sensory feedback systems in prosthetic applications.

A Behavior Study of the Effects of Visual Feedback on Motor Output

A Behavior Study on the Effect of Visual Feedback Gain to Force Production

Effect of Visual Feedback on Behavioral Control and Functional Activity During Bilateral Hand Movement

Perceptual Scale Expansion: A Natural Design for Improving the Precision of Motor Control.

Visual Feedback Gain Modulates the Activation of Task-Related Networks and the Suppression of Non-Task Networks During Precise Grasping

The Amount and Pattern of Reciprocal Compensations Predict Performance Stability in a Visually Guided Finger Force Production Task

Effects of Auditory Feedback on Fine Motor Output and Corticomuscular Coherence During a Unilateral Finger Pinch Task

Effect of visual and tactile feedback on kinematic synergies in the grasping hand

Visual feedbacks influence short-term learning of torque versus motion profile with robotic guidance among young adults

Influence of visual feedback on force-EMG curves from spinally innervated versus trigeminally innervated muscles

Feedback Type May Change the EMG Pattern and Kinematics During Robot Supported Upper Limb Reaching Task

Effects of Different Tactile Feedback on Myoelectric Closed-Loop Control for Grasping Based on Electrotactile Stimulation.

Variations in Static Force Control and Motor Unit Behavior with Error Amplification Feedback in the Elderly

Sensorimotor Knowledge From Task-Irrelevant Feedback Contributes To Motor Learning

The impact of objective functions on control policies in closed-loop control of grasping force with a myoelectric prosthesis

Distinct and additive effects of visual and vibratory feedback for motor rehabilitation: an EEG study in healthy subjects

Visuoinertial and visual feedback in online steering control

Immersive Real-Time Biofeedback Optimized With Enhanced Expectancies Improves Motor Learning: A Feasibility Study

Closed-Loop Force Control by Biorealistic Hand Prosthesis With Visual and Tactile Sensory Feedback

Motor Performance, Mental Workload and Self-Efficacy Dynamics during Learning of Reaching Movements throughout Multiple Practice Sessions

Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: a preliminary study