Abstract:Cutaneous sensation is vital to controlling our hands and upper limbs. It helps close the motor control loop by informing adjustments of grasping forces during object manipulations and provides much of the information the brain requires to perceive our limbs as a part of our bodies. This sensory information is absent to upper-limb prosthesis users. Although robotic prostheses are becoming increasingly sophisticated, the absence of feedback imposes a reliance on open-loop control and limits the functional potential as an integrated part of the body. Experimental systems to restore physiologically relevant sensory information to prosthesis users are beginning to emerge. However, the impact of their long-term use on functional abilities, body image, and neural adaptation processes remains unclear. Understanding these effects is essential to transition sensate prostheses from sophisticated assistive tools to integrated replacement limbs. We recruited three participants with high-level upper-limb amputation who previously received targeted reinnervation surgery. Each participant was fit with a neural-machine-interface prosthesis that allowed participants to operate their device by thinking about moving their missing limb. Additionally, we fit a sensory feedback system that allowed participants to experience touch to the prosthesis as touch on their missing limb. All three participants performed a long-term take-home trial. Two participants used their neural-machine-interface systems with touch feedback and one control participant used his prescribed, insensate prosthesis. A series of functional outcome metrics and psychophysical evaluations were performed using sensate neural-machine-interface prostheses before and after the take-home period to capture changes in functional abilities, limb embodiment, and neural adaptation. Our results demonstrated that the relationship between users and sensate neural-machine-interface prostheses is dynamic and changes with long-term use. The presence of touch sensation had a near-immediate impact on how the users operated their prostheses. In the multiple independent measures of users' functional abilities employed, we observed a spectrum of performance changes following long-term use. Furthermore, after the take-home period, participants more appropriately integrated their prostheses into their body images and psychophysical tests provided strong evidence that neural and cortical adaptation occurred.

The Three Stages of Learning to Master a Sensory Augmentation Device: Activation - Acquisition - Integration

A Wearable Vision-To-Audio Sensory Substitution Device for Blind Assistance and the Correlated Neural Substrates

Development And Evaluation Of A Multimodal Sensor Motor Learning Assessment

Investigating the Effect of Sensory Concurrency on Learning Haptic Spatiotemporal Signals

Evaluation of a Vision-to-Audition Substitution System that Provides 2D WHERE Information and Fast User Learning

System design for using multimodal trace data in modeling self-regulated learning

Sensorimotor learning for artificial body perception

Learning active sensing strategies using a sensory brain-machine interface.

Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis

Perceiving depth beyond sight: Evaluating intrinsic and learned cues via a proof of concept sensory substitution method in the visually impaired and sighted

A Novel Wearable and Wireless Device to Investigate Perception in Interactive Scenarios

A First Step in Using Machine Learning Methods to Enhance Interaction Analysis for Embodied Learning Environments

Hand-Controlled User Interfacing for Head-Mounted Augmented Reality Learning Environments

POV Learning: Individual Alignment of Multimodal Models using Human Perception

An Integrative Introduction to Human Augmentation Science

Multisensory Perception and Learning: Linking Pedagogy, Psychophysics, and Human-Computer Interaction

Applying the New World Kirkpatrick Model to evaluate an online training course introducing a multi-sensory device

Long-Term Home-Use of Sensory-Motor-Integrated Bidirectional Bionic Prosthetic Arms Promotes Functional, Perceptual, and Cognitive Changes

The Modelfest Perceptual Learning Initiative: A Status Report

Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke

Lessons Learnt from a Multimodal Learning Analytics Deployment In-the-wild