Abstract:Vision and proprioception regulate motor output during reaching. To study the effects of sensory input on motor control, brain computer interfaces (BCIs) offer particular advantages. As part of a long-term clinical BCI trial, we implanted two 96-channel microelectrode arrays into M1 of a person who was completely paralyzed below the neck but retained intact somatosensation. Neural recordings from M1 were transformed into a 2-dimensional velocity control signal for a robotic arm using an optimal linear estimator decoder that was calibrated while the participant imagined performing movements demonstrated by a virtual arm. Once the decoder was calibrated, we asked the participant to move the robotic arm left and right past a pair of lines as many times as possible in one minute. We examined how visual and proprioceptive feedback were incorporated into BCI control during this task by providing the participant with either visual or proprioceptive feedback, both, or neither. Proprioceptive feedback was provided by moving the participant’s own arm to match the movement of the robotic arm. Task performance with vision or proprioception alone was better than when neither were provided. However, providing proprioceptive feedback impaired performance relative to visual feedback alone, unless the decoder was calibrated with neural data collected while both visual and proprioceptive feedback were provided. Providing proprioceptive feedback during decoder calibration rescued performance because it better captured M1’s neural activity during BCI control with proprioceptive feedback. In general, BCI performance was positively correlated with how well the decoder captured variance in neural activity during the task. In summary, we found that while the BCI participant was able to use proprioceptive feedback regardless of whether the decoder was trained with vision only or vision and proprioception, training the decoder with both visual and proprioceptive feedback made performance more robust to the addition or removal of visual or proprioceptive feedback. This was because training a decoder with proprioceptive feedback allows the decoder to take advantage of proprioception-driven activity in M1. Overall, we demonstrated that natural sensation can be effectively combined with BCI to improve performance in humans.

Planning and movement activities co-adapt in a motor-reference frame during 3D BCI-controlled reach adaptation in monkey frontal and parietal cortices

Volitional control of movement interacts with proprioceptive feedback in motor cortex during brain-computer interface control in humans

Towards unlocking motor control in spinal cord injured by applying an online EEG-based framework to decode motor intention, trajectory and error processing

Mapping eye, arm, and reward information in frontal motor cortices using electrocorticography in non-human primates

Concurrent Control of a Brain–computer Interface and Natural Overt Movements

Reconfiguring motor circuits for a joint manual and BCI task

Tracking Neural Modulation Depth by Dual Sequential Monte Carlo Estimation on Point Processes for Brain–Machine Interfaces

Neural Synergies for Controlling Reach and Grasp Movement in Macaques.

Accurate neural control of a hand prosthesis by posture-related activity in the primate grasping circuit

Bi-cephalic parietal and cerebellar direct current stimulation interferes with early error correction in prism adaptation: Toward a complex view of the neural mechanisms underlying visuomotor control

Visuomotor prediction during action planning in the human frontoparietal cortex and cerebellum

Three-Dimensional Brain-Computer Interface Control Through Simultaneous Overt Spatial Attentional and Motor Imagery Tasks

On the Assessment of Functional Connectivity in an Immersive Brain-Computer Interface During Motor Imagery

Neural mechanisms of brain–computer interface control

On the assesment of functional connectivity in an immersive brain-computer interface during motor imagery

Natural movement with concurrent brain-computer interface control induces persistent dissociation of neural activity

Direct Cortical Control of Primate Whole-Body Navigation in a Mobile Robotic Wheelchair

Continuous Decoding of Movement Trajectory During Unimanual Movement Using Bilateral Motor Cortex Signals.

Decoding unconstrained arm movements in primates using high-density electrocorticography signals for brain-machine interface use

A lateralized motor network in order to understand adaptation to visuomotor rotation