Abstract:Objectives. Coadaptive brain-machine interfaces (BMIs) allow subjects and external devices to adapt to each other during the closed-loop control, which provides a promising solution for paralyzed individuals. Previous studies have focused on either improving sensory feedback to facilitate subject learning or developing adaptive algorithms to maintain stable decoder performance. In this work, we aim to design an efficient coadaptive BMI framework which not only facilitates the learning of subjects on new tasks with designed sensory feedback, but also improves decoders' learning ability by extracting sensory feedback-induced evaluation information. Approach. We designed audio feedback during the trial according to the subjects' performance when they were trained to learn a new behavioral task. We compared the learning performance of two groups of Sprague Dawley rats, one with and the other without audio feedback to show whether this audio feedback could facilitate the subjects' learning. Compared with the traditional closed-loop in BMI systems, an additional closed-loop involving medial prefrontal cortex (mPFC) activity was introduced into the coadaptive framework. The neural dynamics of audio-induced mPFC activity was analyzed to investigate whether a significant neural response could be triggered. This audio-induced response was then translated into reward expectation information to guide the learning of decoders on a new task . The multiday decoding performance of the decoders with and without audio-induced reward expecation was compared to investigate whether the extracted information could accelerate decoders to learn a new task. Main results. The behavior performance comparison showed that the average days for rats to achieve 80% well-trained behavioral performance was improved by 26.4% after introducing the designed audio feedback sequence. The analysis of neural dynamics showed that a significant neural response of mPFC activity could be elicited by the audio feedback and the visualization of audio-induced neural patterns was emerged and accompanied by the behavioral improvement of subjects. The multiday decoding performance comparison showed that the decoder taking the reward expectation information could achieve faster task learning by 33.8% on average across subjects. Significance. This study demonstrates that the designed audio feedback could improve the learning of subjects and the mPFC activity induced by audio feedback can be utilized to improve the decoder's learning efficiency on new tasks. The coadaptive framework involving mPFC dynamics in the closed-loop interaction can advance the BMIs into a more adaptive and efficient system with learning ability on new tasks.

Intermediate Sensory Feedback Assisted Multi-Step Neural Decoding for Reinforcement Learning Based Brain-Machine Interfaces

A multi-step neural control for motor brain-machine interface by reinforcement learning

Neural Control of a Tracking Task Via Attention-Gated Reinforcement Learning for Brain-Machine Interfaces

Quantized Attention-Gated Kernel Reinforcement Learning for Brain-Machine Interface Decoding.

Fast and Accurate Decoding of Finger Movements from ECoG Through Riemannian Features and Modern Machine Learning Techniques

Tracking Neural Modulation Depth by Dual Sequential Monte Carlo Estimation on Point Processes for Brain–Machine Interfaces

Hidden Brain State-Based Internal Evaluation Using Kernel Inverse Reinforcement Learning in Brain-Machine Interfaces

Real-time Decoding Algorithm in Brain Machine Interfaces

A Pilot Study on Two Stage Decoding Strategies.

Decoding the Nonstationary Neural Activity in Motor Cortex for Brain Machine Interfaces

Local-learning-based Neuron Selection for Grasping Gesture Prediction in Motor Brain Machine Interfaces

Adaptive Decoding for Brain-Machine Interfaces Through Bayesian Parameter Updates

Robust neural decoding by kernel regression with Siamese representation learning

A symbiotic brain-machine interface through value-based decision making

Kernel Reinforcement Learning-Assisted Adaptive Decoder Facilitates Stable and Continuous Brain Control Tasks

Neural Decoding Based on Probabilistic Neural Network

A Human-Machine Joint Learning Framework to Boost Endogenous BCI Training

Maximum Correntropy Based Attention-Gated Reinforcement Learning Designed for Brain Machine Interface.

Decoding Grasp Movement from Monkey Premotor Cortex for Real-time Prothetic Hand Control

Audio-induced medial prefrontal cortical dynamics enhances coadaptive learning in brain-machine interfaces

A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control