Abstract:Background: In the development of Brain Machine Interfaces (BMIs), there is a great need to enable users to interact with changing environments during the activities of daily life. It is expected that the number and scope of the learning tasks encountered during interaction with the environment as well as the pattern of brain activity will vary over time. These conditions, in addition to neural reorganization, pose a challenge to decoding neural commands for BMIs. We have developed a new BMI framework in which a computational agent symbiotically decoded users' intended actions by utilizing both motor commands and goal information directly from the brain through a continuous Perception-Action-Reward Cycle (PARC). Methodology: The control architecture designed was based on Actor-Critic learning, which is a PARC-based reinforcement learning method. Our neurophysiology studies in rat models suggested that Nucleus Accumbens (NAcc) contained a rich representation of goal information in terms of predicting the probability of earning reward and it could be translated into an evaluative feedback for adaptation of the decoder with high precision. Simulated neural control experiments showed that the system was able to maintain high performance in decoding neural motor commands during novel tasks or in the presence of reorganization in the neural input. We then implanted a dual micro-wire array in the primary motor cortex (M1) and the NAcc of rat brain and implemented a full closed-loop system in which robot actions were decoded from the single unit activity in M1 based on an evaluative feedback that was estimated from NAcc. Conclusions: Our results suggest that adapting the BMI decoder with an evaluative feedback that is directly extracted from the brain is a possible solution to the problem of operating BMIs in changing environments with dynamic neural signals. During closed-loop control, the agent was able to solve a reaching task by capturing the action and reward interdependency in the brain.

Brain-machine Interface （BMI） and Cyborg Intelligence

Invasive Brain Machine Interface System.

System-On-A-Chip Brain-Machine-Interface Design A Review And Perspective

The Next-Generation Brain Machine Interface System for Neuroscience Research and Neuroprosthetics Development

Defining brain–machine interface applications by matching interface performance with device requirements

Brain-Machine Interface-Based Rat-Robot Behavior Control.

Human Mind Control of Rat Cyborg’s Continuous Locomotion with Wireless Brain-to-Brain Interface

The Brain-Inspired Cooperative Shared Control Framework for Brain-Machine Interface

A symbiotic brain-machine interface through value-based decision making

Neuromorphic computing facilitates deep brain-machine fusion for high-performance neuroprosthesis

Brain-Machine Interfaces: The Perception-Action Closed Loop: A Two-Learner System

Brain-machine interfaces researches in rats

A Reconfigurable General Behavior Data Acquisition System For Motor Brain Machine Interface

A multi-step neural control for motor brain-machine interface by reinforcement learning

Decoding motor plans using a closed-loop ultrasonic brain–machine interface

A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control

Machine-vision fused brain machine interface based on dynamic augmented reality visual stimulation

A brain machine interface framework for exploring proactive control of smart environments

Challenges in Designing a Brain-Machine Search Interface.

How using brain-machine interfaces influences the human sense of agency

Real-time brain machine interaction via social robot gesture control