Abstract:Background: In the development of Brain Machine Interfaces (BMIs), there is a great need to enable users to interact with changing environments during the activities of daily life. It is expected that the number and scope of the learning tasks encountered during interaction with the environment as well as the pattern of brain activity will vary over time. These conditions, in addition to neural reorganization, pose a challenge to decoding neural commands for BMIs. We have developed a new BMI framework in which a computational agent symbiotically decoded users' intended actions by utilizing both motor commands and goal information directly from the brain through a continuous Perception-Action-Reward Cycle (PARC). Methodology: The control architecture designed was based on Actor-Critic learning, which is a PARC-based reinforcement learning method. Our neurophysiology studies in rat models suggested that Nucleus Accumbens (NAcc) contained a rich representation of goal information in terms of predicting the probability of earning reward and it could be translated into an evaluative feedback for adaptation of the decoder with high precision. Simulated neural control experiments showed that the system was able to maintain high performance in decoding neural motor commands during novel tasks or in the presence of reorganization in the neural input. We then implanted a dual micro-wire array in the primary motor cortex (M1) and the NAcc of rat brain and implemented a full closed-loop system in which robot actions were decoded from the single unit activity in M1 based on an evaluative feedback that was estimated from NAcc. Conclusions: Our results suggest that adapting the BMI decoder with an evaluative feedback that is directly extracted from the brain is a possible solution to the problem of operating BMIs in changing environments with dynamic neural signals. During closed-loop control, the agent was able to solve a reaching task by capturing the action and reward interdependency in the brain.

System-On-A-Chip Brain-Machine-Interface Design A Review And Perspective

The Next-Generation Brain Machine Interface System for Neuroscience Research and Neuroprosthetics Development

Invasive Brain Machine Interface System.

Brain-machine Interface （BMI） and Cyborg Intelligence

Design of a Closed-Loop, Bidirectional Brain Machine Interface System With Energy Efficient Neural Feature Extraction and PID Control

Electrode materials for brain–machine interface: A review

A Reconfigurable General Behavior Data Acquisition System For Motor Brain Machine Interface

Challenges in Designing a Brain-Machine Search Interface.

The PennBMBI: Design of a General Purpose Wireless Brain-Machine-Brain Interface System

Toward a Brain-Neuromorphics Interface

Decoding Neural Signals with Computational Models: A Systematic Review of Invasive BMI

Defining brain–machine interface applications by matching interface performance with device requirements

Flexible and smart electronics for single-cell resolved brain–machine interfaces

Brain-Machine Interfaces: The Perception-Action Closed Loop: A Two-Learner System

The Brain-Inspired Cooperative Shared Control Framework for Brain-Machine Interface

An integrated brain-machine interface platform with thousands of channels

A symbiotic brain-machine interface through value-based decision making

A Review of EEG-Based Brain-Computer Interface Systems Design

Review of brain encoding and decoding mechanisms for EEG-based brain–computer interface

State-of-the-Art on Brain-Computer Interface Technology