Abstract:Background: In the development of Brain Machine Interfaces (BMIs), there is a great need to enable users to interact with changing environments during the activities of daily life. It is expected that the number and scope of the learning tasks encountered during interaction with the environment as well as the pattern of brain activity will vary over time. These conditions, in addition to neural reorganization, pose a challenge to decoding neural commands for BMIs. We have developed a new BMI framework in which a computational agent symbiotically decoded users' intended actions by utilizing both motor commands and goal information directly from the brain through a continuous Perception-Action-Reward Cycle (PARC). Methodology: The control architecture designed was based on Actor-Critic learning, which is a PARC-based reinforcement learning method. Our neurophysiology studies in rat models suggested that Nucleus Accumbens (NAcc) contained a rich representation of goal information in terms of predicting the probability of earning reward and it could be translated into an evaluative feedback for adaptation of the decoder with high precision. Simulated neural control experiments showed that the system was able to maintain high performance in decoding neural motor commands during novel tasks or in the presence of reorganization in the neural input. We then implanted a dual micro-wire array in the primary motor cortex (M1) and the NAcc of rat brain and implemented a full closed-loop system in which robot actions were decoded from the single unit activity in M1 based on an evaluative feedback that was estimated from NAcc. Conclusions: Our results suggest that adapting the BMI decoder with an evaluative feedback that is directly extracted from the brain is a possible solution to the problem of operating BMIs in changing environments with dynamic neural signals. During closed-loop control, the agent was able to solve a reaching task by capturing the action and reward interdependency in the brain.

Human in the collaborative loop: a strategy for integrating human activity recognition and non-invasive brain-machine interfaces to control collaborative robots

The Brain-Inspired Cooperative Shared Control Framework for Brain-Machine Interface

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Towards a Safe Human-Robot Collaboration Using Information on Human Worker Activity

A Human-Machine Joint Learning Framework to Boost Endogenous BCI Training

A closed-loop brain-computer interface with augmented reality feedback for industrial human-robot collaboration

Coordinating human-robot collaboration by EEG-based human intention prediction and vigilance control

An adaptive human sensor framework for human–robot collaboration

Real-time brain machine interaction via social robot gesture control

Non-invasive brain-machine interface control with artificial intelligence copilots

A symbiotic brain-machine interface through value-based decision making

A Vision-based Human Digital Twin Modelling Approach for Adaptive Human-Robot Collaboration

Enhancing Human Activity Recognition through Integrated Multimodal Analysis: A Focus on RGB Imaging, Skeletal Tracking, and Pose Estimation

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

A High‐Precision Dynamic Movement Recognition Algorithm Using Multimodal Biological Signals for Human–Machine Interaction

Robotic arm control using hybrid brain-machine interface and augmented reality feedback

Study of Human–Robot Interactions for Assistive Robots Using Machine Learning and Sensor Fusion Technologies

Closed-Loop Hybrid Gaze Brain-Machine Interface Based Robotic Arm Control with Augmented Reality Feedback

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information

Passive Brain-Computer Interfaces for Enhanced Human-Robot Interaction

Benchmarking Adaptive Intelligence and Computer Vision on Human-Robot Collaboration