Abstract:Objective: Brain-computer interface (BCI) control systems monitor neural activity to detect the user's intentions, enabling device control through mental imagery. Despite their potential, decoding neural activity in real-world conditions poses significant challenges, making BCIs currently impractical compared to traditional interaction methods. This study introduces a novel motor imagery (MI) BCI control strategy for operating a physically assistive robotic arm, addressing the difficulties of MI decoding from electroencephalogram (EEG) signals, which are inherently non-stationary and vary across individuals. Approach: A proof-of-concept BCI control system was developed using commercially available hardware, integrating MI with eye tracking in an augmented reality (AR) user interface to facilitate a shared control approach. This system proposes actions based on the user's gaze, enabling selection through imagined movements. A user study was conducted to evaluate the system's usability, focusing on its effectiveness and efficiency. Main results: Participants performed tasks that simulated everyday activities with the robotic arm, demonstrating the shared control system's feasibility and practicality in real-world scenarios. Despite low online decoding performance (mean accuracy: 0.52 9, F1: 0.29, Cohen's Kappa: 0.12), participants achieved a mean success rate of 0.83 in the final phase of the user study when given 15 minutes to complete the evaluation tasks. The success rate dropped below 0.5 when a 5-minute cutoff time was selected. Significance: These results indicate that integrating AR and eye tracking can significantly enhance the usability of BCI systems, despite the complexities of MI-EEG decoding. While efficiency is still low, the effectiveness of our approach was verified. This suggests that BCI systems have the potential to become a viable interaction modality for everyday applications in the future.

Decoding Multi-class Motor-related Intentions with User-optimized and Robust BCI System Based on Multimodal Dataset

Decoding Multi-Class Motor Imagery from Unilateral Limbs Using EEG Signals

Enhanced Motor Imagery Decoding by Calibration Model-Assisted with Tactile ERD

Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

A Motor Imagery Signals Classification Method via the Difference of EEG Signals Between Left and Right Hemispheric Electrodes

A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

Decoding Continual Muscle Movements Related to Complex Hand Grasping from EEG Signals

Flexible coding scheme for robotic arm control driven by motor imagery decoding

Decoding of Grasp Motions from EEG Signals Based on a Novel Data Augmentation Strategy

Motor Imagery Classification of Single-Arm Tasks Using Convolutional Neural Network based on Feature Refining

Decoding Multi-Class EEG Signals of Hand Movement Using Multivariate Empirical Mode Decomposition and Convolutional Neural Network

Decoding Hand Movement Types and Kinematic Information From Electroencephalogram

Decoding Movement Imagination and Execution from EEG Signals using BCI-Transfer Learning Method based on Relation Network

Motor Imagery Classification Emphasizing Corresponding Frequency Domain Method based on Deep Learning Framework

Exploring Feature Selection and Classification Techniques to Improve the Performance of an Electroencephalography-Based Motor Imagery Brain-Computer Interface System

Brain Computer Interface Based on Motor Imagery for Mechanical Arm Grasp Control

A shared robot control system combining augmented reality and motor imagery brain-computer interfaces with eye tracking

Discriminating hand gesture motor imagery tasks using cortical current density estimation

Motor Imagery Classification for Asynchronous EEG-Based Brain–Computer Interfaces

An optimized EEGNet decoder for decoding motor image of four class fingers flexion

Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model