Abstract:Brain–computer interface (BCI) based on motor imagery (MI) supplies a communication method between humans and machines independent of external stimulation. MI is based on the imagination quality of the subjects, which resulted in large variability and unreliability of the signals. Improved MI paradigms and data analysis methods would be helpful to reduce the side effects of the individual specificity and temporal variation, and increase the classification performance of MI-based BCI. Visual guidance could improve the MI quality, but there is a lack of a systematic analysis of the forms of visual guidance and their effects on MI. In this article, we conducted a comparative study to evaluate the MI paradigms with different visual guidance manners. Five paradigms were designed, i.e., pure MI, MI with synchronous pursuit (SP), asynchronous pursuit (AP), synchronous saccade (SS), and asynchronous saccade (AS). Furthermore, a convolutional neural network (CNN) architecture with multiple receptive fields and attention module was proposed. Twenty subjects accomplished the experiments. The SP paradigm induced the most significant event-related desynchronization (ERD) phenomenon and the highest classification accuracy for electroencephalograph (EEG) signals. The proposed network achieved an average classification accuracy of 91.89% and standard deviation of 5.55%, which outperformed the compared methods. To test the applicability of the paradigm and the method, six subjects with different performance in the offline experiment then participated in an online experiment and a simulated brain-controlled trajectory tracking flight of the unmanned aerial vehicle (UAV). All the subjects could accomplish the task, and their performance was positively correlated with the classification accuracy and negatively correlated with the complexity of the tracking path. In general, the SP visual guidance effectively helped the subjects modulate their brain activity, leading to increased MI quality. The convolutional network with multiple receptive fields and an attention module showed the improved classification performance and robustness.

Vision Bionics and Its Application on Design of Multi-Waveband Imaging Guidance Head

Vision bionics and application on the design of imaging guidance head

Assisting the Visually Impaired: Multitarget Warning Through Millimeter Wave Radar and RGB-depth Sensors.

Human-Computer Interaction System Based on Binocular Stereo Vision

Application of Human Vision Bionics in Detection, Estimation and Tracking for Photoelectric Target

IR Guiding Technology Based on Multispectral Imaging for Air to Air Missile

Bionic Vision Imaging Technology Based on Visible and NIR Light

Multispectral Visual Image Processing Method Based on Adaptive Regulation of Humanoid Eye

Design and Implementation of Panorama Vehicle-Mounted Battlefield Perception System Based on Multi-Light Fusion Imaging Technology

Design and Implementation of a Binocular Vision Moving Target Tracking System

Design and Implementation of Multi-sensors Maintenances Guiding System

Research on Wavelet Analysis in Target Detection Based on Bionic Vision Model

Bionic vision inspired on-road obstacle detection and tracking using radar and visual information

The Application of Artificial Compound Eye in Precision Guided Munitions for Urban Combat

Brain-computer Interface Based on Motor Imagery with Visual Guidance and Its Application in Control of Simulated Unmanned Aerial Vehicle

An Eye Tracking based Aircraft Helmet Mounted Display Aiming System

Research and Development of Multi-Freedom Stereovision Navigating System with Biological Vision Mechanisms

The Design of Multi-section Bionic Robot and the Development of Control System

Simulation Designing of Imaging Laser Radar Guidance System

A Method Integrating Human Visual Attention and Consciousness of Radar and Vision Fusion for Autonomous Vehicle Navigation

Research on the Image Fusion and Target Extraction Based on Bionic Compound Eye System