Abstract:Brain–computer interfaces (BCIs) allow information to be transmitted directly from the human brain to a computer, enhancing the ability of human brain activity to interact with the environment. In particular, BCI-based control systems are highly desirable because they can control equipment used by people with disabilities, such as wheelchairs and prosthetic legs. BCIs make use of electroencephalograms (EEGs) to decode the human brain's status. This paper presents an EEG-based facial gesture recognition method based on a self-organizing map (SOM). The proposed facial gesture recognition uses α, β, and θ power bands of the EEG signals as the features of the gesture. The SOM-Hebb classifier is utilized to classify the feature vectors. We utilized the proposed method to develop an online facial gesture recognition system. The facial gestures were defined by combining facial movements that are easy to detect in EEG signals. The recognition accuracy of the system was examined through experiments. The recognition accuracy of the system ranged from 76.90% to 97.57% depending on the number of gestures recognized. The lowest accuracy (76.90%) occurred when recognizing seven gestures, though this is still quite accurate when compared to other EEG-based recognition systems. The implemented online recognition system was developed using MATLAB, and the system took 5.7 s to complete the recognition flow.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to use electroencephalogram (EEG) signals for facial expression recognition. Specifically, the author proposes a method based on Self - Organizing Map (SOM) to recognize facial expressions. This method uses brainwave signals in the α, β and θ frequency bands as features and uses the SOM - Hebb classifier to classify these feature vectors. The main contributions of the paper include: 1. **Utilization of electromyographic signals**: Usually, in EEG analysis, electromyographic signals (such as signals caused by eye movements) are regarded as noise and filtered out. However, these signals can actually better represent the changes in facial expressions. Therefore, instead of filtering these signals, this system effectively uses them to detect facial expressions. 2. **Application of the SOM - Hebb classifier**: The paper shows how to use the SOM - Hebb classifier in EEG - based recognition tasks. The SOM - Hebb classifier is a hybrid network that combines SOM and a single - layer feed - forward neural network. In this network, SOM is used for data clustering, and the feed - forward neural network labels the clusters through a simple Hebbian learning algorithm. 3. **Implementation of an online recognition system**: Many researchers use EEG or ECoG datasets to evaluate their methods, but the author of this paper verifies the recognition performance of the proposed method in a near - real - time environment through experiments. They develop an online facial expression recognition system and test its performance in practical applications. ### Paper Structure - **Introduction**: Introduces the brain - computer interface (BCI) technology and its application background, and emphasizes the importance of EEG signals in BCI. - **Related Work**: Reviews existing BCI systems, including various methods of EEG signal processing and classification. - **Materials and Methods**: Describes in detail the EEG signal collection, feature extraction, and the working principle of the SOM - Hebb classifier. - **Results**: Defines seven facial expressions, describes the design of the experimental system, and shows the experimental results, including the accuracy of recognizing different numbers of facial expressions. - **Conclusion**: Summarizes the main findings of the research and proposes directions for future work. ### Experimental Results - **Facial Expression Definitions**: - G1: Open eyes - G2: Close eyes - G3: Open eyes and clench the right teeth - G4: Open eyes and clench the left teeth - G5: Open eyes wide - G6: Close eyes and clench the right teeth - G7: Close eyes and clench the left teeth - **Recognition Accuracy**: - Recognition of 2 expressions: 97.57% - Recognition of 4 expressions: 94.35% - Recognition of 5 expressions: 92.67% - Recognition of 7 expressions: 76.90% Although the accuracy decreases as the number of recognized facial expressions increases, the overall recognition performance is still relatively high. In particular, for the recognition of 7 expressions, an accuracy of 76.90% is still good in similar studies. ### Summary This paper proposes an innovative EEG - based facial expression recognition method. By using electromyographic signals and the SOM - Hebb classifier, it achieves high - accuracy online recognition. This method is not only innovative in technology but also shows good performance in practical applications.

Electroencephalogram-Based Facial Gesture Recognition Using Self-Organizing Map

Eye-Moving Assisted Eeg Acquisition and Eeg Feature Detection

Rapid Decoding of Hand Gestures in Electrocorticography Using Recurrent Neural Networks.

Gesture recognition by instantaneous surface EMG images

An Iterative Approach for EEG based Rapid Face Search: A Refined Retrieval by Brain Computer Interfaces

Rapid Face Recognition Based On Single-Trial Event-Related Potential Detection Over Multiple Brains

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm

Human-Robot Interaction Based on Biosignals

Gesture Recognition System Based on CNN-IndRNN and OpenBCI

Gesture Decoding Using ECoG Signals from Human Sensorimotor Cortex: A Pilot Study

Brain Computer Interface for Gesture Control of a Social Robot: an Offline Study

A novel EEG decoding method for a facial-expression-based BCI system using the combined convolutional neural network and genetic algorithm

GOM-Face: GKP, EOG, and EMG-based multimodal interface with application to humanoid robot control

Trial of Brain–Computer Interface for Continuous Motion Using Electroencephalography and Electromyography

Intelligent Human-Computer Interaction Based on Surface EMG Gesture Recognition

Self-organizing Maps for Motor Tasks Recognition from Electrical Brain Signals

A Convolutional Spiking Network for Gesture Recognition in Brain-Computer Interfaces

Pattern Recognition Of Motor Imagery Eeg Signal In Noninvasive Brain-Computer Interface

Development of emotion recognition interface using complex EEG/ECG bio-signal for interactive contents

Hand Movement Recognition Using Dynamical Graph Convolutional Neural Network in EEG Source Space