Abstract:Background: Multimedia stimulation of brain activity is important for emotion induction. Based on brain activity, emotion recognition using EEG signals has become a hot issue in the field of affective computing. New method: In this paper, we develop a noval odor-video elicited physiological signal database (OVPD), in which we collect the EEG signals from eight participants in positive, neutral and negative emotional states when they are stimulated by synchronizing traditional video content with the odors. To make full use of the EEG features from different domains, we design a 3DCNN-BiLSTM model combining convolutional neural network (CNN) and bidirectional long short term memory (BiLSTM) for EEG emotion recognition. First, we transform EEG signals into 4D representations that retain spatial, frequency and temporal information. Then, the representations are fed into the 3DCNN-BiLSTM model to recognize emotions. CNN is applied to learn spatial and frequency information from the 4D representations. BiLSTM is designed to extract forward and backward temporal dependences. Results: We conduct 5-fold cross validation experiments five times on the OVPD dataset to evaluate the performance of the model. The experimental results show that our presented model achieves an average accuracy of 98.29% with the standard deviation of 0.72% under the olfactory-enhanced video stimuli, and an average accuracy of 98.03% with the standard deviation of 0.73% under the traditional video stimuli on the OVPD dataset in the three-class classification of positive, neutral and negative emotions. To verify the generalisability of our proposed model, we also evaluate this approach on the public EEG emotion dataset (SEED). Comparison with existing method: Compared with other baseline methods, our designed model achieves better recognition performance on the OVPD dataset. The average accuracy of positive, neutral and negative emotions is better in response to the olfactory-enhanced videos than the pure videos for the 3DCNN-BiLSTM model and other baseline methods. Conclusion: The proposed 3DCNN-BiLSTM model is effective by fusing the spatial-frequency-temporal features of EEG signals for emotion recognition. The provided olfactory stimuli can induce stronger emotions than traditional video stimuli and improve the accuracy of emotion recognition to a certain extent. However, superimposing odors unrelated to the video scenes may distract participants' attention, and thus reduce the final accuracy of EEG emotion recognition.

Basic Taste Sensation Recognition from EEG Based on Multiscale Convolutional Neural Network with Residual Learning.

Basic Taste Sensation Recognition from EEG Based on Multi-Scale Convolutional Neural Network with Residual Learning

Bimodal Fusion Network for Basic Taste Sensation Recognition from Electroencephalography and Electromyography

Basic Taste Intensity Recognition Based on Semg and EEG Signals

Feature Extraction and Feature Combination for Basic Taste Sensation Recognition Based on Facial Electromyography

Decoding Taste Information in Human Brain: A Temporal and Spatial Reconstruction Data Augmentation Method Coupled with Taste EEG

Qualitative Recognition of Primary Taste Sensation Based on Surface Electromyography

Decoding human taste perception by reconstructing and mining temporal-spatial features of taste-related EEGs

An in Vivo Bioelectronic Tongue for Sweetness Detection Using Rat Gustatory Perception Based on Brain-Computer Interface

Optimizing food taste sensory evaluation through neural network-based taste electroencephalogram channel selection

TastePeptides-EEG: an Ensemble Model for Umami Taste Evaluation Based on Electroencephalogram and Machine Learning.

A Comprehensive Framework for Decoding Salty Taste Information from EEG Signals: Distinguishing Brain Reactions to Saltiness of Comparable Intensity

SwinTaste: Bimodal Biosignals Taste Sensation Recognition Via Swin Transformer

Insights into Brain Perceptions of the Different Taste Qualities and Hedonic Valence of Food Via Scalp Electroencephalogram

Recognition of odor and pleasantness based on olfactory EEG combined with functional brain network model

Flavor Identification Based on Olfactory-Taste Synesthesia Model and Hybrid Convolutional Neural Network-Random Forest

Advancing research on odor-induced sweetness enhancement: A EEG local-global fusion transformer network for sweetness quantification combined with EEG technology

An efficient CNN-LSTM Network with spectral normalization and label smoothing technologies for SSVEP frequency recognition

Attention-Based Parallel Multiscale Convolutional Neural Network for Visual Evoked Potentials EEG Classification.

Surface Electromyography-Based Recognition of Electronic Taste Sensations

Spatial-frequency-temporal convolutional recurrent network for olfactory-enhanced EEG emotion recognition