Dental treatment in young handicapped patients

M. Manford,G. Roberts

DOI: https://doi.org/10.1111/j.1365-2044.1980.tb05072.x

IF: 12.893

1980-12-01

Anaesthesia

Abstract:A trial was undertaken to assess the suitability of oxygen/nitrous oxide sedation (relative analgesia) for dental treatment in unmanageable handicapped young patients.

What problem does this paper attempt to address?

Sub-seafloor resistivity sensing using a vertical electrode configuration

T. Ueda,Y. Mitsuhata,Motoharu Jinguji,H. Baba

DOI: https://doi.org/10.1186/1880-5981-66-31

2014-05-06

Abstract:
Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

Baixi Xing,Hui Zhang,Kejun Zhang,Lekai Zhang,Xinda Wu,Xiaoying Shi,Shanghai Yu,Sanyuan Zhang

DOI: https://doi.org/10.1109/ACCESS.2019.2914872

IF: 3.9

2019-01-01

IEEE Access

Abstract:External stimulation, mood swing, and physiological arousal are closely related and induced by each other. The exploration of internal relations between these three aspects is interesting and significant. Currently, video is the most popular multimedia stimuli that can express rich emotional semantics by its visual and auditory features. Apart from the video features, human electroencephalography (EEG) features can provide useful information for video emotion recognition, as they are the direct and instant authentic feedback on human perception with individuality. In this paper, we collected a total of 39 participants' EEG data induced by watching emotional video clips and built a fusion dataset of EEG and video features. Subsequently, the machine-learning algorithms, including Liblinear, REPTree, XGBoost, MultilayerPerceptron, RandomTree, and RBFNetwork were applied to obtain the optimal model for video emotion recognition based on a multi-modal dataset. We discovered that using the data fusion of all-band EEG power spectrum density features and video audio-visual features can achieve the best recognition results. The video emotion classification accuracy achieves 96.79% for valence (Positive/Negative) and 97.79% for arousal (High/Low). The study shows that this method can be a potential method of video emotion indexing for video information retrieval.
Defective forebrain development in mice lacking gp330/megalin.

T. Willnow,J. Hilpert,S. Armstrong,A. Rohlmann,R. Hammer,D. Burns,J. Herz

DOI: https://doi.org/10.1073/PNAS.93.16.8460

1996-08-06

Abstract:gp330/megalin, a member of the low density lipoprotein (LDL) receptor gene family, is expressed on the apical surfaces of epithelial tissues, including the neuroepithelium, where it mediates the endocytic uptake of diverse macromolecules, such as cholesterol-carrying lipoproteins, proteases, and antiproteinases. Megalin knockout mice manifest abnormalities in epithelial tissues including lung and kidney that normally express the protein and they die perinatally from respiratory insufficiency. In brain, impaired proliferation of neuroepithelium produces a holoprosencephalic syndrome, characterized by lack of olfactory bulbs, forebrain fusion, and a common ventricular system. Similar syndromes in humans and animals are caused by insufficient supply of cholesterol during development. Because megalin can bind lipoproteins, we propose that the receptor is part of the maternal-fetal lipoprotein transport system and mediates the endocytic uptake of essential nutrients in the postgastrulation stage.
Multi-modal emotion analysis from facial expressions and electroencephalogram.

Xiaohua Huang,Jukka Kortelainen,Guoying Zhao,Xiaobai Li,Antti Moilanen,Tapio Seppänen,Matti Pietikäinen

DOI: https://doi.org/10.1016/j.cviu.2015.09.015

IF: 4.886

2016-01-01

Computer Vision and Image Understanding

Abstract:Emotion recognition from spontaneous facial expression with a new percentage feature.Extraction and selection of spectral power and spectral power difference features for EEG.A multi-modal emotion recognition for valence and arousal classes.A comparison of multi-modal emotion recognition to human performance for emotion recognition and analysis. Display Omitted Automatic analysis of human spontaneous behavior has attracted increasing attention in recent years from researchers in computer vision. This paper proposes an approach for multi-modal video-induced emotion recognition, based on facial expression and electroencephalogram (EEG) technologies. Spontaneous facial expression is utilized as an external channel. A new feature, formed by percentage of nine facial expressions, is proposed for analyzing the valence and arousal classes. Furthermore, EEG is used as an internal channel supplementing facial expressions for more reliable emotion recognition. Discriminative spectral power and spectral power difference features are exploited for EEG analysis. Finally, these two channels are fused on feature-level and decision-level for multi-modal emotion recognition. Experiments are conducted on MAHNOB-HCI database, including 522 spontaneous facial expression videos and EEG signals from 27 participants. Moreover, human perception in emotion recognition compared to the proposed approach is tested with 10 volunteers. The experimental results and comparisons with the average human performance show the effectiveness of the proposed multi-modal approach.
Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Zhen-Tao Liu,Qiao Xie,Min Wu,Wei-Hua Cao,Dan-Yun Li,Si-Han Li

DOI: https://doi.org/10.1109/tcds.2018.2868121

IF: 4.546

2019-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Electroencephalogram (EEG) emotion recognition based on a hybrid feature extraction method in empirical mode decomposition domain combining with optimal feature selection based on sequence backward selection is proposed, which can reflect subtle information of multiscale components of unstable and nonlinear EEG signals and remove the reductant features to improve the performance of emotion recognition. The proposal is tested on DEAP dataset, in which the emotional states in the Valance dimension and Arousal dimension are classified by both K-nearest neighbor and support vector machine, respectively. In the experiments, temporal windows of different length and three kinds of rhythms of EEG signal are taken into account for comparison, from which the results show that EEG signal with 1s temporal window achieves highest recognition accuracy of 86.46% in Valence dimension and 84.90% in Arousal dimension, respectively, which is superior to some state-of-the-art works. The proposed method would be applied to real-time emotion recognition in multimodal emotional communication-based humans-robots interaction system.
Olfactory Affective Computation Based on EEG Signal Data

Weihui Dai,Xinyue Li,Ziqing Xia,Jintian Zhou,Lijuan Song,Huajuan Mao,Yan Kang

DOI: https://doi.org/10.1109/pic53636.2021.9687068

2021-01-01

Abstract:It is well known that the sense of smell has significant impacts on human moods, therefore olfactory effects have been widely applied to psychological adjustment as well as clinical treatment. Unlike other senses, smell works through the molecules of olfactory stimuli acting on the human nervous system to elicit psychological effects, which is difficult to be accurately described and measured. This makes the commonly used methods hardly applicable to olfactory affective computation. Through analysis of the neural mechanism of human emotions evoked by olfactory sense, this paper specifically designed an EEG experiment to obtain the neural activity data of olfactory stimuli, and compares the clustering characteristics of neural feature data with self-reported scores in PAD emotional space. Thereout, the LS-SVR estimator based on the feature parameters extracted from EEG signal data is proposed for olfactory affective computation. It shows better distinguishing performance and potential reliability than self-reported data, and thus provides an enlightening exploration of this issue.
Emotion recognition with residual network driven by spatial-frequency characteristics of EEG recorded from hearing-impaired adults in response to video clips

Zhongli Bai,Junjie Liu,Fazheng Hou,Yirui Chen,Meiyi Cheng,Zemin Mao,Yu Song,Qiang Gao

DOI: https://doi.org/10.1016/j.compbiomed.2022.106344

IF: 7.7

2022-12-02

Computers in Biology and Medicine

Abstract:In recent years, emotion recognition based on electroencephalography (EEG) signals has attracted plenty of attention. Most of the existing works focused on normal or depressed people. Due to the lack of hearing ability, it is difficult for hearing-impaired people to express their emotions through language in their social activities. In this work, we collected the EEG signals of hearing-impaired subjects when they were watching six kinds of emotional video clips (happiness, inspiration, neutral, anger, fear, and sadness) for emotion recognition. The biharmonic spline interpolation method was utilized to convert the traditional frequency domain features, Differential Entropy (DE), Power Spectral Density (PSD), and Wavelet Entropy (WE) into the spatial domain. The patch embedding (PE) method was used to segment the feature map into the same patch to obtain the differences in the distribution of emotional information among brain regions. For feature classification, a compact residual network with Depthwise convolution (DC) and Pointwise convolution (PC) is proposed to separate spatial and channel mixing dimensions to better extract information between channels. Dependent subject experiments based on 70% training sets and 30% testing sets were performed. The results showed that the average classification accuracies by PE (DE), PE (PSD), and PE (WE) were 91.75%, 85.53%, and 75.68%, respectively which were improved by 11.77%, 23.54%, and 16.61% compared with DE, PSD, and WE. Moreover, the comparison experiments were carried out on the SEED and DEAP datasets with PE (DE), which achieved average accuracies of 90.04% (positive, neutral, and negative) and 88.75% (high valence and low valence). By exploring the emotional brain regions, we found that the frontal, parietal, and temporal lobes of hearing-impaired people were associated with emotional activity compared to normal people whose main emotional brain area was the frontal lobe.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Jiaheng Wang,Yueming Wang,Lin Yao

DOI: https://doi.org/10.7507/1001-5515.202012054

2021-01-01

Abstract:Emotion plays an important role in people's cognition and communication. By analyzing electroencephalogram (EEG) signals to identify internal emotions and feedback emotional information in an active or passive way, affective brain-computer interactions can effectively promote human-computer interaction. This paper focuses on emotion recognition using EEG. We systematically evaluate the performance of state-of-the-art feature extraction and classification methods with a public-available dataset for emotion analysis using physiological signals (DEAP). The common random split method will lead to high correlation between training and testing samples. Thus, we use block-wise fold cross validation. Moreover, we compare the accuracy of emotion recognition with different time window length. The experimental results indicate that 4 s time window is appropriate for sampling. Filter-bank long short-term memory networks (FBLSTM) using differential entropy features as input was proposed. The average accuracy of low and high in valance dimension, arousal dimension and combination of the four in valance-arousal plane is 78.8%, 78.4% and 70.3%, respectively. These results demonstrate the advantage of our emotion recognition model over the current studies in terms of classification accuracy. Our model might provide a novel method for emotion recognition in affective brain-computer interactions.
Odor-induced emotion recognition based on average frequency band division of EEG signals

Hui-Rang Hou,Xiao-Nei Zhang,Qing-Hao Meng

DOI: https://doi.org/10.1016/j.jneumeth.2020.108599

IF: 2.987

2020-03-01

Journal of Neuroscience Methods

Abstract:BackgroundEmotion recognition plays a key role in multimedia. To enhance the sensation of reality, smell has been incorporated into multimedia systems because it can directly stimulate memories and trigger strong emotions.New methodFor the recognition of olfactory-induced emotions, this study explored a combination method using a support vector machine (SVM) with an average frequency band division (AFBD) method, where the AFBD method was proposed to extract the power-spectral-density (PSD) features from electroencephalogram (EEG) signals induced by smelling different odors. The so-called AFBD method means that each PSD feature was calculated based on equal frequency bandwidths, rather than the traditional EEG rhythm-based bandwidth. Thirteen odors were used to induce olfactory EEGs and their corresponding emotions. These emotions were then divided into two types of emotions, pleasure and disgust, or five types of emotions that were very unpleasant, slightly unpleasant, neutral, slightly pleasant, and very pleasant.ResultsComparison between the proposed SVM plus AFBD method and other methods found average accuracies of 98.9% and 88.5% for two- and five-emotion recognition, respectively. These values were considerably higher than those of other combination methods, such as the combinations of AFBD or EEG rhythm-based features with naive Bayesian, k-nearest neighbor classification, voting-extreme learning machine, and backpropagation neural network methods.ConclusionsThe SVM plus AFBD method represents a useful contribution to olfactory-induced emotion recognition. Classification of the five-emotion categories was generally inferior to the classification of the two-emotion categories, suggesting that the recognition performance decreased as the number of emotions in the category increased.

neurosciences,biochemical research methods
Electroencephalogram Emotion Recognition Based on Dispersion Entropy Feature Extraction Using Random Oversampling Imbalanced Data Processing

Xue-Wen Ding,Zhen-Tao Liu,Dan-Yun Li,Yong He,Min Wu

DOI: https://doi.org/10.1109/tcds.2021.3074811

IF: 4.546

2022-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:Electroencephalogram (EEG) is the brain’s electrical activity measure, which can reflect people’s inner emotional states objectively. In this article, a dispersion entropy (DispEn) feature extraction-based EEG emotion recognition method is proposed. In feature extraction, the DispEn is computed for the four typical frequency bands, i.e., $\theta $ , $\alpha $ , $\beta $ , and $\gamma $ of EEG signals which are filtered from 32 channels. Furthermore, a random oversampling algorithm is employed to balance the data for the emotional labels to avoid majority biases. The proposed method not only has a better ability to characterize EEG signals but also has a faster recognition speed. In the experiments, the DEAP dataset is used to validate the effectiveness of the proposal, in which the DispEn is extracted from the undecomposed signal and four typical EEG rhythms are compared for emotion recognition by using a support vector machine (SVM). Besides, comparison experiments using DispEn, sample entropy (SampEn), permutation entropy (PerEn), and three other commonly used statistical features are performed. The experimental results show that the proposed method achieves recognition accuracy in high valence (HV)/low valence (LV) and high arousal (HA)/low arousal (LA) is 72.95% and 76.67%, respectively. The computation cost of DispEn feature extraction is ${O}(N)$ that better than some state-of-the-art methods.
Domain-adaptive emotion recognition based on horizontal vertical flow representation of EEG signals

Zhongli Bai,Zeyu Li,Zhiwei Li,Yu Song,Qiang Gao,Zemin Mao

DOI: https://doi.org/10.1109/access.2023.3270977

IF: 3.9

2023-01-01

IEEE Access

Abstract:With the development of cognitive science and brain science, brain-computer interface technology can use Electroencephalogram (EEG) signals to better represent the inner changes of emotions. In this paper, A video-induced emotional stimulation experimental paradigm was designed, and the EEG signals of 15 hearing-impaired subjects under three emotions (positive, neutral, and negative) were collected. Considering the flow diffusion properties of EEG signals, we used the diffusion effect based on horizontal representation and vertical representation forms to obtain the spatial domain features. After EEG preprocessing, the differential entropy feature (DE) in the frequency domain is extracted. The frequency domain features of 62 channels are delivered to two Bi-directional Long Short-Term Memory (BiLSTM) to obtain spatial domain features of horizontal and vertical representations respectively, and then two kinds of domain features are fused by the residual network. The attention mechanism is applied to effectively extract emotional representational information from the fused features. To solve the cross-subject problem of emotion recognition, the domain adaptation method is utilized, and a center alignment loss function is applied to increase the distance of inter-class and reduce the distance of intra-class. According to the experimental results, the average accuracies of 75.89% (subject- dependent) and 69.59% (cross-subject) are obtained. Moreover, the validation was also performed on the public dataset SEED, achieving average accuracies of 93.99% (subject-dependent) and 84.22% (cross-subject), respectively.

computer science, information systems,telecommunications,engineering, electrical & electronic
Inter-Brain EEG Feature Extraction and Analysis for Continuous Implicit Emotion Tagging During Video Watching

Yue Ding,Xin Hu,Zhenyi Xia,Yong-Jin Liu,Dan Zhang

DOI: https://doi.org/10.1109/taffc.2018.2849758

IF: 13.99

2021-01-01

IEEE Transactions on Affective Computing

Abstract:How to efficiently tag the emotional experience of multimedia contents is an important and challenging problem in the field of affective computing. This paper presents an EEG-based real-time emotion tagging approach, by extracting inter-brain features from a group of participants when they watch the same emotional video clips. First, the continuous subjective reports on both the arousal and valence dimensions of emotion were obtained by employing a three-round behavioral rating paradigm. Second, the inter-brain features were systematically explored in both spectral and temporal domain. Finally, regression analyses were performed to evaluate the effectiveness of inter-brain amplitude and phase features. The inter-brain amplitude feature showed significantly better prediction performance than the inter-brain phase feature, as well as another two conventional features (spectral power and inter-subject correlation). By combining the four types of features, regression values (R2) were obtained for the prediction of arousal (0.61 + 0.01) and valence (0.70 + 0.01), corresponding to prediction errors of 1.01 + 0.02 and 0.78 + 0.02 (unit on 9-point scales), respectively. The contributions of different electrodes and frequency bands were also analyzed. Our results show promising potentials of inter-brain EEG features in real-time emotion tagging applications.
Analysis of the human cofilin 1 structure reveals conformational changes required for actin binding.

M. Klejnot,M. Gabrielsen,Jenifer M. Cameron,Andrzej Mleczak,S. Talapatra,F. Kozielski,A. Pannifer,M. Olson

DOI: https://doi.org/10.1107/S0907444913014418

2013-09-01

Abstract:The actin cytoskeleton is the chassis that gives a cell its shape and structure, and supplies the power for numerous dynamic processes including motility, endocytosis, intracellular transport and division. To perform these activities, the cytoskeleton undergoes constant remodelling and reorganization. One of the major actin-remodelling families are the cofilin proteins, made up of cofilin 1, cofilin 2 and actin-depolymerizing factor (ADF), which sever aged ADP-associated actin filaments to reduce filament length and provide new potential nucleation sites. Despite the significant interest in cofilin as a central node in actin-cytoskeleton dynamics, to date the only forms of cofilin for which crystal structures have been solved are from the yeast, Chromalveolata and plant kingdoms; none have previously been reported for an animal cofilin protein. Two distinct regions in animal cofilin are significantly larger than in the forms previously crystallized, suggesting that they would be uniquely organized. Therefore, it was sought to determine the structure of human cofilin 1 by X-ray crystallography to elucidate how it could interact with and regulate dynamic actin-cytoskeletal structures. Although wild-type human cofilin 1 proved to be recalcitrant, a C147A point mutant yielded crystals that diffracted to 2.8 Å resolution. These studies revealed how the actin-binding helix undergoes a conformational change that increases the number of potential hydrogen bonds available for substrate binding.
Cross-subject emotion EEG signal recognition based on source microstate analysis

Lei Zhang,Di Xiao,Xiaojing Guo,Fan Li,Wen Liang,Bangyan Zhou

DOI: https://doi.org/10.3389/fnins.2023.1288580

IF: 4.3

2023-11-29

Frontiers in Neuroscience

Abstract:Electroencephalogram (EEG) signals are very weak and have low spatial resolution, which has led to less satisfactory accuracy in cross-subject EEG-based emotion classification studies. Microstate analyses of EEG sources can be performed to determine the important spatiotemporal characteristics of EEG signals. Such analyses can be used to cluster rapidly changing EEG signals into multiple brain prototype topographies, fully utilizing the spatial information contained in the EEG signals and providing a neural representation for emotional dynamics. To better utilize the spatial information of brain signals, source localization analysis on the EEG signals was first conducted. Then, a microstate analysis on the source-reconstructed EEG signals is conducted to extract the microstate features of the data. We conducted source microstate analysis on the participant data from the odor-video physiological signal database (OVPD-II) dataset. The experimental results show that the source microstate feature topologies of different participants under the same emotion exhibited a high degree of correlation, which was proven by the analysis of microstate feature topographic maps and the comparison of two-dimensional feature visualization maps of the differential entropy (DE) and power spectral density (PSD). The microstate features represent more abstract emotional information and are more robust. The extracted microstate features were then used with the style transfer mapping method to transfer the feature data from the source domain to the target domain and were then used in support vector machines (SVMs) and convolutional neural networks (CNNs) for emotion recognition. The experimental results show that the cross-subject classification accuracies of the microstate features in SVMs were 84.90 ± 8.24% and 87.43 ± 7.54%, which were 7.19 and 6.95% higher than those obtained with the PSD and 0.51 and 1.79% higher than those obtained with the DE features. In CNN, the average cross-subject classification accuracies of the microstate features were 86.44 and 91.49%, which were 7.71 and 19.41% higher than those obtained with the PSD and 2.7 and 11.76% higher than those obtained with the DE features.

neurosciences
Emotion recognition from users' EEG signals with the help of stimulus VIDEOS

Yachen Zhu,Shangfei Wang,Qiang Ji

DOI: https://doi.org/10.1109/ICME.2014.6890161

2014-01-01

Abstract:In this paper, we propose a novel approach to recognize users' emotions from electroencephalogram (EEG) signals by using stimulus videos as privileged information, which is only available during training. Firstly, five frequency features are extracted from each channel of the EEG signals, and several audio/visual features are extracted from video stimulus. Secondly, features are selected by statistical analyses. Then, a new EEG feature space is constructed using Canonical Correlation Analysis under the help of video content. Finally, a support vector machine is adopted as the classifier on the constructed EEG feature space. Experimental results on two benchmark databases demonstrate that video content, as the context, can improve the emotion recognition performance when employed as privileged information.
MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition

Tengfei Song,Wenming Zheng,Cheng Lu,Yuan Zong,Xilei Zhang,Zhen Cui

DOI: https://doi.org/10.1109/access.2019.2891579

IF: 3.9

2019-01-01

IEEE Access

Abstract:To explore human emotions, in this paper, we design and build a multi-modal physiological emotion database, which collects four modal physiological signals, i.e., electroencephalogram (EEG), galvanic skin response, respiration, and electrocardiogram (ECG). To alleviate the influence of culture dependent elicitation materials and evoke desired human emotions, we specifically collect an emotion elicitation material database selected from more than 1500 video clips. By the considerable amount of strict man-made labeling, we elaborately choose 28 videos as standardized elicitation samples, which are assessed by psychological methods. The physiological signals of participants were synchronously recorded when they watched these standardized video clips that described six discrete emotions and neutral emotion. With three types of classification protocols, different feature extraction methods and classifiers (support vector machine and k-NearestNeighbor) were used to recognize the physiological responses of different emotions, which presented the baseline results. Simultaneously, we present a novel attention-long short-term memory (A-LSTM), which strengthens the effectiveness of useful sequences to extract more discriminative features. In addition, correlations between the EEG signals and the participants' ratings are investigated. The database has been made publicly available to encourage other researchers to use it to evaluate their own emotion estimation methods.

computer science, information systems,telecommunications,engineering, electrical & electronic
Channel attention convolutional aggregation network based on video-level features for EEG emotion recognition

Xin Feng,Ping Cong,Lin Dong,Yongxian Xin,Fengbo Miao,Ruihao Xin

DOI: https://doi.org/10.1007/s11571-023-10034-4

Abstract:Electroencephalogram (EEG) emotion recognition plays a vital role in affective computing. A limitation of the EEG emotion recognition task is that the features of multiple domains are rarely included in the analysis simultaneously because of the lack of an effective feature organization form. This paper proposes a video-level feature organization method to effectively organize the temporal, frequency and spatial domain features. In addition, a deep neural network, Channel Attention Convolutional Aggregation Network, is designed to explore deeper emotional information from video-level features. The network uses a channel attention mechanism to adaptively captures critical EEG frequency bands. Then the frame-level representation of each time point is obtained by multi-layer convolution. Finally, the frame-level features are aggregated through NeXtVLAD to learn the time-sequence-related features. The method proposed in this paper achieves the best classification performance in SEED and DEAP datasets. The mean accuracy and standard deviation of the SEED dataset are 95.80% and 2.04%. In the DEAP dataset, the average accuracy with the standard deviation of arousal and valence are 98.97% ± 1.13% and 98.98% ± 0.98%, respectively. The experimental results show that our approach based on video-level features is effective for EEG emotion recognition tasks.
Comparison of different feature extraction methods for EEG-based emotion recognition

Rab Nawaz,Kit Hwa Cheah,Humaira Nisar,Vooi Voon Yap

DOI: https://doi.org/10.1016/j.bbe.2020.04.005

IF: 5.687

2020-07-01

Biocybernetics and Biomedical Engineering

Abstract:EEG-based emotion recognition is a challenging and active research area in affective computing. We used three-dimensional (arousal, valence and dominance) model of emotion to recognize the emotions induced by music videos. The participants watched a video (1 min long) while their EEG was recorded. The main objective of the study is to identify the features that can best discriminate the emotions. Power, entropy, fractal dimension, statistical features and wavelet energy are extracted from the EEG signals. The effects of these features are investigated and the best features are identified. The performance of the two feature selection methods, Relief based algorithm and principle component analysis (PCA), is compared. PCA is adopted because of its improved performance and the efficacies of the features are validated using support vector machine, K-nearest neighbors and decision tree classifiers. Our system achieves an overall best classification accuracy of 77.62%, 78.96% and 77.60% for valence, arousal and dominance respectively. Our results demonstrated that time-domain statistical characteristics of EEG signals can efficiently discriminate different emotional states. Also, the use of three-dimensional emotion model is able to classify similar emotions that were not correctly classified by two-dimensional model (e.g. anger and fear). The results of this study can be used to support the development of real-time EEG-based emotion recognition systems.

engineering, biomedical
Emotion Recognition of Subjects With Hearing Impairment Based on Fusion of Facial Expression and EEG Topographic Map

Dahua Li,Jiayin Liu,Yi Yang,Fazheng Hou,Haotian Song,Yu Song,Qiang Gao,Zemin Mao

DOI: https://doi.org/10.1109/TNSRE.2022.3225948

IF: 4.9

2023-01-01

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Emotion analysis has been employed in many fields such as human-computer interaction, rehabilitation, and neuroscience. But most emotion analysis methods mainly focus on healthy controls or depression patients. This paper aims to classify the emotional expressions in individuals with hearing impairment based on EEG signals and facial expressions. Two kinds of signals were collected simultaneously when the subjects watched affective video clips, and we labeled the video clips with discrete emotional states (fear, happiness, calmness, and sadness). We extracted the differential entropy (DE) features based on EEG signals and converted DE features into EEG topographic maps (ETM). Next, the ETM and facial expressions were fused by the multichannel fusion method. Finally, ${a}$ deep learning classifier CBAM_ResNet34 combined Residual Network (ResNet) and Convolutional Block Attention Module (CBAM) was used for subject-dependent emotion classification. The results show that the average classification accuracy of four emotions recognition after multimodal fusion achieves 78.32%, which is higher than 67.90% for facial expressions and 69.43% for EEG signals. Moreover, visualization by the Gradient-weighted Class Activation Mapping (Grad-CAM) of ETM showed that the prefrontal, temporal and occipital lobes were the brain regions closely related to emotional changes in individuals with hearing impairment.
Exploring EEG Microstates for Affective Computing: Decoding Valence and Arousal Experiences During Video Watching

Xinke Shen,Xin Hu,Shizhao Liu,Sen Song,Dan Zhang

DOI: https://doi.org/10.1109/embc44109.2020.9175482

2020-01-01

Abstract:Investigating the electroencephalography (EEG) correlates of human emotional experiences has attracted increasing interest in the field of affective computing. Substantial progress has been made during the past decades, mainly by using EEG features extracted from localized brain activities. The present study explored a brain network-based feature defined by EEG microstates for a possible representation of emotional experiences. A publicly available and widely used benchmarking EEG dataset called DEAP was used, in which 32 participants watched 40 one-minute music videos with their 32channel EEG recorded. Four quasi-stable prototypical microstates were obtained, and their temporal parameters were extracted as features. In random forest regression, the microstate features showed better performances for decoding valence (model fitting mean squared error (MSE) = 3.85±0.28 and 4.07 ± 0.30, respectively, p = 0.022) and comparable performances for decoding arousal (MSE = 3.30±0.30 and 3.41 ±0.31, respectively, p = 0.169), as compared to conventional spectral power features. As microstate features describe neural activities from a global spatiotemporal dynamical perspective, our findings demonstrate a possible new mechanism for understanding human emotion and provide a promising type of EEG feature for affective computing.

Dental treatment in young handicapped patients

Sub-seafloor resistivity sensing using a vertical electrode configuration

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

Defective forebrain development in mice lacking gp330/megalin.

Multi-modal emotion analysis from facial expressions and electroencephalogram.

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Olfactory Affective Computation Based on EEG Signal Data

Emotion recognition with residual network driven by spatial-frequency characteristics of EEG recorded from hearing-impaired adults in response to video clips

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Odor-induced emotion recognition based on average frequency band division of EEG signals

Electroencephalogram Emotion Recognition Based on Dispersion Entropy Feature Extraction Using Random Oversampling Imbalanced Data Processing

Domain-adaptive emotion recognition based on horizontal vertical flow representation of EEG signals

Inter-Brain EEG Feature Extraction and Analysis for Continuous Implicit Emotion Tagging During Video Watching

Analysis of the human cofilin 1 structure reveals conformational changes required for actin binding.

Cross-subject emotion EEG signal recognition based on source microstate analysis

Emotion recognition from users' EEG signals with the help of stimulus VIDEOS

MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition

Channel attention convolutional aggregation network based on video-level features for EEG emotion recognition

Comparison of different feature extraction methods for EEG-based emotion recognition

Emotion Recognition of Subjects With Hearing Impairment Based on Fusion of Facial Expression and EEG Topographic Map

Exploring EEG Microstates for Affective Computing: Decoding Valence and Arousal Experiences During Video Watching