Abstract:The weight-adapted convolution neural network (WACNN) is proposed to extract discriminative expression representations for recognizing facial expression. It aims to make good use of the convolution neural network's (CNN's) potential performance in avoiding local optima and speeding up convergence by the hybrid genetic algorithm (HGA) with optimal initial population, in such a way that it realizes deep and global emotion understanding in human-robot interaction. Moreover, the idea of novelty search is introduced to solve the deception problem in the HGA, which can expend the search space to help genetic algorithm jump out of local optimum and optimize large-scale parameters. In the proposal, the facial expression image preprocessing is conducted first, then the low-level expression features are extracted by using a principal component analysis. Finally, the high-level expression semantic features are extracted and recognized by WACNN which is optimized by HGA. In order to evaluate the effectiveness of WACNN, experiments on JAFFE, CK+, and static facial expressions in the wild 2.0 databases are carried out by using k -fold cross validation, and experimental results show the recognition accuracies of the proposal are superior to that of the state-of-the-art, such as local directional ternary pattern and weighted mixture deep neural network (DNN), which aim to extract discriminative and are the DNN-based methods. Moreover, recognition accuracies of the proposal are also higher than the deep CNN without HGA, which indicates that the proposal has better global optimization ability. Meanwhile, preliminary application experiments are also carried out by using the proposed algorithm on the emotional social robot system, where nine volunteers and two-wheeled robots experience the scenario of emotion understanding. Application results indicate that the wheeled robots can recognize basic expressions, such as happy, surprise, and so on.

Facial Expression Intensity Estimation Based on CNN Features and RankBoost

Fine-Grained Facial Expression Analysis Using Dimensional Emotion Model

Intensity Estimation of the Real-World Facial Expression.

Deep Facial Expression Recognition Using Transfer Learning and Fine-Tuning Techniques

Facial Expression Intensity Estimation Using Ordinal Information

Multi-modal Facial Expression Feature Based on Deep-Neural Networks

Weight-Adapted Convolution Neural Network for Facial Expression Recognition

Effective Facial Expression Recognition via the Boosted Convolutional Neural Network

Recognition of Facial Expression Based on CNN-CBP Features

Boosting-POOF: Boosting Part Based One Vs One Feature for Facial Expression Recognition in the Wild

Dynamic Facial Expression Recognition Using Boosted Component-Based Spatiotemporal Features and Multi-classifier Fusion

Facial Expression Recognition Based on Convolution Neural Network

Facial Expression Recognition Using Hierarchical Features with Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks

Facial Expression Recognition Based on Ensemble of Mulitple CNNs.

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Leveraging 3D Blendshape for Facial Expression Recognition Using CNN

Attention mechanism-based CNN for facial expression recognition

Design and Experiment of Facial Expression Recognition Method Based on LBP and CNN

Uncertain and Biased Facial Expression Recognition Based on Depthwise Separable Convolutional Neural Network with Embedded Attention Mechanism

Facial Expression Recognition Based on Gabor Wavelet Transform and 2-Channel CNN

A discriminative multiscale feature extraction network for facial expression recognition in the wild