Abstract:The weight-adapted convolution neural network (WACNN) is proposed to extract discriminative expression representations for recognizing facial expression. It aims to make good use of the convolution neural network's (CNN's) potential performance in avoiding local optima and speeding up convergence by the hybrid genetic algorithm (HGA) with optimal initial population, in such a way that it realizes deep and global emotion understanding in human-robot interaction. Moreover, the idea of novelty search is introduced to solve the deception problem in the HGA, which can expend the search space to help genetic algorithm jump out of local optimum and optimize large-scale parameters. In the proposal, the facial expression image preprocessing is conducted first, then the low-level expression features are extracted by using a principal component analysis. Finally, the high-level expression semantic features are extracted and recognized by WACNN which is optimized by HGA. In order to evaluate the effectiveness of WACNN, experiments on JAFFE, CK+, and static facial expressions in the wild 2.0 databases are carried out by using k -fold cross validation, and experimental results show the recognition accuracies of the proposal are superior to that of the state-of-the-art, such as local directional ternary pattern and weighted mixture deep neural network (DNN), which aim to extract discriminative and are the DNN-based methods. Moreover, recognition accuracies of the proposal are also higher than the deep CNN without HGA, which indicates that the proposal has better global optimization ability. Meanwhile, preliminary application experiments are also carried out by using the proposed algorithm on the emotional social robot system, where nine volunteers and two-wheeled robots experience the scenario of emotion understanding. Application results indicate that the wheeled robots can recognize basic expressions, such as happy, surprise, and so on.

A novel facial expression recognition method based on semantic knowledge of analytical hierarchy process

3D facial expression recognition method based on bimodal and semantic knowledge

Semantic and case-based reasoning for facial expression recognition

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

A facial expression recognition algorithm based on feature fusion and hierarchical decision tree technology

Weight-Adapted Convolution Neural Network for Facial Expression Recognition

Faceknow: Facial Expression Recognition by a Global-Local Network with a Sub-Images-Related Contextual Attention Mechanism

Semantic Knowledge Based On Fuzzy System For Describing Facial Expression

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

A Novel Semantic Approach for Multi-Ethnic Face Recognition

A Novel Automatic Facial Expression Recognition Method Based on AAM

A Novel Neuro Fuzzy Approach to Human Emotion Determination

An efficient facial emotion recognition system using novel deep learning neural network-regression activation classifier

Semantic facial descriptor extraction via Axiomatic Fuzzy Set

A Novel Algorithm of Facial Expression Recognition Based on Discriminative Component Analysis

Human Facial Expression Recognition Based on Mixed Features and Hierarchical Nearest Neighbor Method

New semantic descriptor construction for facial expression recognition based on axiomatic fuzzy set

A New Facial Expression Recognition Method Based on Local Gabor Filter Bank and PCA plus LDA

Facial Expression Recognition Based on Data Field

A Novel Feature Extraction Method for Facial Expression Recognition.