Abstract:The weight-adapted convolution neural network (WACNN) is proposed to extract discriminative expression representations for recognizing facial expression. It aims to make good use of the convolution neural network's (CNN's) potential performance in avoiding local optima and speeding up convergence by the hybrid genetic algorithm (HGA) with optimal initial population, in such a way that it realizes deep and global emotion understanding in human-robot interaction. Moreover, the idea of novelty search is introduced to solve the deception problem in the HGA, which can expend the search space to help genetic algorithm jump out of local optimum and optimize large-scale parameters. In the proposal, the facial expression image preprocessing is conducted first, then the low-level expression features are extracted by using a principal component analysis. Finally, the high-level expression semantic features are extracted and recognized by WACNN which is optimized by HGA. In order to evaluate the effectiveness of WACNN, experiments on JAFFE, CK+, and static facial expressions in the wild 2.0 databases are carried out by using k-fold cross validation, and experimental results show the recognition accuracies of the proposal are superior to that of the state-of-the-art, such as local directional ternary pattern and weighted mixture deep neural network (DNN), which aim to extract discriminative and are the DNN-based methods. Moreover, recognition accuracies of the proposal are also higher than the deep CNN without HGA, which indicates that the proposal has better global optimization ability. Meanwhile, preliminary application experiments are also carried out by using the proposed algorithm on the emotional social robot system, where nine volunteers and two-wheeled robots experience the scenario of emotion understanding. Application results indicate that the wheeled robots can recognize basic expressions, such as happy, surprise, and so on.

Optimal Gabor Feature for Facial Expression Recognition

Face Recognition Using Ada-Boosted Gabor Features

Robust Feature Extracted by the Generalized Optimal Discriminant Vectors for Face Recognition

Facial Expression Recognition Based on Gabor Feature and Adaboost

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

AdaBoost Gabor Fisher Classifier for Face Recognition

Gabor Boost Linear Discriminant Analysis for face recognition

Novel face detection method based on gabor features

Gabor Wavelets Transform and Extended Nearest Feature Space Classifier for Face Recognition

A hierarchical algorithm with multi-feature fusion for facial expression recognition

Feature Level Analysis for 3D Facial Expression Recognition.

Facial Expression Recognition Based on G-2DPCA Feature and Sparse Representation Classification

Multiple Fisher Classifiers Combination for Face Recognition Based on Grouping AdaBoosted Gabor Features.

Expression Recognition Based on Variant Sampling Method and Gabor Features

Face Recognition Using Gabor-based Complete Kernel Fisher Discriminant Analysis with Fractional Power Polynomial Models

Face recognition with the robust feature extracted by the generalized Foley-Sammon transform

Facial Expression Recognition Based on Gabor Wavelet Transform and 2-Channel CNN

Human vision inspired feature extraction for facial expression recognition

Video-Based Facial Expression Recognition Using Histogram Sequence of Local Gabor Binary Patterns from Three Orthogonal Planes

Weight-Adapted Convolution Neural Network for Facial Expression Recognition in Human–Robot Interaction

A high precision feature based on LBP and Gabor theory for face recognition