Abstract:The weight-adapted convolution neural network (WACNN) is proposed to extract discriminative expression representations for recognizing facial expression. It aims to make good use of the convolution neural network's (CNN's) potential performance in avoiding local optima and speeding up convergence by the hybrid genetic algorithm (HGA) with optimal initial population, in such a way that it realizes deep and global emotion understanding in human-robot interaction. Moreover, the idea of novelty search is introduced to solve the deception problem in the HGA, which can expend the search space to help genetic algorithm jump out of local optimum and optimize large-scale parameters. In the proposal, the facial expression image preprocessing is conducted first, then the low-level expression features are extracted by using a principal component analysis. Finally, the high-level expression semantic features are extracted and recognized by WACNN which is optimized by HGA. In order to evaluate the effectiveness of WACNN, experiments on JAFFE, CK+, and static facial expressions in the wild 2.0 databases are carried out by using k -fold cross validation, and experimental results show the recognition accuracies of the proposal are superior to that of the state-of-the-art, such as local directional ternary pattern and weighted mixture deep neural network (DNN), which aim to extract discriminative and are the DNN-based methods. Moreover, recognition accuracies of the proposal are also higher than the deep CNN without HGA, which indicates that the proposal has better global optimization ability. Meanwhile, preliminary application experiments are also carried out by using the proposed algorithm on the emotional social robot system, where nine volunteers and two-wheeled robots experience the scenario of emotion understanding. Application results indicate that the wheeled robots can recognize basic expressions, such as happy, surprise, and so on.

Learning features from covariance matrix of gabor wavelet for face recognition under adverse conditions

Learning a Locality Preserving Subspace for Visual Recognition.

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

LGLG-WPCA: an Effective Texture-based Method for Face Recognition

Gabor Wavelets Transform and Extended Nearest Feature Space Classifier for Face Recognition

Common Vector Analysis Of Gabor Features With Kernel Space Isomorphic Mapping For Face Recognition

CDF Space Covariance Matrix of Gabor Wavelet with Convolutional Neural Network for Texture Recognition.

Face Recognition with Convolutional Neural Networks and subspace learning

Weight-Adapted Convolution Neural Network for Facial Expression Recognition

Pseudo-Gabor wavelet for face recognition

Extended Locally Linear Embedding with Gabor Wavelets for Face Recognition.

Gabor Log-Euclidean Gaussian and its fusion with deep network based on self-attention for face recognition

G-LBP and Variance Cross Projection Function for Face Recognition

Gabor features-based classification using SVM for face recognition

Unified Principal Component Analysis With Generalized Covariance Matrix For Face Recognition

Deep Covariance Descriptors for Facial Expression Recognition

Learning Robust and Discriminative Low-Rank Representations for Face Recognition with Occlusion.

Gabor Binary Codes for Face Recognition

A Face Recognition Algorithm Using Gabor Wavelet and Orthogonal Locality Preserving Projection

2D Gaborface Representation Method for Face Recognition with Ensemble and Multichannel Model.

Face Recognition Based on Local Gabor Binary Patterns and Convolutional Neural Network