Abstract:The weight-adapted convolution neural network (WACNN) is proposed to extract discriminative expression representations for recognizing facial expression. It aims to make good use of the convolution neural network's (CNN's) potential performance in avoiding local optima and speeding up convergence by the hybrid genetic algorithm (HGA) with optimal initial population, in such a way that it realizes deep and global emotion understanding in human-robot interaction. Moreover, the idea of novelty search is introduced to solve the deception problem in the HGA, which can expend the search space to help genetic algorithm jump out of local optimum and optimize large-scale parameters. In the proposal, the facial expression image preprocessing is conducted first, then the low-level expression features are extracted by using a principal component analysis. Finally, the high-level expression semantic features are extracted and recognized by WACNN which is optimized by HGA. In order to evaluate the effectiveness of WACNN, experiments on JAFFE, CK+, and static facial expressions in the wild 2.0 databases are carried out by using k -fold cross validation, and experimental results show the recognition accuracies of the proposal are superior to that of the state-of-the-art, such as local directional ternary pattern and weighted mixture deep neural network (DNN), which aim to extract discriminative and are the DNN-based methods. Moreover, recognition accuracies of the proposal are also higher than the deep CNN without HGA, which indicates that the proposal has better global optimization ability. Meanwhile, preliminary application experiments are also carried out by using the proposed algorithm on the emotional social robot system, where nine volunteers and two-wheeled robots experience the scenario of emotion understanding. Application results indicate that the wheeled robots can recognize basic expressions, such as happy, surprise, and so on.

A Loss Function Base on Softmax for Expression Recognition

A Loss Combination Based Deep Model for Person Re-Identification

Accurate and Reliable Facial Expression Recognition Using Advanced Softmax Loss with Fixed Weights

EnhanceFace: Adaptive Weighted SoftMax Loss for Deep Face Recognition

Angle-based Softmax Loss for Face Verification

Class-Variant Margin Normalized Softmax Loss for Deep Face Recognition

Ensemble Soft-Margin Softmax Loss for Image Classification

CosFace: Large Margin Cosine Loss for Deep Face Recognition

Loss Function Search for Face Recognition

Weight-Adapted Convolution Neural Network for Facial Expression Recognition

X2-Softmax: Margin adaptive loss function for face recognition

Misclassification-guided loss under the weighted cross-entropy loss framework

Adaptive Sparse Softmax: An Effective and Efficient Softmax Variant for Text Classification

On the Learning Property of Logistic and Softmax Losses for Deep Neural Networks

Inter-Class Angular Loss for Convolutional Neural Networks.

Sample hardness guided softmax loss for face recognition

Chi-square Loss for Softmax: an Echo of Neural Network Structure

Semantic Softmax Loss for Zero-Shot Learning

Combination of Valence-Sensitive Loss with Restrictive Center Loss for Facial Expression Recognition

Large-Margin Regularized Softmax Cross-Entropy Loss

Bi-Center Loss for Compound Facial Expression Recognition