Abstract:The weight-adapted convolution neural network (WACNN) is proposed to extract discriminative expression representations for recognizing facial expression. It aims to make good use of the convolution neural network's (CNN's) potential performance in avoiding local optima and speeding up convergence by the hybrid genetic algorithm (HGA) with optimal initial population, in such a way that it realizes deep and global emotion understanding in human-robot interaction. Moreover, the idea of novelty search is introduced to solve the deception problem in the HGA, which can expend the search space to help genetic algorithm jump out of local optimum and optimize large-scale parameters. In the proposal, the facial expression image preprocessing is conducted first, then the low-level expression features are extracted by using a principal component analysis. Finally, the high-level expression semantic features are extracted and recognized by WACNN which is optimized by HGA. In order to evaluate the effectiveness of WACNN, experiments on JAFFE, CK+, and static facial expressions in the wild 2.0 databases are carried out by using k-fold cross validation, and experimental results show the recognition accuracies of the proposal are superior to that of the state-of-the-art, such as local directional ternary pattern and weighted mixture deep neural network (DNN), which aim to extract discriminative and are the DNN-based methods. Moreover, recognition accuracies of the proposal are also higher than the deep CNN without HGA, which indicates that the proposal has better global optimization ability. Meanwhile, preliminary application experiments are also carried out by using the proposed algorithm on the emotional social robot system, where nine volunteers and two-wheeled robots experience the scenario of emotion understanding. Application results indicate that the wheeled robots can recognize basic expressions, such as happy, surprise, and so on.

Multi-task aided face recognition network with convolution kernel spatial collaboration

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

Multi-task Convolution Network for Face Alignment

Multitask learning and CNN for application of face recognition.

Acceleration of multi-task cascaded convolutional networks

Weight-Adapted Convolution Neural Network for Facial Expression Recognition in Human–Robot Interaction

Co-attentive multi-task convolutional neural network for facial expression recognition

A joint hierarchical cross‐attention graph convolutional network for multi‐modal facial expression recognition

Facial expression recognition based on improved depthwise separable convolutional network

Research on facial expression recognition based on Multimodal data fusion and neural network

Lightweight Facial Expression Recognition Based on Multi-scale Dense Convolutional Neural Network

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Cross Task Modality Alignment Network for Sketch Face Recognition

Multi-Task Deep Neural Network for Joint Face Recognition and Facial Attribute Prediction

Facial expression recognition with multi-scale convolution neural network

Cross-Task Multi-Branch Vision Transformer for Facial Expression and Mask Wearing Classification

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

Multi-face detection and alignment using multiple kernels

Deep Multi-task Learning for Facial Expression Recognition and Synthesis Based on Selective Feature Sharing

A convolution-transformer dual branch network for head-pose and occlusion facial expression recognition

Multi-task Gaze Estimation Via Unidirectional Convolution