Abstract:Background and objective: Facial expression recognition technology will play an increasingly important role in our daily life. Autonomous driving, virtual reality and all kinds of robots integrated into our life depend on the development of facial expression recognition technology. Many tasks in the field of computer vision are based on deep learning technology and convolutional neural network. The paper proposes an occluded expression recognition model based on the generated countermeasure network. The model is divided into two modules, namely, occluded face image restoration and face recognition. Methods: Firstly, this paper summarizes the research status of deep facial expression recognition methods in recent ten years and the development of related facial expression database. Then, the current facial expression recognition methods based on deep learning are divided into two categories: Static facial expression recognition and dynamic facial expression recognition. The two methodswill be introduced and summarized respectively. Aiming at the advanced deep expression recognition algorithms in the field, the performance of these algorithms on common expression databases is compared, and the strengths and weaknesses of these algorithms are analyzed in detail. Discussion and results: As the task of facial expression recognition is gradually transferred from the controlled laboratory environment to the challenging real-world environment, with the rapid development of deep learning technology, deep neural network can learn discriminative features, and is gradually applied to automatic facial expression recognition task. The current deep facial expression recognition system is committed to solve the following two problems: (1) Overfitting due to lack of sufficient training data; (2) In the real world environment, other variables that have nothing to do with expression bring interference problems. Conclusion: From the perspective of algorithm, combining other expression models, such as facial action unit model and pleasure arousal dimension model, as well as other multimodal models, such as audio mode, 3D face depth information and human physiological information, can make expression recognition more practical.

Facial Representation Extraction by Mutual Information Maximization and Correlation Minimization.

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

Joint Structured Sparsity Regularized Multiview Dimension Reduction for Video-Based Facial Expression Recognition.

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

A Unified Deep Model for Joint Facial Expression Recognition, Face Synthesis, and Face Alignment.

Harmonious Mutual Learning for Facial Emotion Recognition

Robust Face Recognition via Multimodal Deep Face Representation

A Multi-Task Model for Simultaneous Face Identification and Facial Expression Recognition.

Simultaneous Facial Feature Tracking and Facial Expression Recognition.

Expression-Guided Deep Joint Learning for Facial Expression Recognition

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Jointly Optimizing Expressional and Residual Models for 3D Facial Expression Removal.

Unpaired Multimodal Facial Expression Recognition.

Identity-aware Facial Expression Recognition via Deep Metric Learning based on Synthesized Images

An End-to-End Learning Approach for Multimodal Emotion Recognition: Extracting Common and Private Information.

Learning Better Representations for Audio-Visual Emotion Recognition with Common Information

Identity-Enhanced Network for Facial Expression Recognition

Facial expression recognition based on deep learning

Learning Robust 3D Face Reconstruction and Discriminative Identity Representation

Joint Boosting Feature Selection for Robust Face Recognition

A joint hierarchical cross‐attention graph convolutional network for multi‐modal facial expression recognition