Abstract:Background and objective: Facial expression recognition technology will play an increasingly important role in our daily life. Autonomous driving, virtual reality and all kinds of robots integrated into our life depend on the development of facial expression recognition technology. Many tasks in the field of computer vision are based on deep learning technology and convolutional neural network. The paper proposes an occluded expression recognition model based on the generated countermeasure network. The model is divided into two modules, namely, occluded face image restoration and face recognition. Methods: Firstly, this paper summarizes the research status of deep facial expression recognition methods in recent ten years and the development of related facial expression database. Then, the current facial expression recognition methods based on deep learning are divided into two categories: Static facial expression recognition and dynamic facial expression recognition. The two methodswill be introduced and summarized respectively. Aiming at the advanced deep expression recognition algorithms in the field, the performance of these algorithms on common expression databases is compared, and the strengths and weaknesses of these algorithms are analyzed in detail. Discussion and results: As the task of facial expression recognition is gradually transferred from the controlled laboratory environment to the challenging real-world environment, with the rapid development of deep learning technology, deep neural network can learn discriminative features, and is gradually applied to automatic facial expression recognition task. The current deep facial expression recognition system is committed to solve the following two problems: (1) Overfitting due to lack of sufficient training data; (2) In the real world environment, other variables that have nothing to do with expression bring interference problems. Conclusion: From the perspective of algorithm, combining other expression models, such as facial action unit model and pleasure arousal dimension model, as well as other multimodal models, such as audio mode, 3D face depth information and human physiological information, can make expression recognition more practical.

Facial Expression Recognition Using Deep Boltzmann Machine from Thermal Infrared Images

Emotion Recognition from Thermal Infrared Images Using Deep Boltzmann Machine

Posed and spontaneous facial expression differentiation using deep Boltzmann machines

Facial Expression Recognition from Infrared Thermal Videos.

Facial Expression Recognition from Infrared Thermal Images Using Temperature Difference by Voting

Spontaneous Facial Expression Recognition by Using Feature-Level Fusion of Visible and Thermal Infrared Images

Expression Recognition from Visible Images with the Help of Thermal Images

Thermal Augmented Expression Recognition

Face emotion recognition based on infrared thermal imagery by applying machine learning and parallelism

A deep learning model for classifying human facial expressions from infrared thermal images

Fusion of visible and thermal images for facial expression recognition

Facial Expression Recognition Enhanced by Thermal Images Through Adversarial Learning.

Facial Expression Recognition With Deep Two-View Support Vector Machine

Infrared Facial Expression Recognition Using Wavelet Transform

Posed and spontaneous expression distinguishment from infrared thermal images

Facial Expression Recognition with LBP and ORB Features

A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference

Facial expression recognition based on deep learning

Infrared thermal imaging face expression recognition based on Harris algorithm

Facial Expression Recognition from a Single Face Image Based on Deep Learning and Broad Learning

Unpaired Multimodal Facial Expression Recognition.