Abstract:As an important part of emotion research, facial expression recognition is a necessary condition for intelligent interaction between human and machine, which has an important research significance and a potential commercial value. Convolutional neural network (CNN) is an effective method to recognize facial emotions, which can perform feature extraction and classification simultaneously, and can automatically discover multiple levels of representations in data. Due to the fact that there are millions of parameters involved in training the convolutional neural network model, and there is a large demand for marked samples, transfer learning is often used to fine-tune the pre-trained model for a small target sample set. However, there are often some content differences between data sets during deep transfer learning, which will affect the recognition ability of feature extraction. In order to improve the facial expression recognition ability in transfer learning, a hybrid transfer learning model based on an improved convolution restricted boltzmann machine (CRBM) model and a CNN model is proposed in this paper. This method is fused by two learning abilities of these two models. When the pre-trained CNN model is transferred to a small target set, the CRBM is used to replace the full connection layer in the CNN model, and the CRBM layer and the sofmax layer will be retrained on the target set. The added CRBM layer can not only fully connects all feature maps, but can also learn about the unique statistical characteristics about the target set, which eliminates the influence of content differences between data sets, and extracts higher-order statistical features of facial expression images from the target set. The proposed method is evaluated based on four publicly available facial expression databases: JAFFE, FER2013, SFEW and RAF-DB. The new method can achieve better performance than most state-of-the-art methods, and it can effectively prevent the negative influence of transfer learning features between different data sets.

Facial Expression Recognition Based on an Improved Data Augmentation Method and A Multichannel Convolutional Neural Network Model

Facial Expression Recognition Model Based on CNN and Data Augmentation Method

Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network

A Facial Expression Recognition Method Based on a Multibranch Cross-Connection Convolutional Neural Network

Enhancing facial expression recognition through generative adversarial networks-based augmentation

Data Augmentation and Transfer Learning Approaches Applied to Facial Expressions Recognition

An Efficient Channel Attention CNN for Facial Expression Recognition

A Facial Expression Synthesis Method Based on Generative Adversarial Network.

Facial Expression Recognition Based on Contextual Generative Adversarial Network

An Improved SimAM Based CNN for Facial Expression Recognition

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Facial Expression Recognition Method Based on Multi-scale Efficient Channel Attention Mechanism.

The Application of a Hybrid Transfer Algorithm Based on a Convolutional Neural Network Model and an Improved Convolution Restricted Boltzmann Machine Model in Facial Expression Recognition

Facial expression recognition based on improved depthwise separable convolutional network

Data Augmentation Techniques and Transfer Learning Approaches Applied to Facial Expressions Recognition Systems

Facial Expression Recognition with Data Augmentation and Compact Feature Learning.

Multi-View Facial Expression Recognition Based O N Multitask Learning and Generative Adversarial Network.

A Convolutional Neural Network Face Recognition Method Based on BiLSTM and Attention Mechanism

Convolutional Neural Network Based Expression Classification with Face Alignment

Facial Expression Recognition Based on Improved LeNet-5 CNN

Data Augmentation Using Conditional GANs for Facial Emotion Recognition