Abstract:As an important part of emotion research, facial expression recognition is a necessary condition for intelligent interaction between human and machine, which has an important research significance and a potential commercial value. Convolutional neural network (CNN) is an effective method to recognize facial emotions, which can perform feature extraction and classification simultaneously, and can automatically discover multiple levels of representations in data. Due to the fact that there are millions of parameters involved in training the convolutional neural network model, and there is a large demand for marked samples, transfer learning is often used to fine-tune the pre-trained model for a small target sample set. However, there are often some content differences between data sets during deep transfer learning, which will affect the recognition ability of feature extraction. In order to improve the facial expression recognition ability in transfer learning, a hybrid transfer learning model based on an improved convolution restricted boltzmann machine (CRBM) model and a CNN model is proposed in this paper. This method is fused by two learning abilities of these two models. When the pre-trained CNN model is transferred to a small target set, the CRBM is used to replace the full connection layer in the CNN model, and the CRBM layer and the sofmax layer will be retrained on the target set. The added CRBM layer can not only fully connects all feature maps, but can also learn about the unique statistical characteristics about the target set, which eliminates the influence of content differences between data sets, and extracts higher-order statistical features of facial expression images from the target set. The proposed method is evaluated based on four publicly available facial expression databases: JAFFE, FER2013, SFEW and RAF-DB. The new method can achieve better performance than most state-of-the-art methods, and it can effectively prevent the negative influence of transfer learning features between different data sets.

Facial Expression Recognition Model Based on CNN and Data Augmentation Method

Facial Expression Recognition Based on an Improved Data Augmentation Method and A Multichannel Convolutional Neural Network Model

Facial Expression Recognition Using Deep Neural Network

An Improved SimAM Based CNN for Facial Expression Recognition

Facial Expression Recognition with Data Augmentation and Compact Feature Learning.

Face Emotion Recognization Using Dataset Augmentation Based on Neural Network

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy

Static Facial Expression Recognition with Convolution Neural Networks

The application of deep learning in computer vision: Facial emotion recognition based on convolutional neural network

Facial Expression Recognition Based On Global And Local Feature Fusion With Cnns

Deep Facial Expression Recognition Using Transfer Learning and Fine-Tuning Techniques

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

Dnn-Cbam: an Enhanced Dnn Model for Facial Emotion Recognition

An Efficient Channel Attention CNN for Facial Expression Recognition

Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network

The Application of a Hybrid Transfer Algorithm Based on a Convolutional Neural Network Model and an Improved Convolution Restricted Boltzmann Machine Model in Facial Expression Recognition

Uncertain and Biased Facial Expression Recognition Based on Depthwise Separable Convolutional Neural Network with Embedded Attention Mechanism

A Deep Learning Perspective on the Origin of Facial Expressions

Relation and context augmentation network for facial expression recognition

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Data Augmentation and Transfer Learning Approaches Applied to Facial Expressions Recognition