Abstract:As an important part of emotion research, facial expression recognition is a necessary condition for intelligent interaction between human and machine, which has an important research significance and a potential commercial value. Convolutional neural network (CNN) is an effective method to recognize facial emotions, which can perform feature extraction and classification simultaneously, and can automatically discover multiple levels of representations in data. Due to the fact that there are millions of parameters involved in training the convolutional neural network model, and there is a large demand for marked samples, transfer learning is often used to fine-tune the pre-trained model for a small target sample set. However, there are often some content differences between data sets during deep transfer learning, which will affect the recognition ability of feature extraction. In order to improve the facial expression recognition ability in transfer learning, a hybrid transfer learning model based on an improved convolution restricted boltzmann machine (CRBM) model and a CNN model is proposed in this paper. This method is fused by two learning abilities of these two models. When the pre-trained CNN model is transferred to a small target set, the CRBM is used to replace the full connection layer in the CNN model, and the CRBM layer and the sofmax layer will be retrained on the target set. The added CRBM layer can not only fully connects all feature maps, but can also learn about the unique statistical characteristics about the target set, which eliminates the influence of content differences between data sets, and extracts higher-order statistical features of facial expression images from the target set. The proposed method is evaluated based on four publicly available facial expression databases: JAFFE, FER2013, SFEW and RAF-DB. The new method can achieve better performance than most state-of-the-art methods, and it can effectively prevent the negative influence of transfer learning features between different data sets.

Using Human-like Mechanism to Weaken Effect of Pre-training Weight Bias in Face-Recognition Convolutional Neural Network

The Application of a Hybrid Transfer Algorithm Based on a Convolutional Neural Network Model and an Improved Convolution Restricted Boltzmann Machine Model in Facial Expression Recognition

Seeing eye-to-eye? A comparison of object recognition performance in humans and deep convolutional neural networks under image manipulation

Face processing emerges from object-trained convolutional neural networks

Weight-Adapted Convolution Neural Network for Facial Expression Recognition

Implementation-independent Representation for Deep Convolutional Neural Networks and Humans in Processing Faces

A Convolutional Neural Network Face Recognition Method Based on BiLSTM and Attention Mechanism

Deblurring Method of Face Recognition AI Technology Based on Deep Learning

Dissociable Neural Representations of Adversarially Perturbed Images in Convolutional Neural Networks and the Human Brain

Facial Expression Recognition Model Based on CNN and Data Augmentation Method

Facial Expressions Recognition for Human-Robot Interaction Using Deep Convolutional Neural Networks with Rectified Adam Optimizer

MENTOR: Human Perception-Guided Pretraining for Increased Generalization

Negative facial expression recognition based on improved convolutional neural networks

Research on Facial Expression Recognition Technology Based on Convolutional-Neural-Network Structure

Attention mechanism-based CNN for facial expression recognition

Human Behavior Recognition Based on Multiscale Convolutional Neural Network.

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

Enhancing Facial Emotion Recognition with a Modified Deep Convolutional Neural Network

Convolutional Neural Networks Exploiting Attributes of Biological Neurons

A new humanlike facial attractiveness predictor with cascaded fine-tuning deep learning model

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy