Abstract:Facial expression recognition plays an important role in human-computer interaction. At present, the traditional algorithm applied to facial expression recognition is not accurate enough, and deep learning methods have problems such as a large number of network model parameters, insufficient generalization ability, and high requirements on hardware devices in actual deployment. To solve these problems, a lightweight facial expression recognition model based on multi-scale feature fusion and attention mechanism is proposed in this paper. Firstly, a multi-scale deeply separable densely connected convolutional neural network is constructed, which can greatly reduce the number of parameters and computation. The convolution kernel of different scales can obtain the receptive fields of different scales, and finally integrate the features of multiple scales, which is beneficial to the learning of the features of different scales. A dense connection reduces gradient disappearance and improves model generalization performance. Secondly, group convolution is introduced to further reduce the number of parameters. Finally, the attention mechanism and multi-scale were integrated to improve the classification accuracy of the model. The network model proposed in this paper has been trained and verified on RAF-DB, FER2013, CK+ and FERPlus datasets. Experimental results show that compared with other classical convolutional neural networks, the model proposed in this paper can significantly reduce the number of parameters and calculation amount while ensuring high accuracy. In the future, it is of great significance for the practical application of facial expression recognition in medical monitoring, education assistance, traffic warning and other fields.

Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy

SDNET: Lightweight Facial Expression Recognition For Sample Disequilibrium.

Efficient Facial Expression Recognition with Representation Reinforcement Network and Transfer Self-Training for Human–Machine Interaction

The Facial Expression Recognition Method Based on Image Fusion and CNN

Facial Expression Recognition Via Region-Based Convolutional Fusion Network.

Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-network Structure

Deep Facial Expression Recognition Using Transfer Learning and Fine-Tuning Techniques

Facial Expression Recognition Based on Multi-scale Feature Fusion Convolutional Neural Network and Attention Mechanism

Facial Expression Recognition Using Deep Neural Network

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

Facial expression recognition through multi-level features extraction and fusion

Facial Attention based Convolutional Neural Network for 2D+3D Facial Expression Recognition

Facial Expression Recognition Using Hierarchical Features with Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks

Facial expression recognition using HOG and LBP features with convolutional neural network

A novel modular deep fully convolutional network for efficient low resolution facial expression recognition

Three Convolutional Neural Network Models for Facial Expression Recognition in the Wild

Improved Facial Expression Recognition Method Based on ROI Deep Convolutional Neutral Network

Facial Expression Recognition Based On Global And Local Feature Fusion With Cnns

Two-pathway attention network for real-time facial expression recognition

Facial Expression Recognition Model Based on CNN and Data Augmentation Method

Facial Expression Recognition Using Hybrid Features of Pixel and Geometry