Abstract:Convolutional neural networks (CNNs) have made significant progress in the field of facial expression recognition (FER). However, due to challenges such as occlusion, lighting variations, and changes in head pose, facial expression recognition in real-world environments remains highly challenging. At the same time, methods solely based on CNN heavily rely on local spatial features, lack global information, and struggle to balance the relationship between computational complexity and recognition accuracy. Consequently, the CNN-based models still fall short in their ability to address FER adequately. To address these issues, we propose a lightweight facial expression recognition method based on a hybrid vision transformer. This method captures multi-scale facial features through an improved attention module, achieving richer feature integration, enhancing the network's perception of key facial expression regions, and improving feature extraction capabilities. Additionally, to further enhance the model's performance, we have designed the patch dropping (PD) module. This module aims to emulate the attention allocation mechanism of the human visual system for local features, guiding the network to focus on the most discriminative features, reducing the influence of irrelevant features, and intuitively lowering computational costs. Extensive experiments demonstrate that our approach significantly outperforms other methods, achieving an accuracy of 86.51% on RAF-DB and nearly 70% on FER2013, with a model size of only 3.64 MB. These results demonstrate that our method provides a new perspective for the field of facial expression recognition.

68 Face Feature Points Detection Based on Cascading Convolutional Neural Network with Small Filter

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Research on Deep Convolution Neural Network with Small Filter Used in Facial Landmark Detection

A Convolutional Neural Network Cascade for Face Detection

Feature Agglomeration Networks for Single Stage Face Detection

Research and Implementation on Face Detection Approach Based on Cascaded Convolutional Neural Networks

A Face Detection Method Based on Cascade Convolutional Neural Network

A Multi-Scale Fusion Convolutional Neural Network for Face Detection.

Face detection algorithm based on cascaded convolutional neural network

Multi-Path Region-Based Convolutional Neural Network for Accurate Detection of Unconstrained "Hard Faces"

Dense Small Face Detection Based on Regional Cascade Multi-Scale Method

CaCCNN: Context-Aware Cascaded CNN for Face Detection

Hybrid Pyramid Convolutional Network for Multiscale Face Detection.

Facial Landmark Detection Via Cascade Multi-Channel Convolutional Neural Network

Face detection method fusing multi-layer features

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

A Multi-Scale Cascade Fully Convolutional Network Face Detector

CSSD: Cascade Single Shot Face Detector

SFA: Small Faces Attention Face Detector

Cascaded Structure-Learning Network with Using Adversarial Training for Robust Facial Landmark Detection

Face Detection Using Hierarchical Fully Convolutional Networks