Abstract:In demanding application scenarios such as clinical psychotherapy and criminal interrogation, the accurate recognition of micro-expressions is of utmost importance but poses significant challenges. One of the main difficulties lies in effectively capturing weak and fleeting facial features and improving recognition performance. To address this fundamental issue, this paper proposed a novel architecture based on a multi-scale 3D residual convolutional neural network. The algorithm leveraged a deep 3D-ResNet50 as the skeleton model and utilized the micro-expression optical flow feature map as the input for the network model. Drawing upon the complex spatial and temporal features inherent in micro-expressions, the network incorporated multi-scale convolutional modules of varying sizes to integrate both global and local information. Furthermore, an attention mechanism feature fusion module was introduced to enhance the model's contextual awareness. Finally, to optimize the model's prediction of the optimal solution, a discriminative network structure with multiple output channels was constructed. The algorithm's performance was evaluated using the public datasets SMIC, SAMM, and CASME II. The experimental results demonstrated that the proposed algorithm achieves recognition accuracies of 74.6, 84.77 and 91.35% on these datasets, respectively. This substantial improvement in efficiency compared to existing mainstream methods for extracting micro-expression subtle features effectively enhanced micro-expression recognition performance and increased the accuracy of high-precision micro-expression recognition. Consequently, this paper served as an important reference for researchers working on high-precision micro-expression recognition.

Micro-Expression Recognition Based on Multi-task Learning and Resnet18

Fine-Grained Micro-Expression Recognition Based on Hierarchical Attention Mechanism

Micro-Expression Recognition by Motion Feature Extraction based on Pre-training

Objective Class-based Micro-Expression Recognition through Simultaneous Action Unit Detection and Feature Aggregation

MERTA: Micro-Expression Recognition with Ternary Attentions

GEME: Dual-stream Multi-Task GEnder-based Micro-Expression Recognition.

AU-assisted Graph Attention Convolutional Network for Micro-Expression Recognition

From Macro to Micro: Boosting micro-expression recognition via pre-training on macro-expression videos

Micro-Expression Recognition Using Uncertainty-Aware Magnification-Robust Networks

Meta-Auxiliary Learning for Micro-Expression Recognition

Micro-Attention for Micro-Expression recognition

MFDAN: Multi-level Flow-Driven Attention Network for Micro-Expression Recognition

An Enhanced Facial Expression Recognition Method Based on Multi-task Learning

Cross-database Micro-Expression Recognition with Deep Convolutional Networks

Micro-expression recognition based on multi-scale 3D residual convolutional neural network

Exploring Holistic Discriminative Representation for Micro-Expression Recognition Via Contrastive Learning

Dual-Branch Cross-Attention Network for Micro-Expression Recognition with Transformer Variants

Micro-expression Recognition with Supervised Contrastive Learning

A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations.

Deep Learning for Micro-Expression Recognition: A Survey

High-level LoRA and Hierarchical Fusion for Enhanced Micro-Expression Recognition