Abstract:In demanding application scenarios such as clinical psychotherapy and criminal interrogation, the accurate recognition of micro-expressions is of utmost importance but poses significant challenges. One of the main difficulties lies in effectively capturing weak and fleeting facial features and improving recognition performance. To address this fundamental issue, this paper proposed a novel architecture based on a multi-scale 3D residual convolutional neural network. The algorithm leveraged a deep 3D-ResNet50 as the skeleton model and utilized the micro-expression optical flow feature map as the input for the network model. Drawing upon the complex spatial and temporal features inherent in micro-expressions, the network incorporated multi-scale convolutional modules of varying sizes to integrate both global and local information. Furthermore, an attention mechanism feature fusion module was introduced to enhance the model's contextual awareness. Finally, to optimize the model's prediction of the optimal solution, a discriminative network structure with multiple output channels was constructed. The algorithm's performance was evaluated using the public datasets SMIC, SAMM, and CASME II. The experimental results demonstrated that the proposed algorithm achieves recognition accuracies of 74.6, 84.77 and 91.35% on these datasets, respectively. This substantial improvement in efficiency compared to existing mainstream methods for extracting micro-expression subtle features effectively enhanced micro-expression recognition performance and increased the accuracy of high-precision micro-expression recognition. Consequently, this paper served as an important reference for researchers working on high-precision micro-expression recognition.

Fine-Grained Micro-Expression Recognition Based on Hierarchical Attention Mechanism

Micro-Expression Recognition Based on Multi-task Learning and Resnet18

High-level LoRA and Hierarchical Fusion for Enhanced Micro-Expression Recognition

MFDAN: Multi-level Flow-Driven Attention Network for Micro-Expression Recognition

Micro-Attention for Micro-Expression recognition

Micro-expression recognition based on multi-scale 3D residual convolutional neural network

Objective Class-based Micro-Expression Recognition through Simultaneous Action Unit Detection and Feature Aggregation

Deep Learning for Micro-Expression Recognition: A Survey

Micro-Expression Recognition by Motion Feature Extraction based on Pre-training

Hierarchical Space-Time Attention for Micro-Expression Recognition

Adaptive Graph Attention Network with Temporal Fusion for Micro-Expressions Recognition

Meta-Auxiliary Learning for Micro-Expression Recognition

A Novel Micro-Expression Recognition Approach Using Attention-Based Magnification-Adaptive Networks

Hierarchical Region Learning and Patch Attention for Micro-Expression Recognition

AU-assisted Graph Attention Convolutional Network for Micro-Expression Recognition

Dual-stream network with cross-layer attention and similarity constraint for micro-expression recognition

MER-GCN: Micro Expression Recognition Based on Relation Modeling with Graph Convolutional Network

Cross-database Micro-Expression Recognition with Deep Convolutional Networks

Dual-Branch Cross-Attention Network for Micro-Expression Recognition with Transformer Variants

DFFCN: Dual Flow Fusion Convolutional Network for Micro Expression Recognition

Diverse Local Facial Behaviors Learning from Enhanced Expression Flow for Microexpression Recognition