Abstract:Micro-expression (ME) is spontaneous, rapid, and subtle facial mechanism that can reveal the concealed emotions. However, the short duration, low motion intensity, and small dataset of MEs make the extraction and learning of features from ME samples more challenging for existing micro-expression recognition (MER) methods. To address this issue, we propose a novel decomposition MER method, called AST+SVMNet, and the primary architecture of our method integrates improved fusion attention and spatio-temporal convolutional neural network, achieving efficient MER through feature transfer to SVM. This method consists of four main components: feature extraction, fusion attention, spatio-temporal feature extraction, and feature transfer modules. In the feature extraction part, we designed a novel ME texture feature called the image sequence difference feature (ISDF). It mitigates the negative impact of optical flow calculation noise on MER task when applying optical flow features simultaneously. In the fusion attention part, we designed a fusion attention module (FAM) that reduces the extraction of redundant information for ME samples, optimizing the extraction of finer-grained spatio-temporal information. In the third part, we reduced the parameter count through 2D and 3D Inception Modules without compromising the performance of spatio-temporal feature extraction. In the feature transfer part, we achieved rapid and efficient MER by training the SVM classifier through feature transfer on high-dimensional spatio-temporal features. Finally, the performance of our proposed method on four publicly available spontaneous ME datasets surpasses that of existing baseline methods in MER. In addition, through effectiveness experiments and ablation studies, we demonstrated the effectiveness of the proposed texture feature ISDF and the MER method AST+SVMNet.

Identity-invariant representation and transformer-style relation for micro-expression recognition

Facial micro-expression recognition using three-stream vision transformer network with sparse sampling and relabeling

AU-assisted Graph Attention Convolutional Network for Micro-Expression Recognition

Dual-Branch Cross-Attention Network for Micro-Expression Recognition with Transformer Variants

Objective Class-based Micro-Expression Recognition through Simultaneous Action Unit Detection and Feature Aggregation

From Macro to Micro: Boosting micro-expression recognition via pre-training on macro-expression videos

Micro-Expression Recognition by Motion Feature Extraction based on Pre-training

Micro-Expression Recognition with Layered Relations and More Input Frames

Micro-Expression Recognition Based on Multi-task Learning and Resnet18

Geometric Graph Representation with Learnable Graph Structure and Adaptive AU Constraint for Micro-Expression Recognition

Boosting Micro-Expression Recognition Via Self-Expression Reconstruction and Memory Contrastive Learning

Feature Representation Learning with Adaptive Displacement Generation and Transformer Fusion for Micro-Expression Recognition

A Boost in Revealing Subtle Facial Expressions: A Consolidated Eulerian Framework

Inceptr: micro-expression recognition integrating inception-CBAM and vision transformer

Micro-Expression Recognition Using Uncertainty-Aware Magnification-Robust Networks

MER-GCN: Micro Expression Recognition Based on Relation Modeling with Graph Convolutional Network

Objective Class-Based Micro-Expression Recognition Under Partial Occlusion Via Region-Inspired Relation Reasoning Network

Transformer-Based Multimodal Emotional Perception for Dynamic Facial Expression Recognition in the Wild

AST+SVMNet: A Novel Decomposition Method for Micro-Expression Recognition Based on Fusion Attention and Improved Spatio- Temporal Convolution by Feature Transfer

MMNet: Muscle motion-guided network for micro-expression recognition

Short and Long Range Relation Based Spatio-Temporal Transformer for Micro-Expression Recognition