Abstract:Micro-expressions (MEs) are involuntary movements revealing people's hidden feelings, which has attracted numerous interests for its objectivity in emotion detection. However, despite its wide applications in various scenarios, micro-expression recognition (MER) remains a challenging problem in real life due to three reasons, including (i) data-level: lack of data and imbalanced classes, (ii) feature-level: subtle, rapid changing, and complex features of MEs, and (iii) decision-making-level: impact of individual differences. To address these issues, we propose a dual-branch meta-auxiliary learning method, called LightmanNet, for fast and robust micro-expression recognition. Specifically, LightmanNet learns general MER knowledge from limited data through a dual-branch bi-level optimization process: (i) In the first level, it obtains task-specific MER knowledge by learning in two branches, where the first branch is for learning MER features via primary MER tasks, while the other branch is for guiding the model obtain discriminative features via auxiliary tasks, i.e., image alignment between micro-expressions and macro-expressions since their resemblance in both spatial and temporal behavioral patterns. The two branches of learning jointly constrain the model of learning meaningful task-specific MER knowledge while avoiding learning noise or superficial connections between MEs and emotions that may damage its generalization ability. (ii) In the second level, LightmanNet further refines the learned task-specific knowledge, improving model generalization and efficiency. Extensive experiments on various benchmark datasets demonstrate the superior robustness and efficiency of LightmanNet.

A Novel Micro-Expression Recognition Approach Using Attention-Based Magnification-Adaptive Networks

Micro-Expression Recognition Using Uncertainty-Aware Magnification-Robust Networks

A Novel Magnification-Robust Network with Sparse Self-Attention for Micro-expression Recognition

CMNet: Contrastive Magnification Network for Micro-Expression Recognition.

Adaptive Graph Attention Network with Temporal Fusion for Micro-Expressions Recognition

Meta-Auxiliary Learning for Micro-Expression Recognition

MFDAN: Multi-level Flow-Driven Attention Network for Micro-Expression Recognition

Facial micro-expression recognition based on motion magnification network and graph attention mechanism

AU-assisted Graph Attention Convolutional Network for Micro-Expression Recognition

Structure Representation with Adaptive and Compact Facial Graph for Micro-Expression Recognition

Micro-Attention for Micro-Expression recognition

Geometric Graph Representation with Learnable Graph Structure and Adaptive AU Constraint for Micro-Expression Recognition

Objective Class-based Micro-Expression Recognition through Simultaneous Action Unit Detection and Feature Aggregation

Micro-Expression Recognition Based on Multi-task Learning and Resnet18

Micro-expression spotting with a novel wavelet convolution magnification network in long videos

GEME: Dual-stream Multi-Task GEnder-based Micro-Expression Recognition.

MER-GCN: Micro Expression Recognition Based on Relation Modeling with Graph Convolutional Network

Motion magnification multi-feature relation network for facial microexpression recognition

SKD-TSTSAN: Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition

Recognizing Spontaneous Micro-Expression Using a Three-Stream Convolutional Neural Network.

PASTFNet: a paralleled attention spatio-temporal fusion network for micro-expression recognition