Abstract:Micro-expressions (MEs) are involuntary movements revealing people's hidden feelings, which has attracted numerous interests for its objectivity in emotion detection. However, despite its wide applications in various scenarios, micro-expression recognition (MER) remains a challenging problem in real life due to three reasons, including (i) data-level: lack of data and imbalanced classes, (ii) feature-level: subtle, rapid changing, and complex features of MEs, and (iii) decision-making-level: impact of individual differences. To address these issues, we propose a dual-branch meta-auxiliary learning method, called LightmanNet, for fast and robust micro-expression recognition. Specifically, LightmanNet learns general MER knowledge from limited data through a dual-branch bi-level optimization process: (i) In the first level, it obtains task-specific MER knowledge by learning in two branches, where the first branch is for learning MER features via primary MER tasks, while the other branch is for guiding the model obtain discriminative features via auxiliary tasks, i.e., image alignment between micro-expressions and macro-expressions since their resemblance in both spatial and temporal behavioral patterns. The two branches of learning jointly constrain the model of learning meaningful task-specific MER knowledge while avoiding learning noise or superficial connections between MEs and emotions that may damage its generalization ability. (ii) In the second level, LightmanNet further refines the learned task-specific knowledge, improving model generalization and efficiency. Extensive experiments on various benchmark datasets demonstrate the superior robustness and efficiency of LightmanNet.

Micro-Expression Recognition Using Uncertainty-Aware Magnification-Robust Networks

A Novel Micro-Expression Recognition Approach Using Attention-Based Magnification-Adaptive Networks

A Novel Magnification-Robust Network with Sparse Self-Attention for Micro-expression Recognition

CMNet: Contrastive Magnification Network for Micro-Expression Recognition.

AU-assisted Graph Attention Convolutional Network for Micro-Expression Recognition

Micro-Expression Recognition with Pre-trained Neural Network Models

Micro-Expression Recognition by Combining Progressive-Learning Intensity Magnification with Self-Attention-Convolution Classification

Facial micro-expression recognition based on motion magnification network and graph attention mechanism

MMNet: Muscle motion-guided network for micro-expression recognition

Micro-expression recognition based on the fusion between optical flow and dynamic image

Micro-Expression Recognition Based on Multi-task Learning and Resnet18

Recognizing Spontaneous Micro-Expression Using a Three-Stream Convolutional Neural Network.

Micro-Attention for Micro-Expression recognition

Adaptive Graph Attention Network with Temporal Fusion for Micro-Expressions Recognition

Facial Micro-Expressions: an Overview

A Multi-stream Convolutional Neural Network for Micro-expression Recognition Using Optical Flow and EVM

MERTA: Micro-Expression Recognition with Ternary Attentions

Meta-Auxiliary Learning for Micro-Expression Recognition

A Spatiotemporal Network Using a Local Spatial Difference Stack Block for Facial Micro-Expression Recognition

Micro-Expression Recognition Based on Multiple Aggregation Networks

Micro-Expression Recognition by Motion Feature Extraction based on Pre-training