Abstract:Micro-expressions (MEs) are spontaneous and involuntary facial subtle reactions which often reveal the genuine emotions within human beings. Recognizing MEs automatically is becoming increasingly crucial for many areas such as diagnosis and security. However, the short time duration and low spatial intensity of MEs pose great challenges for accurately recognizing them. Additionally, the lack of sufficient and balanced spontaneous MEs data also makes this problem even harder to solve, and some adaptive modeling strategies have been quite urgent recently. To this end, this paper draws inspirations from few-shot learning to propose a novel two-stage learning (i.e., prior learning and target learning) method based on a siamese 3D convolutional neural network for MEs recognition (MERSiamC3D). Specifically, in the prior learning stage, the proposed MERSiamC3D is used to extract the generic features of MEs. In the target learning stage, the structure and parameters of the MERSiamC3D will be carefully adjusted and the Focal Loss is adopted for high-level features learning. Afterwards, in order to effectively retain the spatiotemporal information of the original MEs video, an adaptive construction method based on adaptive convolutional neural network is proposed to construct the key-frames sequence to summarize the original MEs video, which is able to help drop the redundant frames and relatively highlight the movement of the apex frame. Then, the new key-frames are taken as the input of the two-stage learning method. Finally, through extensive evaluations and experiments on three publically available MEs datasets, the proposed method in this work could outperform traditional methods and other deep learning baselines, which provides a novel insight on how to leverage scarce data for MEs recognition. (c) 2021 Elsevier B.V. All rights reserved.

MESNet: A Convolutional Neural Network for Spotting Multi-Scale Micro-Expression Intervals in Long Videos

Micro-Expression Spotting Based on a Short-Duration Prior and Multi-Stage Feature Extraction

Micro-expression spotting with a novel wavelet convolution magnification network in long videos

Micro-expression Spotting with Multi-scale Local Transformer in Long Videos

LGSNet: A Two-Stream Network for Micro- and Macro-Expression Spotting With Background Modeling

Multi-Scale Spatio-Temporal Graph Convolutional Network for Facial Expression Spotting

Micro-expression recognition based on multi-scale 3D residual convolutional neural network

Spotting Micro-Expressions on Long Videos Sequences

3D-CNN for Facial Micro- and Macro-expression Spotting on Long Video Sequences using Temporal Oriented Reference Frame

Spatiotemporal Convolutional Neural Network with Convolutional Block Attention Module for Micro-Expression Recognition

Facial Micro-Expression Recognition Based on Multi-Scale Temporal and Spatial Features

Micro-expression Recognition with Small Sample Size by Transferring Long-Term Convolutional Neural Network

Synergistic Spotting and Recognition of Micro-Expression via Temporal State Transition

Spotting Macro- and Micro-expression Intervals in Long Video Sequences

Integrating VideoMAE based model and Optical Flow for Micro- and Macro-expression Spotting

Micro-expression recognition using 3D DenseNet fused Squeeze-and-Excitation Networks

SpotFormer: Multi-Scale Spatio-Temporal Transformer for Facial Expression Spotting

A Two-Stage 3D CNN Based Learning Method for Spontaneous Micro-Expression Recognition

MEGC2024: ACM Multimedia 2024 Facial Micro-Expression Grand Challenge

A Multi-stream Convolutional Neural Network for Micro-expression Recognition Using Optical Flow and EVM

PASTFNet: a paralleled attention spatio-temporal fusion network for micro-expression recognition