Abstract:Micro-expression (ME) is spontaneous, rapid, and subtle facial mechanism that can reveal the concealed emotions. However, the short duration, low motion intensity, and small dataset of MEs make the extraction and learning of features from ME samples more challenging for existing micro-expression recognition (MER) methods. To address this issue, we propose a novel decomposition MER method, called AST+SVMNet, and the primary architecture of our method integrates improved fusion attention and spatio-temporal convolutional neural network, achieving efficient MER through feature transfer to SVM. This method consists of four main components: feature extraction, fusion attention, spatio-temporal feature extraction, and feature transfer modules. In the feature extraction part, we designed a novel ME texture feature called the image sequence difference feature (ISDF). It mitigates the negative impact of optical flow calculation noise on MER task when applying optical flow features simultaneously. In the fusion attention part, we designed a fusion attention module (FAM) that reduces the extraction of redundant information for ME samples, optimizing the extraction of finer-grained spatio-temporal information. In the third part, we reduced the parameter count through 2D and 3D Inception Modules without compromising the performance of spatio-temporal feature extraction. In the feature transfer part, we achieved rapid and efficient MER by training the SVM classifier through feature transfer on high-dimensional spatio-temporal features. Finally, the performance of our proposed method on four publicly available spontaneous ME datasets surpasses that of existing baseline methods in MER. In addition, through effectiveness experiments and ablation studies, we demonstrated the effectiveness of the proposed texture feature ISDF and the MER method AST+SVMNet.

Cross-Database Micro-Expression Recognition: A Style Aggregated and Attention Transfer Approach

Cross-database Micro-Expression Recognition with Deep Convolutional Networks

Micro-Expression Recognition Based on Multi-task Learning and Resnet18

Cross-Database Micro-Expression Recognition Exploiting Intradomain Structure

Cross-database non-frontal facial expression recognition based on transductive deep transfer learning

Micro-Attention for Micro-Expression recognition

Domain Regeneration for Cross-Database Micro-Expression Recognition

Cross-Database Micro-Expression Recognition: A Benchmark

Seeking Salient Facial Regions for Cross-Database Micro-Expression Recognition

Deep Emotion Transfer Network for Cross-database Facial Expression Recognition

AU-assisted Graph Attention Convolutional Network for Micro-Expression Recognition

Cross-Database Micro-Expression Recognition Based on a Dual-Stream Convolutional Neural Network

Micro-Expression Recognition Enhanced by Macro-Expression from Spatial-Temporal Domain.

Cross-Database Facial Expression Recognition Based on Fine-Tuned Deep Convolutional Network

From Macro to Micro: Boosting micro-expression recognition via pre-training on macro-expression videos

Micro-Expression Recognition Based on Attribute Information Embedding and Cross-modal Contrastive Learning

AST+SVMNet: A Novel Decomposition Method for Micro-Expression Recognition Based on Fusion Attention and Improved Spatio- Temporal Convolution by Feature Transfer

Fine-Grained Micro-Expression Recognition Based on Hierarchical Attention Mechanism

SKD-TSTSAN: Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition

Dual-Branch Cross-Attention Network for Micro-Expression Recognition with Transformer Variants

Cross-Database Facial Expression Recognition With Domain Alignment And Compact Feature Learning