Abstract:As opposed to macro-expressions, micro-expressions are subtle and not easily detectable emotional expressions, often containing rich information about mental activities. The practical recognition of micro-expressions is essential in interrogation and healthcare. Neural networks are currently one of the most common approaches to micro-expression recognition. Still, neural networks often increase their complexity when improving accuracy, and overly large neural networks require extremely high hardware requirements for running equipment. In recent years, vision transformers based on self-attentive mechanisms have achieved accuracy in image recognition and classification that is no less than that of neural networks. Still, the drawback is that without the image-specific biases inherent to neural networks, the cost of improving accuracy is an exponential increase in the number of parameters. This approach describes training a facial expression feature extractor by transfer learning and then fine-tuning and optimizing the MobileViT model to perform the micro-expression recognition task. First, the CASME II, SAMM, and SMIC datasets are combined into a compound dataset, and macro-expression samples are extracted from the three macro-expression datasets. Each macro-expression sample and micro-expression sample are pre-processed identically to make them similar. Second, the macro-expression samples were used to train the MobileNetV2 block in MobileViT as a facial expression feature extractor and to save the weights when the accuracy was highest. Finally, some of the hyperparameters of the MobileViT model are determined by grid search and then fed into the micro-expression samples for training. The samples are classified using an SVM classifier. In the experiments, the proposed method obtained an accuracy of 84.27%, and the time to process individual samples was only 35.4 ms. Comparative experiments show that the proposed method is comparable to state-of-the-art methods in terms of accuracy while improving recognition efficiency.

Micro-expression Recognition with Small Sample Size by Transferring Long-Term Convolutional Neural Network

Real-Time Micro-Expression Detection In Unlabeled Long Videos Using Optical Flow And Lstm Neural Network

Micro-expression Spotting with Multi-scale Local Transformer in Long Videos

Facial Micro-Expression Recognition Based on Multi-Scale Temporal and Spatial Features

MESNet: A Convolutional Neural Network for Spotting Multi-Scale Micro-Expression Intervals in Long Videos

Spatiotemporal Convolutional Neural Network with Convolutional Block Attention Module for Micro-Expression Recognition

Micro-expression Recognition Using Dynamic Textures on Tensor Independent Color Space

Lightweight ViT Model for Micro-Expression Recognition Enhanced by Transfer Learning

Transferring Dual Stochastic Graph Convolutional Network for Facial Micro-expression Recognition

Micro-expression recognition based on multi-scale 3D residual convolutional neural network

Micro-expression recognition model based on TV-L1 optical flow method and improved ShuffleNet

Enriched Long-Term Recurrent Convolutional Network for Facial Micro-Expression Recognition

Micro-expression recognition based on euler video magnification and 3D residual network under imbalanced sample

Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-expressions

Micro-Expression Recognition Using Color Spaces.

MCCA-VNet: A Vit-Based Deep Learning Approach for Micro-Expression Recognition Based on Facial Coding

Micro-expression recognition based on contextual transformer networks

Short and Long Range Relation Based Spatio-Temporal Transformer for Micro-Expression Recognition

Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition

Micro-Attention for Micro-Expression recognition

Micro-expression recognition using 3D DenseNet fused Squeeze-and-Excitation Networks