Abstract:A micro-expression is a fleeting, delicate and localized facial gesture. It can expose the true feelings that someone is trying to hide and is seen to be a crucial indicator for spotting lies. Because of its possible applications in a variety of sectors, micro-expression research has garnered a lot of attention. The accuracy of micro-expression recognition still needs to be improved, though, because of the brief and weak motions that make up micro-expressions. In recent years, Deep convolution neural methods have depicted a higher degree of efficiency for complex challenge of face detection. Although several attempts were made for micro-expression recognition (MER), the problem is far from being resolved problem which is portrayed by the lowest accuracy rate depicted by the other models. In this study, present a Facial Micro-Expression Detection and Classification using Modified Multimodal Ensemble Learning (FMEDC-MMEL) approach. The major intention of the FMEDC-MMEL technique lies in the proficient identification of MEs that exist in the facial images. As a pre-processing phase, the FMEDC-MMEL technique exploits histogram equalization (HE) approach to improve the contrast level of the image. In the FMEDC-MMEL technique, improved densely connected networks (DenseNet) model is used for learning feature patterns from the pre-processed images. To enhance the proficiency of the improved DenseNet model, stochastic gradient descent (SGD) approach is used for hyperparameter selection process. For facial ME detection, the FMEDC-MMEL technique follows an ensemble of three classifiers namely bi-directional gated recurrent unit (Bi-GRU), long short-term memory (LSTM) and extreme learning machine (ELM). A tailored ensemble learning approach is shown, which combines many machine learning models to improve classification performance and detection accuracy. Sophisticated feature extraction methods are utilized to extract the subtle aspects of micro-expressions, and precision is maintained by optimizations that minimize computing cost. Empirical findings reveal that this methodology notably surpasses conventional techniques, providing enhanced precision and resilience on a variety of complex and demanding datasets. In addition to pushing the boundaries of micro-expression analysis research, the proposed strategy has potential uses in the real world in fields including security, psychology testing, and human-computer interaction.

TGMAE: Self-supervised Micro-Expression Recognition with Temporal Gaussian Masked Autoencoder

MEGC2022

SKD-TSTSAN: Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition

MEGC2024: ACM Multimedia 2024 Facial Micro-Expression Grand Challenge

Enhancing Micro-Expression Analysis Performance by Effectively Addressing Data Imbalance

MEGC2023: ACM Multimedia 2023 ME Grand Challenge

4DME: A Spontaneous 4D Micro-Expression Dataset with Multimodalities

Adaptive Graph Attention Network with Temporal Fusion for Micro-Expressions Recognition

AU-assisted Graph Attention Convolutional Network for Micro-Expression Recognition

Multimodal Multi-View Spectral-Spatial-Temporal Masked Autoencoder for Self-Supervised Emotion Recognition

MAE-DFER: Efficient Masked Autoencoder for Self-supervised Dynamic Facial Expression Recognition

Boosting Micro-Expression Recognition Via Self-Expression Reconstruction and Memory Contrastive Learning

Facial Micro-Expressions: an Overview

Towards Facial Micro-Expression Detection and Classification using Modified Multimodal Ensemble Learning Approach

A Two-Stage 3D CNN Based Learning Method for Spontaneous Micro-Expression Recognition

MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition

Global and Local Mixer for Micro-Expression Recognition

Micro-Expression Recognition by Motion Feature Extraction based on Pre-training

Extended Local Binary Patterns for Efficient and Robust Spontaneous Facial Micro-Expression Recognition

ME-PLAN: A deep prototypical learning with local attention network for dynamic micro-expression recognition

Recognizing Spontaneous Micro-Expression Using a Three-Stream Convolutional Neural Network.