Abstract:A micro-expression is a fleeting, delicate and localized facial gesture. It can expose the true feelings that someone is trying to hide and is seen to be a crucial indicator for spotting lies. Because of its possible applications in a variety of sectors, micro-expression research has garnered a lot of attention. The accuracy of micro-expression recognition still needs to be improved, though, because of the brief and weak motions that make up micro-expressions. In recent years, Deep convolution neural methods have depicted a higher degree of efficiency for complex challenge of face detection. Although several attempts were made for micro-expression recognition (MER), the problem is far from being resolved problem which is portrayed by the lowest accuracy rate depicted by the other models. In this study, present a Facial Micro-Expression Detection and Classification using Modified Multimodal Ensemble Learning (FMEDC-MMEL) approach. The major intention of the FMEDC-MMEL technique lies in the proficient identification of MEs that exist in the facial images. As a pre-processing phase, the FMEDC-MMEL technique exploits histogram equalization (HE) approach to improve the contrast level of the image. In the FMEDC-MMEL technique, improved densely connected networks (DenseNet) model is used for learning feature patterns from the pre-processed images. To enhance the proficiency of the improved DenseNet model, stochastic gradient descent (SGD) approach is used for hyperparameter selection process. For facial ME detection, the FMEDC-MMEL technique follows an ensemble of three classifiers namely bi-directional gated recurrent unit (Bi-GRU), long short-term memory (LSTM) and extreme learning machine (ELM). A tailored ensemble learning approach is shown, which combines many machine learning models to improve classification performance and detection accuracy. Sophisticated feature extraction methods are utilized to extract the subtle aspects of micro-expressions, and precision is maintained by optimizations that minimize computing cost. Empirical findings reveal that this methodology notably surpasses conventional techniques, providing enhanced precision and resilience on a variety of complex and demanding datasets. In addition to pushing the boundaries of micro-expression analysis research, the proposed strategy has potential uses in the real world in fields including security, psychology testing, and human-computer interaction.

A Review of Micro-expression Recognition Based on Deep Learning

Deep Learning for Micro-Expression Recognition: A Survey

Deep Insights of Learning based Micro Expression Recognition: A Perspective on Promises, Challenges and Research Needs

An Overview of Facial Micro-Expression Analysis: Data, Methodology and Challenge

A Survey of Micro-expression Recognition Methods Based on LBP, Optical Flow and Deep Learning

Facial Micro-Expressions: an Overview

Spontaneous Facial Micro-expression Recognition Via Deep Convolutional Network

Exploring Holistic Discriminative Representation for Micro-Expression Recognition Via Contrastive Learning

A Review on Facial Micro-Expressions Analysis: Datasets, Features and Metrics

Facial Micro-Expression Recognition Based on Deep Local-Holistic Network

Micro-Expression Recognition by Motion Feature Extraction based on Pre-training

Micro-Expression Recognition Using Uncertainty-Aware Magnification-Robust Networks

Towards Facial Micro-Expression Detection and Classification using Modified Multimodal Ensemble Learning Approach

Micro-Expression Recognition Based on Multi-task Learning and Resnet18

A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face

Micro-Attention for Micro-Expression recognition

Fine-Grained Micro-Expression Recognition Based on Hierarchical Attention Mechanism

Review of Micro-Expression Spotting and Recognition in Video Sequences

A comprehensive bibliometric survey of micro-expression recognition system based on deep learning

SKD-TSTSAN: Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition

MERTA: Micro-Expression Recognition with Ternary Attentions