Abstract:A micro-expression is a fleeting, delicate and localized facial gesture. It can expose the true feelings that someone is trying to hide and is seen to be a crucial indicator for spotting lies. Because of its possible applications in a variety of sectors, micro-expression research has garnered a lot of attention. The accuracy of micro-expression recognition still needs to be improved, though, because of the brief and weak motions that make up micro-expressions. In recent years, Deep convolution neural methods have depicted a higher degree of efficiency for complex challenge of face detection. Although several attempts were made for micro-expression recognition (MER), the problem is far from being resolved problem which is portrayed by the lowest accuracy rate depicted by the other models. In this study, present a Facial Micro-Expression Detection and Classification using Modified Multimodal Ensemble Learning (FMEDC-MMEL) approach. The major intention of the FMEDC-MMEL technique lies in the proficient identification of MEs that exist in the facial images. As a pre-processing phase, the FMEDC-MMEL technique exploits histogram equalization (HE) approach to improve the contrast level of the image. In the FMEDC-MMEL technique, improved densely connected networks (DenseNet) model is used for learning feature patterns from the pre-processed images. To enhance the proficiency of the improved DenseNet model, stochastic gradient descent (SGD) approach is used for hyperparameter selection process. For facial ME detection, the FMEDC-MMEL technique follows an ensemble of three classifiers namely bi-directional gated recurrent unit (Bi-GRU), long short-term memory (LSTM) and extreme learning machine (ELM). A tailored ensemble learning approach is shown, which combines many machine learning models to improve classification performance and detection accuracy. Sophisticated feature extraction methods are utilized to extract the subtle aspects of micro-expressions, and precision is maintained by optimizations that minimize computing cost. Empirical findings reveal that this methodology notably surpasses conventional techniques, providing enhanced precision and resilience on a variety of complex and demanding datasets. In addition to pushing the boundaries of micro-expression analysis research, the proposed strategy has potential uses in the real world in fields including security, psychology testing, and human-computer interaction.

MicroEmo: Time-Sensitive Multimodal Emotion Recognition with Micro-Expression Dynamics in Video Dialogues

MFDR: Multiple-stage Fusion and Dynamically Refined Network for Multimodal Emotion Recognition

EmoLLM: Multimodal Emotional Understanding Meets Large Language Models

Video Emotion Open-vocabulary Recognition Based on Multimodal Large Language Model

Synergistic Spotting and Recognition of Micro-Expression via Temporal State Transition

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

EALD-MLLM: Emotion Analysis in Long-sequential and De-identity videos with Multi-modal Large Language Model

Multimodal interaction enhanced representation learning for video emotion recognition

A robust multimodal approach for emotion recognition

FV2ES: A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition Inference

Speak From Heart: An Emotion-Guided LLM-Based Multimodal Method for Emotional Dialogue Generation

Enhancing Micro-Expression Analysis Performance by Effectively Addressing Data Imbalance

EMO-LLaMA: Enhancing Facial Emotion Understanding with Instruction Tuning

Multiple Spatio-temporal Feature Learning for Video-based Emotion Recognition in the Wild

Multimodal Utterance-level Affect Analysis using Visual, Audio and Text Features

Micro-Attention for Micro-Expression recognition

Transformer-Based Multimodal Emotional Perception for Dynamic Facial Expression Recognition in the Wild

Adaptive Graph Attention Network with Temporal Fusion for Micro-Expressions Recognition

Self-adaptive Context and Modal-interaction Modeling For Multimodal Emotion Recognition

Towards Facial Micro-Expression Detection and Classification using Modified Multimodal Ensemble Learning Approach

Micro-expression recognition based on euler video magnification and 3D residual network under imbalanced sample