Abstract:Micro-expressions describe unconscious facial movements which reflect a person's psychological state even when there is an attempt to conceal it. Often used in psychological and forensic applications, their manual recognition requires professional training and is time consuming. Therefore, achieving automatic recognition by means of computer vision would confer enormous benefits. Facial Action Unit (AU) is a coding of facial muscular complexes which can be independently activated. Each AU represents a specific facial action. In the present paper, we propose a method for the challenging task that is the detection of activated AUs when the micro-expression occurs, which is crucial in the inference of emotion from a video capturing a micro-expression. This specific problem is made all the more difficult in the light of limited amounts of data available and the subtlety of micro-movements. We propose a segmentation method for key facial sub-regions based on the location of AUs and facial landmarks, which extracts 11 facial key regions from each sequence of micro-expression images. AUs are assigned to different local areas for multi-label classification. Considering that there is little prior work on the specific task of detection of AU activation in the existing literature on micro-expression analysis, for the evaluation of the proposed method we design an AU independent cross-validation method and adopt Unweighted Average Recall (UAR), Unweighted F1-score (UF1), and their average as the scoring criteria. Evaluated using the established standards in the field and compared with previous work, our approach is shown to exhibit state-of-the-art performance.

Facial Action Unit Detection with Multilayer Fused Multi-Task and Multi-Label Deep Learning Network

Facial Action Units Detection Aided by Global-Local Expression Embedding

View-Independent Facial Action Unit Detection.

Region And Temporal Dependency Fusion For Multi-Label Action Unit Detection

Multi View Facial Action Unit Detection Based on CNN and BLSTM-RNN.

Graph-Based Multi-Modal Multi-View Fusion for Facial Action Unit Recognition

Facial Action Unit Detection by Exploring the Weak Relationships Between AU Labels

Facial Action Units Detection with Multi-Features and -AUs Fusion

Multi-view Facial Action Unit Detection Via Deep Feature Enhancement

AU-vMAE: Knowledge-Guide Action Units Detection via Video Masked Autoencoder

Facial Action Unit Detection with Local Key Facial Sub-region Based Multi-label Classification for Micro-expression Analysis.

MMA-Net: Multi-view Mixed Attention Mechanism for Facial Action Unit Detection

AU-aware Deep Networks for Facial Expression Recognition

Joint Patch And Multi-Label Learning For Facial Action Unit Detection

A Novel Dual-channel Graph Convolutional Neural Network for Facial Action Unit Recognition

Facial Action Unit Detection Using Attention and Relation Learning

Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment

Multi-Scale Region with Local Relationship Learning for Facial Action Unit Detection

Deep Region And Multi-Label Learning For Facial Action Unit Detection

Boosting Facial Action Unit Detection Through Jointly Learning Facial Landmark Detection and Domain Separation and Reconstruction

Dual Learning for Joint Facial Landmark Detection and Action Unit Recognition