Abstract:The interest in the facial expression recognition (FER) is increasing day by day due to its practical and potential applications, such as human physiological interaction diagnosis and mental diseases detection. This area has received much attention from the research community in recent years and achieved remarkable results; however, a significant improvement is required in spatial problems. This research work presents a novel framework and proposes an effective and robust solution for FER under an unconstrained environment. Face detection is performed using the supervision of facial attributes. Faceness-Net is used for deep facial part responses for the detection of faces under severe unconstrained variations. In order to improve the generalization problems and avoid insufficient data regime, Deep Convolutional Graphical Adversarial Network (DC-GAN) is utilized. Due to the challenging environmental factors faced in the wild, a large number of noises disrupt feature extraction, thus making it hard to capture ground truth. We leverage different multimodal sensors with a camera that aids in data acquisition, by extracting the features more accurately and improve the overall performance of FER. These intelligent sensors are used to tackle the significant challenges like illumination variance, subject dependence, and head pose. Dual-enhanced capsule network is used which is able to handle the spatial problem. The traditional capsule networks are unable to sufficiently extract the features, as the distance varies greatly between facial features. Therefore, the proposed network is capable of spatial transformation due to action unit aware mechanism and thus forward most desiring features for dynamic routing between capsules. Squashing function is used for the classification function. We have elaborated the effectiveness of our method by validating the results on four popular and versatile databases that outperform all state-of-the-art methods.

Multi-facial patches aggregation network for facial expression recognition and facial regions contributions to emotion display

Deep Multi-Facial Patches Aggregation Network For Facial Expression Recognition

Facial Expression Recognition Using Hierarchical Features with Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks

Facial expression recognition through multi-level features extraction and fusion

Multi-Attention Module for Dynamic Facial Emotion Recognition

Facial Expression Recognition Via Region-Based Convolutional Fusion Network.

Adaptive multilayer perceptual attention network for facial expression recognition

Visual Scene-Aware Hybrid and Multi-Modal Feature Aggregation for Facial Expression Recognition

Facial Expression Recognition Using Deep Neural Network

Empirical Investigation of Multimodal Sensors in Novel Deep Facial Expression Recognition In-the-Wild

Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network

Facial Expression Recognition Using Hybrid Features of Pixel and Geometry

FLEPNet: Feature Level Ensemble Parallel Network for Facial Expression Recognition

The Facial Expression Recognition Method Based on Image Fusion and CNN

MCF-Net: Fusion Network of Facial and Scene Features for Expression Recognition in the Wild

Patch Attention Network for Video Facial Expression Recognition.

A Robust Facial Expression Recognition Algorithm Based on Multi-Rate Feature Fusion Scheme

Multi-relations Aware Network for in-the-wild Facial Expression Recognition

Deep Spatial and Channel Sliding Attention Patches for Pose-invariant Facial Expression Recognition

Improved facial emotion recognition model based on a novel deep convolutional structure

Uncertain and Biased Facial Expression Recognition Based on Depthwise Separable Convolutional Neural Network with Embedded Attention Mechanism