Abstract:The interest in the facial expression recognition (FER) is increasing day by day due to its practical and potential applications, such as human physiological interaction diagnosis and mental diseases detection. This area has received much attention from the research community in recent years and achieved remarkable results; however, a significant improvement is required in spatial problems. This research work presents a novel framework and proposes an effective and robust solution for FER under an unconstrained environment. Face detection is performed using the supervision of facial attributes. Faceness-Net is used for deep facial part responses for the detection of faces under severe unconstrained variations. In order to improve the generalization problems and avoid insufficient data regime, Deep Convolutional Graphical Adversarial Network (DC-GAN) is utilized. Due to the challenging environmental factors faced in the wild, a large number of noises disrupt feature extraction, thus making it hard to capture ground truth. We leverage different multimodal sensors with a camera that aids in data acquisition, by extracting the features more accurately and improve the overall performance of FER. These intelligent sensors are used to tackle the significant challenges like illumination variance, subject dependence, and head pose. Dual-enhanced capsule network is used which is able to handle the spatial problem. The traditional capsule networks are unable to sufficiently extract the features, as the distance varies greatly between facial features. Therefore, the proposed network is capable of spatial transformation due to action unit aware mechanism and thus forward most desiring features for dynamic routing between capsules. Squashing function is used for the classification function. We have elaborated the effectiveness of our method by validating the results on four popular and versatile databases that outperform all state-of-the-art methods.

Training deep networks for facial expression recognition with crowd-sourced label distribution

Cgan Based Facial Expression Recognition for Human-Robot Interaction

A New Deep Learning Method for Multi-label Facial Expression Recognition Based on Local Constraint Features

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network.

USTST: Unsupervised Self-Training Similarity Transfer for Cross-Domain Facial Expression Recognition

Facial Emotion Recognition with Noisy Multi-task Annotations

Joint Deep Learning of Facial Expression Synthesis and Recognition

Blended Emotion in-the-Wild: Multi-label Facial Expression Recognition Using Crowdsourced Annotations and Deep Locality Feature Learning

Deep Learning from Crowds

Reliable Crowdsourcing and Deep Locality-Preserving Learning for Expression Recognition in the Wild

Facial expression recognition of masked faces using deep learning

Adaptively Learning Facial Expression Representation via C-F Labels and Distillation

Robust Lightweight Facial Expression Recognition Network with Label Distribution Training

Deep Balanced Learning for Long-tailed Facial Expressions Recognition

Facial Expression Recognition Using Deep Neural Network

Uncertain and Biased Facial Expression Recognition Based on Depthwise Separable Convolutional Neural Network with Embedded Attention Mechanism

Distribution Mining and Noise Correction for Facial Expression Recognition

A dual‐channel ensembled deep convolutional neural network for facial expression recognition in the wild

Empirical Investigation of Multimodal Sensors in Novel Deep Facial Expression Recognition In-the-Wild

Cross-Domain Facial Expression Recognition via Contrastive Warm up and Complexity-Aware Self-Training