Abstract:The interest in Facial Expression Recognition (FER) is increasing day by day due to its practical and potential applications, such as human physiological interaction diagnosis and mental disease detection. This area has received much attention from the research community in recent years and achieved remarkable results; however, a significant improvement is required in spatial problems. This research work presents a novel framework and proposes an effective and robust solution for FER under an unconstrained environment; it also helps us to classify facial images in the client/server model along with preserving privacy. There are a lot of cryptography techniques available but they are computationally expensive; on the other side, we have implemented a lightweight method capable of ensuring secure communication with the help of randomization. Initially, we perform preprocessing techniques to encounter the unconstrained environment. Face detection is performed for the removal of excessive background and it detects the face in the real-world environment. Data augmentation is for the insufficient data regime. A dual-enhanced capsule network is used to handle the spatial problem. The traditional capsule networks are unable to sufficiently extract the features, as the distance varies greatly between facial features. Therefore, the proposed network is capable of spatial transformation due to the action unit aware mechanism and thus forwards the most desiring features for dynamic routing between capsules. The squashing function is used for classification purposes. Simple classification is performed through a single party, whereas we also implemented the client/server model with privacy measurements. Both parties do not trust each other, as they do not know the input of each other. We have elaborated that the effectiveness of our method remains unchanged by preserving privacy by validating the results on four popular and versatile databases that outperform all the homomorphic cryptographic techniques.

Facial Expression Recognition with Controlled Privacy Preservation and Feature Compensation

DR-FER: Discriminative and Robust Representation Learning for Facial Expression Recognition

Fusion of Machine Learning and Privacy Preserving for Secure Facial Expression Recognition

Privacy-Protected Facial Expression Recognition Augmented by High-Resolution Facial Images.

Towards a dynamic expression recognition system under facial occlusion

A Multi-Input Fusion Model for Privacy and Semantic Preservation in Facial Image Datasets

PRO-Face C: Privacy-Preserving Recognition of Obfuscated Face via Feature Compensation

Edge-AI-Driven Framework with Efficient Mobile Network Design for Facial Expression Recognition

Improving Federated Learning Face Recognition via Privacy-Agnostic Clusters

Facial Expression Recognition Considering Individual Differences in Facial Structure and Texture.

ErasableMask: A Robust and Erasable Privacy Protection Scheme against Black-box Face Recognition Models

Transferable Adversarial Facial Images for Privacy Protection

Feeling Without Sharing: A Federated Video Emotion Recognition Framework Via Privacy-Agnostic Hybrid Aggregation

Efficient lower layers parameter decoupling personalized federated learning method of facial expression recognition for home care robots

Facial Expression Recognition of Intercepted Video Sequences Based on Feature Point Movement Trend and Feature Block Texture Variation.

Real-Time Facial Expression Recognition Based on Attention Mechanism

Pri-EMO: A Universal Perturbation Method for Privacy Preserving Facial Emotion Recognition

Privacy Preserving Face Recognition Utilizing Differential Privacy

Disentangling Identity and Pose for Facial Expression Recognition

Privileged Attribution Constrained Deep Networks for Facial Expression Recognition

Feeling Without Sharing