Abstract:Datasets play an important role in the progress of facial expression recognition algorithms, but they may suffer from obvious biases caused by different cultures and collection conditions. To look deeper into this bias, we first conduct comprehensive experiments on dataset recognition and cross-dataset generalization tasks, and for the first time, explore the intrinsic causes of the dataset discrepancy. The results quantitatively verify that current datasets have a strong build-in bias, and corresponding analyses indicate that the conditional probability distributions between source and target datasets are different. However, previous researches are mainly based on shallow features with limited discriminative ability under the assumption that the conditional distribution remains unchanged across domains. To address these issues, we further propose a novel deep Emotion-Conditional Adaption Network (ECAN) to learn domain-invariant and discriminative feature representations, which can match not only the marginal distribution but also the class-conditional distribution across domains by exploring the underlying label information of the target dataset. Moreover, the largely ignored expression class distribution bias is also addressed so that the training and testing domains can share similar class distribution. Extensive cross-database experiments on both lab-controlled datasets (CK+, JAFFE, MMI, and Oulu-CASIA) and real-world databases (AffectNet, FER2013, RAF-DB 2.0, and SFEW 2.0) demonstrate that our ECAN can yield competitive performances across various cross-dataset facial expression recognition tasks and outperform the state-of-the-art methods.

Facial Expressions as a Vulnerability in Face Recognition

Investigating Bias and Fairness in Facial Expression Recognition

On the Robustness of Face Recognition Algorithms Against Attacks and Bias

Adv-Emotion: the Facial Expression Adversarial Attack

The More Secure, The Less Equally Usable: Gender and Ethnicity (Un)fairness of Deep Face Recognition along Security Thresholds

Learning Emotional-Blinded Face Representations

Explaining Bias in Deep Face Recognition via Image Characteristics

Ethical AI in facial expression analysis: racial bias

Facial identity protection using deep learning technologies: an application in affective computing

Robustness Disparities in Face Detection

Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition

Rethinking the Vulnerabilities of Face Recognition Systems:From a Practical Perspective

A Deeper Look at Facial Expression Dataset Bias

Exploring Racial Bias within Face Recognition via per-subject Adversarially-Enabled Data Augmentation

Fairness Under Cover: Evaluating the Impact of Occlusions on Demographic Bias in Facial Recognition

A Survey of the Trends in Facial and Expression Recognition Databases and Methods

A Comprehensive Study on Face Recognition Biases Beyond Demographics

Enhancing Fairness in Face Detection in Computer Vision Systems by Demographic Bias Mitigation.

Racial Bias within Face Recognition: A Survey

Comparing Human and Machine Bias in Face Recognition

Using Positive Matching Contrastive Loss with Facial Action Units to mitigate bias in Facial Expression Recognition