Achieve Fairness without Demographics for Dermatological Disease Diagnosis

Ching-Hao Chiu,Yu-Jen Chen,Yawen Wu,Yiyu Shi,Tsung-Yi Ho

DOI: https://doi.org/10.1016/j.media.2024.103188

2024-01-16

Abstract:In medical image diagnosis, fairness has become increasingly crucial. Without bias mitigation, deploying unfair AI would harm the interests of the underprivileged population and potentially tear society apart. Recent research addresses prediction biases in deep learning models concerning demographic groups (e.g., gender, age, and race) by utilizing demographic (sensitive attribute) information during training. However, many sensitive attributes naturally exist in dermatological disease images. If the trained model only targets fairness for a specific attribute, it remains unfair for other attributes. Moreover, training a model that can accommodate multiple sensitive attributes is impractical due to privacy concerns. To overcome this, we propose a method enabling fair predictions for sensitive attributes during the testing phase without using such information during training. Inspired by prior work highlighting the impact of feature entanglement on fairness, we enhance the model features by capturing the features related to the sensitive and target attributes and regularizing the feature entanglement between corresponding classes. This ensures that the model can only classify based on the features related to the target attribute without relying on features associated with sensitive attributes, thereby improving fairness and accuracy. Additionally, we use disease masks from the Segment Anything Model (SAM) to enhance the quality of the learned feature. Experimental results demonstrate that the proposed method can improve fairness in classification compared to state-of-the-art methods in two dermatological disease datasets.

Computer Vision and Pattern Recognition,Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve fairness prediction in dermatological diagnosis without using demographic information. Specifically, the authors note that existing deep - learning models have prediction biases when processing skin disease images of different populations. These biases may lead to unfair treatment of certain groups, thereby harming social interests. To overcome this problem, the paper proposes a method that can achieve fair prediction of sensitive attributes during the testing phase without using this sensitive - attribute information during the training process. This method improves fairness and accuracy by capturing features related to sensitive and target attributes and regularizing the feature entanglement of corresponding categories, ensuring that the model classifies only based on features related to the target attribute and not on those related to the sensitive attribute. In addition, the paper also utilizes disease masks generated by the Segment Anything Model (SAM) to enhance the quality of the learned features. Experimental results show that the proposed method can improve the fairness of classification better than the existing state - of - the - art methods on two dermatological disease datasets.