FairCLIP: Harnessing Fairness in Vision-Language Learning

Yan Luo,Min Shi,Muhammad Osama Khan,Muhammad Muneeb Afzal,Hao Huang,Shuaihang Yuan,Yu Tian,Luo Song,Ava Kouhana,Tobias Elze,Yi Fang,Mengyu Wang

2024-04-06

Abstract:Fairness is a critical concern in deep learning, especially in healthcare, where these models influence diagnoses and treatment decisions. Although fairness has been investigated in the vision-only domain, the fairness of medical vision-language (VL) models remains unexplored due to the scarcity of medical VL datasets for studying fairness. To bridge this research gap, we introduce the first fair vision-language medical dataset Harvard-FairVLMed that provides detailed demographic attributes, ground-truth labels, and clinical notes to facilitate an in-depth examination of fairness within VL foundation models. Using Harvard-FairVLMed, we conduct a comprehensive fairness analysis of two widely-used VL models (CLIP and BLIP2), pre-trained on both natural and medical domains, across four different protected attributes. Our results highlight significant biases in all VL models, with Asian, Male, Non-Hispanic, and Spanish being the preferred subgroups across the protected attributes of race, gender, ethnicity, and language, respectively. In order to alleviate these biases, we propose FairCLIP, an optimal-transport-based approach that achieves a favorable trade-off between performance and fairness by reducing the Sinkhorn distance between the overall sample distribution and the distributions corresponding to each demographic group. As the first VL dataset of its kind, Harvard-FairVLMed holds the potential to catalyze advancements in the development of machine learning models that are both ethically aware and clinically effective. Our dataset and code are available at

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper aims to address the fairness issues of Vision-Language (VL) models in the medical field. Specifically:

- **Research Background and Motivation**: Despite the great potential of deep learning in medical diagnosis, biases in models can lead to healthcare inequalities and adverse patient outcomes. Existing research mainly focuses on the fairness of image processing models, while there is less research on the fairness of Vision-Language models (especially in the medical field). Additionally, there is currently a lack of multimodal datasets with detailed demographic information, which limits in-depth research on the fairness of these models.

- **Main Contributions**:
- Introduced the first medical dataset (Harvard-FairVLMed) for studying the fairness of VL models, which includes detailed patient demographic attributes, ground truth labels, and clinical notes.
- Conducted a comprehensive fairness analysis of two widely used VL models (CLIP and BLIP2) using this dataset, revealing significant disparities among different demographic groups.
- Proposed a method based on optimal transport (FairCLIP) that improves the balance between model performance and fairness by minimizing the Sinkhorn distance between sample distributions.

Through this work, the paper hopes to promote the development of machine learning models that are both ethical and clinically effective, laying the foundation for future research.