ViG-Bias: Visually Grounded Bias Discovery and Mitigation

Badr-Eddine Marani,Mohamed Hanini,Nihitha Malayarukil,Stergios Christodoulidis,Maria Vakalopoulou,Enzo Ferrante

2024-08-05

Abstract:The proliferation of machine learning models in critical decision making processes has underscored the need for bias discovery and mitigation strategies. Identifying the reasons behind a biased system is not straightforward, since in many occasions they are associated with hidden spurious correlations which are not easy to spot. Standard approaches rely on bias audits performed by analyzing model performance in pre-defined subgroups of data samples, usually characterized by common attributes like gender or ethnicity when it comes to people, or other specific attributes defining semantically coherent groups of images. However, it is not always possible to know a-priori the specific attributes defining the failure modes of visual recognition systems. Recent approaches propose to discover these groups by leveraging large vision language models, which enable the extraction of cross-modal embeddings and the generation of textual descriptions to characterize the subgroups where a certain model is underperforming. In this work, we argue that incorporating visual explanations (e.g. heatmaps generated via GradCAM or other approaches) can boost the performance of such bias discovery and mitigation frameworks. To this end, we introduce Visually Grounded Bias Discovery and Mitigation (ViG-Bias), a simple yet effective technique which can be integrated to a variety of existing frameworks to improve both, discovery and mitigation performance. Our comprehensive evaluation shows that incorporating visual explanations enhances existing techniques like DOMINO, FACTS and Bias-to-Text, across several challenging datasets, including CelebA, Waterbirds, and NICO++.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper attempts to address the issue of discovering and mitigating bias in machine learning models. Specifically, the authors point out that in many critical decision-making processes where machine learning models are widely used, identifying the causes of bias is not easy because these causes are often related to hidden spurious correlations that are not easily detected. Existing methods typically rely on bias audits of predefined data subsets, which are usually defined by common attributes (such as gender, race, etc.), but this approach does not always reveal the specific attributes of failure patterns in visual recognition systems.

To overcome this challenge, the paper proposes a new technique called ViG-Bias (Visually Grounded Bias Discovery and Mitigation). ViG-Bias enhances existing bias discovery and mitigation frameworks by incorporating visual explanations (e.g., heatmaps generated by GradCAM or other methods). This approach aims to improve the effectiveness of bias discovery and mitigation by focusing attention on the spurious features on which model biases are based.

The main contributions of the paper include:
1. Providing experimental evidence that visual explanations of biased models often focus on spurious correlations.
2. Using these visual explanations to guide the attention of existing bias discovery and mitigation methods, thereby improving performance.
3. Demonstrating that ViG-Bias can be easily adapted to various existing bias discovery and mitigation methods, such as DOMINO, FACTS, and Bias-to-Text, and systematically enhancing the performance of these methods on multiple challenging datasets.

In summary, the paper proposes a novel approach to improve bias discovery and mitigation in machine learning models by leveraging visual explanations, thereby enhancing the fairness and robustness of the models.