Fairness and Bias Mitigation in Computer Vision: A Survey

Sepehr Dehdashtian,Ruozhen He,Yi Li,Guha Balakrishnan,Nuno Vasconcelos,Vicente Ordonez,Vishnu Naresh Boddeti

2024-08-05

Abstract:Computer vision systems have witnessed rapid progress over the past two decades due to multiple advances in the field. As these systems are increasingly being deployed in high-stakes real-world applications, there is a dire need to ensure that they do not propagate or amplify any discriminatory tendencies in historical or human-curated data or inadvertently learn biases from spurious correlations. This paper presents a comprehensive survey on fairness that summarizes and sheds light on ongoing trends and successes in the context of computer vision. The topics we discuss include 1) The origin and technical definitions of fairness drawn from the wider fair machine learning literature and adjacent disciplines. 2) Work that sought to discover and analyze biases in computer vision systems. 3) A summary of methods proposed to mitigate bias in computer vision systems in recent years. 4) A comprehensive summary of resources and datasets produced by researchers to measure, analyze, and mitigate bias and enhance fairness. 5) Discussion of the field's success, continuing trends in the context of multimodal foundation and generative models, and gaps that still need to be addressed. The presented characterization should help researchers understand the importance of identifying and mitigating bias in computer vision and the state of the field and identify potential directions for future research.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper primarily focuses on ensuring fairness and mitigating bias in computer vision systems. As computer vision technology becomes increasingly prevalent in high-risk real-world applications, it is crucial to ensure that these systems do not propagate or exacerbate any discriminatory tendencies present in historical data or human-annotated data. Additionally, it is equally important to prevent the systems from inadvertently learning biases from incorrect correlations.

The paper explores this topic through the following points:
1. **Origins and Technical Definitions of Fairness**: Summarizes the origins and technical definitions of fairness from the broader fair machine learning literature and other related disciplines.
2. **Bias Discovery and Analysis**: Reviews the work on discovering and analyzing bias in computer vision systems.
3. **Bias Mitigation Methods**: Summarizes the methods proposed in recent years to mitigate bias in computer vision systems.
4. **Resources and Datasets**: Provides a comprehensive overview of the resources and datasets generated by researchers to measure, analyze, and mitigate bias and improve fairness.
5. **Current Trends and Future Research Directions**: Discusses the success stories, ongoing trends (especially in multimodal foundation models and generative models), and gaps that still need to be addressed in this field.

The paper particularly emphasizes the differences between computer vision models and models in other domains (such as tabular data and graph data) when addressing fairness issues. It points out that computer vision datasets often lack explicit labels of sensitive attributes, which are usually implicit in the combination of input image pixels and the task-specific target attributes to be inferred. Therefore, the paper presents a comprehensive survey aimed at helping researchers understand the importance of identifying and mitigating computer vision bias and identifying potential research directions for emerging computer vision models in a rapidly evolving space.