Abstract:In recent years, there have been significant advancements in computer vision which have led to the widespread deployment of image recognition and generation systems in socially relevant applications, from hiring to security screening. However, the prevalence of biases within these systems has raised significant ethical and social concerns. The most extensively studied biases in this context are related to gender, race and age. Yet, other biases are equally pervasive and harmful, such as lookism, i.e., the preferential treatment of individuals based on their physical appearance. Lookism remains under-explored in computer vision but can have profound implications not only by perpetuating harmful societal stereotypes but also by undermining the fairness and inclusivity of AI technologies. Thus, this paper advocates for the systematic study of lookism as a critical bias in computer vision models. Through a comprehensive review of existing literature, we identify three areas of intersection between lookism and computer vision. We illustrate them by means of examples and a user study. We call for an interdisciplinary approach to address lookism, urging researchers, developers, and policymakers to prioritize the development of equitable computer vision systems that respect and reflect the diversity of human appearances.
Computer Vision and Pattern Recognition,Artificial Intelligence,Computers and Society
What problem does this paper attempt to address?
The paper primarily explores the issue of "lookism" bias present in computer vision systems and calls for systematic research and solutions to address this problem. Lookism refers to the preferential treatment based on an individual's appearance, a bias that is prevalent in society and may be amplified or perpetuated by computer vision systems, thereby affecting fairness and inclusivity.
The paper first introduces the widespread application of computer vision technology in modern society, including areas such as recruitment, security screening, social media interaction, and medical diagnosis. However, the bias issues in these systems have raised ethical and social concerns. While gender, race, and age biases have been extensively studied, lookism, as another equally pervasive and harmful bias, has not been sufficiently explored in the field of computer vision.
Next, the paper explains the roots of lookism from the perspective of cognitive biases, mentioning concepts such as the halo effect of attractiveness, aesthetic heuristics, and confirmation bias. The authors then discuss the interaction between lookism and computer vision, divided into two aspects:
1. **Beauty Filters and Lookism**: Beauty filters can mitigate human appearance biases by making people's appearances more aligned with societal aesthetic standards, achieving a certain degree of equalization. However, this may also exacerbate gender stereotypes.
2. **Algorithmic Lookism**: When the datasets used to train computer vision systems reflect human biases, these systems may learn and perpetuate these biases. For example, facial recognition systems may tend to associate certain appearance features with positive traits, leading to unfair treatment and reinforcing social biases.
Additionally, the paper mentions the potential lookism issues in text-to-image (T2I) models and explores similar biases that may exist in decision support systems.
Finally, the authors point out the challenges in researching lookism, including the subjectivity and cultural differences in appearance perception, the lack of awareness of this bias, and inconsistencies in legal protections. The paper emphasizes the importance of interdisciplinary collaboration and calls on researchers, developers, and policymakers to work together to ensure that computer vision technology reflects the diversity of human appearances, promoting a fair and inclusive social environment.