Abstract:Three state-of-the-art language-and-image AI models, CLIP, SLIP, and BLIP, are evaluated for evidence of a bias previously observed in social and experimental psychology: equating American identity with being White. Embedding association tests (EATs) using standardized images of self-identified Asian, Black, Latina/o, and White individuals from the Chicago Face Database (CFD) reveal that White individuals are more associated with collective in-group words than are Asian, Black, or Latina/o individuals. In assessments of three core aspects of American identity reported by social psychologists, single-category EATs reveal that images of White individuals are more associated with patriotism and with being born in America, but that, consistent with prior findings in psychology, White individuals are associated with being less likely to treat people of all races and backgrounds equally. Three downstream machine learning tasks demonstrate biases associating American with White. In a visual question answering task using BLIP, 97% of White individuals are identified as American, compared to only 3% of Asian individuals. When asked in what state the individual depicted lives in, the model responds China 53% of the time for Asian individuals, but always with an American state for White individuals. In an image captioning task, BLIP remarks upon the race of Asian individuals as much as 36% of the time, but never remarks upon race for White individuals. Finally, provided with an initialization image from the CFD and the text "an American person," a synthetic image generator (VQGAN) using the text-based guidance of CLIP lightens the skin tone of individuals of all races (by 35% for Black individuals, based on pixel brightness). The results indicate that biases equating American identity with being White are learned by language-and-image AI, and propagate to downstream applications of such models.

Implicit Attitudes Evoked by a Singular American Slur: Five Experiments on Ner and Na in Samples of Black and White Americans

Black and White: the Role of Color Bias in Implicit Race Bias

Contextual determinants on the meaning of the N word

The development of implicit attitudes. Evidence of race evaluations from ages 6 and 10 and adulthood

Racial slurs and perception of racism in Heart of Darkness

The Price of Racial Bias

An Unintentional, Robust, and Replicable Pro-Black Bias in Social Judgment

Intonation and Referee Design Phenomena in the Narrative Speech of Black/Biracial Men

Implicit Black identification among White non-Hispanic respondents and support for Black reparations

Attitudes Influence Implicit Racial Face Categorization in a Perceptual Task

Social-Cognitive and Affective Antecedents of Code Switching and the Consequences of Linguistic Racism for Black People and People of Color

A Novel Method for Analysing Racial Bias: Collection of Person Level References

Shifts in Racial Inequalities and White Backlash in the 21st Century U.S.

Status Characteristics, Implicit Bias, and the Production of Racial Inequality

When Societal Norms and Social Identity Collide

Black Americans suppress emotions when prejudice is believed to stem from shared ignorance

Identifying Racial Minorities' Nationality: Non-verbal Accent as a Cue to Cultural Group Membership

Rating the Honesty of White and Black Children via Implicit and Explicit Measures: Implications for Child Victims in the Criminal Justice System

Income Inequality and White-on-Black Racial Bias in the United States: Evidence From Project Implicit and Google Trends

Shades of meaning: skin tone, racial attitudes, and constructive memory in African American children

American == White in Multimodal Language-and-Image AI

Implicit Attitudes Evoked by a Singular American Slur: Five Experiments on N***er and N***a in Samples of Black and White Americans