Abstract:Three state-of-the-art language-and-image AI models, CLIP, SLIP, and BLIP, are evaluated for evidence of a bias previously observed in social and experimental psychology: equating American identity with being White. Embedding association tests (EATs) using standardized images of self-identified Asian, Black, Latina/o, and White individuals from the Chicago Face Database (CFD) reveal that White individuals are more associated with collective in-group words than are Asian, Black, or Latina/o individuals. In assessments of three core aspects of American identity reported by social psychologists, single-category EATs reveal that images of White individuals are more associated with patriotism and with being born in America, but that, consistent with prior findings in psychology, White individuals are associated with being less likely to treat people of all races and backgrounds equally. Three downstream machine learning tasks demonstrate biases associating American with White. In a visual question answering task using BLIP, 97% of White individuals are identified as American, compared to only 3% of Asian individuals. When asked in what state the individual depicted lives in, the model responds China 53% of the time for Asian individuals, but always with an American state for White individuals. In an image captioning task, BLIP remarks upon the race of Asian individuals as much as 36% of the time, but never remarks upon race for White individuals. Finally, provided with an initialization image from the CFD and the text "an American person," a synthetic image generator (VQGAN) using the text-based guidance of CLIP lightens the skin tone of individuals of all races (by 35% for Black individuals, based on pixel brightness). The results indicate that biases equating American identity with being White are learned by language-and-image AI, and propagate to downstream applications of such models.

Beliefs About Jesus’s Race, Implicit Bias, and Cultural Correlates Among Asian American College Students

Acceptability of racial microaggressions among Asian American college students: internalized model minority myth, individualism, and social conscience as correlates

Internalized model minority myth among Asian Americans: Links to anti-Black attitudes and opposition to affirmative action.

The color continuum: Skin tone and online dating preferences among Asian Americans

Black and White: the Role of Color Bias in Implicit Race Bias

Lay theory of race affects and moderates Asian Americans' responses toward American culture.

Color-Blindness and Commonality

Model Minority Stereotype: Influence on Perceived Mental Health Needs of Asian Americans

Jewish Americans' identity salience and effects on attitudes toward diversity

To See or Not To See: Preservice Teacher Attitudes Toward Color Blindness

Discrimination and depressive symptoms among Black and Asian American college students: Shared and group-specific processes of self-concept.

Looking White But Feeling Asian: The Role of Perceived Membership Permeability and Perceived Discrimination in Multiracial-Monoracial Alliances

American == White in Multimodal Language-and-Image AI

The influence of task demands and implicit racial bias on face-sensitive visual ERPs to own- and other-race faces

Income Inequality and White-on-Black Racial Bias in the United States: Evidence From Project Implicit and Google Trends

Profiles of racial discussions and associations with parent sociocultural factors and internalized racism in Asian American families

Belief in biological origin of race (racial essentialism) increases sensitivities to cultural category changes measured by ERP mismatch negativity (MMN)

An Unintentional, Robust, and Replicable Pro-Black Bias in Social Judgment

Effects of Implicit Racial Bias and Standardized Patient Race on Genetic Counseling Students' Patient-Centered Communication

Familial and religious ethnic-racial socialization in promoting activism among Asian American Christians

Internalized Racism and Gendered Colorism Among African Americans: a Study of Intragroup Bias, Perceived Discrimination, and Psychological Well-being