Abstract:The increasingly popular application of AI runs the risk of amplifying social bias, such as classifying non-white faces as animals. Recent research has largely attributed this bias to the training data implemented. However, the underlying mechanism is poorly understood; therefore, strategies to rectify the bias are unresolved. Here, we examined a typical deep convolutional neural network (DCNN), VGG-Face, which was trained with a face dataset consisting of more white faces than black and Asian faces. The transfer learning result showed significantly better performance in identifying white faces, similar to the well-known social bias in humans, the other-race effect (ORE). To test whether the effect resulted from the imbalance of face images, we retrained the VGG-Face with a dataset containing more Asian faces, and found a reverse ORE that the newly-trained VGG-Face preferred Asian faces over white faces in identification accuracy. Additionally, when the number of Asian faces and white faces were matched in the dataset, the DCNN did not show any bias. To further examine how imbalanced image input led to the ORE, we performed a representational similarity analysis on VGG-Face's activation. We found that when the dataset contained more white faces, the representation of white faces was more distinct, indexed by smaller in-group similarity and larger representational Euclidean distance. That is, white faces were scattered more sparsely in the representational face space of the VGG-Face than the other faces. Importantly, the distinctiveness of faces was positively correlated with identification accuracy, which explained the ORE observed in the VGG-Face. In summary, our study revealed the mechanism underlying the ORE in DCNNs, which provides a novel approach to studying AI ethics. In addition, the face multidimensional representation theory discovered in humans was also applicable to DCNNs, advocating for future studies to apply more cognitive theories to understand DCNNs' behavior.

Neural Dynamics of Racial Categorization Predicts Racial Bias in Face Recognition and Altruism

Functional neuroanatomy of racial categorization from visual perception: A meta-analytic study

Non-phase-locked Alpha Oscillations Are Involved in Spontaneous Racial Categorization of Faces

Distinct Patterns of Neural Response to Faces from Different Races in Humans and Deep Networks

The Neural Basis of Contextual Influences on Face Categorization.

Attitudes Influence Implicit Racial Face Categorization in a Perceptual Task

Revealing the neural representations underlying other-race face perception

Reflexive Activation of Monoracial Categories During Multiracial Categorization

Neurocognitive Basis of Racial Ingroup Bias in Empathy.

Priority of Racial and Gender Categorization of Faces: A Social Task Demand Framework.

Creative Mindset Reduces Racial Ingroup Bias in Empathic Neural Responses.

Shifting racial identities reduces racial ingroup biases in empathy and altruistic decision-making

Multidimensional Face Representation in a Deep Convolutional Neural Network Reveals the Mechanism Underlying AI Racism

Influences of Culture and Visual Context on Real-Time Social Categorization.

Representing Object Categories by Connections: Evidence from a Mutivariate Connectivity Pattern Classification Approach.

Manipulations of Cognitive Strategies and Intergroup Relationships Reduce the Racial Bias in Empathic Neural Responses

Empirically Identifying and Computationally Modeling the Brain-Behavior Relationship for Human Scene Categorization

Belief in biological origin of race (racial essentialism) increases sensitivities to cultural category changes measured by ERP mismatch negativity (MMN)

Minimal group membership biases early neural processing of emotional expressions

Neural representation of perceived race mediates the opposite relationship between subcomponents of self-construals and racial outgroup punishment.

Individuating and categorizing faces: The other-race effect is reduced by attending to racial but not identity cues