Abstract:Appearance can affect social interaction, which in turn affects personality development. There is ample evidence that facial morphology and social cues provide information about human personality and behavior. In this study, we focused on the relationship between self-reported personality characteristics and facial features. We propose a new approach for predicting college students' personality characteristics (on the basis of the Big Five personality characteristics) with static facial images. First, we construct a dataset containing 13,347 data pairs composed of facial images and personality characteristics. Second, we train a deep neural network with 10,667 sample pairs from the dataset and use the remaining samples to test (1335 pairs) and validate (1335 pairs) self-reported Big Five personalities. We trained a series of deep neural networks on a large, labeled dataset to predict the self-reported Big Five personality trait scores. This novel work applies deep learning to this topic. We also verify the network's advanced nature on the publicly available database with obvious personality characteristics. The experimental results show that 1) personality traits can be reliably predicted from facial images with an accuracy that exceeds 70%. In five-character tag classification, the recognition accuracy of neuroticism and extroversion was the most accurate, and the prediction accuracy exceeded 90%. 2) Deep learning neural network features are better than traditional manual features in predicting personality characteristics. The results strongly support the application of neural networks trained on large-scale labeled datasets in multidimensional personality feature prediction from static facial images. 3) There are some differences in the personality traits of college students with different academic backgrounds. Future research can explore the relative contribution of other facial image fe-tures in predicting other personality characteristics.

Unpacking the CNN’s Algorithmic “Glass Ceiling” of Inferring Psychological Traits from Facial Images

Enhancing Facial Emotion Recognition with a Modified Deep Convolutional Neural Network

Golden Ratio: The Attributes Of Facial Attractiveness Learned By Cnn

Scoring facial attractiveness with deep convolutional neural networks: How training on standardized images reduces the bias of facial expressions

Deep learning reveals what facial expressions mean to people in different cultures

A set of distinct facial traits learned by machines is not predictive of appearance bias in the wild

Physiognomy: Personality Traits Prediction by Learning

Identifying individual facial expressions by deconstructing a neural network

Using Human-like Mechanism to Weaken Effect of Pre-training Weight Bias in Face-Recognition Convolutional Neural Network

Learning to see people like people

Predicting and visualizing psychological attributions with a deep neural network

A new humanlike facial attractiveness predictor with cascaded fine-tuning deep learning model

Putative Ratios of Facial Attractiveness in a Deep Neural Network

Predicting Social Perception from Faces: A Deep Learning Approach

Automated Facial Trait Judgment and Election Outcome Prediction: Social Dimensions of Face

Face processing emerges from object-trained convolutional neural networks

Learning the Cultural Consistent Facial Aesthetics by Convolutional Neural Network

Which Face is More Attractive?

Prediction of the Big Five Personality Traits Using Static Facial Images of College Students With Different Academic Backgrounds

The differences in essential facial areas for impressions between humans and deep learning models: An eye‐tracking and explainable AI approach

Face representation by deep learning: a linear encoding in a parameter space?