Abstract:Personality determines a wide variety of human daily and working behaviours, and is crucial for understanding human internal and external states. In recent years, a large number of automatic personality computing approaches have been developed to predict either the apparent personality or self-reported personality of the subject based on non-verbal audio-visual behaviours. However, the majority of them suffer from complex and dataset-specific pre-processing steps and model training tricks. In the absence of a standardized benchmark with consistent experimental settings, it is not only impossible to fairly compare the real performances of these personality computing models but also makes them difficult to be reproduced. In this paper, we present the first reproducible audio-visual benchmarking framework to provide a fair and consistent evaluation of eight existing personality computing models (e.g., audio, visual and audio-visual) and seven standard deep learning models on both self-reported and apparent personality recognition tasks. Building upon a set of benchmarked models, we also investigate the impact of two previously-used long-term modelling strategies for summarising short-term/frame-level predictions on personality computing results. We conduct a comprehensive investigation into all the benchmarked models to demonstrate their capabilities in modelling personality traits on two publicly available datasets, audio-visual apparent personality (ChaLearn First Impression) and self-reported personality (UDIVA) datasets. The experimental results conclude: (i) apparent personality traits, inferred from facial behaviours by most benchmarked deep learning models, show more reliability than self-reported ones; (ii) visual models frequently achieved superior performances than audio models on personality recognition; (iii) non-verbal behaviours contribute differently in predicting different personality traits; and (iv) our reproduced personality computing models generally achieved worse performances than their original reported results. We make all the code and settings of this personality computing benchmark publicly available at https://github.com/liaorongfan/DeepPersonality.

Developing and evaluating language-based machine learning algorithms for inferring applicant personality in video interviews

Can Large Language Models Assess Personality from Asynchronous Video Interviews? A Comprehensive Evaluation of Validity, Reliability, Fairness, and Rating Patterns

Validity Evidence for Off-the-Shelf Language-Based Personality Assessment Using Video Interviews: Convergent and Discriminant Relationships with Self and Observer Ratings

Grading video interviews with fairness considerations

Psychometric and Validity Issues in Machine Learning Approaches to Personality Assessment: A Focus on Social Media Text Mining

Estimating the Personality of White-Box Language Models

Exploring a Language-Based Interest Assessment: Predicting Vocational Interests on Social Media Using Natural Language Processing

Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation

Feasibility of Big Data Analytics to Assess Personality Based on Voice Analysis

A deep learning approach to text-based personality prediction using multiple data sources mapping

Humanity in AI: Detecting the Personality of Large Language Models

Scoring a forced-choice image-based assessment of personality: A comparison of machine learning, regression, and summative approaches

Using Machine Learning to Advance Personality Assessment and Theory

Evaluating and Inducing Personality in Pre-trained Language Models

AI Psychometrics: Assessing the Psychological Profiles of Large Language Models Through Psychometric Inventories

Getting Personal: A Deep Learning Artifact for Text-Based Measurement of Personality

Leveraging Multimodal Behavioral Analytics for Automated Job Interview Performance Assessment and Feedback

LMLPA: Language Model Linguistic Personality Assessment

PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits

Latent Human Traits in the Language of Social Media: An Open-Vocabulary Approach

An Open-source Benchmark of Deep Learning Models for Audio-visual Apparent and Self-reported Personality Recognition