Abstract:Background:Personality psychology studies personality and its variation among individuals and is an essential branch of psychology. In recent years, machine learning research related to personality assessment has started to focus on the online environment and showed outstanding performance in personality assessment. However, the aspects of the personality of these prediction models measure remain unclear because few studies focus on the interpretability of personality prediction models. The objective of this study is to develop and validate a machine learning model with domain knowledge introduced to enhance accuracy and improve interpretability.Methods:Study participants were recruited via an online experiment platform. After excluding unqualified participants and downloading the Weibo posts of eligible participants, we used six psycholinguistic and mental health-related lexicons to extract textual features. Then the predictive personality model was developed using the multi-objective extra trees method based on 3,411 pairs of social media expression and personality trait scores. Subsequently, the prediction model's validity and reliability were evaluated, and each lexicon's feature importance was calculated. Finally, the interpretability of the machine learning model was discussed.Results:The features from Culture Value Dictionary were found to be the most important predictors. The fivefold cross-validation results regarding the prediction model for personality traits ranged between 0.44 and 0.48 (p < 0.001). The correlation coefficients of five personality traits between the two "split-half" datasets data ranged from 0.84 to 0.88 (p < 0.001). Moreover, the model performed well in terms of contractual validity.Conclusion:By introducing domain knowledge to the development of a machine learning model, this study not only ensures the reliability and validity of the prediction model but also improves the interpretability of the machine learning method. The study helps explain aspects of personality measured by such prediction models and finds a link between personality and mental health. Our research also has positive implications regarding the combination of machine learning approaches and domain knowledge in the field of psychiatry and its applications to mental health.

Modeling of User Portrait Through Social Media

Cross-Platform Modeling of Users' Behavior on Social Media

Personality Prediction Based on All Characters of User Social Media Information

Identifying Users Based On Behavioral-Modeling Across Social Media Sites

Social Media Profiler: Inferring Your Social Media Personality from Visual Attributes in Portrait.

Modeling and Analysis of Group User Portrait through WeChat Mini Program

An Algorithm for User Interest Modeling Using Facial Expression Recognition.

Thinking Like Psychologist: Learning to Predict Personality by Using Features from Portrait and Social Media.

Big-Five Personality Prediction Based on User Behaviors at Social Network Sites

Privacy-Friendly Personality Recognition in Social Media: A Case Study of Chinese WeChat Users

Predicting Users' Demographic Characteristics in a Chinese Social Media Network

Characterizing User Behavior in Weibo

How Social Media Expression Can Reveal Personality.

Exploring the Dynamic Interplay of User Characteristics and Topic Influence on Weibo: A Comprehensive Analysis

Understanding User Behavior in Sina Weibo Online Social Network: A Community Approach

A Multi-Model Approach for User Portrait.

Inferring User Profiles in Social Media by Joint Modeling of Text and Networks

Deep Learning for Constructing Microblog Behavior Representation to Identify Social Media User’s Personality

A Novel Adaptive Conditional Probability-Based Predicting Model for User’s Personality Traits

When A Friend Online Is More Than A Friend In Life: Intimate Relationship Prediction In Microblogs

Two-Faced Humans on Twitter and Facebook: Harvesting Social Multimedia for Human Personality Profiling