Abstract:Personality analysis from online short videos has gained prominence due to its applications in personalized recommendation systems, sentiment analysis, and human-computer interaction. Traditional assessment methods, such as questionnaires based on the Big Five Personality Framework, are limited by self-report biases and are impractical for large-scale or real-time analysis. Leveraging the rich, multi-modal data present in short videos offers a promising alternative for more accurate personality inference. However, integrating these diverse and asynchronous modalities poses significant challenges, particularly in aligning time-varying data and ensuring models generalize well to new domains with limited labeled data. In this paper, we propose a novel multi-modal personality analysis framework that addresses these challenges by synchronizing and integrating features from multiple modalities and enhancing model generalization through domain adaptation. We introduce a timestamp-based modality alignment mechanism that synchronizes data based on spoken word timestamps, ensuring accurate correspondence across modalities and facilitating effective feature integration. To capture temporal dependencies and inter-modal interactions, we employ Bidirectional Long Short-Term Memory networks and self-attention mechanisms, allowing the model to focus on the most informative features for personality prediction. Furthermore, we develop a gradient-based domain adaptation method that transfers knowledge from multiple source domains to improve performance in target domains with scarce labeled data. Extensive experiments on real-world datasets demonstrate that our framework significantly outperforms existing methods in personality prediction tasks, highlighting its effectiveness in capturing complex behavioral cues and robustness in adapting to new domains.

Personality Assessment Based on Multimodal Attention Network Learning With Category-Based Mean Square Error

Video-based multimodal personality analysis

Multimodal Video-based Apparent Personality Recognition Using Long Short-Term Memory and Convolutional Neural Networks

Cognition-driven multimodal personality classification

Adaptive information fusion network for multi‐modal personality recognition

DeepFace-Attention: Multimodal Face Biometrics for Attention Estimation with Application to e-Learning

PCENet: Psychological Clues Exploration Network for Multimodal Personality Assessment

Enhancing Apparent Personality Trait Analysis with Cross-Modal Embeddings

Integrating audio and visual modalities for multimodal personality trait recognition via hybrid deep learning

CR-Net: A Deep Classification-Regression Network for Multimodal Apparent Personality Analysis

A Comprehensive Multimodal Humanoid System for Personality Assessment Based on the Big Five Model

Gated Siamese Fusion Network based on multimodal deep and hand-crafted features for personality traits assessment

Personality Traits Inference in the Hybrid Foraging Search Task.

Personality-aware Human-centric Multimodal Reasoning: A New Task, Dataset and Baselines

Inferring Personality Traits from Attentive Regions of User Liked Images Via Weakly Supervised Dual Convolutional Network.

Deep learning-based personality recognition from text posts of online social networks

Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation

PsyAttention: Psychological Attention Model for Personality Detection

Deep Bimodal Regression For Apparent Personality Analysis

Learning Person-specific Cognition from Facial Reactions for Automatic Personality Recognition

Personality Classification of Social Users Based on Feature Fusion