Abstract:In recent years, the usage of social media has been increasing exponentially because of its various real world applications in digital communication such as content sharing, entertainment, creating awareness, sending alerts, etc. One such task is to upload images/videos, write comments and post user reactions to express feedback, which can then be used to study human personality traits. Classifying images according to different personality traits, like Agreeableness, Conscientiousness , Extraversion , Neuroticism, Openness, etc., is challenging and essential because of several real-world applications mentioned above. This paper proposes a new personality-traits based method for classifying social images using Fuzzy and genetic algorithms. For each user, the proposed approach extracts profile picture, banners and descriptions to construct a set of vocabularies with the help of text detection, recognition and image annotation. For each word in the vocabulary, we employ a fuzzy logic-based method for obtaining a fuzzy co-occurrence matrix by defining the relationship between the words, which results in a fuzzy co-occurrence matrix for each input data point. We also propose a genetic algorithm based fusion method to generate a feature matrix, which is ultimately fed to the fully connected neural network for classification. The effectiveness of the proposed approach is demonstrated on our dataset with five classes containing 5000 images along with four benchmark datasets, namely, (i) five classes of Liu et al.’s dataset (33556 images) (ii) five classes of PERS dataset (28434 images), (iii) ten classes of Krishnani et al.’s dataset (2000 images), and (iv) two classes of facial emotions of FERPlus dataset (26398 images). The results show that the proposed approach outperforms the existing methods for all the datasets in terms of classification rate.

Feature Analysis and Optimisation for Computational Personality Recognition

Deep learning-based personality recognition from text posts of online social networks

Dynamic Facial Features in Positive-Emotional Speech for Identification of Depressive Tendencies

Thinking Like Psychologist: Learning to Predict Personality by Using Features from Portrait and Social Media.

Speech Personality Recognition Based on Annotation Classification Using Log-Likelihood Distance and Extraction of Essential Audio Features.

Utilizing social media and machine learning for personality and emotion recognition using PERS

A sentiment-aware deep learning approach for personality detection from text

Combining machine learning algorithms for personality trait prediction

Personality Traits Inference in the Hybrid Foraging Search Task.

PsyAttention: Psychological Attention Model for Personality Detection

An Attention-Based Denoising Framework for Personality Detection in Social Media Texts

Two-Faced Humans on Twitter and Facebook: Harvesting Social Multimedia for Human Personality Profiling

A Weighted ML-KNN Model for Predicting Users Personality Traits

A Personality-Based Instant Messaging Software User Classification Model

Beyond The Words: Predicting User Personality From Heterogeneous Information

A Novel Adaptive Conditional Probability-Based Predicting Model for User’s Personality Traits

Fuzzy and Genetic Algorithm Based Approach for Classification of Personality Traits Oriented Social Media Images

Research on Emotion Recognition with Physiological Signals Based on Hybrid Intelligent Optimization Algorithm

Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Features

Integrating audio and visual modalities for multimodal personality trait recognition via hybrid deep learning

TranSentGAT: A Sentiment-Based Lexical Psycholinguistic Graph Attention Network for Personality Prediction