Abstract:Images play a vital role in social media platforms, which can more vividly reflect people's inner emotions and preferences, so visual sentiment analysis has become an important research topic. In this paper, we propose a Supervised Contrastive Learning-based model for image emotion classification, which consists of two modules of low-level feature extraction and deep emotional feature extraction, and feature fusion is used to enhance the overall perception of image emotions. In the low-level feature extraction module, the LBP-U (Local Binary Patterns with Uniform Patterns) algorithm is employed to extract texture features from the images, which can effectively capture the texture information of the images, aiding in the differentiation of images belonging to different emotion categories. In the deep emotional feature extraction module, we introduce a Supervised Contrastive Learning approach to improve the extraction of deep emotional features by narrowing the intra-class distance among images of the same emotion category while expanding the inter-class distance between images of different emotion categories. Through fusing the low-level and deep emotional features, our model comprehensively utilizes features at different levels, thereby enhancing the overall emotion classification performance. To assess the classification performance and generalization capability of the proposed model, we conduct experiments on the publicly FI (Flickr and Instagram) Emotion dataset. Comparative analysis of the experimental results demonstrates that our proposed model has good performance for image emotion classification. Additionally, we conduct ablation experiments to analyze the impact of different levels of features and various loss functions on the model's performance, thereby validating the superiority of our proposed approach.

Object aroused emotion analysis network for image sentiment analysis

Object Semantics Sentiment Correlation Analysis Enhanced Image Sentiment Classification

ARMNet: A Network for Image Dimensional Emotion Prediction Based on Affective Region Extraction and Multi-Channel Fusion

Graph-based Object Semantic Refinement for Visual Emotion Recognition

A Multi-Stage Visual Perception Approach for Image Emotion Analysis

Human Emotion Recognition With Relational Region-Level Analysis

Progressive Visual Content Understanding Network for Image Emotion Classification

Beyond Object Recognition: Visual Sentiment Analysis with Deep Coupled Adjective and Noun Neural Networks

A Multi-feature Fusion and SSAE-Based Deep Network for Image Semantic Recognition

Recognizing Image Semantic Information Through Multi-Feature Fusion and SSAE-Based Deep Network

Object-Based Visual Sentiment Concept Analysis and Application

Multimodal Emotion Classification with Multi-Level Semantic Reasoning Network

A supervised contrastive learning-based model for image emotion classification

Attention-based multi-level image and text sentiment analysis

Image Emotion Analysis Based on Semantic Concepts

Image Aesthetic Assessment Based on Emotion-Assisted Multi-Task Learning Network

Image Aesthetics Assessment With Emotion-Aware Multibranch Network

Visual Sentiment Prediction Based on Automatic Discovery of Affective Regions

Objectivity meets subjectivity: A subjective and objective feature fused neural network for emotion recognition

Joint Weakly Supervised Image Emotion Analysis Based on Interclass Discrimination and Intraclass Correlation

Establishing a Large Scale Dataset for Image Emotion Analysis Using Chinese Emotion Ontology