Abstract:Previous studies have demonstrated that images are of great importance in attracting people’s attention and motivating them to take action. Various attributes (e.g., colors, aesthetics, and embedded objects) related to images are considered driving factors. Among which emotions in images, in particular, play a critical role in stimulating individuals, based on the Stimulus–Organism–Response theory. Consequently, many researchers put great efforts to understand image emotions, ranging from developing theoretical models to a broad spectrum of applications. Due to the complex and unstructured characteristics of images, identifying image emotions is challenging. Although some significant progress in image emotion classification has been achieved, inherent constraints still remain unaddressed. For example, acquiring a sufficiently large amount of labeled data to train a good model is costly and inevitably requires lots of human efforts. Besides, building a generalized model applicable to different datasets still needs a deep exploration. Image emotions are very subjective, which also makes such a classification task difficult. This paper proposes a general meta-learning framework for the few-shot image emotion classification, called Meta-IEC. Meta-IEC provides the capability of: (i) adapting to a similar dataset but new classes that have not been encountered before, and (ii) generalizing to a completely different dataset where emotion classes are unseen in the training dataset and only very few labeled images are available. Meta-IEC is also able to capture the uncertainty and ambiguity during the meta-testing, where we implement a hierarchical Bayesian graphical model to understand latent relationships among various parameters between meta-training and meta-testing. Extensive experiments on three commonly used datasets empirically demonstrate the superiority of our method over several state-of-the-art baselines. For example, our meta-learning based model can achieve performance improvement up to 5+%. We also provide some managerial implications on parameter sensitivity and label selection of meta-training and meta-testing.

Learning Meta-Knowledge for Few-Shot Image Emotion Recognition

Finding Emotions in Faces: A Meta-Classifier

Speech Emotion Recognition Based on Meta-Transfer Learning with Domain Adaption

Meta-learning methodology based on meta-unsupervised algorithm for meta-model selection to solve few-shot base-tasks

Zero-Shot Emotion Recognition Via Affective Structural Embedding.

Few-Shot Classification of Aerial Scene Images via Meta-Learning

Meta-Prototypical Learning for Domain-Agnostic Few-Shot Recognition

Image Emotion Computing

A Multi-Stage Visual Perception Approach for Image Emotion Analysis

A supervised contrastive learning-based model for image emotion classification

MetaDelta: A Meta-Learning System for Few-shot Image Classification

Predicting Personalized Emotion Perceptions of Social Images

Learning Multi-level Representations for Image Emotion Recognition in the Deep Convolutional Network

Few-shot Learning for Fine-grained Emotion Recognition using Physiological Signals

Adaptive Deep Metric Learning for Affective Image Retrieval and Classification

A Versatile Multimodal Learning Framework For Zero-shot Emotion Recognition

Structural Attention Enhanced Continual Meta-Learning for Graph Edge Labeling Based Few-Shot Remote Sensing Scene Classification

Meta-Information Guided Meta-Learning for Few-Shot Relation Classification.

Multi-Output Learning Based on Multimodal GCN and Co-Attention for Image Aesthetics and Emotion Analysis

Optimization model based on attention mechanism for few-shot image classification

Learning to focus: cascaded feature matching network for few-shot image recognition