Abstract:Previous studies have demonstrated that images are of great importance in attracting people’s attention and motivating them to take action. Various attributes (e.g., colors, aesthetics, and embedded objects) related to images are considered driving factors. Among which emotions in images, in particular, play a critical role in stimulating individuals, based on the Stimulus–Organism–Response theory. Consequently, many researchers put great efforts to understand image emotions, ranging from developing theoretical models to a broad spectrum of applications. Due to the complex and unstructured characteristics of images, identifying image emotions is challenging. Although some significant progress in image emotion classification has been achieved, inherent constraints still remain unaddressed. For example, acquiring a sufficiently large amount of labeled data to train a good model is costly and inevitably requires lots of human efforts. Besides, building a generalized model applicable to different datasets still needs a deep exploration. Image emotions are very subjective, which also makes such a classification task difficult. This paper proposes a general meta-learning framework for the few-shot image emotion classification, called Meta-IEC. Meta-IEC provides the capability of: (i) adapting to a similar dataset but new classes that have not been encountered before, and (ii) generalizing to a completely different dataset where emotion classes are unseen in the training dataset and only very few labeled images are available. Meta-IEC is also able to capture the uncertainty and ambiguity during the meta-testing, where we implement a hierarchical Bayesian graphical model to understand latent relationships among various parameters between meta-training and meta-testing. Extensive experiments on three commonly used datasets empirically demonstrate the superiority of our method over several state-of-the-art baselines. For example, our meta-learning based model can achieve performance improvement up to 5+%. We also provide some managerial implications on parameter sensitivity and label selection of meta-training and meta-testing.

Finding Emotions in Faces: A Meta-Classifier

Facial Emotions Recognition Using Deep Learning Technology

Human Facial Emotion Recognition using Deep Neural Networks

Optimal Facial Feature Based Emotional Recognition Using Deep Learning Algorithm

EmoNet: Exploring Facial Emotion Recognition Through Machine Learning

AI in Pursuit of Happiness, Finding Only Sadness: Multi-Modal Facial Emotion Recognition Challenge

Face Emotion Recognition Based on Machine Learning: A Review

Facial geometric feature extraction based emotional expression classification using machine learning algorithms

Can CNNs Accurately Classify Human Emotions? A Deep-Learning Facial Expression Recognition Study

Hybrid CNN-SVM Classifier for Human Emotion Recognition Using ROI Extraction and Feature Fusion

A real time face emotion classification and recognition using deep learning model

FER_ML: Facial Emotion Recognition using Machine Learning

Face Emotion Recognization Using Dataset Augmentation Based on Neural Network

Learning Meta-Knowledge for Few-Shot Image Emotion Recognition

A comparative study on facial expression recognition using local binary patterns, convolutional neural network and frequency neural network

Sentiment Analysis from Face Expressions Based on Image Processing Using Deep Learning Methods

Breaking New Ground in Affective Computing: Enhanced Facial Expression Classification via CNN-SVM Integration

Mental Health State Classification Using Facial Emotion Recognition and Detection

Human Face Emotion in 3D Using Machine Learning

Human facial emotion recognition using improved black hole based extreme learning machine

Image-based facial emotion recognition using convolutional neural network on emognition dataset