Abstract:The ability to perceive human facial emotions is an essential feature of various multi-modal applications, especially in the intelligent human-computer interaction (HCI) area. In recent decades, considerable efforts have been put into researching automatic facial emotion recognition (FER). However, most of the existing FER methods only focus on either basic emotions such as the seven/eight categories (e.g., happiness, anger and surprise ) or abstract dimensions ( valence, arousal, etc. ), while neglecting the fruitful nature of emotion statements. In real-world scenarios, there is definitely a larger vocabulary for describing human's inner feelings as well as their reflection on facial expressions. In this work, we propose to address the semantic richness issue in the FER problem, with an emphasis on the granularity of the emotion concepts. Particularly, we take inspiration from former psycho-linguistic research, which conducted a prototypicality rating study and chose 135 emotion names from hundreds of English emotion terms. Based on the 135 emotion categories, we investigate the corresponding facial expressions by collecting a large-scale 135-class FER image dataset and propose a consequent facial emotion recognition framework. To demonstrate the accessibility of prompting FER research to a fine-grained level, we conduct extensive evaluations on the dataset credibility and the accompanying baseline classification model. The qualitative and quantitative results prove that the problem is meaningful and our solution is effective. To the best of our knowledge, this is the first work aimed at exploiting such a large semantic space for emotion representation in the FER problem.

Creating a Chinese Emotion Lexicon Based on Corpus Ren-CECps

Build Chinese emotion lexicons using a graph-based algorithm and multiple resources

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Manually Crafted Chinese Text Corpus for Text Emotion Recognition.

A CRF-based Method for Automatic Construction of Chinese Symptom Lexicon

Attention-Enhanced Connectionist Temporal Classification for Discrete Speech Emotion Recognition

Chinese EmoBank: Building Valence-Arousal Resources for Dimensional Sentiment Analysis

Building Corpus with Emoticons for Sentiment Analysis.

A Novel Emotion Lexicon for Chinese Emotional Expression Analysis on Weibo: Using Grounded Theory and Semi-Automatic Methods

The Creation of a Chinese Emotion Ontology Based on HowNet

Emotion-enhanced classification based on fuzzy reasoning

Building a Chinese Natural Emotional Audio-Visual Database

Semantic-Rich Facial Emotional Expression Recognition

Attention-Based BiLSTM Network with Lexical Feature for Emotion Classification

CHEAVD: a Chinese natural emotional audio–visual database

Generating sentiment lexicon of online social network based on emotions

Emotional Classification of Chinese Idioms Based on Chinese Idiom Knowledge Base.

Text-based emotion classification using emotion cause extraction

Sentiment Analysis of Chinese Micro-blogs Based on Emoticons and Emotional Words

Research on Sentiment Dictionary Based on Sentiment Analysis in News Domain.

Human-LLM Collaborative Construction of a Cantonese Emotion Lexicon