Abstract:The most prominent tasks in emotion analysis are to assign emotions to texts and to understand how emotions manifest in language. An observation for NLP is that emotions can be communicated implicitly by referring to events, appealing to an empathetic, intersubjective understanding of events, even without explicitly mentioning an emotion name. In psychology, the class of emotion theories known as appraisal theories aims at explaining the link between events and emotions. Appraisals can be formalized as variables that measure a cognitive evaluation by people living through an event that they consider relevant. They include the assessment if an event is novel, if the person considers themselves to be responsible, if it is in line with the own goals, and many others. Such appraisals explain which emotions are developed based on an event, e.g., that a novel situation can induce surprise or one with uncertain consequences could evoke fear. We analyze the suitability of appraisal theories for emotion analysis in text with the goal of understanding if appraisal concepts can reliably be reconstructed by annotators, if they can be predicted by text classifiers, and if appraisal concepts help to identify emotion categories. To achieve that, we compile a corpus by asking people to textually describe events that triggered particular emotions and to disclose their appraisals. Then, we ask readers to reconstruct emotions and appraisals from the text. This setup allows us to measure if emotions and appraisals can be recovered purely from text and provides a human baseline. Our comparison of text classification methods to human annotators shows that both can reliably detect emotions and appraisals with similar performance. Therefore, appraisals constitute an alternative computational emotion analysis paradigm and further improve the categorization of emotions in text with joint models.

APPReddit: a Corpus of Reddit Posts Annotated for Appraisal

Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Prediction

Emotion-Aware, Emotion-Agnostic, or Automatic: Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

Evaluating Subjective Cognitive Appraisals of Emotions from Large Language Models

Appraisal Theories for Emotion Classification in Text

x-enVENT: A Corpus of Event Descriptions with Experiencer-specific Emotion and Appraisal Annotations

Crowdsourcing and Validating Event-focused Emotion Corpora for German and English

On the Complementarity of Images and Text for the Expression of Emotions in Social Media

A First Step in Combining Cognitive Event Features and Natural Language Representations to Predict Emotions

The Moral Foundations Reddit Corpus

Manually Crafted Chinese Text Corpus for Text Emotion Recognition.

An approach for evaluating emotion tagged corpus

GoodNewsEveryone: A Corpus of News Headlines Annotated with Emotions, Semantic Roles, and Reader Perception

The ABBE Corpus: Animate Beings Being Emotional

Experiencer-Specific Emotion and Appraisal Prediction

EmoBank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion Analysis

CAPE: A Chinese Dataset for Appraisal-based Emotional Generation using Large Language Models

Nonlinguistic vocalizations from online amateur videos for emotion research: A validated corpus

Chinese EmoBank: Building Valence-Arousal Resources for Dimensional Sentiment Analysis

Towards a new Benchmark for Emotion Detection in NLP: A Unifying Framework of Recent Corpora

APTNESS: Incorporating Appraisal Theory and Emotion Support Strategies for Empathetic Response Generation