Abstract:Affective Computing (AC), integrating computer science, psychology, and cognitive science knowledge, aims to enable machines to recognize, interpret, and simulate human <a class="link-external link-http" href="http://emotions.To" rel="external noopener nofollow">this http URL</a> create more value, AC can be applied to diverse scenarios, including social media, finance, healthcare, education, etc. Affective Computing (AC) includes two mainstream tasks, i.e., Affective Understanding (AU) and Affective Generation (AG). Fine-tuning Pre-trained Language Models (PLMs) for AU tasks has succeeded considerably. However, these models lack generalization ability, requiring specialized models for specific tasks. Additionally, traditional PLMs face challenges in AG, particularly in generating diverse and emotionally rich responses. The emergence of Large Language Models (LLMs), such as the ChatGPT series and LLaMA models, brings new opportunities and challenges, catalyzing a paradigm shift in AC. LLMs possess capabilities of in-context learning, common sense reasoning, and advanced sequence generation, which present unprecedented opportunities for AU. To provide a comprehensive overview of AC in the LLMs era from an NLP perspective, we summarize the development of LLMs research in this field, aiming to offer new insights. Specifically, we first summarize the traditional tasks related to AC and introduce the preliminary study based on LLMs. Subsequently, we outline the relevant techniques of popular LLMs to improve AC tasks, including Instruction Tuning and Prompt Engineering. For Instruction Tuning, we discuss full parameter fine-tuning and parameter-efficient methods such as LoRA, P-Tuning, and Prompt Tuning. In Prompt Engineering, we examine Zero-shot, Few-shot, Chain of Thought (CoT), and Agent-based methods for AU and AG. To clearly understand the performance of LLMs on different Affective Computing tasks, we further summarize the existing benchmarks and evaluation methods.

Affect Recognition in Conversations Using Large Language Models

DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations

AER-LLM: Ambiguity-aware Emotion Recognition Leveraging Large Language Models

E-chat: Emotion-sensitive Spoken Dialogue System with Large Language Models

Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Models

Language Models as Emotional Classifiers for Textual Conversation

Recognizing Emotion Regulation Strategies from Human Behavior with Large Language Models

Real-time emotion generation in human-robot dialogue using large language models

Recent Advancement of Emotion Cognition in Large Language Models

Customising General Large Language Models for Specialised Emotion Recognition Tasks

Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective

Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal Nuances

Large Language Models Understand and Can be Enhanced by Emotional Stimuli

Emotion-Aware Response Generation Using Affect-Enriched Embeddings with LLMs

EmoLLMs: A Series of Emotional Large Language Models and Annotation Tools for Comprehensive Affective Analysis

Speak From Heart: An Emotion-Guided LLM-Based Multimodal Method for Emotional Dialogue Generation

EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models

Emotional intelligence of Large Language Models

Understanding Naturalistic Facial Expressions with Deep Learning and Multimodal Large Language Models

Toward a Dialogue System Using a Large Language Model to Recognize User Emotions with a Camera

Modeling Emotions and Ethics with Large Language Models