Abstract:Affective Computing (AC), integrating computer science, psychology, and cognitive science knowledge, aims to enable machines to recognize, interpret, and simulate human <a class="link-external link-http" href="http://emotions.To" rel="external noopener nofollow">this http URL</a> create more value, AC can be applied to diverse scenarios, including social media, finance, healthcare, education, etc. Affective Computing (AC) includes two mainstream tasks, i.e., Affective Understanding (AU) and Affective Generation (AG). Fine-tuning Pre-trained Language Models (PLMs) for AU tasks has succeeded considerably. However, these models lack generalization ability, requiring specialized models for specific tasks. Additionally, traditional PLMs face challenges in AG, particularly in generating diverse and emotionally rich responses. The emergence of Large Language Models (LLMs), such as the ChatGPT series and LLaMA models, brings new opportunities and challenges, catalyzing a paradigm shift in AC. LLMs possess capabilities of in-context learning, common sense reasoning, and advanced sequence generation, which present unprecedented opportunities for AU. To provide a comprehensive overview of AC in the LLMs era from an NLP perspective, we summarize the development of LLMs research in this field, aiming to offer new insights. Specifically, we first summarize the traditional tasks related to AC and introduce the preliminary study based on LLMs. Subsequently, we outline the relevant techniques of popular LLMs to improve AC tasks, including Instruction Tuning and Prompt Engineering. For Instruction Tuning, we discuss full parameter fine-tuning and parameter-efficient methods such as LoRA, P-Tuning, and Prompt Tuning. In Prompt Engineering, we examine Zero-shot, Few-shot, Chain of Thought (CoT), and Agent-based methods for AU and AG. To clearly understand the performance of LLMs on different Affective Computing tasks, we further summarize the existing benchmarks and evaluation methods.

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve This paper aims to explore the development of Affective Computing (AC) in the era of Large Language Models (LLMs) and provides a comprehensive review from the perspective of Natural Language Processing (NLP). Specifically, the paper focuses on the following aspects: 1. The traditional tasks of **Affective Understanding (AU)** and **Affective Generation (AG)** and their progress in the era of LLMs. 2. How techniques such as **Instruction Tuning** and **Prompt Engineering** enhance the performance of LLMs in affective computing tasks. 3. **Existing benchmarks and evaluation methods** to systematically assess the performance of LLMs in affective computing tasks. 4. **Challenges and future research directions**, including ethical considerations and effective evaluation. ### Background and Motivation Before the emergence of LLMs, affective computing mainly relied on the fine-tuning of Pre-trained Language Models (PLMs) such as BERT and RoBERTa. Although these methods achieved significant success in affective understanding tasks, they had limitations in generalization ability and affective generation tasks. The advent of LLMs has brought new opportunities and challenges, especially excelling in affective understanding and generation tasks. However, there is currently a lack of comprehensive reviews on LLMs in the field of affective computing, and this paper fills that gap. ### Main Contributions 1. **Summary of Developments**: An overview of the research progress of LLMs in the field of affective computing, providing new insights. 2. **Technical Introduction**: A detailed introduction to techniques such as instruction tuning and prompt engineering, and their applications in affective computing tasks. 3. **Performance Evaluation**: A summary of existing benchmarks and evaluation methods, providing references for systematically assessing the performance of LLMs. 4. **Challenges and Prospects**: A discussion of the main challenges faced in the field of affective computing and suggestions for future research directions. ### Conclusion Through this review, the authors hope to provide valuable references for researchers, helping them better understand and apply the potential of LLMs in affective computing. The paper highlights the advantages and limitations of LLMs in affective computing tasks and points out key directions for future research.

Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspective

Recent Advancement of Emotion Cognition in Large Language Models

Large Language Models Understand and Can be Enhanced by Emotional Stimuli

Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Models

Large Multimodal Agents: A Survey

Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey

Large Language Models Meet NLP: A Survey

Affect Recognition in Conversations Using Large Language Models

EmoLLMs: A Series of Emotional Large Language Models and Annotation Tools for Comprehensive Affective Analysis

A Survey of Large Language Models

What's Next in Affective Modeling? Large Language Models

Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements

Can Large Language Models Exhibit Cognitive and Affective Empathy as Humans?

A Survey of Large Language Models in Medicine: Progress, Application, and Challenge

A Survey on Evaluation of Large Language ModelsJust Accepted

Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Support

Do Large Language Models Possess Sensitive to Sentiment?

The Rise and Potential of Large Language Model Based Agents: A Survey

A Survey on Evaluation of Large Language Models

From Linguistic Giants to Sensory Maestros: A Survey on Cross-Modal Reasoning with Large Language Models

Large Language Models for Data Annotation and Synthesis: A Survey