Abstract:Emotional intelligence significantly impacts our daily behaviors and interactions. Although Large Language Models (LLMs) are increasingly viewed as a stride toward artificial general intelligence, exhibiting impressive performance in numerous tasks, it is still uncertain if LLMs can genuinely grasp psychological emotional stimuli. Understanding and responding to emotional cues gives humans a distinct advantage in problem-solving. In this paper, we take the first step towards exploring the ability of LLMs to understand emotional stimuli. To this end, we first conduct automatic experiments on 45 tasks using various LLMs, including Flan-T5-Large, Vicuna, Llama 2, BLOOM, ChatGPT, and GPT-4. Our tasks span deterministic and generative applications that represent comprehensive evaluation scenarios. Our automatic experiments show that LLMs have a grasp of emotional intelligence, and their performance can be improved with emotional prompts (which we call "EmotionPrompt" that combines the original prompt with emotional stimuli), e.g., 8.00% relative performance improvement in Instruction Induction and 115% in BIG-Bench. In addition to those deterministic tasks that can be automatically evaluated using existing metrics, we conducted a human study with 106 participants to assess the quality of generative tasks using both vanilla and emotional prompts. Our human study results demonstrate that EmotionPrompt significantly boosts the performance of generative tasks (10.9% average improvement in terms of performance, truthfulness, and responsibility metrics). We provide an in-depth discussion regarding why EmotionPrompt works for LLMs and the factors that may influence its performance. We posit that EmotionPrompt heralds a novel avenue for exploring interdisciplinary knowledge for human-LLMs interaction.

Integrating Physiological Data with Large Language Models for Empathic Human-AI Interaction

Assessing Empathy in Large Language Models with Real-World Physician-Patient Interactions

Modeling Emotions and Ethics with Large Language Models

PhysioLLM: Supporting Personalized Health Insights with Wearables and Large Language Models

Labels Generated by Large Language Model Helps Measuring People's Empathy in Vitro

Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental Health

Can AI Relate: Testing Large Language Model Response for Mental Health Support

Are Large Language Models More Empathetic than Humans?

Empathy Through Multimodality in Conversational Interfaces

Large Language Models Understand and Can be Enhanced by Emotional Stimuli

Can Large Language Models Exhibit Cognitive and Affective Empathy as Humans?

Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Support

Large Language Models (LLMs) and Empathy - A Systematic Review

Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements

Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction

Building Emotional Support Chatbots in the Era of LLMs

Large Language Models Produce Responses Perceived to be Empathic

PALLM: Evaluating and Enhancing PALLiative Care Conversations with Large Language Models

EEG Emotion Copilot: Pruning LLMs for Emotional EEG Interpretation with Assisted Medical Record Generation

Emotion-Aware Response Generation Using Affect-Enriched Embeddings with LLMs

Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Models