Large Language Models are Capable of Offering Cognitive Reappraisal, if Guided

Hongli Zhan,Allen Zheng,Yoon Kyung Lee,Jina Suh,Junyi Jessy Li,Desmond C. Ong
2024-08-08
Abstract:Large language models (LLMs) have offered new opportunities for emotional support, and recent work has shown that they can produce empathic responses to people in distress. However, long-term mental well-being requires emotional self-regulation, where a one-time empathic response falls short. This work takes a first step by engaging with cognitive reappraisals, a strategy from psychology practitioners that uses language to targetedly change negative appraisals that an individual makes of the situation; such appraisals is known to sit at the root of human emotional experience. We hypothesize that psychologically grounded principles could enable such advanced psychology capabilities in LLMs, and design RESORT which consists of a series of reappraisal constitutions across multiple dimensions that can be used as LLM instructions. We conduct a first-of-its-kind expert evaluation (by clinical psychologists with M.S. or Ph.D. degrees) of an LLM's zero-shot ability to generate cognitive reappraisal responses to medium-length social media messages asking for support. This fine-grained evaluation showed that even LLMs at the 7B scale guided by RESORT are capable of generating empathic responses that can help users reappraise their situations.
Computation and Language
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to use large - language models (LLMs) to provide cognitive reappraisal to help people regulate their emotions. Specifically, the author focuses on how, through guiding principles, LLMs can generate reappraisal suggestions for specific negative cognitive evaluations, thus helping individuals re - evaluate the situations they face and further improve their emotional states. Traditional psychological support methods are time - consuming, labor - intensive and costly, while LLMs, due to their high efficiency, low cost and scalability, become a potential solution. However, to achieve this goal, it is necessary to design a guiding framework based on psychological principles so that LLMs can generate effective cognitive reappraisal responses. To this end, the author proposes the RESORT framework, which contains a series of reappraisal principles for multiple cognitive evaluation dimensions and can be used as instructions for LLMs. The effectiveness of this framework has been verified through expert evaluation (conducted by clinical psychologists with master's or doctorate degrees). The results show that even in LLMs with a scale of 7B, after being guided by RESORT, they can be significantly better than human - written responses and non - evaluation - based prompts. In addition, the study also explores the possibility of automatic evaluation. Using GPT - 4 as an automatic evaluator, it has reached a moderate level of consistency with the evaluations of expert evaluators, which provides hope for rapid prototyping in future work. In summary, this paper aims to explore how to make LLMs play a greater role in mental health support, especially by providing cognitive reappraisal to help individuals better regulate their emotions.