Abstract:Reframing a negative into a positive thought is at the crux of several cognitive approaches to mental health and psychotherapy that could be made more accessible by large language model-based solutions. Such reframing is typically non-trivial and requires multiple rationalization steps to uncover the underlying issue of a negative thought and transform it to be more positive. However, this rationalization process is currently neglected by both datasets and models which reframe thoughts in one step. In this work, we address this gap by augmenting open-source datasets for positive text rewriting with synthetically-generated Socratic rationales using a novel framework called \textsc{SocraticReframe}. \textsc{SocraticReframe} uses a sequence of question-answer pairs to rationalize the thought rewriting process. We show that such Socratic rationales significantly improve positive text rewriting for different open-source LLMs according to both automatic and human evaluations guided by criteria from psychotherapy research.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that the current open - source data sets and models used for positive text rewriting overlook the rationalization step in the cognitive reframing process. Specifically, existing methods usually complete the transformation from negative thoughts to positive thoughts in one step, without going through a multi - step rationalization process to reveal the underlying problems of negative thoughts and transform them into more positive thoughts. This lack of a detailed rationalization process limits the performance of the model and makes the thinking process behind reframing opaque. To address this issue, the author proposes a new framework named **SOCRATIC REFRAME**, which significantly improves the performance of different open - source large - language models (LLMs) on the positive text - rewriting task by using a series of question - and - answer pairs to rationalize the thinking - reframing process. This method not only improves the performance of the model but also enhances the model's interpretability. The main contributions of the paper include: 1. **Proposing a new framework**: The **SOCRATIC REFRAME** framework is introduced to enhance the data set for positive text rewriting by synthesizing generated Socratic rationalization steps. 2. **Data set enhancement**: Three existing data sets (CognitiveReframe, PatternReframe, and PositiveReframe) are enriched by adding Socratic rationalization steps. 3. **Model training and evaluation**: A series of language models are fine - tuned using these enhanced data sets, and the performance improvement of the models on the positive text - rewriting task is verified through automatic and manual evaluations. Through these methods, the paper aims to make positive text rewriting more effective and transparent, thereby better supporting the development of mental health intervention techniques.

Socratic Reasoning Improves Positive Text Rewriting

Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction

Positive Text Reframing under Multi-strategy Optimization

SocREval: Large Language Models with the Socratic Method for Reference-Free Reasoning Evaluation

Training Models to Generate, Recognize, and Reframe Unhelpful Thoughts

Change My Frame: Reframing in the Wild in r/ChangeMyView

Detection and Positive Reconstruction of Cognitive Distortion sentences: Mandarin Dataset and Evaluation

HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapy

Self-Polish: Enhance Reasoning in Large Language Models Via Problem Refinement.

ArgRewrite V.2: an Annotated Argumentative Revisions Corpus

Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs

Tailoring Self-Rationalizers with Multi-Reward Distillation

Re-Reading Improves Reasoning in Large Language Models

Promoting Constructive Deliberation: Reframing for Receptiveness

DIR: A Large-Scale Dialogue Rewrite Dataset for Cross-Domain Conversational Text-to-SQL

Reversal of Thought: Enhancing Large Language Models with Preference-Guided Reverse Reasoning Warm-up

Can Language Models Employ the Socratic Method? Experiments with Code Debugging

Improving Language Model Reasoning with Self-motivated Learning

Persuasiveness of Generated Free-Text Rationales in Subjective Decisions: A Case Study on Pairwise Argument Ranking

Let's Do a Thought Experiment: Using Counterfactuals to Improve Moral Reasoning

ENTRUST: Argument Reframing with Language Models and Entailment