Positive Text Reframing under Multi-strategy Optimization

Shutong Jia,Biwei Cao,Qingqing Gao,Jiuxin Cao,Bo Liu

2024-07-27

Abstract:Differing from sentiment transfer, positive reframing seeks to substitute negative perspectives with positive expressions while preserving the original meaning. With the emergence of pre-trained language models (PLMs), it is possible to achieve acceptable results by fine-tuning PLMs. Nevertheless, generating fluent, diverse and task-constrained reframing text remains a significant challenge. To tackle this issue, a \textbf{m}ulti-\textbf{s}trategy \textbf{o}ptimization \textbf{f}ramework (MSOF) is proposed in this paper. Starting from the objective of positive reframing, we first design positive sentiment reward and content preservation reward to encourage the model to transform the negative expressions of the original text while ensuring the integrity and consistency of the semantics. Then, different decoding optimization approaches are introduced to improve the quality of text generation. Finally, based on the modeling formula of positive reframing, we propose a multi-dimensional re-ranking method that further selects candidate sentences from three dimensions: strategy consistency, text similarity and fluency. Extensive experiments on two Seq2Seq PLMs, BART and T5, demonstrate our framework achieves significant improvements on unconstrained and controlled positive reframing tasks.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

### The Problem the Paper Aims to Solve

The paper aims to address several key challenges in positive reframing. Unlike sentiment transfer, the goal of positive reframing is to replace negative perspectives with positive expressions while preserving the original meaning of the text. Although pre-trained language models (PLMs) can achieve acceptable results after fine-tuning, generating fluent, diverse, and task-compliant reframed text remains a significant challenge. To this end, the paper proposes a Multi-Strategy Optimization Framework (MSOF) to tackle these challenges.

Specifically, the paper focuses on the following aspects:
1. **Positive Sentiment Reward**: A positive sentiment reward mechanism is designed to encourage the model to maintain positive sentiment when transforming the text.
2. **Content Preservation Reward**: A content preservation reward is introduced to ensure semantic consistency and completeness in the transformed text.
3. **Decoding Optimization**: Various decoding optimization methods, such as beam search and random sampling, are employed to improve the quality and diversity of the generated text.
4. **Multi-Dimensional Re-ranking**: A multi-dimensional re-ranking method based on the positive reframing modeling formula is proposed, which comprehensively evaluates candidate sentences from the dimensions of strategy consistency, text similarity, and fluency to select the best output.

Through these methods, the paper aims to significantly enhance the performance of both unconstrained and controlled positive reframing tasks. Experimental results show that the framework achieves significant improvements across multiple metrics.