Boosting Distress Support Dialogue Responses with Motivational Interviewing Strategy

Anuradha Welivita,Pearl Pu

2023-05-17

Abstract:AI-driven chatbots have become an emerging solution to address psychological distress. Due to the lack of psychotherapeutic data, researchers use dialogues scraped from online peer support forums to train them. But since the responses in such platforms are not given by professionals, they contain both conforming and non-conforming responses. In this work, we attempt to recognize these conforming and non-conforming response types present in online distress-support dialogues using labels adapted from a well-established behavioral coding scheme named Motivational Interviewing Treatment Integrity (MITI) code and show how some response types could be rephrased into a more MI adherent form that can, in turn, enable chatbot responses to be more compliant with the MI strategy. As a proof of concept, we build several rephrasers by fine-tuning Blender and GPT3 to rephrase MI non-adherent "Advise without permission" responses into "Advise with permission". We show how this can be achieved with the construction of pseudo-parallel corpora avoiding costs for human labor. Through automatic and human evaluation we show that in the presence of less training data, techniques such as prompting and data augmentation can be used to produce substantially good rephrasings that reflect the intended style and preserve the content of the original text.

Computation and Language

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to improve the response quality of chatbots in psychological support conversations, especially by using Motivational Interviewing (MI) strategies to improve the support responses provided by non - professionals. Specifically, the researchers focus on how to identify response types that conform to and do not conform to MI principles in online psychological support conversations, and propose methods to re - phrase those suggestions that do not conform to MI principles (such as "Advise without permission") into forms that are more in line with MI principles (such as "Advise with permission"). This can make the chatbot's responses more professional, reduce potential risks, and at the same time improve the user experience and treatment effects.

To achieve this goal, the author developed a classifier to automatically identify different types of responses and constructed multiple re - phrasing models (by fine - tuning the Blender and GPT - 3 models), which can convert suggestions that do not conform to MI principles into forms that conform to MI principles. In addition, the study also explored how to use prompting and data augmentation techniques to improve the performance of the re - phrasing models when the training data is limited.

Overall, this study aims to provide higher - quality mental health services by improving the chatbot's support responses to psychological stress.