Facilitating Self-Guided Mental Health Interventions Through Human-Language Model Interaction: A Case Study of Cognitive Restructuring

Ashish Sharma,Kevin Rushton,Inna Wanyin Lin,Theresa Nguyen,Tim Althoff
2024-04-11
Abstract:Self-guided mental health interventions, such as "do-it-yourself" tools to learn and practice coping strategies, show great promise to improve access to mental health care. However, these interventions are often cognitively demanding and emotionally triggering, creating accessibility barriers that limit their wide-scale implementation and adoption. In this paper, we study how human-language model interaction can support self-guided mental health interventions. We take cognitive restructuring, an evidence-based therapeutic technique to overcome negative thinking, as a case study. In an IRB-approved randomized field study on a large mental health website with 15,531 participants, we design and evaluate a system that uses language models to support people through various steps of cognitive restructuring. Our findings reveal that our system positively impacts emotional intensity for 67% of participants and helps 65% overcome negative thoughts. Although adolescents report relatively worse outcomes, we find that tailored interventions that simplify language model generations improve overall effectiveness and equity.
Computation and Language
What problem does this paper attempt to address?
The problem this paper attempts to address is: how to support self-guided mental health interventions through human-language model interaction, particularly Cognitive Restructuring, to improve the accessibility and effectiveness of these interventions. ### Background and Problem Mental health issues are becoming increasingly severe worldwide, but healthcare systems struggle to provide adequate mental health services. Self-guided mental health interventions (such as journaling and tools for reflecting on negative emotions) offer hope for expanding care models and helping people learn coping strategies. However, these interventions often carry a heavy cognitive load and are emotionally challenging, limiting their large-scale implementation and adoption. For example, Cognitive Restructuring is an evidence-based therapeutic technique that helps people identify and change negative thinking patterns, but its complex steps (such as identifying thinking traps) are a significant challenge for many. Additionally, analyzing one's thoughts, emotions, and behavior patterns can trigger emotional responses, especially for those experiencing distress. ### Paper Objective To overcome these obstacles, this paper explores how to support self-guided mental health interventions through human-language model interaction. Specifically, the authors chose Cognitive Restructuring as a case study, designing and evaluating a system that uses language models to help people complete various steps of Cognitive Restructuring, including identifying thinking traps and restructuring negative thoughts. ### Research Methods - **Design Hypotheses**: Based on feedback from early prototype users, collaboration with mental health experts, and insights from previous research, the authors proposed several design hypotheses aimed at improving the effectiveness and safety of the intervention. - **Large-Scale Randomized Field Experiment**: A large-scale randomized field experiment was conducted on the Mental Health America (MHA) website, with a total of 15,531 participants. This experiment evaluated the overall effectiveness of the system, the impact of different design hypotheses, and fairness across different populations. ### Key Findings - **Overall Effectiveness**: 67.64% of participants reported a reduction in emotional intensity, and 65.65% indicated that the system helped them overcome negative thinking. - **Impact of Design Hypotheses**: Through randomized controlled trials, the authors assessed the effects of different design hypotheses, finding that certain types of support (such as simplifying task complexity and reducing emotional triggers) significantly improved the effectiveness of the intervention. - **Fairness**: While the intervention was more effective for women, older adults, highly educated individuals, and those facing parenting or work issues, it was less effective for men, adolescents, less educated individuals, and those feeling hopeless or lonely. Simplifying the suggestions generated by the language model could improve the intervention's effectiveness for adolescents. ### Conclusion By designing and evaluating a system based on human-language model interaction, this paper demonstrates how to support self-guided Cognitive Restructuring interventions, thereby improving the accessibility and effectiveness of mental health interventions. However, further research and improvements are needed to ensure fairness and safety through personalized support strategies for different populations.