Computational Psychotherapy System for Mental Health Prediction and Behavior Change with a Conversational Agent
Tine Kolenik,Günter Schiepek,Matjaž Gams
DOI: https://doi.org/10.2147/ndt.s417695
IF: 2.989
2024-12-17
Neuropsychiatric Disease and Treatment
Abstract:Tine Kolenik, 1– 3 Günter Schiepek, 3, 4 Matjaž Gams 1 1 Department of Intelligent Systems, Jožef Stefan Institute, Ljubljana, Slovenia; 2 Jožef Stefan International Postgraduate School, Ljubljana, Slovenia; 3 Institute of Synergetics and Psychotherapy Research, University Hospital of Psychiatry, Psychotherapy and Psychosomatics, Paracelsus Medical University, Salzburg, Austria; 4 Department of Psychology, Ludwig Maximilian University of Munich, Munich, Germany Correspondence: Tine Kolenik, Email Background: The importance of computational psychotherapy is increasing due to the record high prevalence of mental health issues worldwide. Despite advancements, current computational psychotherapy systems lack advanced prediction and behavior change mechanisms using conversational agents. Purpose: This work presents a computational psychotherapy system for mental health prediction and behavior change using a conversational agent. It makes two major contributions. First, we introduce a novel, golden standard dataset, comprising panel data with 1495 instances of quantitative stress, anxiety, and depression (SAD) symptom scores from diagnostic-level questionnaires and qualitative daily diary entries. Second, we present the computational psychotherapy system itself. Hypothesis: We hypothesize that simulating a theory of mind - the human cognitive ability to understand others – in a conversational agent enhances its effectiveness in relieving mental health issues. Methods: The system simulates theory of mind with a cognitive architecture comprising an ensemble of computational models, using cognitive modelling and machine learning models trained on the novel dataset, and novel ontologies. The system was evaluated through a computational experiment on mental health phenomena prediction from text, and an empirical interventional study on relieving mental health issues in 42 participants. Results: The system outperformed state-of-the-art systems in terms of the number of detected categories and detection accuracy (highest accuracy: 91.41% using k-nearest neighbors (kNN); highest accuracy of other systems: 84% using long-short term memory network (LSTM)). The highest accuracy for 7-day forecasting was 87.68%, whereas the other systems were not able to forecast trends. In the study, the system outperformed Woebot, the current state-of-the-art, in reducing stress ( p = 0.004) and anxiety ( p = 0.008) levels. Conclusion: The confirmation of our hypothesis indicates that incorporating theory of mind simulation in conversational agents significantly enhances their efficacy in computational psychotherapy, offering a promising advancement for mental health interventions and support compared to current state-of-the-art systems. Keywords: generative artificial intelligence, attitude and behavior change support systems, digital mental health, intelligent cognitive conversational agent, artificial cognitive architecture, machine learning Currently, the world is experiencing a mental health pandemic. 1 There are numerous calls for action, even to the degree to which mental health is now included in Goal 3 of the 17 UN Sustainable Development Goals. 2 However, the number of mental health professionals per 100.000 people is declining, not rising, and current regulations do not seem to improve the situation. 3 Stress, anxiety, and depression (SAD) are at the forefront of mental health issues; in some groups, figures reach 74% for disabling stress, 4 28% for anxiety disorder 5 and 48% for depression. 6 Between 76% and 85% of people in low- and middle-income countries receive no treatment for their issues. 7 In high-income countries, treatment coverage for depression was only 33%. 8 Many countries have struggled with high suicide rate. 9 The COVID-19 pandemic has further exposed how harmful neglecting people's well-being for decades can be, 10 with social distancing helping in the exponential rise in psychopathological symptoms. Mental health issues have considerable effects on patients, their immediate surroundings (family, caretakers), and wider society. 11 This may be why decision-makers are turning to technology to see how it can contribute toward easing the load on mental healthcare. A recent analysis 12 identified the possible positive and negative effects that using technology might have in mental healthcare, where the former seems to outweigh the latter. Technology can lower costs for patients, make help available at all times (eg, during a nighttime panic attack) and in more places (eg, remote p -Abstract Truncated-
psychiatry,clinical neurology