INTRAUTERINE CONTRACEPTION WITH LEVONORGESTREL: A COMPARATIVE RANDOMISED CLINICAL PERFORMANCE STUDY

C. Nilsson,T. Luukkainen,Juan Díaz,H. Allonen

DOI: https://doi.org/10.1016/S0140-6736(81)92031-6

IF: 202.731

1981-03-14

The Lancet

Abstract:

What problem does this paper attempt to address?

Automated evaluation of psychotherapy skills using speech and language technologies

Nikolaos Flemotomos,Victor R. Martinez,Zhuohao Chen,Karan Singla,Victor Ardulov,Raghuveer Peri,Derek D. Caperton,James Gibson,Michael J. Tanana,Panayiotis Georgiou,Jake Van Epps,Sarah P. Lord,Tad Hirsch,Zac E. Imel,David C. Atkins,Shrikanth Narayanan

DOI: https://doi.org/10.3758/s13428-021-01623-4

IF: 5.953

2021-08-03

Behavior Research Methods

Abstract:With the growing prevalence of psychological interventions, it is vital to have measures which rate the effectiveness of psychological care to assist in training, supervision, and quality assurance of services. Traditionally, quality assessment is addressed by human raters who evaluate recorded sessions along specific dimensions, often codified through constructs relevant to the approach and domain. This is, however, a cost-prohibitive and time-consuming method that leads to poor feasibility and limited use in real-world settings. To facilitate this process, we have developed an automated competency rating tool able to process the raw recorded audio of a session, analyzing who spoke when, what they said, and how the health professional used language to provide therapy. Focusing on a use case of a specific type of psychotherapy called "motivational interviewing", our system gives comprehensive feedback to the therapist, including information about the dynamics of the session (e.g., therapist's vs. client's talking time), low-level psychological language descriptors (e.g., type of questions asked), as well as other high-level behavioral constructs (e.g., the extent to which the therapist understands the clients' perspective). We describe our platform and its performance using a dataset of more than 5000 recordings drawn from its deployment in a real-world clinical setting used to assist training of new therapists. Widespread use of automated psychotherapy rating tools may augment experts' capabilities by providing an avenue for more effective training and skill improvement, eventually leading to more positive clinical outcomes.

psychology, experimental, mathematical
Characterizing Therapist's Speaking Style in Relation to Empathy in Psychotherapy

Dehua Tao,Tan Lee,Harold Chui,Sarah Luk

DOI: https://doi.org/10.48550/arXiv.2203.13127

2022-03-24

Audio and Speech Processing

Abstract:In conversation-based psychotherapy, therapists use verbal techniques to help clients express thoughts and feelings and change behaviors. In particular, how well therapists convey empathy is an essential quality index of psychotherapy sessions and is associated with psychotherapy outcome. In this paper, we analyze the prosody of therapist speech and attempt to associate the therapist's speaking style with subjectively perceived empathy. An automatic speech and text processing system is developed to segment long recordings of psychotherapy sessions into pause-delimited utterances with text transcriptions. Data-driven clustering is applied to the utterances from different therapists in multiple sessions. For each cluster, a typological representation of utterance genre is derived based on quantized prosodic feature parameters. Prominent speaking styles of the therapist can be observed and interpreted from salient utterance genres that are correlated with empathy. Using the salient utterance genres, an accuracy of 71% is achieved in classifying psychotherapy sessions into "high" and "low" empathy level. Analysis of results suggests that empathy level tends to be (1) low if therapists speak long utterances slowly or speak short utterances quickly; and (2) high if therapists talk to clients with a steady tone and volume.
Objective measures of subjective experience: the use of therapist notes in process-outcome research

Wilma Bucci,Bernard Maskit,Leon Hoffman

DOI: https://doi.org/10.1521/pdps.2012.40.2.303

Abstract:Computerized linguistic measures of emotional engagement, and reflective and affective language, previously applied to session transcripts, were applied to notes of 14 treatments by candidates under supervision at the New York Psychoanalytic Society and Institute, covering the five decades from the 1950s to the 1990s. The findings indicate a strong relationship between candidates' subjective experience as represented unintentionally in the linguistic style of their case notes and the effectiveness of their clinical work. The treatments were evaluated for effectiveness by experienced clinicians using the Global Assessment of Functioning (GAF) and the Psychodynamic Functioning Scales of Høglend and colleagues; a Composite Clinical Effectiveness (CCE) measure was constructed based on level and change in these measures. The Mean High Weighted Referential Activity Dictionary (MHW), a computerized measure of emotional engagement developed in the framework of Bucci's theory of multiple coding and the referential process, showed a positive correlation of .73 with CCE. The Hostility subcategory of the Negative Affect Dictionary (ANH) showed a negative correlation, -.48, with CCE. In a multiple regression analysis, these two variables accounted for over three-quarters of the variance in the CCE. Implications of the findings for process/outcome research and supervision and evaluation of trainees are discussed.
Integrating exploration and prediction in computational psychotherapy science: proof of concept

Hadar Fisher,Suzannah J. Stone,Sigal Zilcha-Mano,Pavel Goldstein,Timothy Anderson

DOI: https://doi.org/10.3389/fpsyt.2023.1274764

IF: 4.7

2024-01-13

Frontiers in Psychiatry

Abstract:Introduction: Psychotherapy research has long preferred explanatory over predictive models. As a result, psychotherapy research is currently limited in the variability that can be accounted for in the process and outcome of treatment. The present study is a proof-of-concept approach to psychotherapy science that uses a datadriven approach to achieve robust predictions of the process and outcome of treatment. Methods: A trial including 65 therapeutic dyads was designed to enable an adequate level of variability in therapist characteristics, overcoming the common problem of restricted range. A mixed-model, data-driven approach with cross-validation machine learning algorithms was used to predict treatment outcome and alliance (within- and between-clients; client- and therapist-rated alliance). Results and discussion: Based on baseline predictors only, the models explained 52.8% of the variance for out-of-sample prediction in treatment outcome, and 24.1–52.8% in therapeutic alliance. The identified predictors were consistent with previous findings and point to directions for future investigation. Although limited by its sample size, this study serves as proof of the great potential of the presented approach to produce robust predictions regarding the process and outcome of treatment, offering a potential solution to problems such as p -hacking and lack of replicability. Findings should be replicated using larger samples and distinct populations and settings.

psychiatry
A Computational Framework for Behavioral Assessment of LLM Therapists

Yu Ying Chiu,Ashish Sharma,Inna Wanyin Lin,Tim Althoff

2024-01-02

Abstract:The emergence of ChatGPT and other large language models (LLMs) has greatly increased interest in utilizing LLMs as therapists to support individuals struggling with mental health challenges. However, due to the lack of systematic studies, our understanding of how LLM therapists behave, i.e., ways in which they respond to clients, is significantly limited. Understanding their behavior across a wide range of clients and situations is crucial to accurately assess their capabilities and limitations in the high-risk setting of mental health, where undesirable behaviors can lead to severe consequences. In this paper, we propose BOLT, a novel computational framework to study the conversational behavior of LLMs when employed as therapists. We develop an in-context learning method to quantitatively measure the behavior of LLMs based on 13 different psychotherapy techniques including reflections, questions, solutions, normalizing, and psychoeducation. Subsequently, we compare the behavior of LLM therapists against that of high- and low-quality human therapy, and study how their behavior can be modulated to better reflect behaviors observed in high-quality therapy. Our analysis of GPT and Llama-variants reveals that these LLMs often resemble behaviors more commonly exhibited in low-quality therapy rather than high-quality therapy, such as offering a higher degree of problem-solving advice when clients share emotions, which is against typical recommendations. At the same time, unlike low-quality therapy, LLMs reflect significantly more upon clients' needs and strengths. Our analysis framework suggests that despite the ability of LLMs to generate anecdotal examples that appear similar to human therapists, LLM therapists are currently not fully consistent with high-quality care, and thus require additional research to ensure quality care.

Computation and Language,Human-Computer Interaction
Towards Automated Psychotherapy via Language Modeling

Houjun Liu

DOI: https://doi.org/10.48550/arXiv.2104.10661

2021-04-05

Abstract:In this experiment, a model was devised, trained, and evaluated to automate psychotherapist/client text conversations through the use of state-of-the-art, Seq2Seq Transformer-based Natural Language Generation (NLG) systems. Through training the model upon a mix of the Cornell Movie Dialogue Corpus for language understanding and an open-source, anonymized, and public licensed psychotherapeutic dataset, the model achieved statistically significant performance in published, standardized qualitative benchmarks against human-written validation data - meeting or exceeding human-written responses' performance in 59.7% and 67.1% of the test set for two independent test methods respectively. Although the model cannot replace the work of psychotherapists entirely, its ability to synthesize human-appearing utterances for the majority of the test set serves as a promising step towards communizing and easing stigma at the psychotherapeutic point-of-care.

Computation and Language
Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health

Tim Althoff,Kevin Clark,Jure Leskovec

DOI: https://doi.org/10.1162/tacl_a_00111

IF: 10.9

2016-12-01

Transactions of the Association for Computational Linguistics

Abstract:Mental illness is one of the most pressing public health issues of our time. While counseling and psychotherapy can be effective treatments, our knowledge about how to conduct successful counseling conversations has been limited due to lack of large-scale data with labeled outcomes of the conversations. In this paper, we present a large-scale, quantitative study on the discourse of text-message-based counseling conversations. We develop a set of novel computational discourse analysis methods to measure how various linguistic aspects of conversations are correlated with conversation outcomes. Applying techniques such as sequence-based conversation models, language model comparisons, message clustering, and psycholinguistics-inspired word frequency analyses, we discover actionable conversation strategies that are associated with better conversation outcomes.

English Else
Measurement-based matching of patients to psychotherapists' strengths.

Michael J. Constantino

DOI: https://doi.org/10.1037/ccp0000897

2024-07-20

Journal of Consulting and Clinical Psychology

Abstract:Treatment personalization has evolved into an important zeitgeist in psychotherapy research. To date, such efforts have principally embodied a unidirectional focus on personalizing interventions to the patient. For example, earlier work in this area attempted to determine whether, on average, certain patients with certain characteristics or needs would respond better to one treatment package versus others. To the extent such aggregate "Aptitude × Treatment interactions" emerged, they could help guide overarching treatment selection. More recently, and drawing on technological and statistical advancements (e.g., machine learning, dynamic modeling), predictive algorithms can help determine for which individual patients certain treatment packages (DeRubeis et al., 2014) or specific during-session interventions within them (Fisher & Boswell, 2016) confer the most advantage for clinical improvement. Again, such work can help guide treatment decisions, though now at multiple care points. Although the aforementioned innovations in personalized psychotherapy have been leading-edge, precision care need not remain unidirectional. Rather, it can be complemented by efforts to personalize treatment decisions to the therapist . Namely, we can harness therapist effectiveness data to help ensure that therapists treat the patients they are empirically most equipped to help and use the interventions with which they have had the most empirical success. Such threads have been the focus of our team's novel, evolving, and multimethod work on improving psychotherapy by leveraging therapists' own practice-based evidence. (PsycInfo Database Record (c) 2024 APA, all rights reserved)

psychology, clinical
An automated quality evaluation framework of psychotherapy conversations with local quality estimates

Zhuohao Chen,Nikolaos Flemotomos,Karan Singla,Shrikanth Narayanan,Torrey A. Creed,David C. Atkins

DOI: https://doi.org/10.1016/j.csl.2022.101380

2022-09-01

Abstract:Text-based computational approaches for assessing the quality of psychotherapy are being developed to support quality assurance and clinical training. However, due to the long durations of typical conversation based therapy sessions, and due to limited annotated modeling resources, computational methods largely rely on frequency-based lexical features or dialogue acts to assess the overall session level characteristics. In this work, we propose a hierarchical framework to automatically evaluate the quality of transcribed Cognitive Behavioral Therapy (CBT) interactions. Given the richly dynamic nature of the spoken dialog within a talk therapy session, to evaluate the overall session level quality, we propose to consider modeling it as a function of local variations across the interaction. To implement that empirically, we divide each psychotherapy session into conversation segments and initialize the segment-level qualities with the session-level scores. First, we produce segment embeddings by fine-tuning a BERT-based model, and predict segment-level (local) quality scores. These embeddings are used as the lower-level input to a Bidirectional LSTM-based neural network to predict the session-level (global) quality estimates. In particular, we model the global quality as a linear function of the local quality scores, which allows us to update the segment-level quality estimates based on the session-level quality prediction. These newly estimated segment-level scores benefit the BERT fine-tuning process, which in turn results in better segment embeddings. We evaluate the proposed framework on automatically derived transcriptions from real-world CBT clinical recordings to predict session-level behavior codes. The results indicate that our approach leads to improved evaluation accuracy for most codes when used for both regression and classification tasks.

computer science, artificial intelligence
Clinically indicated replacement versus routine replacement of peripheral venous catheters in adults: A nonblinded, cluster‐randomized trial in China

Lichun Xu,Yan Hu,Xiaojin Huang,Jianguo Fu,Jinhui Zhang

DOI: https://doi.org/10.1111/ijn.12595

2017-10-09

International Journal of Nursing Practice

Abstract:AIM The purpose of this study was to investigate the safety of clinically indicated peripheral intravenous catheters (PIVC) replacement intervals. BACKGROUND Peripheral intravenous catheters are used internationally, including in China where PIVCs are routinely replaced every 72 to 96 hours. Despite some recent international evidence showing such routine replacement is unnecessary, developing countries such as China have no supporting data. METHOD This cluster-randomized trial was conducted between December 2 and December 31, 2013, in 10 internal medicine wards and 10 surgery wards at a tertiary referral teaching hospital in Xiamen, China. Patients were randomly divided into an experimental group (PIVCs were replaced only when clinical indications appeared) and a control group (PIVCs were routinely changed every 72-96 hours). Per-protocol analysis and intention-to-treat analysis were used to analyse the data. Primary end point was the incidence of phlebitis. RESULTS This study analysed the data of 1198 patients (553 patients in the experimental group and 645 patients in the control group). There were no catheter-related bloodstream infections or local infections in the 2 groups. The 2 groups showed no statistically significant differences in the incidence of phlebitis, catheter occlusion, infiltration, and accidental removal. CONCLUSIONS Clinically indicated PIVC replacement is feasible, and it may reduce nursing staff workload and patient discomfort.
Automated quality assessment of cognitive behavioral therapy sessions through highly contextualized language representations

Nikolaos Flemotomos,Victor R. Martinez,Zhuohao Chen,Torrey A. Creed,David C. Atkins,Shrikanth Narayanan

DOI: https://doi.org/10.1371/journal.pone.0258639

IF: 3.7

2021-10-22

PLoS ONE

Abstract:During a psychotherapy session, the counselor typically adopts techniques which are codified along specific dimensions (e.g., ‘displays warmth and confidence’, or ‘attempts to set up collaboration’) to facilitate the evaluation of the session. Those constructs, traditionally scored by trained human raters, reflect the complex nature of psychotherapy and highly depend on the context of the interaction. Recent advances in deep contextualized language models offer an avenue for accurate in-domain linguistic representations which can lead to robust recognition and scoring of such psychotherapy-relevant behavioral constructs, and support quality assurance and supervision. In this work, we propose a BERT-based model for automatic behavioral scoring of a specific type of psychotherapy, called Cognitive Behavioral Therapy (CBT), where prior work is limited to frequency-based language features and/or short text excerpts which do not capture the unique elements involved in a spontaneous long conversational interaction. The model focuses on the classification of therapy sessions with respect to the overall score achieved on the widely-used Cognitive Therapy Rating Scale (CTRS), but is trained in a multi-task manner in order to achieve higher interpretability. BERT-based representations are further augmented with available therapy metadata, providing relevant non-linguistic context and leading to consistent performance improvements. We train and evaluate our models on a set of 1,118 real-world therapy sessions, recorded and automatically transcribed. Our best model achieves an F 1 score equal to 72.61% on the binary classification task of low vs. high total CTRS.

multidisciplinary sciences
Therapy as an NLP Task: Psychologists' Comparison of LLMs and Human Peers in CBT

Zainab Iftikhar,Sean Ransom,Amy Xiao,Jeff Huang

2024-09-04

Abstract:Wider access to therapeutic care is one of the biggest challenges in mental health treatment. Due to institutional barriers, some people seeking mental health support have turned to large language models (LLMs) for personalized therapy, even though these models are largely unsanctioned and untested. We investigate the potential and limitations of using LLMs as providers of evidence-based therapy by using mixed methods clinical metrics. Using HELPERT, a prompt run on a large language model using the same process and training as a comparative group of peer counselors, we replicated publicly accessible mental health conversations rooted in Cognitive Behavioral Therapy (CBT) to compare session dynamics and counselor's CBT-based behaviors between original peer support sessions and their reconstructed HELPERT sessions. Two licensed, CBT-trained clinical psychologists evaluated the sessions using the Cognitive Therapy Rating Scale and provided qualitative feedback. Our findings show that the peer sessions are characterized by empathy, small talk, therapeutic alliance, and shared experiences but often exhibit therapist drift. Conversely, HELPERT reconstructed sessions exhibit minimal therapist drift and higher adherence to CBT methods but display a lack of collaboration, empathy, and cultural understanding. Through CTRS ratings and psychologists' feedback, we highlight the importance of human-AI collaboration for scalable mental health. Our work outlines the ethical implication of imparting human-like subjective qualities to LLMs in therapeutic settings, particularly the risk of deceptive empathy, which may lead to unrealistic patient expectations and potential harm.

Human-Computer Interaction,Computation and Language
Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling

Christopher Lalk,Tobias Steinbrenner,Weronika Kania,Alexander Popko,Robin Wester,Jana Schaffrath,Steffen Eberhardt,Brian Schwartz,Wolfgang Lutz,Julian Rubel,Popko, Alexander

DOI: https://doi.org/10.1007/s10488-024-01356-4

2024-03-30

Administration and Policy in Mental Health and Mental Health Services Research

Abstract:We aim to use topic modeling, an approach for discovering clusters of related words ("topics"), to predict symptom severity and therapeutic alliance in psychotherapy transcripts, while also identifying the most important topics and overarching themes for prediction. We analyzed 552 psychotherapy transcripts from 124 patients. Using BERTopic (Grootendorst, 2022), we extracted 250 topics each for patient and therapist speech. These topics were used to predict symptom severity and alliance with various competing machine-learning methods. Sensitivity analyses were calculated for a model based on 50 topics, LDA-based topic modeling, and a bigram model. Additionally, we grouped topics into themes using qualitative analysis and identified key topics and themes with eXplainable Artificial Intelligence (XAI). Symptom severity could be predicted with highest accuracy by patient topics ( =0.45, 95%-CI 0.40, 0.51), whereas alliance was better predicted by therapist topics ( =0.20, 95%-CI 0.16, 0.24). Drivers for symptom severity were themes related to health and negative experiences. Lower alliance was correlated with various themes, especially psychotherapy framework, income, and everyday life. This analysis shows the potential of using topic modeling in psychotherapy research allowing to predict several treatment-relevant metrics with reasonable accuracy. Further, the use of XAI allows for an analysis of the individual predictive value of topics and themes. Limitations entail heterogeneity across different topic modeling hyperparameters and a relatively small sample size.

public, environmental & occupational health,health policy & services
Behavioral Activation and Depression Symptomatology: Longitudinal Assessment of Linguistic Indicators in Text-Based Therapy Sessions

Hannah A Burkhardt,George S Alexopoulos,Michael D Pullmann,Thomas D Hull,Patricia A Areán,Trevor Cohen

DOI: https://doi.org/10.2196/28244

IF: 7.076

2021-07-14

Journal of Medical Internet Research

Abstract:Background Behavioral activation (BA) is rooted in the behavioral theory of depression, which states that increased exposure to meaningful, rewarding activities is a critical factor in the treatment of depression. Assessing constructs relevant to BA currently requires the administration of standardized instruments, such as the Behavioral Activation for Depression Scale (BADS), which places a burden on patients and providers, among other potential limitations. Previous work has shown that depressed and nondepressed individuals may use language differently and that automated tools can detect these differences. The increasing use of online, chat-based mental health counseling presents an unparalleled resource for automated longitudinal linguistic analysis of patients with depression, with the potential to illuminate the role of reward exposure in recovery. Objective This work investigated how linguistic indicators of planning and participation in enjoyable activities identified in online, text-based counseling sessions relate to depression symptomatology over time. Methods Using distributional semantics methods applied to a large corpus of text-based online therapy sessions, we devised a set of novel BA-related categories for the Linguistic Inquiry and Word Count (LIWC) software package. We then analyzed the language used by 10,000 patients in online therapy chat logs for indicators of activation and other depression-related markers using LIWC. Results Despite their conceptual and operational differences, both previously established LIWC markers of depression and our novel linguistic indicators of activation were strongly associated with depression scores (Patient Health Questionnaire [PHQ]-9) and longitudinal patient trajectories. Emotional tone; pronoun rates; words related to sadness, health, and biology; and BA-related LIWC categories appear to be complementary, explaining more of the variance in the PHQ score together than they do independently. Conclusions This study enables further work in automated diagnosis and assessment of depression, the refinement of BA psychotherapeutic strategies, and the development of predictive models for decision support.

health care sciences & services,medical informatics
COMPASS: Computational Mapping of Patient-Therapist Alliance Strategies with Language Modeling

Baihan Lin,Djallel Bouneffouf,Yulia Landa,Rachel Jespersen,Cheryl Corcoran,Guillermo Cecchi

2024-10-16

Abstract:The therapeutic working alliance is a critical factor in predicting the success of psychotherapy treatment. Traditionally, working alliance assessment relies on questionnaires completed by both therapists and patients. In this paper, we present COMPASS, a novel framework to directly infer the therapeutic working alliance from the natural language used in psychotherapy sessions. Our approach utilizes advanced large language models (LLMs) to analyze transcripts of psychotherapy sessions and compare them with distributed representations of statements in the working alliance inventory. Analyzing a dataset of over 950 sessions covering diverse psychiatric conditions including anxiety, depression, schizophrenia, and suicidal tendencies, we demonstrate the effectiveness of our method in providing fine-grained mapping of patient-therapist alignment trajectories and offering interpretability for clinical psychiatry and in identifying emerging patterns related to the condition being treated. By employing various deep learning-based topic modeling techniques in combination with prompting generative language models, we analyze the topical characteristics of different psychiatric conditions and their evolution at a turn-level resolution. This combined framework enhances the understanding of therapeutic interactions, enabling timely feedback for therapists regarding the quality of therapeutic relationships and providing interpretable insights to improve the effectiveness of psychotherapy.

Computation and Language,Artificial Intelligence,Human-Computer Interaction,Machine Learning,Neurons and Cognition
Clinical and Research Perspectives on the Therapeutic Conversation: The Case of MS. M.

Charles M. Jaffe,Wilma Bucci,Bernard Maskit,Sean Murphy

DOI: https://doi.org/10.1177/00030651241256650

IF: 0.919

2024-06-14

Journal of the American Psychoanalytic Association

Abstract:Journal of the American Psychoanalytic Association, Ahead of Print. This paper presents a collaboration between a clinician (C.M.J.) and a research team (W.B., B.M., and S.M.) to address the question: At an operational level, what happens in the special form of conversation that is psychotherapy? How can we study, beyond a priori lenses of psychoanalytic models, what we are actually doing when we engage in this process? How can we capture from the linear flow of conversation, the simultaneous, complex, active, interwoven, dimensional emotion schemas that words can only point toward? To address the question, we first present the need for new approaches in the current climate within the clinical and research communities. Next, we address the challenges for clinicians and researchers by using multiple code theory and derived linguistic measures that offer an objective view of the processes of subjectivity. We then apply the research methods to the clinical data to illustrate the yield of the collaborative effort—a yield that captures the connection between the linear flow of words and the arousal, verbal expression, and reflection/integration of emotion schemas without the usual filters of psychoanalytic models of process and change. The project illustrates the critical value of clinicians' perspectives to guide researchers and encourages clinicians to participate in research to advance our field. For researchers, this project represents a "fourth generation" of process research that includes the criteria of video-recorded, transcribed data; the clinician's report of their experience; a theory of how emotion-laden meaning and motivations (emotion schemas) are expressed in the therapeutic conversation; and reliable, valid measures to capture and represent those processes; and that encourages researchers to access the rich contributions of clinicians' understanding. The implication for clinical practice is a new way to look beyond the lens of psychoanalytic models into what is actually unfolding in real time.

psychiatry,psychology, psychoanalysis
Within and between associations of clinical microskills and correct application of techniques/strategies: A longitudinal multilevel approach.

Jessica Uhl,Jana Schaffrath,Brian Schwartz,Kaitlyn Poster,Wolfgang Lutz

DOI: https://doi.org/10.1037/ccp0000738

2022-07-02

Journal of Consulting and Clinical Psychology

Abstract:Objective: The therapist effect has been demonstrated in various studies. However, studies on putative therapist characteristics show heterogeneous results. Although the majority of studies have solely examined effects between therapists, a growing interest in effects within therapists has emerged. However, it remains unclear whether therapist characteristics are rather a state-like than a trait-like phenomenon. The main aim of the present study is to test whether clinical microskills as well as correct application of techniques and strategies (both between and within therapists) predict across-session change of symptom severity in a large naturalistic data set. Method: The results are based on 398 patients and 48 therapists who treated 5–17 patients each. Clinical microskills and correct application of techniques/strategies were rated using the Inventory of Therapeutic Interventions and Skills, and symptom severity was assessed with the Hopkins Symptom Checklist-11. Results: Results demonstrated significant within- and between-therapist variability in clinical microskills and correct application of techniques/strategies, and no change over the course of treatment in both variables. Moreover, correct application of techniques/strategies was significantly associated with symptom improvement within, but not between therapists. In addition, higher treatment difficulty as well as an interaction between treatment difficulty and correct application of techniques/strategies were significantly associated with symptom improvement. Clinical microskills were neither predictive of symptom improvement within nor between therapists. Conclusions: These results provide initial evidence that not the therapist's average correct application of techniques/strategies is important, but rather how correctly they use a technique with a specific patient. (PsycInfo Database Record (c) 2022 APA, all rights reserved)

psychology, clinical
Using Conversational AI to Facilitate Mental Health Assessments and Improve Clinical Efficiency Within Psychotherapy Services: Real-World Observational Study

Keno Juechems,Ross Harper,Tobias U Hauser,Mona Stylianou,M. Rollwage,J. Habicht,Sruthi Viswanathan,Ben Carrington

DOI: https://doi.org/10.2196/44358

2023-01-16

Abstract:Background Most mental health care providers face the challenge of increased demand for psychotherapy in the absence of increased funding or staffing. To overcome this supply-demand imbalance, care providers must increase the efficiency of service delivery. Objective In this study, we examined whether artificial intelligence (AI)–enabled digital solutions can help mental health care practitioners to use their time more efficiently, and thus reduce strain on services and improve patient outcomes. Methods In this study, we focused on the use of an AI solution (Limbic Access) to support initial patient referral and clinical assessment within the UK’s National Health Service. Data were collected from 9 Talking Therapies services across England, comprising 64,862 patients. Results We showed that the use of this AI solution improves clinical efficiency by reducing the time clinicians spend on mental health assessments. Furthermore, we found improved outcomes for patients using the AI solution in several key metrics, such as reduced wait times, reduced dropout rates, improved allocation to appropriate treatment pathways, and, most importantly, improved recovery rates. When investigating the mechanism by which the AI solution achieved these improvements, we found that the provision of clinically relevant information ahead of clinical assessment was critical for these observed effects. Conclusions Our results emphasize the utility of using AI solutions to support the mental health workforce, further highlighting the potential of AI solutions to increase the efficiency of care delivery and improve clinical outcomes for patients.

Psychology,Medicine,Computer Science
Development of a Digital Content-Free Speech Analysis Tool for the Measurement of Mental Health and Follow-Up for Mental Disorders: Protocol for a Case-Control Study

Peter Tonn,Yoav Degani,Shani Hershko,Amit Klein,Lea Seule,Nina Schulze

DOI: https://doi.org/10.2196/13852

2020-05-14

JMIR Research Protocols

Abstract:Background The prevalence of mental disorders worldwide is very high. The guideline-oriented care of patients depends on early diagnosis and regular and valid evaluation of their treatment to be able to quickly intervene should the patient’s mental health deteriorate. To ensure effective treatment, the level of experience of the physician or therapist is of importance, both in the initial diagnosis and in the treatment of mental illnesses. Nevertheless, experienced physicians and psychotherapists are not available in enough numbers everywhere, especially in rural areas or in less developed countries. Human speech can reveal a speaker’s mental state by altering its noncontent aspects (speech melody, intonations, speech rate, etc). This is noticeable in both the clinic and everyday life by having prior knowledge of the normal speech patterns of the affected person, and with enough time spent listening to the patient. However, this time and experience are often unavailable, leaving unused opportunities to capture linguistic, noncontent information. To improve the care of patients with mental disorders, we have developed a concept for assessing their most important mental parameters through a noncontent analysis of their active speech. Using speech analysis for the assessment and tracking of mental health patients opens up the possibility of remote, automatic, and ongoing evaluation when used with patients’ smartphones, as part of the current trends toward the increasing use of digital and mobile health tools. Objective The primary objective of this study is to evaluate measurements of participants' mental state by comparing the analysis of noncontent speech parameters to the results of several psychological questionnaires (Symptom Checklist-90 [SCL-90], the Patient Health Questionnaire [PHQ], and the Big 5 Test). Methods In this paper, we described a case-controlled study (with a case group and one control group). The participants will be recruited in an outpatient neuropsychiatric treatment center. Inclusion criteria are a neurological or psychiatric diagnosis made by a specialist, no terminal or life-threatening illnesses, and fluent use of the German language. Exclusion criteria include psychosis, dementia, speech or language disorders in neurological diseases, addiction history, a suicide attempt recently or in the last 12 months, or insufficient language skills. The measuring instrument will be the VoiceSense digital voice analysis tool, which enables the analysis of 200 specific speech parameters, and the assessment of findings using psychometric instruments and questionnaires (SCL-90, PHQ, Big 5 Test). Results The study is ongoing as of September 2019, but we have enrolled 254 participants. There have been 161 measurements completed at timepoint 1, and a total of 62 participants have completed every psychological and speech analysis measurement. Conclusions It appears that the tone and modulation of speech are as important, if not more so, than the content, and should not be underestimated. This is particularly evident in the interpretation of the psychological findings thus far acquired. Therefore, the application of a software analysis tool could increase the accuracy of finding assessments and improve patient care. Trial Registration ClinicalTrials.gov NCT03700008; https://clinicaltrials.gov/ct2/show/NCT03700008 International Registered Report Identifier (IRRID) PRR1-10.2196/13852

INTRAUTERINE CONTRACEPTION WITH LEVONORGESTREL: A COMPARATIVE RANDOMISED CLINICAL PERFORMANCE STUDY

Automated evaluation of psychotherapy skills using speech and language technologies

Characterizing Therapist's Speaking Style in Relation to Empathy in Psychotherapy

Objective measures of subjective experience: the use of therapist notes in process-outcome research

Integrating exploration and prediction in computational psychotherapy science: proof of concept

A Computational Framework for Behavioral Assessment of LLM Therapists

Towards Automated Psychotherapy via Language Modeling

Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health

Measurement-based matching of patients to psychotherapists' strengths.

An automated quality evaluation framework of psychotherapy conversations with local quality estimates

Clinically indicated replacement versus routine replacement of peripheral venous catheters in adults: A nonblinded, cluster‐randomized trial in China

Automated quality assessment of cognitive behavioral therapy sessions through highly contextualized language representations

Therapy as an NLP Task: Psychologists' Comparison of LLMs and Human Peers in CBT

Measuring Alliance and Symptom Severity in Psychotherapy Transcripts Using Bert Topic Modeling

Behavioral Activation and Depression Symptomatology: Longitudinal Assessment of Linguistic Indicators in Text-Based Therapy Sessions

COMPASS: Computational Mapping of Patient-Therapist Alliance Strategies with Language Modeling

Clinical and Research Perspectives on the Therapeutic Conversation: The Case of MS. M.

Within and between associations of clinical microskills and correct application of techniques/strategies: A longitudinal multilevel approach.

Using Conversational AI to Facilitate Mental Health Assessments and Improve Clinical Efficiency Within Psychotherapy Services: Real-World Observational Study

Development of a Digital Content-Free Speech Analysis Tool for the Measurement of Mental Health and Follow-Up for Mental Disorders: Protocol for a Case-Control Study