Abstract:Automatic coding patient behaviors is essential to support decision making for psychotherapists during the motivational interviewing (MI), a collaborative communication intervention approach to address psychiatric issues, such as alcohol and drug addiction. While the behavior coding task has rapidly adapted machine learning to predict patient states during the MI sessions, lacking of domain-specific knowledge and overlooking patient-therapist interactions are major challenges in developing and deploying those models in real practice. To encounter those challenges, we introduce the Chain-of-Interaction (CoI) prompting method aiming to contextualize large language models (LLMs) for psychiatric decision support by the dyadic interactions. The CoI prompting approach systematically breaks down the coding task into three key reasoning steps, extract patient engagement, learn therapist question strategies, and integrates dyadic interactions between patients and therapists. This approach enables large language models to leverage the coding scheme, patient state, and domain knowledge for patient behavioral coding. Experiments on real-world datasets can prove the effectiveness and flexibility of our prompting method with multiple state-of-the-art LLMs over existing prompting baselines. We have conducted extensive ablation analysis and demonstrate the critical role of dyadic interactions in applying LLMs for psychotherapy behavior understanding.

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve This paper aims to address the challenges of automatically coding patient behavior during Motivational Interviewing (MI) in psychotherapy. Specifically, the paper focuses on the following two main issues: 1. **Lack of Domain Knowledge**: Existing machine learning models often overlook the professional knowledge in the mental health field, especially the guidelines in the MI coding manual (MISC), when predicting patient states. These models generate predictions solely based on the patient's speech input without integrating the concepts and definitions from the MISC coding scheme. 2. **Ignoring Patient-Therapist Interaction**: Current methods typically focus only on the patient's unilateral speech, neglecting the interaction between the patient and the therapist. This interaction is crucial for understanding the patient's behavior and emotional state, but existing methods fail to fully utilize this information. To address these issues, the paper proposes the "Chain-of-Interaction" (CoI) prompting method, which systematically breaks down the coding task into three key steps: extracting patient engagement, learning therapist questioning strategies, and integrating patient-therapist interactions. This enables large language models (LLMs) to utilize the coding scheme, patient states, and domain knowledge to more accurately code patient behavior. ### Main Contributions - **Introduction of the CoI Prompting Method**: Enhances the reasoning ability of LLMs in behavior coding tasks through three consecutive stages (interaction definition, engagement assessment, emotional analysis). - **Experimental Validation**: Conducted extensive experiments on real-world datasets, demonstrating the effectiveness and flexibility of the CoI method, especially in cases of data and label imbalance. - **Ablation Study**: Showcased the critical contribution of domain knowledge and dyadic interaction to LLM performance by removing each stage. ### Conclusion The CoI prompting method proposed in the paper not only improves the accuracy of automatic patient behavior coding but also enhances the model's flexibility and robustness in practical applications. This method provides new insights and tools for applying large language models in the field of psychotherapy.

Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contexts

Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Models

ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting

CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapy

Eliciting Motivational Interviewing Skill Codes in Psychotherapy with LLMs: A Bilingual Dataset and Analytical Study

Optimizing Psychological Counseling with Instruction-Tuned Large Language Models

Toward Large Language Models as a Therapeutic Tool: Comparing Prompting Techniques to Improve GPT-Delivered Problem-Solving Therapy

Large Language Model Prompting Techniques for Advancement in Clinical Medicine

Chain of Thought Utilization in Large Language Models and Application in Nephrology

Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes

Dialectical Behavior Therapy Approach to LLM Prompting

Empowering Psychotherapy with Large Language Models: Cognitive Distortion Detection through Diagnosis of Thought Prompting

Are Large Language Models Possible to Conduct Cognitive Behavioral Therapy?

From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models

Domain-Specific Improvement on Psychotherapy Chatbot Using Assistant

CBT-LLM: A Chinese Large Language Model for Cognitive Behavioral Therapy-based Mental Health Question Answering

A Dual-Prompting for Interpretable Mental Health Language Models

AI-Enhanced Cognitive Behavioral Therapy: Deep Learning and Large Language Models for Extracting Cognitive Pathways from Social Media Texts

Using LLMs to Aid Annotation and Collection of Clinically-Enriched Data in Bipolar Disorder and Schizophrenia