Abstract:We employ a Large Language Model (LLM) to convert unstructured psychological interviews into structured questionnaires spanning various psychiatric and personality domains. The LLM is prompted to answer these questionnaires by impersonating the interviewee. The obtained answers are coded as features, which are used to predict standardized psychiatric measures of depression (PHQ-8) and PTSD (PCL-C), using a Random Forest regressor. Our approach is shown to enhance diagnostic accuracy compared to multiple baselines. It thus establishes a novel framework for interpreting unstructured psychological interviews, bridging the gap between narrative-driven and data-driven approaches for mental health assessment.

What problem does this paper attempt to address?

The main problem this paper attempts to address is improving the accuracy of mental health assessments. Specifically, the authors propose a novel approach that utilizes large language models (LLMs) to transform unstructured psychological interviews into structured questionnaire answers, thereby predicting standardized mental health scores (such as the PHQ-8 score for depression and the PCL-C score for PTSD). This method aims to bridge the gap between narrative-driven and data-driven mental health assessments, enhancing diagnostic precision and consistency through automation. ### Main Issues: 1. **Improving the accuracy of mental health assessments**: - Current mental health assessments rely on patients' verbal reports, which include unstructured interviews and structured questionnaires. These methods suffer from subjectivity, inconsistency, and interviewer bias, making accurate diagnosis challenging. - The authors' method uses large language models (LLMs) to convert unstructured interview text into structured questionnaire answers, generating feature vectors that can be used to predict standardized scores. 2. **Bridging the gap between narrative-driven and data-driven assessment methods**: - Narrative-driven methods allow patients to express themselves freely but lack standardization; data-driven methods are too rigid and may overlook individual differences. - By using LLMs, the authors' method can generate standardized assessment results while preserving patients' personal characteristics, combining the strengths of both approaches. 3. **Automating mental health assessments**: - Traditional assessment methods require significant human resources and time and are prone to human factors. - The authors' method automates the processing of interview texts, reducing human intervention and increasing the efficiency and objectivity of assessments. ### Solution: - **Two-step approach**: 1. **Generate questionnaire answers**: Use LLMs to generate questionnaire answers based on interview texts, simulating the interviewee's responses. 2. **Predict standardized scores**: Use the generated questionnaire answers as features input into a random forest regression model to predict standardized mental health scores (such as PHQ-8 and PCL-C). - **Dataset**: The Extended Distress Analysis Interview Corpus (E-DAIC) dataset is used, which contains 275 psychological interview texts and their corresponding PHQ-8 and PCL-C scores. - **Model evaluation**: The effectiveness of the proposed method is validated by comparing it with various baseline methods. Experimental results show that the LMIQ method exhibits lower mean squared error (MSE) in predicting the severity of depression and PTSD, outperforming other methods. ### Conclusion: - This method shows significant advantages in improving the accuracy and consistency of mental health assessments, providing new tools and ideas for clinical applications. However, further validation is needed to assess its generalizability across different datasets and clinical settings, and ethical and privacy issues must be considered.

LLM Questionnaire Completion for Automatic Psychiatric Assessment

Aligning Large Language Models for Enhancing Psychiatric Interviews through Symptom Delineation and Summarization

The Capability of Large Language Models to Measure Psychiatric Functioning

Automating PTSD Diagnostics in Clinical Interviews: Leveraging Large Language Models for Trauma Assessments

Aligning Large Language Models for Enhancing Psychiatric Interviews Through Symptom Delineation and Summarization: Pilot Study

Cognitive phantoms in LLMs through the lens of latent variables

Using LLMs to Aid Annotation and Collection of Clinically-Enriched Data in Bipolar Disorder and Schizophrenia

Identifying Psychiatric Manifestations in Outpatients with Depression and Anxiety: A Large Language Model-Based Approach

PsycoLLM: Enhancing LLM for Psychological Understanding and Evaluation

PsyEval: A Comprehensive Large Language Model Evaluation Benchmark for Mental Health

LMLPA: Language Model Linguistic Personality Assessment

PsyEval: A Suite of Mental Health Related Tasks for Evaluating Large Language Models

Enhancing health assessments with large language models: A methodological approach

Psy-LLM: Scaling up Global Mental Health Psychological Services with AI-based Large Language Models

AI Psychometrics: Assessing the Psychological Profiles of Large Language Models Through Psychometric Inventories

A Comprehensive Evaluation of Large Language Models on Mental Illnesses

Quantifying AI Psychology: A Psychometrics Benchmark for Large Language Models

A Novel Nuanced Conversation Evaluation Framework for Large Language Models in Mental Health

Severity Prediction in Mental Health: LLM-based Creation, Analysis, Evaluation of a Novel Multilingual Dataset

Psychological Assessments with Large Language Models: A Privacy-Focused and Cost-Effective Approach

Large language models in psychiatry: Opportunities and challenges