Abstract:Advances in artificial intelligence (AI) in general and Natural Language Processing (NLP) in particular are paving the new way forward for the automated detection and prediction of mental health disorders among the population. Recent research in this area has prioritized predictive accuracy over model interpretability by relying on deep learning methods. However, prioritizing predictive accuracy over model interpretability can result in a lack of transparency in the decision-making process, which is critical in sensitive applications such as healthcare. There is thus a growing need for explainable AI (XAI) approaches to psychiatric diagnosis and prediction. The main aim of this work is to address a gap by conducting a systematic investigation of XAI approaches in the realm of automatic detection of mental disorders from language behavior leveraging textual data from social media. In pursuit of this aim, we perform extensive experiments to evaluate the balance between accuracy and interpretability across predictive mental health models. More specifically, we build BiLSTM models trained on a comprehensive set of human-interpretable features, encompassing syntactic complexity, lexical sophistication, readability, cohesion, stylistics, as well as topics and sentiment/emotions derived from lexicon-based dictionaries to capture multiple dimensions of language production. We conduct extensive feature ablation experiments to determine the most informative feature groups associated with specific mental health conditions. We juxtapose the performance of these models against a "black-box" domain-specific pretrained transformer adapted for mental health applications. To enhance the interpretability of the transformers models, we utilize a multi-task fusion learning framework infusing information from two relevant domains (emotion and personality traits). Moreover, we employ two distinct explanation techniques: the local interpretable model-agnostic explanations (LIME) method and a model-specific self-explaining method (AGRAD). These methods allow us to discern the specific categories of words that the information-infused models rely on when generating predictions. Our proposed approaches are evaluated on two public English benchmark datasets, subsuming five mental health conditions (attention-deficit/hyperactivity disorder, anxiety, bipolar disorder, depression and psychological stress).

The Language of Trauma: Modeling Traumatic Event Descriptions Across Domains with Explainable AI

Interdisciplinary approach to identify language markers for post-traumatic stress disorder using machine learning and deep learning

Automating PTSD Diagnostics in Clinical Interviews: Leveraging Large Language Models for Trauma Assessments

Fine-tuning language model embeddings to reveal domain knowledge: An explainable artificial intelligence perspective on medical decision making

An overview of diagnostics and therapeutics using large language models

Toward explainable AI (XAI) for mental health detection based on language behavior

Trauma Isn't One Size Fits All: How Online Support Communities Point to Different Diagnostic Criteria for C-PTSD and PTSD

Applying LLM and Topic Modelling in Psychotherapeutic Contexts

A Methodology for Explainable Large Language Models with Integrated Gradients and Linguistic Analysis in Text Classification

Enhancing post-traumatic stress disorder patient assessment: leveraging natural language processing for research of domain criteria identification using electronic medical records

World Trade Center responders in their own words: Predicting PTSD symptom trajectories with AI-based language analyses of interviews

Performance of trauma-trained large language models on surgical assessment questions: A new approach in resource identification

A data augmentation method for war trauma based on the regression model and deep neural networks

Explaining Speech Classification Models via Word-Level Audio Segments and Paralinguistic Features

Comparative Study of Language Models on Cross-Domain Data with Model Agnostic Explainability

Explaining Agent Behavior with Large Language Models

Modeling Users and Online Communities for Abuse Detection: A Position on Ethics and Explainability

Large Language Models Perform on Par with Experts Identifying Mental Health Factors in Adolescent Online Forums

Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training

BERT meets LIWC: Exploring State-of-the-Art Language Models for Predicting Communication Behavior in Couples' Conflict Interactions

Unveiling Language Competence Neurons: A Psycholinguistic Approach to Model Interpretability