Abstract:Large language models (LLMs) have attracted significant attention for potential applications in digital health, while their application in mental health is subject to ongoing debate. This systematic review aims to evaluate the usage of LLMs in mental health, focusing on their strengths and limitations in early screening, digital interventions, and clinical applications. Adhering to PRISMA guidelines, we searched PubMed, IEEE Xplore, Scopus, JMIR, and ACM using keywords: 'mental health OR mental illness OR mental disorder OR psychiatry' AND 'large language models'. We included articles published between January 1, 2017, and April 30, 2024, excluding non-English articles. 30 articles were evaluated, which included research on mental health conditions and suicidal ideation detection through text (n=15), usage of LLMs for mental health conversational agents (CAs) (n=7), and other applications and evaluations of LLMs in mental health (n=18). LLMs exhibit substantial effectiveness in detecting mental health issues and providing accessible, de-stigmatized eHealth services. However, the current risks associated with the clinical use might surpass their benefits. The study identifies several significant issues: the lack of multilingual datasets annotated by experts, concerns about the accuracy and reliability of the content generated, challenges in interpretability due to the 'black box' nature of LLMs, and persistent ethical dilemmas. These include the lack of a clear ethical framework, concerns about data privacy, and the potential for over-reliance on LLMs by both therapists and patients, which could compromise traditional medical practice. Despite these issues, the rapid development of LLMs underscores their potential as new clinical aids, emphasizing the need for continued research and development in this area.

Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models

Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data

From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models

Dr. GPT in Campus Counseling: Understanding Higher Education Students' Opinions on LLM-assisted Mental Health Services

An Assessment on Comprehending Mental Health through Large Language Models

Large Language Models Perform on Par with Experts Identifying Mental Health Factors in Adolescent Online Forums

Towards Interpretable Mental Health Analysis with Large Language Models

Can AI Relate: Testing Large Language Model Response for Mental Health Support

A Large Language Model Approach to Educational Survey Feedback Analysis

Using Large Language Models for sentiment analysis of health-related social media data: empirical evaluation and practical tips

Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental Health

Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Support

Large Language Model for Mental Health: A Systematic Review

Large Language Models in Mental Health Care: a Scoping Review

A platform for connecting social media data to domain-specific topics using large language models: an application to student mental health

Evaluating Large Language Models for Health-Related Text Classification Tasks with Public Social Media Data

Large Language Models for Automatic Detection of Sensitive Topics

Benefits and Harms of Large Language Models in Digital Mental Health

Sentiment Analysis in the Era of Large Language Models: A Reality Check

Do Large Language Models Possess Sensitive to Sentiment?

Large multimodal models assist in psychiatry disorders prevention and diagnosis of students