Few-Shot Learning for Chronic Disease Management: Leveraging Large Language Models and Multi-Prompt Engineering with Medical Knowledge Injection

Haoxin Liu,Wenli Zhang,Jiaheng Xie,Buomsoo Kim,Zhu Zhang,Yidong Chai

2024-01-16

Abstract:This study harnesses state-of-the-art AI technology for chronic disease management, specifically in detecting various mental disorders through user-generated textual content. Existing studies typically rely on fully supervised machine learning, which presents challenges such as the labor-intensive manual process of annotating extensive training data for each disease and the need to design specialized deep learning architectures for each problem. To address such challenges, we propose a novel framework that leverages advanced AI techniques, including large language models and multi-prompt engineering. Specifically, we address two key technical challenges in data-driven chronic disease management: (1) developing personalized prompts to represent each user's uniqueness and (2) incorporating medical knowledge into prompts to provide context for chronic disease detection, instruct learning objectives, and operationalize prediction goals. We evaluate our method using four mental disorders, which are prevalent chronic diseases worldwide, as research cases. On the depression detection task, our method (F1 = 0.975~0.978) significantly outperforms traditional supervised learning paradigms, including feature engineering (F1 = 0.760) and architecture engineering (F1 = 0.756). Meanwhile, our approach demonstrates success in few-shot learning, i.e., requiring only a minimal number of training examples to detect chronic diseases based on user-generated textual content (i.e., only 2, 10, or 100 subjects). Moreover, our method can be generalized to other mental disorder detection tasks, including anorexia, pathological gambling, and self-harm (F1 = 0.919~0.978).

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address several key issues in chronic disease management, particularly the detection of various mental disorders through user-generated text content. Existing studies typically rely on fully supervised machine learning methods, which present some challenges, such as the need for large amounts of labeled data and the design of specialized deep learning architectures for each disease. To address these issues, the paper proposes a new framework that leverages advanced AI technologies, including large-scale language models (LLMs) and multi-prompt engineering, combined with medical knowledge injection to improve the efficiency and accuracy of chronic disease detection. Specifically, the paper addresses the following two key technical challenges: 1. Developing personalized prompts to represent the uniqueness of each user. 2. Integrating medical knowledge into the prompts to provide context for chronic disease detection, guide learning objectives, and achieve prediction goals. Moreover, this method performs excellently in the task of depression detection (F1 score of 0.975~0.978), significantly outperforming traditional supervised learning methods. Additionally, this method can effectively learn with a small number of samples (e.g., 2, 10, or 100 cases) and can be generalized to other mental disorder detection tasks, such as anorexia, pathological gambling, and self-harm behaviors. Overall, this work not only makes contributions at the technical level but also has the potential to improve patient well-being, control healthcare costs, and establish a more efficient and accessible healthcare system.

Few-Shot Learning for Chronic Disease Management: Leveraging Large Language Models and Multi-Prompt Engineering with Medical Knowledge Injection

Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Media

CALLM: Enhancing Clinical Interview Analysis through Data Augmentation with Large Language Models

Care for the Mind Amid Chronic Diseases: An Interpretable AI Approach Using IoT

Health-LLM: Personalized Retrieval-Augmented Disease Prediction System

Automatic depression severity assessment with deep learning using parameter-efficient tuning

Deep Learning-Based Natural Language Processing for Screening Psychiatric Patients

Large Language Multimodal Models for 5-Year Chronic Disease Cohort Prediction Using EHR Data

Leveraging Medical Knowledge Graphs and Large Language Models for Enhanced Mental Disorder Information Extraction

XAI4LLM. Let Machine Learning Models and LLMs Collaborate for Enhanced In-Context Learning in Healthcare

Depression Detection on Social Media with Large Language Models

A chatbot based question and answer system for the auxiliary diagnosis of chronic diseases based on large language model

Prompting Large Language Models for Zero-Shot Clinical Prediction with Structured Longitudinal Electronic Health Record Data

AI-Enhanced Cognitive Behavioral Therapy: Deep Learning and Large Language Models for Extracting Cognitive Pathways from Social Media Texts

Enhancing Early Detection of Cognitive Decline in the Elderly: A Comparative Study Utilizing Large Language Models in Clinical Notes

Stone Needle: A General Multimodal Large-scale Model Framework towards Healthcare

A Comprehensive Evaluation of Large Language Models on Mental Illnesses

From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models

A Simple and Flexible Modeling for Mental Disorder Detection by Learning from Clinical Questionnaires

Adaptive multi-task positive-unlabeled learning for joint prediction of multiple chronic diseases using online shopping behaviors

Health-LLM: Personalized Retrieval-Augmented Disease Prediction Model