Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review

Mingze Yuan,Peng Bao,Jiajia Yuan,Yunhao Shen,Zifan Chen,Yi Xie,Jie Zhao,Yang Chen,Li Zhang,Lin Shen,Bin Dong

2023-11-03

Abstract:With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to enhance various aspects of healthcare, ranging from medical education to clinical decision support. However, medicine involves multifaceted data modalities and nuanced reasoning skills, presenting challenges for integrating LLMs. This paper provides a comprehensive review on the applications and implications of LLMs in medicine. It begins by examining the fundamental applications of general-purpose and specialized LLMs, demonstrating their utilities in knowledge retrieval, research support, clinical workflow automation, and diagnostic assistance. Recognizing the inherent multimodality of medicine, the review then focuses on multimodal LLMs, investigating their ability to process diverse data types like medical imaging and EHRs to augment diagnostic accuracy. To address LLMs' limitations regarding personalization and complex clinical reasoning, the paper explores the emerging development of LLM-powered autonomous agents for healthcare. Furthermore, it summarizes the evaluation methodologies for assessing LLMs' reliability and safety in medical contexts. Overall, this review offers an extensive analysis on the transformative potential of LLMs in modern medicine. It also highlights the pivotal need for continuous optimizations and ethical oversight before these models can be effectively integrated into clinical practice. Visit <a class="link-external link-https" href="https://github.com/mingze-yuan/Awesome-LLM-Healthcare" rel="external noopener nofollow">this https URL</a> for an accompanying GitHub repository containing latest papers.

Computation and Language,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper primarily explores the applications and potential impacts of large language models (LLMs) in the medical field. Specifically, the paper aims to address the following aspects:

1. **Comprehensive evaluation of LLMs in medicine**: The paper provides a detailed analysis of the applications of both general-purpose and specialized LLMs in medical knowledge retrieval, research support, clinical workflow automation, and diagnostic assistance.

2. **Research on multimodal LLMs**: Given the diversity of medical data (such as pathology, radiology, and genomics), the paper focuses on how multimodal LLMs handle various data types to improve diagnostic accuracy.

3. **Development of autonomous agents**: To overcome the limitations of LLMs in personalized and complex clinical reasoning, the paper explores the application of LLM-based autonomous agents in healthcare and proposes the potential roles these agents might play.

4. **Evaluation methods and ethical considerations**: The paper also summarizes methods for assessing the reliability and safety of LLMs in medical environments and emphasizes the importance of continuous optimization and ethical oversight required to effectively integrate these models into clinical practice.

In summary, this paper aims to comprehensively demonstrate the transformative potential of LLMs in modern medicine and highlights the further research directions and technological improvements needed to realize this potential.