Large language models in medicine: the potentials and pitfalls

Jesutofunmi A. Omiye,Haiwen Gui,Shawheen J. Rezaei,James Zou,Roxana Daneshjou

DOI: https://doi.org/10.7326/M23-2772

2023-09-01

Abstract:Large language models (LLMs) have been applied to tasks in healthcare, ranging from medical exam questions to responding to patient questions. With increasing institutional partnerships between companies producing LLMs and healthcare systems, real world clinical application is coming closer to reality. As these models gain traction, it is essential for healthcare practitioners to understand what LLMs are, their development, their current and potential applications, and the associated pitfalls when utilized in medicine. This review and accompanying tutorial aim to give an overview of these topics to aid healthcare practitioners in understanding the rapidly changing landscape of LLMs as applied to medicine.

Computation and Language,Artificial Intelligence,Computers and Society

What problem does this paper attempt to address?

The paper primarily explores the potential applications and existing issues of large language models (LLMs) in the medical field. Specifically:

1. **Research Background**: With the widespread application of large-scale language models (such as ChatGPT, Bard, etc.) launched by companies like OpenAI and Google, the practical application of these models in the healthcare field is becoming increasingly realistic.

2. **Objective**: This paper aims to provide healthcare practitioners with a comprehensive overview to help them understand the working principles, development history, current applications, and potential issues of using LLMs in the medical field.

3. **Main Content**:
- Introduces the basic concepts and development history of LLMs.
- Summarizes the performance and application examples of different types of LLMs (such as GPT, BERT, PaLM, etc.) in medical tasks.
- Discusses the specific applications of LLMs in the medical field, including but not limited to patient education, clinical workflow support, medical education, and academic research.
- Analyzes the main limitations that LLMs may encounter in medical applications, such as accuracy issues, dataset bias, input-output inconsistency, and privacy and ethical concerns.

Through this content, the paper hopes that healthcare practitioners can better understand the technical characteristics of LLMs and reasonably utilize the advantages of these models in their actual work while being mindful of potential risks.