Abstract:Recent breakthroughs in large language models (LLMs) offer unprecedented natural language understanding and generation capabilities. However, existing surveys on LLMs in biomedicine often focus on specific applications or model architectures, lacking a comprehensive analysis that integrates the latest advancements across various biomedical domains. This review, based on an analysis of 484 publications sourced from databases including PubMed, Web of Science, and arXiv, provides an in-depth examination of the current landscape, applications, challenges, and prospects of LLMs in biomedicine, distinguishing itself by focusing on the practical implications of these models in real-world biomedical contexts. Firstly, we explore the capabilities of LLMs in zero-shot learning across a broad spectrum of biomedical tasks, including diagnostic assistance, drug discovery, and personalized medicine, among others, with insights drawn from 137 key studies. Then, we discuss adaptation strategies of LLMs, including fine-tuning methods for both uni-modal and multi-modal LLMs to enhance their performance in specialized biomedical contexts where zero-shot fails to achieve, such as medical question answering and efficient processing of biomedical literature. Finally, we discuss the challenges that LLMs face in the biomedicine domain including data privacy concerns, limited model interpretability, issues with dataset quality, and ethics due to the sensitive nature of biomedical data, the need for highly reliable model outputs, and the ethical implications of deploying AI in healthcare. To address these challenges, we also identify future research directions of LLM in biomedicine including federated learning methods to preserve data privacy and integrating explainable AI methodologies to enhance the transparency of LLMs.

An Interdisciplinary Outlook on Large Language Models for Scientific Research

How should the advent of large language models affect the practice of science?

The Role of Large Language Models in Interdisciplinary Research: Opportunities, Challenges, and Ways Forward

Large Language Models and Knowledge Graphs: Opportunities and Challenges

Scientific Large Language Models: A Survey on Biological & Chemical Domains

A Bibliometric Review of Large Language Models Research from 2017 to 2023

A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery

Large language models for science and medicine

A Comprehensive Overview of Large Language Models

Towards Efficient Large Language Models for Scientific Text: A Review

Exploring the landscape of large language models: Foundations, techniques, and challenges

A Survey for Large Language Models in Biomedicine

Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understanding

Decoding Large-Language Models: A Systematic Overview of Socio-Technical Impacts, Constraints, and Emerging Questions

An analysis of large language models: their impact and potential applications

The Quo Vadis of the Relationship between Language and Large Language Models

Academic collaboration on large language model studies increases overall but varies across disciplines

Large Language Models in Education: A Systematic Review

Apprentices to Research Assistants: Advancing Research with Large Language Models

Large Language Models for Education: A Survey and Outlook

Scientific Computing with Large Language Models