Abstract:Objectives: Generative large language models (LLMs) are a subset of transformers-based neural network architecture models. LLMs have successfully leveraged a combination of an increased number of parameters, improvements in computational efficiency, and large pre-training datasets to perform a wide spectrum of natural language processing (NLP) tasks. Using a few examples (few-shot) or no examples (zero-shot) for prompt-tuning has enabled LLMs to achieve state-of-the-art performance in a broad range of NLP applications. This article by the American Medical Informatics Association (AMIA) NLP Working Group characterizes the opportunities, challenges, and best practices for our community to leverage and advance the integration of LLMs in downstream NLP applications effectively. This can be accomplished through a variety of approaches, including augmented prompting, instruction prompt tuning, and reinforcement learning from human feedback (RLHF). Target audience: Our focus is on making LLMs accessible to the broader biomedical informatics community, including clinicians and researchers who may be unfamiliar with NLP. Additionally, NLP practitioners may gain insight from the described best practices. Scope: We focus on 3 broad categories of NLP tasks, namely natural language understanding, natural language inferencing, and natural language generation. We review the emerging trends in prompt tuning, instruction fine-tuning, and evaluation metrics used for LLMs while drawing attention to several issues that impact biomedical NLP applications, including falsehoods in generated text (confabulation/hallucinations), toxicity, and dataset contamination leading to overfitting. We also review potential approaches to address some of these current challenges in LLMs, such as chain of thought prompting, and the phenomena of emergent capabilities observed in LLMs that can be leveraged to address complex NLP challenge in biomedical applications.

Large language model to multimodal large language model: A journey to shape the biological macromolecules to biological sciences and medicine

Large language models reshaping molecular biology and drug development

A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine

Large Language Models for Biomolecular Analysis: from Methods to Applications

Large language models in bioinformatics: applications and perspectives

Large language models for science and medicine

An Evaluation of Large Language Models in Bioinformatics Research

A Review of Multi-Modal Large Language and Vision Models

ChatGPT, Bard, and Large Language Models for Biomedical Research: Opportunities and Pitfalls

A Survey of Large Language Models in Medicine: Progress, Application, and Challenge

Large language models for biomedicine: foundations, opportunities, challenges, and best practices

From Text to Multimodality: Exploring the Evolution and Impact of Large Language Models in Medical Practice

A Survey for Large Language Models in Biomedicine

Transformative Trends: A Comprehensive Review of Large Language Models (LLMs) in Healthcare

Large Language Models: A Survey

Large language models: a primer and gastroenterology applications

Multimodal Large Language Models for Bioimage Analysis

Large Language Models in Medicine: The Potentials and Pitfalls

Large Language Models to process, analyze, and synthesize biomedical texts – a scoping review

A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directions

Large Language Models: A Guide for Radiologists