Abstract:Importance: Large language models (LLMs) can assist in various health care activities, but current evaluation approaches may not adequately identify the most useful application areas. Objective: To summarize existing evaluations of LLMs in health care in terms of 5 components: (1) evaluation data type, (2) health care task, (3) natural language processing (NLP) and natural language understanding (NLU) tasks, (4) dimension of evaluation, and (5) medical specialty. Data sources: A systematic search of PubMed and Web of Science was performed for studies published between January 1, 2022, and February 19, 2024. Study selection: Studies evaluating 1 or more LLMs in health care. Data extraction and synthesis: Three independent reviewers categorized studies via keyword searches based on the data used, the health care tasks, the NLP and NLU tasks, the dimensions of evaluation, and the medical specialty. Results: Of 519 studies reviewed, published between January 1, 2022, and February 19, 2024, only 5% used real patient care data for LLM evaluation. The most common health care tasks were assessing medical knowledge such as answering medical licensing examination questions (44.5%) and making diagnoses (19.5%). Administrative tasks such as assigning billing codes (0.2%) and writing prescriptions (0.2%) were less studied. For NLP and NLU tasks, most studies focused on question answering (84.2%), while tasks such as summarization (8.9%) and conversational dialogue (3.3%) were infrequent. Almost all studies (95.4%) used accuracy as the primary dimension of evaluation; fairness, bias, and toxicity (15.8%), deployment considerations (4.6%), and calibration and uncertainty (1.2%) were infrequently measured. Finally, in terms of medical specialty area, most studies were in generic health care applications (25.6%), internal medicine (16.4%), surgery (11.4%), and ophthalmology (6.9%), with nuclear medicine (0.6%), physical medicine (0.4%), and medical genetics (0.2%) being the least represented. Conclusions and relevance: Existing evaluations of LLMs mostly focus on accuracy of question answering for medical examinations, without consideration of real patient care data. Dimensions such as fairness, bias, and toxicity and deployment considerations received limited attention. Future evaluations should adopt standardized applications and metrics, use clinical data, and broaden focus to include a wider range of tasks and specialties.

Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Review

Adapted large language models can outperform medical experts in clinical text summarization

Generating medically-accurate summaries of patient-provider dialogue: A multi-stage approach using large language models

Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts

Comparative Analysis of Open-Source Language Models in Summarizing Medical Text Data

Evaluating large language models in medical applications: a survey

Adapting Large Language Models for Automated Summarisation of Electronic Medical Records in Clinical Coding

A Comparative Study of Recent Large Language Models on Generating Hospital Discharge Summaries for Lung Cancer Patients

Using Large Language Models to Evaluate Biomedical Query-Focused Summarisation

Enhanced Electronic Health Records Text Summarization Using Large Language Models

Testing and Evaluation of Health Care Applications of Large Language Models: A Systematic Review

Synoptic Reporting by Summarizing Cancer Pathology Reports using Large Language Models

A Survey of Large Language Models in Medicine: Progress, Application, and Challenge

Methodical Systematic Review of Abstractive Summarization and Natural Language Processing Models for Biomedical Health Informatics: Approaches, Metrics and Challenges

Qualitative metrics from the biomedical literature for evaluating large language models in clinical decision-making: a narrative review

Large language models encode clinical knowledge

Patient Centric Summarization of Radiology Findings using Large Language Models

Evaluating Large Language Models for Radiology Natural Language Processing

Systematic Review of Large Language Models for Patient Care: Current Applications and Challenges

Using large language models for safety-related table summarization in clinical study reports