Abstract:Background: Medication review and reconciliation is essential for optimizing drug therapy and minimizing medication errors. Large language models (LLMs) have been recently shown to possess a lot of potential applications in healthcare field due to their abilities of deductive, abductive, and logical reasoning. The present study assessed the abilities of LLMs in medication review and medication reconciliation processes. Methods: Four LLMs were prompted with appropriate queries related to dosing regimen errors, drug-drug interactions, therapeutic drug monitoring, and genomics-based decision-making process. The veracity of the LLM outputs were verified from validated sources using pre-validated criteria (accuracy, relevancy, risk management, hallucination mitigation, and citations and guidelines). The impacts of the erroneous responses on the patients' safety were categorized either as major or minor. Results: In the assessment of four LLMs regarding dosing regimen errors, drug-drug interactions, and suggestions for dosing regimen adjustments based on therapeutic drug monitoring and genomics-based individualization of drug therapy, responses were generally consistent across prompts with no clear pattern in response quality among the LLMs. For identification of dosage regimen errors, ChatGPT performed well overall, except for the query related to simvastatin. In terms of potential drug-drug interactions, all LLMs recognized interactions with warfarin but missed the interaction between metoprolol and verapamil. Regarding dosage modifications based on therapeutic drug monitoring, Claude-Instant provided appropriate suggestions for two scenarios and nearly appropriate suggestions for the other two. Similarly, for genomics-based decision-making, Claude-Instant offered satisfactory responses for four scenarios, followed by Gemini for three. Notably, Gemini stood out by providing references to guidelines or citations even without prompting, demonstrating a commitment to accuracy and reliability in its responses. Minor impacts were noted in identifying appropriate dosing regimens and therapeutic drug monitoring, while major impacts were found in identifying drug interactions and making pharmacogenomic-based therapeutic decisions. Conclusion: Advanced LLMs hold significant promise in revolutionizing the medication review and reconciliation process in healthcare. Diverse impacts on patient safety were observed. Integrating and validating LLMs within electronic health records and prescription systems is essential to harness their full potential and enhance patient safety and care quality.

Development and Testing of a Novel Large Language Model-Based Clinical Decision Support Systems for Medication Safety in 12 Clinical Specialties

Development and Testing of Retrieval Augmented Generation in Large Language Models -- A Case Study Report

Development of a Large Language Model-based Multi-Agent Clinical Decision Support System for Korean Triage and Acuity Scale (KTAS)-Based Triage and Treatment Planning in Emergency Departments

Improving Clinical Expertise in Large Language Models Using Electronic Medical Records

Evaluating large language model workflows in clinical decision support: referral, triage, and diagnosis

ShennongMGS: An LLM-based Chinese Medication Guidance System

Large language models improve clinical decision making of medical students through patient simulation and structured feedback: a randomized controlled trial

Enhancing Large Language Models for Clinical Decision Support by Incorporating Clinical Practice Guidelines

Unlocking the potential of advanced large language models in medication review and reconciliation: A proof-of-concept investigation

Answering real-world clinical questions using large language model based systems

Large language models management of complex medication regimens: a case-based evaluation

Large Language Model Prompting Techniques for Advancement in Clinical Medicine

Large language models encode clinical knowledge

Towards Accurate Differential Diagnosis with Large Language Models

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark

The Need for Guardrails with Large Language Models in Medical Safety-Critical Settings: An Artificial Intelligence Application in the Pharmacovigilance Ecosystem

Enhancing Medication Safety with Large Language Models: Advanced Detection and Prediction of Drug-Drug Interactions

Can Large Language Models Provide Emergency Medical Help Where There Is No Ambulance? A Comparative Study on Large Language Model Understanding of Emergency Medical Scenarios in Resource-Constrained Settings

Large language model non-compliance with FDA guidance for clinical decision support devices

Large language models in solving clinical dilemmas - advantages and drawbacks