[Efficacy of laparoscopy in the diagnosis of ascites of indeterminate origin].

J. García‐Pagán,J. Bordas,E. Saperas,F. Mondelo,X. Calvet,J. Rodés

1988-02-20

Abstract:

What problem does this paper attempt to address?

Large language models management of complex medication regimens: a case-based evaluation

Amoreena Most,Aaron Chase,Steven Xu,Tanner Hedrick,Brian Murray,Kelli Keats,Susan Smith,Erin Barreto,Tianming Liu,Andrea Sikora

DOI: https://doi.org/10.1101/2024.07.03.24309889

2024-07-08

Abstract:Background: Large language models (LLMs) have shown capability in diagnosing complex medical cases and passing medical licensing exams, but to date, only limited evaluations have studied how LLMs interpret, analyze, and optimize complex medication regimens. The purpose of this evaluation was to test four LLMs ability to identify medication errors and appropriate medication interventions on complex patient cases from the intensive care unit (ICU). Methods: A series of eight patient cases were developed by critical care pharmacists including history of present illness, laboratory values, vital signs, and medication regimens. Then, four LLMs (ChatGPT (GPT-3.5), ChatGPT (GPT-4), Claude2, and Llama2-7b) were prompted to develop a medication regimen for the patient. LLM generated medication regimens were then reviewed by a panel of seven critical care pharmacists to assess for presence of medication errors and clinical relevance. For each medication regimen recommended by the LLM, clinicians were asked to assess for if they would continue a medication, identify perceived medication errors in the medications recommended, identify the presence of life-threatening medication choices, and rank overall agreement on a 5-point Likert scale. Results: The clinician panel rated to continue therapies recommended by the LLMs between 55.8-67.9% of the time. Clinicians perceived between 1.57-4.29 medication errors per recommended regimen, and life-threatening recommendations were present between 15.0-55.3% of the time. Level agreement was between 1.85-2.67 for the four LLMs. Conclusions: LLMs demonstrated potential to serve as clinical decision support for the management of complex medication regimens with further domain specific training; however, caution should be used when employing LLMs for medication management given the present capabilities.

Pharmacology and Therapeutics
Integrating human expertise & automated methods for a dynamic and multi-parametric evaluation of large language models' feasibility in clinical decision-making

Elena Sblendorio,Vincenzo Dentamaro,Alessio Lo Cascio,Francesco Germini,Michela Piredda,Giancarlo Cicolini

DOI: https://doi.org/10.1016/j.ijmedinf.2024.105501

IF: 4.73

2024-05-28

International Journal of Medical Informatics

Abstract:Background Recent enhancements in Large Language Models (LLMs) such as ChatGPT have exponentially increased user adoption. These models are accessible on mobile devices and support multimodal interactions, including conversations, code generation, and patient image uploads, broadening their utility in providing healthcare professionals with real-time support for clinical decision-making. Nevertheless, many authors have highlighted serious risks that may arise from the adoption of LLMs, principally related to safety and alignment with ethical guidelines. Objective To address these challenges, we introduce a novel methodological approach designed to assess the specific feasibility of adopting LLMs within a healthcare area, with a focus on clinical nursing, evaluating their performance and thereby directing their choice. Emphasizing LLMs' adherence to scientific advancements, this approach prioritizes safety and care personalization, according to the "Organization for Economic Co-operation and Development" frameworks for responsible AI. Moreover, its dynamic nature is designed to adapt to future evolutions of LLMs. Method Through integrating advanced multidisciplinary knowledge, including Nursing Informatics, and aided by a prospective literature review, seven key domains and specific evaluation items were identified as follows: 1. State of the Art Alignment & Safety. 2. Focus, Accuracy & Management of Prompt Ambiguity. 3. Data Integrity, Data Security, Ethics & Sustainability, in accordance with OECD Recommendations for Responsible AI. 4. Temporal Variability of Responses (Consistency) 5. Adaptation to specific standardized terminology and Classifications for healthcare professionals. 6. General Capabilities: Post User Feedback Self-Evolution Capability and Organization in Chapters. 7. Ability to Drive Evolution in Healthcare. A Peer Review by experts in Nursing and AI was performed, ensuring scientific rigor and breadth of insights for an essential, reproducible, and coherent methodological approach. By means of a 7-point Likert scale, thresholds are defined in order to classify LLMs as "unusable", "usable with high caution", and "recommended" categories. Nine state of the art LLMs were evaluated using this methodology in clinical oncology nursing decision-making, producing preliminary results. Gemini Advanced, Anthropic Claude 3 and ChatGPT 4 achieved the minimum score of the State of the Art Alignment & Safety domain for classification as "recommended", being also endorsed across all domains. LLAMA 3 70B and ChatGPT 3.5 were classified as "usable with high caution." Others were classified as unusable in this domain. Conclusion The identification of a recommended LLM for a specific healthcare area, combined with its critical, prudent, and integrative use, can support healthcare professionals in decision-making processes.

health care sciences & services,computer science, information systems,medical informatics
Large language models in solving clinical dilemmas - advantages and drawbacks

Obla Amar Bapu,D.,Juan,J.,Gahleitner,F.,Macleod,K.,Urquhart,D. S.,Mcdougall,C.,Unger,S. A.,Armstrong,D.,Narayanan,M.,Juan,J.

DOI: https://doi.org/10.1183/13993003.congress-2024.pa4379

IF: 24.3

2024-11-01

European Respiratory Journal

Abstract:Background: Large language models (LLMs) have shown potential to assist clinical decisions but concerns about underlying mechanism ('black box phenomenon') have provoked unease. Aims: To explore the LLM black box in the context of complex decision making in paediatric respiratory medicine (PRM) by comparison against trainee doctors (TDs), qualitative assessment of responses and a deep-dive into their sources. Methods: Six complex PRM scenarios were posed to 10 TDs and 3 LLMs. Six PRM experts provided detailed comments on the responses, which were analysed qualitatively using DisplayRTM. Screen recordings of TDs' search and sources provided by LLMs were analysed for further insight. Results: Word-cloud analysis shows features of LLM and TD responses (Table). ChatGPTTM provided useful responses but did not quote sources. TDs sourced responses from patient-facing websites, abstracts and review articles (Figure), while BardTM and BingTM quoted journals or evidence-based reviews. ChatGPTBardBingTDsStructureGoodGoodAdequatePoorOmissionsNoOccasionalYesVariableNew AdvancesPre-2021YesYesVariableIncorrectNoNoNoNoSentiment score0.85–0.15–1.0–0.34 Conclusion: LLMs (particularly ChatGPT and Bard) already surpass TDs in quality of responses. We demonstrate utility of LLMs for non-expert clinicians faced with complex medical scenarios. We explore the drawbacks of the individual LLMs while noting that this is a rapidly changing area.

respiratory system
An Active Inference Strategy for Prompting Reliable Responses from Large Language Models in Medical Practice

Roma Shusterman,Allison C. Waters,Shannon O`Neill,Phan Luu,Don M. Tucker

2024-07-23

Abstract:Continuing advances in Large Language Models (LLMs) in artificial intelligence offer important capacities in intuitively accessing and using medical knowledge in many contexts, including education and training as well as assessment and treatment. Most of the initial literature on LLMs in medicine has emphasized that LLMs are unsuitable for medical use because they are non-deterministic, may provide incorrect or harmful responses, and cannot be regulated to assure quality control. If these issues could be corrected, optimizing LLM technology could benefit patients and physicians by providing affordable, point-of-care medical knowledge. Our proposed framework refines LLM responses by restricting their primary knowledge base to domain-specific datasets containing validated medical information. Additionally, we introduce an actor-critic LLM prompting protocol based on active inference principles of human cognition, where a Therapist agent initially responds to patient queries, and a Supervisor agent evaluates and adjusts responses to ensure accuracy and reliability. We conducted a validation study where expert cognitive behaviour therapy for insomnia (CBT-I) therapists evaluated responses from the LLM in a blind format. Experienced human CBT-I therapists assessed responses to 100 patient queries, comparing LLM-generated responses with appropriate and inappropriate responses crafted by experienced CBT-I therapists. Results showed that LLM responses received high ratings from the CBT-I therapists, often exceeding those of therapist-generated appropriate responses. This structured approach aims to integrate advanced LLM technology into medical applications, meeting regulatory requirements for establishing the safe and effective use of special purpose validated LLMs in medicine.

Computation and Language
Lived Experience Not Found: LLMs Struggle to Align with Experts on Addressing Adverse Drug Reactions from Psychiatric Medication Use

Mohit Chandra,Siddharth Sriraman,Gaurav Verma,Harneet Singh Khanuja,Jose Suarez Campayo,Zihang Li,Michael L. Birnbaum,Munmun De Choudhury

2024-10-25

Abstract:Adverse Drug Reactions (ADRs) from psychiatric medications are the leading cause of hospitalizations among mental health patients. With healthcare systems and online communities facing limitations in resolving ADR-related issues, Large Language Models (LLMs) have the potential to fill this gap. Despite the increasing capabilities of LLMs, past research has not explored their capabilities in detecting ADRs related to psychiatric medications or in providing effective harm reduction strategies. To address this, we introduce the Psych-ADR benchmark and the Adverse Drug Reaction Response Assessment (ADRA) framework to systematically evaluate LLM performance in detecting ADR expressions and delivering expert-aligned mitigation strategies. Our analyses show that LLMs struggle with understanding the nuances of ADRs and differentiating between types of ADRs. While LLMs align with experts in terms of expressed emotions and tone of the text, their responses are more complex, harder to read, and only 70.86% aligned with expert strategies. Furthermore, they provide less actionable advice by a margin of 12.32% on average. Our work provides a comprehensive benchmark and evaluation framework for assessing LLMs in strategy-driven tasks within high-risk domains.

Computation and Language,Artificial Intelligence,Computers and Society
Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review

Mingze Yuan,Peng Bao,Jiajia Yuan,Yunhao Shen,Zifan Chen,Yi Xie,Jie Zhao,Yang Chen,Li Zhang,Lin Shen,Bin Dong

2023-11-03

Abstract:With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to enhance various aspects of healthcare, ranging from medical education to clinical decision support. However, medicine involves multifaceted data modalities and nuanced reasoning skills, presenting challenges for integrating LLMs. This paper provides a comprehensive review on the applications and implications of LLMs in medicine. It begins by examining the fundamental applications of general-purpose and specialized LLMs, demonstrating their utilities in knowledge retrieval, research support, clinical workflow automation, and diagnostic assistance. Recognizing the inherent multimodality of medicine, the review then focuses on multimodal LLMs, investigating their ability to process diverse data types like medical imaging and EHRs to augment diagnostic accuracy. To address LLMs' limitations regarding personalization and complex clinical reasoning, the paper explores the emerging development of LLM-powered autonomous agents for healthcare. Furthermore, it summarizes the evaluation methodologies for assessing LLMs' reliability and safety in medical contexts. Overall, this review offers an extensive analysis on the transformative potential of LLMs in modern medicine. It also highlights the pivotal need for continuous optimizations and ethical oversight before these models can be effectively integrated into clinical practice. Visit <a class="link-external link-https" href="https://github.com/mingze-yuan/Awesome-LLM-Healthcare" rel="external noopener nofollow">this https URL</a> for an accompanying GitHub repository containing latest papers.

Computation and Language,Artificial Intelligence,Machine Learning
Systematic Review of Large Language Models for Patient Care: Current Applications and Challenges

Felix Busch,Lena Hoffmann,Christopher Rueger,Elon HC van Dijk,Rawen Kader,Esteban Ortiz-Prado,Marcus R Makowski,Luca Saba,Martin Hadamitzky,Jakob Nikolas Kather,Daniel Truhn,Renato Cuocolo,Lisa C Adams,Keno K Bressem

DOI: https://doi.org/10.1101/2024.03.04.24303733

2024-03-05

Abstract:The introduction of large language models (LLMs) into clinical practice promises to improve patient education and empowerment, thereby personalizing medical care and broadening access to medical knowledge. Despite the popularity of LLMs, there is a significant gap in systematized information on their use in patient care. Therefore, this systematic review aims to synthesize current applications and limitations of LLMs in patient care using a data-driven convergent synthesis approach. We searched 5 databases for qualitative, quantitative, and mixed methods articles on LLMs in patient care published between 2022 and 2023. From 4,349 initial records, 89 studies across 29 medical specialties were included, primarily examining models based on the GPT-3.5 (53.2%, n=66 of 124 different LLMs examined per study) and GPT-4 (26.6%, n=33/124) architectures in medical question answering, followed by patient information generation, including medical text summarization or translation, and clinical documentation. Our analysis delineates two primary domains of LLM limitations: design and output. Design limitations included 6 second-order and 12 third-order codes, such as lack of medical domain optimization, data transparency, and accessibility issues, while output limitations included 9 second-order and 32 third-order codes, for example, non-reproducibility, non-comprehensiveness, incorrectness, unsafety, and bias. In conclusion, this study is the first review to systematically map LLM applications and limitations in patient care, providing a foundational framework and taxonomy for their implementation and evaluation in healthcare settings.

Health Informatics
The Role of Large Language Models in Transforming Emergency Medicine: Scoping Review

Carl Preiksaitis,Nicholas Ashenburg,Gabrielle Bunney,Andrew Chu,Rana Kabeer,Fran Riley,Ryan Ribeira,Christian Rose

DOI: https://doi.org/10.2196/53787

IF: 3.2

2024-05-12

JMIR Medical Informatics

Abstract:Background: Artificial intelligence (AI), more specifically large language models (LLMs), holds significant potential in revolutionizing emergency care delivery by optimizing clinical workflows and enhancing the quality of decision-making. Although enthusiasm for integrating LLMs into emergency medicine (EM) is growing, the existing literature is characterized by a disparate collection of individual studies, conceptual analyses, and preliminary implementations. Given these complexities and gaps in understanding, a cohesive framework is needed to comprehend the existing body of knowledge on the application of LLMs in EM. Objective: Given the absence of a comprehensive framework for exploring the roles of LLMs in EM, this scoping review aims to systematically map the existing literature on LLMs' potential applications within EM and identify directions for future research. Addressing this gap will allow for informed advancements in the field. Methods: Using PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) criteria, we searched Ovid MEDLINE, Embase, Web of Science, and Google Scholar for papers published between January 2018 and August 2023 that discussed LLMs' use in EM. We excluded other forms of AI. A total of 1994 unique titles and abstracts were screened, and each full-text paper was independently reviewed by 2 authors. Data were abstracted independently, and 5 authors performed a collaborative quantitative and qualitative synthesis of the data. Results: A total of 43 papers were included. Studies were predominantly from 2022 to 2023 and conducted in the United States and China. We uncovered four major themes: (1) clinical decision-making and support was highlighted as a pivotal area, with LLMs playing a substantial role in enhancing patient care, notably through their application in real-time triage, allowing early recognition of patient urgency; (2) efficiency, workflow, and information management demonstrated the capacity of LLMs to significantly boost operational efficiency, particularly through the automation of patient record synthesis, which could reduce administrative burden and enhance patient-centric care; (3) risks, ethics, and transparency were identified as areas of concern, especially regarding the reliability of LLMs' outputs, and specific studies highlighted the challenges of ensuring unbiased decision-making amidst potentially flawed training data sets, stressing the importance of thorough validation and ethical oversight; and (4) education and communication possibilities included LLMs' capacity to enrich medical training, such as through using simulated patient interactions that enhance communication skills. Conclusions: LLMs have the potential to fundamentally transform EM, enhancing clinical decision-making, optimizing workflows, and improving patient outcomes. This review sets the stage for future advancements by identifying key research areas: prospective validation of LLM applications, establishing standards for responsible use, understanding provider and patient perceptions, and improving physicians' AI literacy. Effective integration of LLMs into EM will require collaborative efforts and thorough evaluation to ensure these technologies can be safely and effectively applied.

medical informatics
Revolutionizing Cardiology With Words: Unveiling the Impact of Large Language Models in Medical Science Writing

Abhijit Bhattaru,Naveena Yanamala,Partho P Sengupta

DOI: https://doi.org/10.1016/j.cjca.2024.05.022

2024-05-31

Abstract:Large language models (LLMs) are a unique form of machine learning that facilitates inputs of unstructured text/numerical information for meaningful interpretation and prediction. Recently, LLMs have become commercialized, allowing the average person to access these incredibly powerful tools. Early adopters focused on LLM use in performing logical tasks, including-but not limited to-generating titles, identifying key words, summarizing text, initial editing of scientific work, improving statistical protocols, and performing statistical analysis. More recently, LLMs have been expanded to clinical practice and academia to perform higher cognitive and creative tasks. LLMs provide personalized assistance in learning, facilitate the management of electronic medical records, and offer valuable insights into clinical decision making in cardiology. They enhance patient education by explaining intricate medical conditions in lay terms, have a vast library of knowledge to help clinicians expedite administrative tasks, provide useful feedback regarding content of scientific writing, and assist in the peer-review process. Despite their impressive capabilities, LLMs are not without limitations. They are susceptible to generating incorrect or plagiarized content, face challenges in handling tasks without detailed prompts, and lack originality. These limitations underscore the importance of human oversight in using LLMs in medical science and clinical practice. As LLMs continue to evolve, addressing these challenges will be crucial in maximizing their potential benefits while mitigating risks. This review explores the functions, opportunities, and constraints of LLMs, with a focus on their impact on cardiology, illustrating both the transformative power and the boundaries of current technology in medicine.
The Need for Guardrails with Large Language Models in Medical Safety-Critical Settings: An Artificial Intelligence Application in the Pharmacovigilance Ecosystem

Joe B Hakim,Jeffery L Painter,Darmendra Ramcharran,Vijay Kara,Greg Powell,Paulina Sobczak,Chiho Sato,Andrew Bate,Andrew Beam

2024-09-05

Abstract:Large language models (LLMs) are useful tools with the capacity for performing specific types of knowledge work at an effective scale. However, LLM deployments in high-risk and safety-critical domains pose unique challenges, notably the issue of ``hallucination,'' where LLMs can generate fabricated information. This is particularly concerning in settings such as drug safety, where inaccuracies could lead to patient harm. To mitigate these risks, we have developed and demonstrated a proof of concept suite of guardrails specifically designed to mitigate certain types of hallucinations and errors for drug safety, and potentially applicable to other medical safety-critical contexts. These guardrails include mechanisms to detect anomalous documents to prevent the ingestion of inappropriate data, identify incorrect drug names or adverse event terms, and convey uncertainty in generated content. We integrated these guardrails with an LLM fine-tuned for a text-to-text task, which involves converting both structured and unstructured data within adverse event reports into natural language. This method was applied to translate individual case safety reports, demonstrating effective application in a pharmacovigilance processing task. Our guardrail framework offers a set of tools with broad applicability across various domains, ensuring LLMs can be safely used in high-risk situations by eliminating the occurrence of key errors, including the generation of incorrect pharmacovigilance-related terms, thus adhering to stringent regulatory and quality standards in medical safety-critical environments.

Computation and Language,Artificial Intelligence,Computers and Society,Machine Learning
Large Language Model Prompting Techniques for Advancement in Clinical Medicine

Krish Shah,Andrew Y. Xu,Yatharth Sharma,Mohammed Daher,Christopher McDonald,Bassel G. Diebo,Alan H. Daniels

DOI: https://doi.org/10.3390/jcm13175101

IF: 3.9

2024-08-30

Journal of Clinical Medicine

Abstract:Large Language Models (LLMs have the potential to revolutionize clinical medicine by enhancing healthcare access, diagnosis, surgical planning, and education. However, their utilization requires careful, prompt engineering to mitigate challenges like hallucinations and biases. Proper utilization of LLMs involves understanding foundational concepts such as tokenization, embeddings, and attention mechanisms, alongside strategic prompting techniques to ensure accurate outputs. For innovative healthcare solutions, it is essential to maintain ongoing collaboration between AI technology and medical professionals. Ethical considerations, including data security and bias mitigation, are critical to their application. By leveraging LLMs as supplementary resources in research and education, we can enhance learning and support knowledge-based inquiries, ultimately advancing the quality and accessibility of medical care. Continued research and development are necessary to fully realize the potential of LLMs in transforming healthcare.

medicine, general & internal
A systematic review of large language models and their implications in medical education

Harrison C Lucas,Jeffrey S Upperman,Jamie R Robinson

DOI: https://doi.org/10.1111/medu.15402

2024-04-19

Abstract:Introduction: In the past year, the use of large language models (LLMs) has generated significant interest and excitement because of their potential to revolutionise various fields, including medical education for aspiring physicians. Although medical students undergo a demanding educational process to become competent health care professionals, the emergence of LLMs presents a promising solution to challenges like information overload, time constraints and pressure on clinical educators. However, integrating LLMs into medical education raises critical concerns and challenges for educators, professionals and students. This systematic review aims to explore LLM applications in medical education, specifically their impact on medical students' learning experiences. Methods: A systematic search was performed in PubMed, Web of Science and Embase for articles discussing the applications of LLMs in medical education using selected keywords related to LLMs and medical education, from the time of ChatGPT's debut until February 2024. Only articles available in full text or English were reviewed. The credibility of each study was critically appraised by two independent reviewers. Results: The systematic review identified 166 studies, of which 40 were found by review to be relevant to the study. Among the 40 relevant studies, key themes included LLM capabilities, benefits such as personalised learning and challenges regarding content accuracy. Importantly, 42.5% of these studies specifically evaluated LLMs in a novel way, including ChatGPT, in contexts such as medical exams and clinical/biomedical information, highlighting their potential in replicating human-level performance in medical knowledge. The remaining studies broadly discussed the prospective role of LLMs in medical education, reflecting a keen interest in their future potential despite current constraints. Conclusions: The responsible implementation of LLMs in medical education offers a promising opportunity to enhance learning experiences. However, ensuring information accuracy, emphasising skill-building and maintaining ethical safeguards are crucial. Continuous critical evaluation and interdisciplinary collaboration are essential for the appropriate integration of LLMs in medical education.
Large Language Models in Ophthalmology: Potential and Pitfalls

Antonio Yaghy,Maria Yaghy,Jerry A. Shields,Carol L. Shields

DOI: https://doi.org/10.1080/08820538.2023.2300808

2024-01-07

Seminars in Ophthalmology

Abstract:Large language models (LLMs) show great promise in assisting clinicians in general, and ophthalmology in particular, through knowledge synthesis, decision support, accelerating research, enhancing education, and improving patient interactions. Specifically, LLMs can rapidly summarize the latest literature to keep clinicians up-to-date. They can also analyze patient data to highlight crucial insights and recommend appropriate tests or referrals. LLMs can automate tedious research tasks like data cleaning and literature reviews. As AI tutors, LLMs can fill knowledge gaps and assess competency in trainees. As chatbots, they can provide empathetic, personalized responses to patient inquiries and improve satisfaction. The visual capabilities of LLMs like GPT-4 allow assisting the visually impaired by describing environments. However, there are significant ethical, technical, and legal challenges around the use of LLMs that should be addressed regarding privacy, fairness, robustness, attribution, and regulation. Ongoing oversight and refinement of models is critical to realize benefits while minimizing risks and upholding responsible AI principles. If carefully implemented, LLMs hold immense potential to push the boundaries of care, discovery, and quality of life for ophthalmology patients.

ophthalmology
Enhancing Medication Safety with Large Language Models: Advanced Detection and Prediction of Drug-Drug Interactions

Basma Mohammed J. Alshehri,Houneida Sakly,Nada Alasbali,N. Kraiem

DOI: https://doi.org/10.1109/ATSIP62566.2024.10638993

2024-07-11

Abstract:Poly-pharmacy means the use of multiple medications for multiple Diseases, with impact to the increases of the risk of drug-drug interactions (DDIs), and it may cause a threat to patient safety. Traditional DDI detection methods are often manual and leads to errors. This study investigates the potential of large language models (LLMs) to improve the efficiency of personalized DDI prediction and to use the AI advancements. By using LLMs’ natural language processing capabilities, we will develop a system that analyzes comprehensive patient data, including medical history, and individual characteristics. The system aims to enabling healthcare providers to make informed decisions and improve the treatment plans. Initial results, while promising, highlight the need for further refinement and larger datasets to improve prediction accuracy. However, this research demonstrates the significant potential of LLM-based systems in transforming medication safety, optimizing treatment regimens, and ultimately enhancing patient care and treatment process.

Medicine,Computer Science
The Analysis of the Difference between Infrared Soil Temperature and L Band Effective Soil Temperature

Hongzhang Ma,Qinhuo Liu

DOI: https://doi.org/10.1109/M2RSM.2011.5697425

2011-01-20

Abstract:NA
Evaluation of large language model performance on the Biomedical Language Understanding and Reasoning Benchmark

Hui Feng,Francesco Ronzano,Jude LaFleur,Matthew Garber,Rodrigo de Oliveira,Kathryn Rough,Katharine Roth,Jay Nanavati,Khaldoun Zine El Abidine,Christina Mack

DOI: https://doi.org/10.1101/2024.05.17.24307411

2024-05-19

MedRxiv

Abstract:Background: The ability of large language models (LLMs) to interpret and generate human-like text has been accompanied with speculation about their application in medicine and clinical research. There is limited data available to inform evidence-based decisions on the appropriateness for specific use cases. Methods: We evaluated and compared four general-purpose LLMs (GPT-4, GPT-3.5-turbo, Flan-T5-XXL, and Zephyr-7B-Beta) and a healthcare-specific LLM (MedLLaMA-13B) on a set of 13 datasets - referred to as the Biomedical Language Understanding and Reasoning Benchmark (BLURB) - covering six commonly needed medical natural language processing tasks: named entity recognition (NER); relation extraction; population, interventions, comparators, and outcomes (PICO); sentence similarity; document classification; and question-answering. All models were evaluated without modification. Model performance was assessed according to a range of prompting strategies (formalised as a systematic, reusable prompting framework) and relied on the standard, task-specific evaluation metrics defined by BLURB. Results: Across all tasks, GPT-4 outperformed other LLMs, followed by Flan-T5-XXL and GPT-3.5- turbo, then Zephyr-7b-Beta and MedLLaMA-13B. The most performant prompts for GPT-4 and Flan-T5-XXL both outperformed the previously-reported best results for the PubMedQA task. The domain-specific MedLLaMA-13B achieved lower scores for most tasks except for question-answering tasks. We observed a substantial impact of strategically editing the prompt describing the task and a consistent improvement in performance when including examples semantically similar to the input text in the prompt. Conclusion: These results provide evidence of the potential LLMs may have for medical application and highlight the importance of robust evaluation before adopting LLMs for any specific use cases. Continuing to explore how these emerging technologies can be adapted for the healthcare setting, paired with human expertise, and enhanced through quality control measures will be important research to allow responsible innovation with LLMs in the medical area.
Large language models for preventing medication direction errors in online pharmacies

Cristobal Pais,Jianfeng Liu,Robert Voigt,Vin Gupta,Elizabeth Wade,Mohsen Bayati

DOI: https://doi.org/10.1038/s41591-024-02933-8

IF: 82.9

2024-04-26

Nature Medicine

Abstract:Errors in pharmacy medication directions, such as incorrect instructions for dosage or frequency, can increase patient safety risk substantially by raising the chances of adverse drug events. This study explores how integrating domain knowledge with large language models (LLMs)—capable of sophisticated text interpretation and generation—can reduce these errors. We introduce MEDIC (medication direction copilot), a system that emulates the reasoning of pharmacists by prioritizing precise communication of core clinical components of a prescription, such as dosage and frequency. It fine-tunes a first-generation LLM using 1,000 expert-annotated and augmented directions from Amazon Pharmacy to extract the core components and assembles them into complete directions using pharmacy logic and safety guardrails. We compared MEDIC against two LLM-based benchmarks: one leveraging 1.5 million medication directions and the other using state-of-the-art LLMs. On 1,200 expert-reviewed prescriptions, the two benchmarks respectively recorded 1.51 (confidence interval (CI) 1.03, 2.31) and 4.38 (CI 3.13, 6.64) times more near-miss events—errors caught and corrected before reaching the patient—than MEDIC. Additionally, we tested MEDIC by deploying within the production system of an online pharmacy, and during this experimental period, it reduced near-miss events by 33% (CI 26%, 40%). This study shows that LLMs, with domain expertise and safeguards, improve the accuracy and efficiency of pharmacy operations.

biochemistry & molecular biology,cell biology,medicine, research & experimental
MEDIC: Towards a Comprehensive Framework for Evaluating LLMs in Clinical Applications

Praveen K Kanithi,Clément Christophe,Marco AF Pimentel,Tathagata Raha,Nada Saadi,Hamza Javed,Svetlana Maslenkova,Nasir Hayat,Ronnie Rajan,Shadab Khan

2024-09-11

Abstract:The rapid development of Large Language Models (LLMs) for healthcare applications has spurred calls for holistic evaluation beyond frequently-cited benchmarks like USMLE, to better reflect real-world performance. While real-world assessments are valuable indicators of utility, they often lag behind the pace of LLM evolution, likely rendering findings obsolete upon deployment. This temporal disconnect necessitates a comprehensive upfront evaluation that can guide model selection for specific clinical applications. We introduce MEDIC, a framework assessing LLMs across five critical dimensions of clinical competence: medical reasoning, ethics and bias, data and language understanding, in-context learning, and clinical safety. MEDIC features a novel cross-examination framework quantifying LLM performance across areas like coverage and hallucination detection, without requiring reference outputs. We apply MEDIC to evaluate LLMs on medical question-answering, safety, summarization, note generation, and other tasks. Our results show performance disparities across model sizes, baseline vs medically finetuned models, and have implications on model selection for applications requiring specific model strengths, such as low hallucination or lower cost of inference. MEDIC's multifaceted evaluation reveals these performance trade-offs, bridging the gap between theoretical capabilities and practical implementation in healthcare settings, ensuring that the most promising models are identified and adapted for diverse healthcare applications.

Computation and Language,Artificial Intelligence
Answering real-world clinical questions using large language model based systems

Yen Sia Low,Michael L. Jackson,Rebecca J. Hyde,Robert E. Brown,Neil M. Sanghavi,Julian D. Baldwin,C. William Pike,Jananee Muralidharan,Gavin Hui,Natasha Alexander,Hadeel Hassan,Rahul V. Nene,Morgan Pike,Courtney J. Pokrzywa,Shivam Vedak,Adam Paul Yan,Dong-han Yao,Amy R. Zipursky,Christina Dinh,Philip Ballentine,Dan C. Derieg,Vladimir Polony,Rehan N. Chawdry,Jordan Davies,Brigham B. Hyde,Nigam H. Shah,Saurabh Gombar

2024-06-30

Abstract:Evidence to guide healthcare decisions is often limited by a lack of relevant and trustworthy literature as well as difficulty in contextualizing existing research for a specific patient. Large language models (LLMs) could potentially address both challenges by either summarizing published literature or generating new studies based on real-world data (RWD). We evaluated the ability of five LLM-based systems in answering 50 clinical questions and had nine independent physicians review the responses for relevance, reliability, and actionability. As it stands, general-purpose LLMs (ChatGPT-4, Claude 3 Opus, Gemini Pro 1.5) rarely produced answers that were deemed relevant and evidence-based (2% - 10%). In contrast, retrieval augmented generation (RAG)-based and agentic LLM systems produced relevant and evidence-based answers for 24% (OpenEvidence) to 58% (ChatRWD) of questions. Only the agentic ChatRWD was able to answer novel questions compared to other LLMs (65% vs. 0-9%). These results suggest that while general-purpose LLMs should not be used as-is, a purpose-built system for evidence summarization based on RAG and one for generating novel evidence working synergistically would improve availability of pertinent evidence for patient care.

Computation and Language,Artificial Intelligence,Information Retrieval
Assessing the performance of large language models in literature screening for pharmacovigilance: a comparative study

Dan Li,Leihong Wu,Mingfeng Zhang,Svitlana Shpyleva,Ying-Chi Lin,Ho-Yin Huang,Ting Li,Joshua Xu

DOI: https://doi.org/10.3389/fdsfr.2024.1379260

2024-06-27

Frontiers in Drug Safety and Regulation

Abstract:Pharmacovigilance plays a crucial role in ensuring the safety of pharmaceutical products. It involves the systematic monitoring of adverse events and the detection of potential safety concerns related to drugs. Manual literature screening for pharmacovigilance related articles is a labor-intensive and time-consuming task, requiring streamlined solutions to cope with the continuous growth of literature. The primary objective of this study is to assess the performance of Large Language Models (LLMs) in automating literature screening for pharmacovigilance, aiming to enhance the process by identifying relevant articles more effectively. This study represents a novel application of LLMs including OpenAI’s GPT-3.5, GPT-4, and Anthropic’s Claude2, in the field of pharmacovigilance, evaluating their ability to categorize medical publications as relevant or irrelevant for safety signal reviews. Our analysis encompassed N-shot learning, chain-of-thought reasoning, and evaluating metrics, with a focus on factors impacting accuracy. The findings highlight the promising potential of LLMs in literature screening, achieving a reproducibility of 93%, sensitivity of 97%, and specificity of 67% showcasing notable strengths in terms of reproducibility and sensitivity, although with moderate specificity. Notably, performance improved when models were provided examples consisting of abstracts, labels, and corresponding reasoning explanations. Moreover, our exploration identified several potential contributing factors influencing prediction outcomes. These factors encompassed the choice of key words and prompts, the balance of the examples, and variations in reasoning explanations. By configuring advanced LLMs for efficient screening of extensive literature databases, this study underscores the transformative potential of these models in drug safety monitoring. Furthermore, these insights gained from this study can inform the development of automated systems for pharmacovigilance, contributing to the ongoing efforts to ensure the safety and efficacy of pharmacovigilance products.

[Efficacy of laparoscopy in the diagnosis of ascites of indeterminate origin].

Large language models management of complex medication regimens: a case-based evaluation

Integrating human expertise & automated methods for a dynamic and multi-parametric evaluation of large language models' feasibility in clinical decision-making

Large language models in solving clinical dilemmas - advantages and drawbacks

An Active Inference Strategy for Prompting Reliable Responses from Large Language Models in Medical Practice

Lived Experience Not Found: LLMs Struggle to Align with Experts on Addressing Adverse Drug Reactions from Psychiatric Medication Use

Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review

Systematic Review of Large Language Models for Patient Care: Current Applications and Challenges

The Role of Large Language Models in Transforming Emergency Medicine: Scoping Review

Revolutionizing Cardiology With Words: Unveiling the Impact of Large Language Models in Medical Science Writing

The Need for Guardrails with Large Language Models in Medical Safety-Critical Settings: An Artificial Intelligence Application in the Pharmacovigilance Ecosystem

Large Language Model Prompting Techniques for Advancement in Clinical Medicine

A systematic review of large language models and their implications in medical education

Large Language Models in Ophthalmology: Potential and Pitfalls

Enhancing Medication Safety with Large Language Models: Advanced Detection and Prediction of Drug-Drug Interactions

The Analysis of the Difference between Infrared Soil Temperature and L Band Effective Soil Temperature

Evaluation of large language model performance on the Biomedical Language Understanding and Reasoning Benchmark

Large language models for preventing medication direction errors in online pharmacies

MEDIC: Towards a Comprehensive Framework for Evaluating LLMs in Clinical Applications

Answering real-world clinical questions using large language model based systems

Assessing the performance of large language models in literature screening for pharmacovigilance: a comparative study