Assessing large language models' accuracy in providing patient support for choroidal melanoma

Rodrigo Anguita,Catriona Downie,Lorenzo Ferro Desideri,Mandeep S Sagoo

DOI: https://doi.org/10.1038/s41433-024-03231-w

IF: 4.4563

2024-07-14

Eye

Abstract:This study aimed to evaluate the accuracy of information that patients can obtain from large language models (LLMs) when seeking answers to common questions about choroidal melanoma.

ophthalmology

What problem does this paper attempt to address?

Exploring the role of Large Language Models in Melanoma: a Systemic Review

Mor Zarfati,Girish Nadkarni,Benjamin S Glicksberg,Moti Harats,Shoshana Greenberger,Eyal Klang,Shelly Soffer

DOI: https://doi.org/10.1101/2024.09.23.24314213

2024-09-24

Abstract:Background: Large language models (LLMs) are gaining recognition across various medical fields; however, their specific role in dermatology, particularly in melanoma care, is not well-defined. This systematic review evaluates the current applications, advantages, and challenges associated with the use of LLMs in melanoma care. Methods: We conducted a systematic search of PubMed and Scopus databases for studies published up to July 23, 2024, focusing on the application of LLMs in melanoma. Identified studies were categorized into three subgroups: patient education, diagnosis and clinical management. The review process adhered to PRISMA guidelines, and the risk of bias was assessed using the modified QUADAS-2 tool. Results: Nine studies met the inclusion criteria. Five studies compared various LLM models, while four focused on ChatGPT. Three studies specifically examined multi-modal LLMs. In the realm of patient education, ChatGPT demonstrated high accuracy, though it often surpassed the recommended readability levels for patient comprehension. In diagnosis applications, multi-modal LLMs like GPT-4V showed capabilities in distinguishing melanoma from benign lesions. However, the diagnostic accuracy varied considerably, influenced by factors such as the quality and diversity of training data, image resolution, and the models ability to integrate clinical context. Regarding management advice, one study found that ChatGPT provided more reliable management advice compared to other LLMs, yet all models lacked depth and specificity for individualized decision-making. Conclusions: LLMs, particularly multimodal models, show potential in improving melanoma care through patient education, diagnosis, and management advice. However, current LLM applications require further refinement and validation to confirm their clinical utility. Future studies should explore fine-tuning these models on large dermatological databases and incorporate expert knowledge.

Dermatology
Do Large Language Model Chatbots perform better than established patient information resources in answering patient questions? A comparative study on melanoma

Nadia Cw Kamminga,June Ec Kievits,Peter W Plaisier,Jake S Burgers,Astrid M van der Veldt,J A G J van den Brand,M Mulder,Marlies Wakkee,Marjolein Lugtenberg,Tamar Nijsten

DOI: https://doi.org/10.1093/bjd/ljae377

2024-10-04

Abstract:Background: Large Language Models (LLMs) have a potential role in providing adequate patient information. Objectives: To compare the quality of LLMs' responses with established Dutch patient information resources (PIRs) in answering patient questions regarding melanoma. Methods: Responses from ChatGPT versions 3.5 and 4.0, Gemini, and three leading Dutch melanoma PIRs to 50 melanoma-specific questions were examined at baseline and for LLMs again after eight months. Outcomes included (medical) accuracy, completeness, personalisation, readability, and additionally reproducibility for LLMs. Comparative analyses were performed within LLMs and PIRs using Friedman's ANOVA, and between best-performing LLMs and gold-standard PIR using Wilcoxon Signed Ranks test. Results: Within LLMs, ChatGPT-3.5 demonstrated the highest accuracy (p=0.009). Gemini performed best in completeness (p<0.001), personalisation (p=0.007), and readability (p<0.001). PIRs were consistent in accuracy and completeness, with the general practitioner's website excelling in personalisation (p=0.013) and readability (p<0.001). The best-performing LLMs outperformed the gold-standard PIR on all criteria except accuracy. Over time, response reproducibility decreased for all LLMs, showing variability across outcomes. Conclusions: Although LLMs show potential in providing highly personalised and complete responses to patient questions regarding melanoma, improving and safeguarding accuracy, reproducibility and accessibility is crucial before they can replace or complement conventional PIRs.This study compared the quality of responses from Large Language Models (LLMs) with established Dutch patient information resources (PIRs) for melanoma-related patient questions. Results showed LLMs provided highly personalised and complete answers, often surpassing PIRs. However, improving and safeguarding accuracy, reproducibility and accessibility is crucial before they can replace or complement conventional PIRs.
Clinical Accuracy, Relevance, Clarity, and Emotional Sensitivity of Large Language Models to Surgical Patient Questions: Cross-Sectional Study

Mert Marcel Dagli,Felix Conrad Oettl,Jaskeerat Gujral,Kashish Malhotra,Yohannes Ghenbot,Jang W Yoon,Ali K Ozturk,William C Welch

DOI: https://doi.org/10.2196/56165

2024-06-07

Abstract:This cross-sectional study evaluates the clinical accuracy, relevance, clarity, and emotional sensitivity of responses to inquiries from patients undergoing surgery provided by large language models (LLMs), highlighting their potential as adjunct tools in patient communication and education. Our findings demonstrated high performance of LLMs across accuracy, relevance, clarity, and emotional sensitivity, with Anthropic's Claude 2 outperforming OpenAI's ChatGPT and Google's Bard, suggesting LLMs' potential to serve as complementary tools for enhanced information delivery and patient-surgeon interaction.
Evaluating large language models on medical, lay language, and self-reported descriptions of genetic conditions

Kendall A Flaharty,Ping Hu,Suzanna Ledgister Hanchard,Molly E Ripper,Dat Duong,Rebekah L Waikel,Benjamin D Solomon

DOI: https://doi.org/10.1016/j.ajhg.2024.07.011

2024-07-31

Abstract:Large language models (LLMs) are generating interest in medical settings. For example, LLMs can respond coherently to medical queries by providing plausible differential diagnoses based on clinical notes. However, there are many questions to explore, such as evaluating differences between open- and closed-source LLMs as well as LLM performance on queries from both medical and non-medical users. In this study, we assessed multiple LLMs, including Llama-2-chat, Vicuna, Medllama2, Bard/Gemini, Claude, ChatGPT3.5, and ChatGPT-4, as well as non-LLM approaches (Google search and Phenomizer) regarding their ability to identify genetic conditions from textbook-like clinician questions and their corresponding layperson translations related to 63 genetic conditions. For open-source LLMs, larger models were more accurate than smaller LLMs: 7b, 13b, and larger than 33b parameter models obtained accuracy ranges from 21%-49%, 41%-51%, and 54%-68%, respectively. Closed-source LLMs outperformed open-source LLMs, with ChatGPT-4 performing best (89%-90%). Three of 11 LLMs and Google search had significant performance gaps between clinician and layperson prompts. We also evaluated how in-context prompting and keyword removal affected open-source LLM performance. Models were provided with 2 types of in-context prompts: list-type prompts, which improved LLM performance, and definition-type prompts, which did not. We further analyzed removal of rare terms from descriptions, which decreased accuracy for 5 of 7 evaluated LLMs. Finally, we observed much lower performance with real individuals' descriptions; LLMs answered these questions with a maximum 21% accuracy.
Performance of Large Language Models on Medical Oncology Examination Questions

Jack B. Longwell,Ian Hirsch,Fernando Binder,Galileo Arturo Gonzalez Conchas,Daniel Mau,Raymond Jang,Rahul G. Krishnan,Robert C. Grant

DOI: https://doi.org/10.1001/jamanetworkopen.2024.17641

2024-06-19

JAMA Network Open

Abstract:This cross-sectional study evaluates the accuracy of large language model (LLM) answers to examination-style multiple choice medical oncology questions and assessed whether errors in LLM responses would be likely to cause harm.

medicine, general & internal
Evaluating large language models in medical applications: a survey

Xiaolan Chen,Jiayang Xiang,Shanfu Lu,Yexin Liu,Mingguang He,Danli Shi

DOI: https://doi.org/10.48550/arxiv.2405.07468

2024-05-13

Computation and Language

Abstract:Large language models (LLMs) have emerged as powerful tools with transformative potential across numerous domains, including healthcare and medicine. In the medical domain, LLMs hold promise for tasks ranging from clinical decision support to patient education. However, evaluating the performance of LLMs in medical contexts presents unique challenges due to the complex and critical nature of medical information. This paper provides a comprehensive overview of the landscape of medical LLM evaluation, synthesizing insights from existing studies and highlighting evaluation data sources, task scenarios, and evaluation methods. Additionally, it identifies key challenges and opportunities in medical LLM evaluation, emphasizing the need for continued research and innovation to ensure the responsible integration of LLMs into clinical practice.
Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes

Mauro Giuffrè,Simone Kresevic,Nicola Pugliese,Kisung You,Dennis L. Shung

DOI: https://doi.org/10.1111/liv.15974

IF: 8.754

2024-06-01

Liver International

Abstract:Large Language Models (LLMs) are transformer‐based neural networks with billions of parameters trained on very large text corpora from diverse sources. LLMs have the potential to improve healthcare due to their capability to parse complex concepts and generate context‐based responses. The interest in LLMs has not spared digestive disease academics, who have mainly investigated foundational LLM accuracy, which ranges from 25% to 90% and is influenced by the lack of standardized rules to report methodologies and results for LLM‐oriented research. In addition, a critical issue is the absence of a universally accepted definition of accuracy, varying from binary to scalar interpretations, often tied to grader expertise without reference to clinical guidelines. We address strategies and challenges to increase accuracy. In particular, LLMs can be infused with domain knowledge using Retrieval Augmented Generation (RAG) or Supervised Fine‐Tuning (SFT) with reinforcement learning from human feedback (RLHF). RAG faces challenges with in‐context window limits and accurate information retrieval from the provided context. SFT, a deeper adaptation method, is computationally demanding and requires specialized knowledge. LLMs may increase patient quality of care across the field of digestive diseases, where physicians are often engaged in screening, treatment and surveillance for a broad range of pathologies for which in‐context learning or SFT with RLHF could improve clinical decision‐making and patient outcomes. However, despite their potential, the safe deployment of LLMs in healthcare still needs to overcome hurdles in accuracy, suggesting a need for strategies that integrate human feedback with advanced model training.

gastroenterology & hepatology
Validation of large language models for detecting pathologic complete response in breast cancer using population-based pathology reports

Ken Cheligeer,Guosong Wu,Alison Laws,May Lynn Quan,Andrea Li,Anne-Marie Brisson,Jason Xie,Yuan Xu

DOI: https://doi.org/10.1186/s12911-024-02677-y

IF: 3.298

2024-10-04

BMC Medical Informatics and Decision Making

Abstract:The primary goal of this study is to evaluate the capabilities of Large Language Models (LLMs) in understanding and processing complex medical documentation. We chose to focus on the identification of pathologic complete response (pCR) in narrative pathology reports. This approach aims to contribute to the advancement of comprehensive reporting, health research, and public health surveillance, thereby enhancing patient care and breast cancer management strategies.

medical informatics
Large language model use in clinical oncology

Nicolas Carl,Franziska Schramm,Sarah Haggenmüller,Jakob Nikolas Kather,Martin J Hetz,Christoph Wies,Maurice Stephan Michel,Frederik Wessels,Titus J Brinker

DOI: https://doi.org/10.1038/s41698-024-00733-4

2024-10-23

Abstract:Large language models (LLMs) are undergoing intensive research for various healthcare domains. This systematic review and meta-analysis assesses current applications, methodologies, and the performance of LLMs in clinical oncology. A mixed-methods approach was used to extract, summarize, and compare methodological approaches and outcomes. This review includes 34 studies. LLMs are primarily evaluated on their ability to answer oncologic questions across various domains. The meta-analysis highlights a significant performance variance, influenced by diverse methodologies and evaluation criteria. Furthermore, differences in inherent model capabilities, prompting strategies, and oncological subdomains contribute to heterogeneity. The lack of use of standardized and LLM-specific reporting protocols leads to methodological disparities, which must be addressed to ensure comparability in LLM research and ultimately leverage the reliable integration of LLM technologies into clinical practice.
Accuracy of large language models in answering ophthalmology board-style questions: A meta-analysis

Jo-Hsuan Wu,Takashi Nishida,T Y Alvin Liu

DOI: https://doi.org/10.1016/j.apjo.2024.100106

Abstract:Purpose: To evaluate the accuracy of large language models (LLMs) in answering ophthalmology board-style questions. Design: Meta-analysis. Methods: Literature search was conducted using PubMed and Embase in March 2024. We included full-length articles and research letters published in English that reported the accuracy of LLMs in answering ophthalmology board-style questions. Data on LLM performance, including the number of questions submitted and correct responses generated, were extracted for each question set from individual studies. Pooled accuracy was calculated using a random-effects model. Subgroup analyses were performed based on the LLMs used and specific ophthalmology topics assessed. Results: Among the 14 studies retrieved, 13 (93 %) tested LLMs on multiple ophthalmology topics. ChatGPT-3.5, ChatGPT-4, Bard, and Bing Chat were assessed in 12 (86 %), 11 (79 %), 4 (29 %), and 4 (29 %) studies, respectively. The overall pooled accuracy of LLMs was 0.65 (95 % CI: 0.61-0.69). Among the different LLMs, ChatGPT-4 achieved the highest pooled accuracy at 0.74 (95 % CI: 0.73-0.79), while ChatGPT-3.5 recorded the lowest at 0.52 (95 % CI: 0.51-0.54). LLMs performed best in "pathology" (0.78 [95 % CI: 0.70-0.86]) and worst in "fundamentals and principles of ophthalmology" (0.52 [95 % CI: 0.48-0.56]). Conclusions: The overall accuracy of LLMs in answering ophthalmology board-style questions was acceptable but not exceptional, with ChatGPT-4 and Bing Chat being top-performing models. Performance varied significantly based on specific ophthalmology topics tested. Inconsistent performances are of concern, highlighting the need for future studies to include ophthalmology board-style questions with images to more comprehensively examine the competency of LLMs.
Assessment of Large Language Models in Cataract Care Information Provision: A Quantitative Comparison

Zichang Su,Kai Jin,Hongkang Wu,Ziyao Luo,Andrzej Grzybowski,Juan Ye

DOI: https://doi.org/10.1007/s40123-024-01066-y

2024-11-10

Ophthalmology and Therapy

Abstract:Cataracts are a significant cause of blindness. While individuals frequently turn to the Internet for medical advice, distinguishing reliable information can be challenging. Large language models (LLMs) have attracted attention for generating accurate, human-like responses that may be used for medical consultation. However, a comprehensive assessment of LLMs' accuracy within specific medical domains is still lacking.

ophthalmology
Large Language Models in Ophthalmology: Potential and Pitfalls

Antonio Yaghy,Maria Yaghy,Jerry A. Shields,Carol L. Shields

DOI: https://doi.org/10.1080/08820538.2023.2300808

2024-01-07

Seminars in Ophthalmology

Abstract:Large language models (LLMs) show great promise in assisting clinicians in general, and ophthalmology in particular, through knowledge synthesis, decision support, accelerating research, enhancing education, and improving patient interactions. Specifically, LLMs can rapidly summarize the latest literature to keep clinicians up-to-date. They can also analyze patient data to highlight crucial insights and recommend appropriate tests or referrals. LLMs can automate tedious research tasks like data cleaning and literature reviews. As AI tutors, LLMs can fill knowledge gaps and assess competency in trainees. As chatbots, they can provide empathetic, personalized responses to patient inquiries and improve satisfaction. The visual capabilities of LLMs like GPT-4 allow assisting the visually impaired by describing environments. However, there are significant ethical, technical, and legal challenges around the use of LLMs that should be addressed regarding privacy, fairness, robustness, attribution, and regulation. Ongoing oversight and refinement of models is critical to realize benefits while minimizing risks and upholding responsible AI principles. If carefully implemented, LLMs hold immense potential to push the boundaries of care, discovery, and quality of life for ophthalmology patients.

ophthalmology
Large language models encode clinical knowledge

Karan Singhal,Shekoofeh Azizi,Tao Tu,S. Sara Mahdavi,Jason Wei,Hyung Won Chung,Nathan Scales,Ajay Tanwani,Heather Cole-Lewis,Stephen Pfohl,Perry Payne,Martin Seneviratne,Paul Gamble,Chris Kelly,Abubakr Babiker,Nathanael Schärli,Aakanksha Chowdhery,Philip Mansfield,Dina Demner-Fushman,Blaise Agüera y Arcas,Dale Webster,Greg S. Corrado,Yossi Matias,Katherine Chou,Juraj Gottweis,Nenad Tomasev,Yun Liu,Alvin Rajkomar,Joelle Barral,Christopher Semturs,Alan Karthikesalingam,Vivek Natarajan

DOI: https://doi.org/10.1038/s41586-023-06291-2

IF: 64.8

2023-07-13

Nature

Abstract:Large language models (LLMs) have demonstrated impressive capabilities, but the bar for clinical applications is high. Attempts to assess the clinical knowledge of models typically rely on automated evaluations based on limited benchmarks. Here, to address these limitations, we present MultiMedQA, a benchmark combining six existing medical question answering datasets spanning professional medicine, research and consumer queries and a new dataset of medical questions searched online, HealthSearchQA. We propose a human evaluation framework for model answers along multiple axes including factuality, comprehension, reasoning, possible harm and bias. In addition, we evaluate Pathways Language Model 1 (PaLM, a 540-billion parameter LLM) and its instruction-tuned variant, Flan-PaLM 2 on MultiMedQA. Using a combination of prompting strategies, Flan-PaLM achieves state-of-the-art accuracy on every MultiMedQA multiple-choice dataset (MedQA 3 , MedMCQA 4 , PubMedQA 5 and Measuring Massive Multitask Language Understanding (MMLU) clinical topics 6 ), including 67.6% accuracy on MedQA (US Medical Licensing Exam-style questions), surpassing the prior state of the art by more than 17%. However, human evaluation reveals key gaps. To resolve this, we introduce instruction prompt tuning, a parameter-efficient approach for aligning LLMs to new domains using a few exemplars. The resulting model, Med-PaLM, performs encouragingly, but remains inferior to clinicians. We show that comprehension, knowledge recall and reasoning improve with model scale and instruction prompt tuning, suggesting the potential utility of LLMs in medicine. Our human evaluations reveal limitations of today's models, reinforcing the importance of both evaluation frameworks and method development in creating safe, helpful LLMs for clinical applications.

multidisciplinary sciences
Self-Diagnosis and Large Language Models: A New Front for Medical Misinformation

Francois Barnard,Marlize Van Sittert,Sirisha Rambhatla

2023-07-11

Abstract:Improving healthcare quality and access remains a critical concern for countries worldwide. Consequently, the rise of large language models (LLMs) has erupted a wealth of discussion around healthcare applications among researchers and consumers alike. While the ability of these models to pass medical exams has been used to argue in favour of their use in medical training and diagnosis, the impact of their inevitable use as a self-diagnostic tool and their role in spreading healthcare misinformation has not been evaluated. In this work, we critically evaluate LLMs' capabilities from the lens of a general user self-diagnosing, as well as the means through which LLMs may aid in the spread of medical misinformation. To accomplish this, we develop a testing methodology which can be used to evaluate responses to open-ended questions mimicking real-world use cases. In doing so, we reveal that a) these models perform worse than previously known, and b) they exhibit peculiar behaviours, including overconfidence when stating incorrect recommendations, which increases the risk of spreading medical misinformation.

Computers and Society
Evaluating large language model workflows in clinical decision support: referral, triage, and diagnosis

Farieda Gaber,Maqsood shaik,Vedran Franke,Altuna Akalin

DOI: https://doi.org/10.1101/2024.09.27.24314505

2024-09-28

Abstract:Accurate medical decision-making is critical for both patients and clinicians. Patients often struggle to interpret their symptoms, determine their severity, and select the right specialist. Simultaneously, clinicians face challenges in integrating complex patient data to make timely, accurate diagnoses. Recent advances in large language models (LLMs) offer the potential to bridge this gap by supporting decision-making for both patients and healthcare providers. In this study, we benchmark multiple LLM versions and an LLM-based workflow incorporating retrieval-augmented generation (RAG) on a curated dataset of 2,000 medical cases derived from the Medical Information Mart for Intensive Care database. Our findings show that these LLMs are capable of providing personalized insights into likely diagnoses, suggesting appropriate specialists, and assessing urgent care needs. These models may also support clinicians in refining diagnoses and decision-making, offering a promising approach to improving patient outcomes and streamlining healthcare delivery.

Health Informatics
Applications of large language models in cancer care: current evidence and future perspectives

Giovanni Maria Iannantuono,Dara Bracken-Clarke,Charalampos S. Floudas,Mario Roselli,James L. Gulley,Fatima Karzai

DOI: https://doi.org/10.3389/fonc.2023.1268915

IF: 4.7

2023-09-05

Frontiers in Oncology

Abstract:The development of large language models (LLMs) is a recent success in the field of generative artificial intelligence (AI). They are computer models able to perform a wide range of natural language processing tasks, including content generation, question answering, or language translation. In recent months, a growing number of studies aimed to assess their potential applications in the field of medicine, including cancer care. In this mini review, we described the present published evidence for using LLMs in oncology. All the available studies assessed ChatGPT, an advanced language model developed by OpenAI, alone or compared to other LLMs, such as Google Bard, Chatsonic, and Perplexity. Although ChatGPT could provide adequate information on the screening or the management of specific solid tumors, it also demonstrated a significant error rate and a tendency toward providing obsolete data. Therefore, an accurate, expert-driven verification process remains mandatory to avoid the potential for misinformation and incorrect evidence. Overall, although this new generative AI-based technology has the potential to revolutionize the field of medicine, including that of cancer care, it will be necessary to develop rules to guide the application of these tools to maximize benefits and minimize risks.

oncology
Large language models as decision aids in neuro-oncology: a review of shared decision-making applications

Aaron Lawson McLean,Yonghui Wu,Anna C. Lawson McLean,Vagelis Hristidis

DOI: https://doi.org/10.1007/s00432-024-05673-x

2024-03-21

Journal of Cancer Research and Clinical Oncology

Abstract:Shared decision-making (SDM) is crucial in neuro-oncology, fostering collaborations between patients and healthcare professionals to navigate treatment options. However, the complexity of neuro-oncological conditions and the cognitive and emotional burdens on patients present significant barriers to achieving effective SDM. This discussion explores the potential of large language models (LLMs) such as OpenAI's ChatGPT and Google's Bard to overcome these barriers, offering a means to enhance patient understanding and engagement in their care. LLMs, by providing accessible, personalized information, could support but not supplant the critical insights of healthcare professionals. The hypothesis suggests that patients, better informed through LLMs, may participate more actively in their treatment choices. Integrating LLMs into neuro-oncology requires navigating ethical considerations, including safeguarding patient data and ensuring informed consent, alongside the judicious use of AI technologies. Future efforts should focus on establishing ethical guidelines, adapting healthcare workflows, promoting patient-oriented research, and developing training programs for clinicians on the use of LLMs. Continuous evaluation of LLM applications will be vital to maintain their effectiveness and alignment with patient needs. Ultimately, this exploration contends that the thoughtful integration of LLMs into SDM processes could significantly enhance patient involvement and strengthen the patient-physician relationship in neuro-oncology care.

oncology
Assessing the performance of large language models (LLMs) in answering medical questions regarding breast cancer in the Chinese context

Ying Piao,Hongtao Chen,Shihai Wu,Xianming Li,Zihuang Li,Dong Yang

DOI: https://doi.org/10.1177/20552076241284771

2024-10-07

Abstract:Purpose: Large language models (LLMs) are deep learning models designed to comprehend and generate meaningful responses, which have gained public attention in recent years. The purpose of this study is to evaluate and compare the performance of LLMs in answering questions regarding breast cancer in the Chinese context. Material and methods: ChatGPT, ERNIE Bot, and ChatGLM were chosen to answer 60 questions related to breast cancer posed by two oncologists. Responses were scored as comprehensive, correct but inadequate, mixed with correct and incorrect data, completely incorrect, or unanswered. The accuracy, length, and readability among answers from different models were evaluated using statistical software. Results: ChatGPT answered 60 questions, with 40 (66.7%) comprehensive answers and six (10.0%) correct but inadequate answers. ERNIE Bot answered 60 questions, with 34 (56.7%) comprehensive answers and seven (11.7%) correct but inadequate answers. ChatGLM generated 60 answers, with 35 (58.3%) comprehensive answers and six (10.0%) correct but inadequate answers. The differences for chosen accuracy metrics among the three LLMs did not reach statistical significance, but only ChatGPT demonstrated a sense of human compassion. The accuracy of the three models in answering questions regarding breast cancer treatment was the lowest, with an average of 44.4%. ERNIE Bot's responses were significantly shorter compared to ChatGPT and ChatGLM (p < .001 for both). The readability scores of the three models showed no statistical significance. Conclusions: In the Chinese context, the capabilities of ChatGPT, ERNIE Bot, and ChatGLM are similar in answering breast cancer-related questions at present. These three LLMs may serve as adjunct informational tools for breast cancer patients in the Chinese context, offering guidance for general inquiries. However, for highly specialized issues, particularly in the realm of breast cancer treatment, LLMs cannot deliver reliable performance. It is necessary to utilize them under the supervision of healthcare professionals.
Utilizing large language models in breast cancer management: systematic review

Vera Sorin,Benjamin S. Glicksberg,Yaara Artsi,Yiftach Barash,Eli Konen,Girish N. Nadkarni,Eyal Klang

DOI: https://doi.org/10.1007/s00432-024-05678-6

2024-03-21

Journal of Cancer Research and Clinical Oncology

Abstract:Despite advanced technologies in breast cancer management, challenges remain in efficiently interpreting vast clinical data for patient-specific insights. We reviewed the literature on how large language models (LLMs) such as ChatGPT might offer solutions in this field.

oncology
Evaluating and Mitigating Limitations of Large Language Models in Clinical Decision Making

Paul Hager,Friederike Jungmann,Kunal Bhagat,Inga Hubrecht,Manuel Knauer,Jakob Vielhauer,Robbie Holland,Rickmer Braren,Marcus Makowski,Georgios Kaisis,Daniel Rueckert

DOI: https://doi.org/10.1101/2024.01.26.24301810

2024-01-26

Abstract:Clinical decision making is one of the most impactful parts of a physician’s responsibilities and stands to benefit greatly from AI solutions and large language models (LLMs) in particular. However, while LLMs have achieved excellent performance on medical licensing exams, these tests fail to assess many skills that are necessary for deployment in a realistic clinical decision making environment, including gathering information, adhering to established guidelines, and integrating into clinical workflows. To understand how useful LLMs are in real-world settings, we must evaluate them , i.e. on real-world data under realistic conditions. Here we have created a curated dataset based on the MIMIC-IV database spanning 2400 real patient cases and four common abdominal pathologies as well as a framework to simulate a realistic clinical setting. We show that current state-of-the-art LLMs do not accurately diagnose patients across all pathologies (performing significantly worse than physicians on average), follow neither diagnostic nor treatment guidelines, and cannot interpret laboratory results, thus posing a serious risk to the health of patients. Furthermore, we move beyond diagnostic accuracy and demonstrate that they cannot be easily integrated into existing workflows because they often fail to follow instructions and are sensitive to both the quantity and order of information. Overall, our analysis reveals that LLMs are currently not ready for clinical deployment while providing a dataset and framework to guide future studies.

Health Informatics

Assessing large language models' accuracy in providing patient support for choroidal melanoma

Exploring the role of Large Language Models in Melanoma: a Systemic Review

Do Large Language Model Chatbots perform better than established patient information resources in answering patient questions? A comparative study on melanoma

Clinical Accuracy, Relevance, Clarity, and Emotional Sensitivity of Large Language Models to Surgical Patient Questions: Cross-Sectional Study

Evaluating large language models on medical, lay language, and self-reported descriptions of genetic conditions

Performance of Large Language Models on Medical Oncology Examination Questions

Evaluating large language models in medical applications: a survey

Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes

Validation of large language models for detecting pathologic complete response in breast cancer using population-based pathology reports

Large language model use in clinical oncology

Accuracy of large language models in answering ophthalmology board-style questions: A meta-analysis

Assessment of Large Language Models in Cataract Care Information Provision: A Quantitative Comparison

Large Language Models in Ophthalmology: Potential and Pitfalls

Large language models encode clinical knowledge

Self-Diagnosis and Large Language Models: A New Front for Medical Misinformation

Evaluating large language model workflows in clinical decision support: referral, triage, and diagnosis

Applications of large language models in cancer care: current evidence and future perspectives

Large language models as decision aids in neuro-oncology: a review of shared decision-making applications

Assessing the performance of large language models (LLMs) in answering medical questions regarding breast cancer in the Chinese context

Utilizing large language models in breast cancer management: systematic review

Evaluating and Mitigating Limitations of Large Language Models in Clinical Decision Making