Ethical considerations for large language models in ophthalmology

Fritz Gerald P. Kalaw,Sally L. Baxter

DOI: https://doi.org/10.1097/icu.0000000000001083

2024-09-26

Current Opinion in Ophthalmology

Abstract:This review aims to summarize and discuss the ethical considerations regarding large language model (LLM) use in the field of ophthalmology.

ophthalmology

What problem does this paper attempt to address?

Ethical and regulatory challenges of large language models in medicine

Jasmine Chiat Ling Ong,Shelley Yin-Hsi Chang,Wasswa William,Atul J Butte,Nigam H Shah,Lita Sui Tjien Chew,Nan Liu,Finale Doshi-Velez,Wei Lu,Julian Savulescu,Daniel Shu Wei Ting

DOI: https://doi.org/10.1016/s2589-7500(24)00061-x

IF: 36.615

2024-04-25

The Lancet Digital Health

Abstract:Summary With the rapid growth of interest in and use of large language models (LLMs) across various industries, we are facing some crucial and profound ethical concerns, especially in the medical field. The unique technical architecture and purported emergent abilities of LLMs differentiate them substantially from other artificial intelligence (AI) models and natural language processing techniques used, necessitating a nuanced understanding of LLM ethics. In this Viewpoint, we highlight ethical concerns stemming from the perspectives of users, developers, and regulators, notably focusing on data privacy and rights of use, data provenance, intellectual property contamination, and broad applications and plasticity of LLMs. A comprehensive framework and mitigating strategies will be imperative for the responsible integration of LLMs into medical practice, ensuring alignment with ethical principles and safeguarding against potential societal risks.

medicine, general & internal,medical informatics
Large Language Models in Ophthalmology: Potential and Pitfalls

Antonio Yaghy,Maria Yaghy,Jerry A. Shields,Carol L. Shields

DOI: https://doi.org/10.1080/08820538.2023.2300808

2024-01-07

Seminars in Ophthalmology

Abstract:Large language models (LLMs) show great promise in assisting clinicians in general, and ophthalmology in particular, through knowledge synthesis, decision support, accelerating research, enhancing education, and improving patient interactions. Specifically, LLMs can rapidly summarize the latest literature to keep clinicians up-to-date. They can also analyze patient data to highlight crucial insights and recommend appropriate tests or referrals. LLMs can automate tedious research tasks like data cleaning and literature reviews. As AI tutors, LLMs can fill knowledge gaps and assess competency in trainees. As chatbots, they can provide empathetic, personalized responses to patient inquiries and improve satisfaction. The visual capabilities of LLMs like GPT-4 allow assisting the visually impaired by describing environments. However, there are significant ethical, technical, and legal challenges around the use of LLMs that should be addressed regarding privacy, fairness, robustness, attribution, and regulation. Ongoing oversight and refinement of models is critical to realize benefits while minimizing risks and upholding responsible AI principles. If carefully implemented, LLMs hold immense potential to push the boundaries of care, discovery, and quality of life for ophthalmology patients.

ophthalmology
Large language models and their impact in ophthalmology

Bjorn Kaijun Betzler,Haichao Chen,Ching-Yu Cheng,Cecilia S Lee,Guochen Ning,Su Jeong Song,Aaron Y Lee,Ryo Kawasaki,Peter van Wijngaarden,Andrzej Grzybowski,Mingguang He,Dawei Li,An Ran Ran,Daniel Shu Wei Ting,Kelvin Teo,Paisan Ruamviboonsuk,Sobha Sivaprasad,Varun Chaudhary,Ramin Tadayoni,Xiaofei Wang,Carol Y Cheung,Yingfeng Zheng,Ya Xing Wang,Yih Chung Tham,Tien Yin Wong

DOI: https://doi.org/10.1016/S2589-7500(23)00201-7

Abstract:The advent of generative artificial intelligence and large language models has ushered in transformative applications within medicine. Specifically in ophthalmology, large language models offer unique opportunities to revolutionise digital eye care, address clinical workflow inefficiencies, and enhance patient experiences across diverse global eye care landscapes. Yet alongside these prospects lie tangible and ethical challenges, encompassing data privacy, security, and the intricacies of embedding large language models into clinical routines. This Viewpoint highlights the promising applications of large language models in ophthalmology, while weighing up the practical and ethical barriers towards their real-world implementation. This Viewpoint seeks to stimulate broader discourse on the potential of large language models in ophthalmology and to galvanise both clinicians and researchers into tackling the prevailing challenges and optimising the benefits of large language models while curtailing the associated risks.
Utilizing Large Language Models in Ophthalmology: The Current Landscape and Challenges

Peranut Chotcomwongse,Paisan Ruamviboonsuk,Andrzej Grzybowski

DOI: https://doi.org/10.1007/s40123-024-01018-6

2024-08-24

Abstract:A large language model (LLM) is an artificial intelligence (AI) model that uses natural language processing (NLP) to understand, interpret, and generate human-like language responses from unstructured text input. Its real-time response capabilities and eloquent dialogue enhance the interactive user experience in human-AI communication like never before. By gathering several sources on the internet, LLM chatbots can interact and respond to a wide range of queries, including problem solving, text summarization, and creating informative notes. Since ophthalmology is one of the medical fields integrating image analysis, telemedicine, AI, and other technologies, LLMs are likely to play an important role in eye care in the near future. This review summarizes the performance and potential applicability of LLMs in ophthalmology according to currently available publications.
The ethics of ChatGPT in medicine and healthcare: a systematic review on Large Language Models (LLMs)

Joschka Haltaufderheide,Robert Ranisch

DOI: https://doi.org/10.1038/s41746-024-01157-x

IF: 15.2

2024-07-09

npj Digital Medicine

Abstract:With the introduction of ChatGPT, Large Language Models (LLMs) have received enormous attention in healthcare. Despite potential benefits, researchers have underscored various ethical implications. While individual instances have garnered attention, a systematic and comprehensive overview of practical applications currently researched and ethical issues connected to them is lacking. Against this background, this work maps the ethical landscape surrounding the current deployment of LLMs in medicine and healthcare through a systematic review. Electronic databases and preprint servers were queried using a comprehensive search strategy which generated 796 records. Studies were screened and extracted following a modified rapid review approach. Methodological quality was assessed using a hybrid approach. For 53 records, a meta-aggregative synthesis was performed. Four general fields of applications emerged showcasing a dynamic exploration phase. Advantages of using LLMs are attributed to their capacity in data analysis, information provisioning, support in decision-making or mitigating information loss and enhancing information accessibility. However, our study also identifies recurrent ethical concerns connected to fairness, bias, non-maleficence, transparency, and privacy. A distinctive concern is the tendency to produce harmful or convincing but inaccurate content. Calls for ethical guidance and human oversight are recurrent. We suggest that the ethical guidance debate should be reframed to focus on defining what constitutes acceptable human oversight across the spectrum of applications. This involves considering the diversity of settings, varying potentials for harm, and different acceptable thresholds for performance and certainty in healthcare. Additionally, critical inquiry is needed to evaluate the necessity and justification of LLMs' current experimental use.

health care sciences & services,medical informatics
Review of emerging trends and projection of future developments in large language models research in ophthalmology

Matthew Wong,Zhi Wei Lim,Krithi Pushpanathan,Carol Y Cheung,Ya Xing Wang,David Chen,Yih Chung Tham

DOI: https://doi.org/10.1136/bjo-2023-324734

2024-09-20

Abstract:Background: Large language models (LLMs) are fast emerging as potent tools in healthcare, including ophthalmology. This systematic review offers a twofold contribution: it summarises current trends in ophthalmology-related LLM research and projects future directions for this burgeoning field. Methods: We systematically searched across various databases (PubMed, Europe PMC, Scopus and Web of Science) for articles related to LLM use in ophthalmology, published between 1 January 2022 and 31 July 2023. Selected articles were summarised, and categorised by type (editorial, commentary, original research, etc) and their research focus (eg, evaluating ChatGPT's performance in ophthalmology examinations or clinical tasks). Findings: We identified 32 articles meeting our criteria, published between January and July 2023, with a peak in June (n=12). Most were original research evaluating LLMs' proficiency in clinically related tasks (n=9). Studies demonstrated that ChatGPT-4.0 outperformed its predecessor, ChatGPT-3.5, in ophthalmology exams. Furthermore, ChatGPT excelled in constructing discharge notes (n=2), evaluating diagnoses (n=2) and answering general medical queries (n=6). However, it struggled with generating scientific articles or abstracts (n=3) and answering specific subdomain questions, especially those regarding specific treatment options (n=2). ChatGPT's performance relative to other LLMs (Google's Bard, Microsoft's Bing) varied by study design. Ethical concerns such as data hallucination (n=27), authorship (n=5) and data privacy (n=2) were frequently cited. Interpretation: While LLMs hold transformative potential for healthcare and ophthalmology, concerns over accountability, accuracy and data security remain. Future research should focus on application programming interface integration, comparative assessments of popular LLMs, their ability to interpret image-based data and the establishment of standardised evaluation frameworks.
Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine

Stefan Harrer

DOI: https://doi.org/10.1016/j.ebiom.2023.104512

IF: 11.205

2023-04-01

EBioMedicine

Abstract:Large Language Models (LLMs) are a key component of generative artificial intelligence (AI) applications for creating new content including text, imagery, audio, code, and videos in response to textual instructions. Without human oversight, guidance and responsible design and operation, such generative AI applications will remain a party trick with substantial potential for creating and spreading misinformation or harmful and inaccurate content at unprecedented scale. However, if positioned and developed responsibly as companions to humans augmenting but not replacing their role in decision making, knowledge retrieval and other cognitive processes, they could evolve into highly efficient, trustworthy, assistive tools for information management. This perspective describes how such tools could transform data management workflows in healthcare and medicine, explains how the underlying technology works, provides an assessment of risks and limitations, and proposes an ethical, technical, and cultural framework for responsible design, development, and deployment. It seeks to incentivise users, developers, providers, and regulators of generative AI that utilises LLMs to collectively prepare for the transformational role this technology could play in evidence-based sectors.

medicine, research & experimental
Large language models in radiology: fundamentals, applications, ethical considerations, risks, and future directions

Tugba Akinci D'Antonoli,Arnaldo Stanzione,Christian Bluethgen,Federica Vernuccio,Lorenzo Ugga,Michail E Klontzas,Renato Cuocolo,Roberto Cannella,Burak Koçak

DOI: https://doi.org/10.4274/dir.2023.232417

2024-03-06

Abstract:With the advent of large language models (LLMs), the artificial intelligence revolution in medicine and radiology is now more tangible than ever. Every day, an increasingly large number of articles are published that utilize LLMs in radiology. To adopt and safely implement this new technology in the field, radiologists should be familiar with its key concepts, understand at least the technical basics, and be aware of the potential risks and ethical considerations that come with it. In this review article, the authors provide an overview of the LLMs that might be relevant to the radiology community and include a brief discussion of their short history, technical basics, ChatGPT, prompt engineering, potential applications in medicine and radiology, advantages, disadvantages and risks, ethical and regulatory considerations, and future directions.
Empathy and Equity: Key Considerations for Large Language Model Adoption in Health Care

Erica Koranteng,Arya Rao,Efren Flores,Michael Lev,Adam Landman,Keith Dreyer,Marc Succi

DOI: https://doi.org/10.2196/51199

2023-12-28

JMIR Medical Education

Abstract:The growing presence of large language models (LLMs) in health care applications holds significant promise for innovative advancements in patient care. However, concerns about ethical implications and potential biases have been raised by various stakeholders. Here, we evaluate the ethics of LLMs in medicine along 2 key axes: empathy and equity. We outline the importance of these factors in novel models of care and develop frameworks for addressing these alongside LLM deployment.
A look at the emerging trends of large language models in ophthalmology

Ting Fang Tan,Chrystie Quek,Joy Wong,Daniel S W Ting

DOI: https://doi.org/10.1097/ICU.0000000000001097

2025-01-01

Abstract:Purpose of review: As the surge in large language models (LLMs) and generative artificial intelligence (AI) applications in ophthalmology continue to expand, this review seeks to update physicians of the current progress, to catalyze further work to harness its capabilities to enhance healthcare delivery in ophthalmology. Recent findings: Generative AI applications have shown promising performance in Ophthalmology. Beyond native LLMs and question-answering based tasks, there has been increasing work in employing novel LLM techniques and exploring wider use case applications. Summary: In this review, we first look at existing LLM use case applications specific to Ophthalmology, followed by an overview of commonly used LLM techniques. We finally focus on the emerging trends of the generative AI space with an angle from ophthalmology.
The long but necessary road to responsible use of large language models in healthcare research

Jethro C C Kwong,Serena C Y Wang,Grace C Nickel,Giovanni E Cacciamani,Joseph C Kvedar

DOI: https://doi.org/10.1038/s41746-024-01180-y

2024-07-04

Abstract:Large language models (LLMs) have shown promise in reducing time, costs, and errors associated with manual data extraction. A recent study demonstrated that LLMs outperformed natural language processing approaches in abstracting pathology report information. However, challenges include the risks of weakening critical thinking, propagating biases, and hallucinations, which may undermine the scientific method and disseminate inaccurate information. Incorporating suitable guidelines (e.g., CANGARU), should be encouraged to ensure responsible LLM use.
Large language models in medicine: the potentials and pitfalls

Jesutofunmi A. Omiye,Haiwen Gui,Shawheen J. Rezaei,James Zou,Roxana Daneshjou

DOI: https://doi.org/10.7326/M23-2772

2023-09-01

Abstract:Large language models (LLMs) have been applied to tasks in healthcare, ranging from medical exam questions to responding to patient questions. With increasing institutional partnerships between companies producing LLMs and healthcare systems, real world clinical application is coming closer to reality. As these models gain traction, it is essential for healthcare practitioners to understand what LLMs are, their development, their current and potential applications, and the associated pitfalls when utilized in medicine. This review and accompanying tutorial aim to give an overview of these topics to aid healthcare practitioners in understanding the rapidly changing landscape of LLMs as applied to medicine.

Computation and Language,Artificial Intelligence,Computers and Society
AI and Ethics: A Systematic Review of the Ethical Considerations of Large Language Model Use in Surgery Research

Sophia M. Pressman,Sahar Borna,Cesar A. Gomez-Cabello,Syed A. Haider,Clifton Haider,Antonio J. Forte

DOI: https://doi.org/10.3390/healthcare12080825

2024-04-14

Health Care

Abstract:Introduction: As large language models receive greater attention in medical research, the investigation of ethical considerations is warranted. This review aims to explore surgery literature to identify ethical concerns surrounding these artificial intelligence models and evaluate how autonomy, beneficence, nonmaleficence, and justice are represented within these ethical discussions to provide insights in order to guide further research and practice. Methods: A systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Five electronic databases were searched in October 2023. Eligible studies included surgery-related articles that focused on large language models and contained adequate ethical discussion. Study details, including specialty and ethical concerns, were collected. Results: The literature search yielded 1179 articles, with 53 meeting the inclusion criteria. Plastic surgery, orthopedic surgery, and neurosurgery were the most represented surgical specialties. Autonomy was the most explicitly cited ethical principle. The most frequently discussed ethical concern was accuracy (n = 45, 84.9%), followed by bias, patient confidentiality, and responsibility. Conclusion: The ethical implications of using large language models in surgery are complex and evolving. The integration of these models into surgery necessitates continuous ethical discourse to ensure responsible and ethical use, balancing technological advancement with human dignity and safety.

health care sciences & services,health policy & services
Understanding natural language: Potential application of large language models to ophthalmology

Zefeng Yang,Deming Wang,Fengqi Zhou,Diping Song,Yinhang Zhang,Jiaxuan Jiang,Kangjie Kong,Xiaoyi Liu,Yu Qiao,Robert T Chang,Ying Han,Fei Li,Clement C Tham,Xiulan Zhang

DOI: https://doi.org/10.1016/j.apjo.2024.100085

2024-07-25

Abstract:Large language models (LLMs), a natural language processing technology based on deep learning, are currently in the spotlight. These models closely mimic natural language comprehension and generation. Their evolution has undergone several waves of innovation similar to convolutional neural networks. The transformer architecture advancement in generative artificial intelligence marks a monumental leap beyond early-stage pattern recognition via supervised learning. With the expansion of parameters and training data (terabytes), LLMs unveil remarkable human interactivity, encompassing capabilities such as memory retention and comprehension. These advances make LLMs particularly well-suited for roles in healthcare communication between medical practitioners and patients. In this comprehensive review, we discuss the trajectory of LLMs and their potential implications for clinicians and patients. For clinicians, LLMs can be used for automated medical documentation, and given better inputs and extensive validation, LLMs may be able to autonomously diagnose and treat in the future. For patient care, LLMs can be used for triage suggestions, summarization of medical documents, explanation of a patient's condition, and customizing patient education materials tailored to their comprehension level. The limitations of LLMs and possible solutions for real-world use are also presented. Given the rapid advancements in this area, this review attempts to briefly cover many roles that LLMs may play in the ophthalmic space, with a focus on improving the quality of healthcare delivery.
Ethical Considerations and Fundamental Principles of Large Language Models in Medical Education: Viewpoint

Li Zhui,Li Fenghe,Wang Xuehu,Fu Qining,Ren Wei

DOI: https://doi.org/10.2196/60083

IF: 7.076

2024-08-02

Journal of Medical Internet Research

Abstract:This viewpoint article first explores the ethical challenges associated with the future application of large language models (LLMs) in the context of medical education. These challenges include not only ethical concerns related to the development of LLMs, such as artificial intelligence (AI) hallucinations, information bias, privacy and data risks, and deficiencies in terms of transparency and interpretability but also issues concerning the application of LLMs, including deficiencies in emotional intelligence, educational inequities, problems with academic integrity, and questions of responsibility and copyright ownership. This paper then analyzes existing AI-related legal and ethical frameworks and highlights their limitations with regard to the application of LLMs in the context of medical education. To ensure that LLMs are integrated in a responsible and safe manner, the authors recommend the development of a unified ethical framework that is specifically tailored for LLMs in this field. This framework should be based on 8 fundamental principles: quality control and supervision mechanisms; privacy and data protection; transparency and interpretability; fairness and equal treatment; academic integrity and moral norms; accountability and traceability; protection and respect for intellectual property; and the promotion of educational research and innovation. The authors further discuss specific measures that can be taken to implement these principles, thereby laying a solid foundation for the development of a comprehensive and actionable ethical framework. Such a unified ethical framework based on these 8 fundamental principles can provide clear guidance and support for the application of LLMs in the context of medical education. This approach can help establish a balance between technological advancement and ethical safeguards, thereby ensuring that medical education can progress without compromising the principles of fairness, justice, or patient safety and establishing a more equitable, safer, and more efficient environment for medical education.

health care sciences & services,medical informatics
ChatGPT and Beyond: An overview of the growing field of large language models and their use in ophthalmology

Nikita Kedia,Suvansh Sanjeev,Joshua Ong,Jay Chhablani

DOI: https://doi.org/10.1038/s41433-023-02915-z

IF: 4.4563

2024-01-04

Eye

Abstract:ChatGPT, an artificial intelligence (AI) chatbot built on large language models (LLMs), has rapidly gained popularity. The benefits and limitations of this transformative technology have been discussed across various fields, including medicine. The widespread availability of ChatGPT has enabled clinicians to study how these tools could be used for a variety of tasks such as generating differential diagnosis lists, organizing patient notes, and synthesizing literature for scientific research. LLMs have shown promising capabilities in ophthalmology by performing well on the Ophthalmic Knowledge Assessment Program, providing fairly accurate responses to questions about retinal diseases, and in generating differential diagnoses list. There are current limitations to this technology, including the propensity of LLMs to "hallucinate", or confidently generate false information; their potential role in perpetuating biases in medicine; and the challenges in incorporating LLMs into research without allowing "AI-plagiarism" or publication of false information. In this paper, we provide a balanced overview of what LLMs are and introduce some of the LLMs that have been generated in the past few years. We discuss recent literature evaluating the role of these language models in medicine with a focus on ChatGPT. The field of AI is fast-paced, and new applications based on LLMs are being generated rapidly; therefore, it is important for ophthalmologists to be aware of how this technology works and how it may impact patient care. Here, we discuss the benefits, limitations, and future advancements of LLMs in patient care and research.

ophthalmology
[Large Language Models: A Comprehensive Guide for Radiologists]

Sunkyu Kim,Choong-Kun Lee,Seung-Seob Kim

DOI: https://doi.org/10.3348/jksr.2024.0080

Abstract:Large language models (LLMs) have revolutionized the global landscape of technology beyond the field of natural language processing. Owing to their extensive pre-training using vast datasets, contemporary LLMs can handle tasks ranging from general functionalities to domain-specific areas, such as radiology, without the need for additional fine-tuning. Importantly, LLMs are on a trajectory of rapid evolution, addressing challenges such as hallucination, bias in training data, high training costs, performance drift, and privacy issues, along with the inclusion of multimodal inputs. The concept of small, on-premise open source LLMs has garnered growing interest, as fine-tuning to medical domain knowledge, addressing efficiency and privacy issues, and managing performance drift can be effectively and simultaneously achieved. This review provides conceptual knowledge, actionable guidance, and an overview of the current technological landscape and future directions in LLMs for radiologists.

Ethical considerations for large language models in ophthalmology

Ethical and regulatory challenges of large language models in medicine

Large Language Models in Ophthalmology: Potential and Pitfalls

Large language models and their impact in ophthalmology

Utilizing Large Language Models in Ophthalmology: The Current Landscape and Challenges

The ethics of ChatGPT in medicine and healthcare: a systematic review on Large Language Models (LLMs)

Review of emerging trends and projection of future developments in large language models research in ophthalmology

Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine

Large language models in radiology: fundamentals, applications, ethical considerations, risks, and future directions

Empathy and Equity: Key Considerations for Large Language Model Adoption in Health Care

A look at the emerging trends of large language models in ophthalmology

The long but necessary road to responsible use of large language models in healthcare research

Large language models in medicine: the potentials and pitfalls

AI and Ethics: A Systematic Review of the Ethical Considerations of Large Language Model Use in Surgery Research

Understanding natural language: Potential application of large language models to ophthalmology

Ethical Considerations and Fundamental Principles of Large Language Models in Medical Education: Viewpoint

ChatGPT and Beyond: An overview of the growing field of large language models and their use in ophthalmology

[Large Language Models: A Comprehensive Guide for Radiologists]