Abstract:Introduction: In the past year, the use of large language models (LLMs) has generated significant interest and excitement because of their potential to revolutionise various fields, including medical education for aspiring physicians. Although medical students undergo a demanding educational process to become competent health care professionals, the emergence of LLMs presents a promising solution to challenges like information overload, time constraints and pressure on clinical educators. However, integrating LLMs into medical education raises critical concerns and challenges for educators, professionals and students. This systematic review aims to explore LLM applications in medical education, specifically their impact on medical students' learning experiences. Methods: A systematic search was performed in PubMed, Web of Science and Embase for articles discussing the applications of LLMs in medical education using selected keywords related to LLMs and medical education, from the time of ChatGPT's debut until February 2024. Only articles available in full text or English were reviewed. The credibility of each study was critically appraised by two independent reviewers. Results: The systematic review identified 166 studies, of which 40 were found by review to be relevant to the study. Among the 40 relevant studies, key themes included LLM capabilities, benefits such as personalised learning and challenges regarding content accuracy. Importantly, 42.5% of these studies specifically evaluated LLMs in a novel way, including ChatGPT, in contexts such as medical exams and clinical/biomedical information, highlighting their potential in replicating human-level performance in medical knowledge. The remaining studies broadly discussed the prospective role of LLMs in medical education, reflecting a keen interest in their future potential despite current constraints. Conclusions: The responsible implementation of LLMs in medical education offers a promising opportunity to enhance learning experiences. However, ensuring information accuracy, emphasising skill-building and maintaining ethical safeguards are crucial. Continuous critical evaluation and interdisciplinary collaboration are essential for the appropriate integration of LLMs in medical education.

The transformative impact of large language models on medical writing and publishing: current applications, challenges and future directions

Harnessing Large Language Models in Medical Research and Scientific Writing: A Closer Look to The Future

Large language models are changing landscape of academic publications. A positive transformation?

Revolutionizing Cardiology With Words: Unveiling the Impact of Large Language Models in Medical Science Writing

A systematic review of large language models and their implications in medical education

Practical Applications of Large Language Models for Health Care Professionals and Scientists

Impact of Large Language Models on Medical Education and Teaching Adaptations

Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysis

Key Insights for the Ethical and Appropriate Use of Artificial Intelligence by Medical Learners

Harnessing the potential of large language models in medical education: promise and pitfalls

The future landscape of large language models in medicine

Adapting to the Impact of AI in Scientific Writing: Balancing Benefits and Drawbacks while Developing Policies and Regulations

Large language models in medical and healthcare fields: applications, advances, and challenges

Potential Roles of Large Language Models in the Production of Systematic Reviews and Meta-Analyses

LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions

Large language models reshaping molecular biology and drug development

Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine

Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review

Revolutionizing Healthcare: the Transformative Impact of LLMs in Medicine (Preprint)

Understanding and training for the impact of large language models and artificial intelligence in healthcare practice: a narrative review

Large language models for biomedicine: foundations, opportunities, challenges, and best practices