Abstract:Abstract Background Large Language Models (LLMs) have revolutionized the way plastic surgeons and their patients may access and leverage artificial Intelligence (AI). Objectives The present study aims to comparatively assess the performance of two current publically-available and patient-accessible LLMs in the potential application of AI as postoperative medical support chatbots in an aesthetic surgeon’s practice. Methods Twenty-two simulated postoperative patient presentations following aesthetic breast plastic surgery were devised and expert-validated. Complications varied in their latency within the postoperative period, as well as urgency of required medical attention. In response to each patient-reported presentation, Open AI’s ChatGPT and Google’s Bard, in their unmodified and freely available versions, were objectively assessed for their comparative accuracy in generating an appropriate differential diagnosis, most likely diagnosis, suggested medical disposition, treatments or interventions to begin from home, and/or red flag signs/symptoms indicating deterioration. Results ChatGPT cumulatively and significantly outperformed Bard across all objective assessement metrics examined (66% vs. 55%, respectively; p < 0.05). Accuracy in generating an appropriate differential diagnosis were 61% for ChatGPT, and 57% for Bard (p = 0.45). ChatGPT asked an average of 9.2 questions on history, relative to 6.8 questions by Bard (p < 0.001), following which, accuracies of 91% vs. 68% at arriving at the most-likely diagnosis were noted, respectively (p < 0.01). Appropriate medical dispositions were suggested with an accuracy of 50% by ChatGPT, and 41% by Bard (p = 0.40); relevant home interventions/treatments with an accuracy of 59% and 55% (p = 0.94), and red flag signs/symptoms with accuracies of 79% and 54% (p < 0.01), respectively. Detailed and comparative performance breakdowns according to complication latency and urgency are presented herein. Conclusions ChatGPT represents the superior LLM for the potential application of AI technology in postoperative medical support chatbots. Imperfect performance and limitations identified herein may guide the necessary refinement to facilitate adoption.

Large Language Models and Artificial Intelligence-chatbots in Vascular Surgery

Artificial intelligence: revolutionizing cardiology with large language models

Utilizing Large Language Models in Ophthalmology: The Current Landscape and Challenges

Large Language Models and Artificial Intelligence: A Primer for Plastic Surgeons on the Demonstrated and Potential Applications, Promises, and Limitations of ChatGPT

Large Language Models in Ophthalmology: Potential and Pitfalls

Academic Surgery in the Era of Large Language Models

Utility and Comparative Performance of Current Artificial Intelligence Large Language Models as Postoperative Medical Support Chatbots in Aesthetic Surgery

Comprehensive review of virtual assistants in vascular surgery

Large Language Models as Agents in the Clinic

Large language model application in emergency medicine and critical care

Generative Pre-Trained Transformer-Empowered Healthcare Conversations: Current Trends, Challenges, and Future Directions in Large Language Model-Enabled Medical Chatbots

Large language models in health care: Development, applications, and challenges

Understanding and training for the impact of large language models and artificial intelligence in healthcare practice: a narrative review

Large Language Models in Medicine: The Potentials and Pitfalls

Large Language Models Illuminate a Progressive Pathway to Artificial Intelligent Healthcare Assistant

From Bench to Bedside With Large Language Models: AJR Expert Panel Narrative Review

The future landscape of large language models in medicine

Large language models: a primer and gastroenterology applications

The Breakthrough of Large Language Models Release for Medical Applications: 1-Year Timeline and Perspectives

ChatGPT and Beyond: An overview of the growing field of large language models and their use in ophthalmology

Artificial Intelligence in Postoperative Care: Assessing Large Language Models for Patient Recommendations in Plastic Surgery