Abstract:Importance Ophthalmology is reliant on effective interpretation of multimodal imaging to ensure diagnostic accuracy. The new ability of ChatGPT-4 (OpenAI) to interpret ophthalmic images has not yet been explored. Objective To evaluate the performance of the novel release of an artificial intelligence chatbot that is capable of processing imaging data. Design, Setting, and Participants This cross-sectional study used a publicly available dataset of ophthalmic cases from OCTCases, a medical education platform based out of the Department of Ophthalmology and Vision Sciences at the University of Toronto, with accompanying clinical multimodal imaging and multiple-choice questions. Across 137 available cases, 136 contained multiple-choice questions (99%). Exposures The chatbot answered questions requiring multimodal input from October 16 to October 23, 2023. Main Outcomes and Measures The primary outcome was the accuracy of the chatbot in answering multiple-choice questions pertaining to image recognition in ophthalmic cases, measured as the proportion of correct responses. χ 2 Tests were conducted to compare the proportion of correct responses across different ophthalmic subspecialties. Results A total of 429 multiple-choice questions from 136 ophthalmic cases and 448 images were included in the analysis. The chatbot answered 299 of multiple-choice questions correctly across all cases (70%). The chatbot’s performance was better on retina questions than neuro-ophthalmology questions (77% vs 58%; difference = 18%; 95% CI, 7.5%-29.4%; χ 2 1 = 11.4; P &lt; .001). The chatbot achieved a better performance on nonimage–based questions compared with image-based questions (82% vs 65%; difference = 17%; 95% CI, 7.8%-25.1%; χ 2 1 = 12.2; P &lt; .001).The chatbot performed best on questions in the retina category (77% correct) and poorest in the neuro-ophthalmology category (58% correct). The chatbot demonstrated intermediate performance on questions from the ocular oncology (72% correct), pediatric ophthalmology (68% correct), uveitis (67% correct), and glaucoma (61% correct) categories. Conclusions and Relevance In this study, the recent version of the chatbot accurately responded to approximately two-thirds of multiple-choice questions pertaining to ophthalmic cases based on imaging interpretation. The multimodal chatbot performed better on questions that did not rely on the interpretation of imaging modalities. As the use of multimodal chatbots becomes increasingly widespread, it is imperative to stress their appropriate integration within medical contexts.

Identification of kidney-related medications using AI from self-captured pill images

AI-Powered Renal Diet Support: Performance of ChatGPT, Bard AI, and Bing Chat

Evaluating ChatGPT's efficacy in assessing the safety of non-prescription medications and supplements in patients with kidney disease

Innovating Personalized Nephrology Care: Exploring the Potential Utilization of ChatGPT

Using automated machine learning to detect kidney anomalies.

Evaluating ChatGPT's Accuracy in Responding to Patient Education Questions on Acute Kidney Injury and Continuous Renal Replacement Therapy

AI-Driven Patient Education in Chronic Kidney Disease: Evaluating Chatbot Responses against Clinical Guidelines

Automation of the kidney function prediction and classification through ultrasound-based kidney imaging using deep learning

Using ChatGPT-4 to Analyze 24-Hour Urine Results and Generate Custom Dietary Recommendations for Nephrolithiasis

An Accurate Deep Learning-Based System for Automatic Pill Identification: Model Development and Validation

AI integration in nephrology: evaluating ChatGPT for accurate ICD-10 documentation and coding

Large language model triaging of simulated nephrology patient inbox messages

Enhancing Kidney Transplant Care through the Integration of Chatbot

Multi-Class Kidney Abnormalities Detecting Novel System Through Computed Tomography

ChatGPT Solving Complex Kidney Transplant Cases: A Comparative Study With Human Respondents

Artificial intelligence-assisted quantification and assessment of whole slide images for pediatric kidney disease diagnosis

Digital health tools in nephrology: A comparative analysis of AI and professional opinions via online polls

Examining the Validity of ChatGPT in Identifying Relevant Nephrology Literature: Findings and Implications

Identification of kidney stones in KUB X-ray images using VGG16 empowered with explainable artificial intelligence

Accuracy of an Artificial Intelligence Chatbot’s Interpretation of Clinical Ophthalmic Images

Towards Accurate and Efficient Diagnoses in Nephropathology: An AI-Based Approach for Assessing Kidney Transplant Rejection