Abstract:Importance Telemedicine use accelerated during the COVID-19 pandemic, and skin conditions were a common use case. However, many images submitted may be of insufficient quality for making a clinical determination. Objective To determine whether an artificial intelligence (AI) decision support tool, a machine learning algorithm, could improve the quality of images submitted for telemedicine by providing real-time feedback and explanations to patients. Design, Setting, and Participants This quality improvement study with an AI performance component and single-arm clinical pilot study component was conducted from March 2020 to October 2021. After training, the AI decision support tool was tested on 357 retrospectively collected telemedicine images from Stanford telemedicine from March 2020 to June 2021. Subsequently, a single-arm clinical pilot study was conducted to assess feasibility with 98 patients in the Stanford Department of Dermatology across 2 clinical sites from July 2021 to October 2021. For the clinical pilot study, inclusion criteria for patients included being adults (aged ≥18 years), presenting to clinic for a skin condition, and being able to photograph their own skin with a smartphone. Interventions During the clinical pilot study, patients were given a handheld smartphone device with a machine learning algorithm interface loaded and were asked to take images of any lesions of concern. Patients were able to review and retake photos prior to submitting, so each submitted photo met the patient’s assumed standard of clinical acceptability. A machine learning algorithm then gave the patient feedback on whether the image was acceptable. If the image was rejected, the patient was provided a reason by the AI decision support tool and allowed to retake the photos. Main Outcomes and Measures The main outcome of the retrospective image analysis was the receiver operator curve area under the curve (ROC-AUC). The main outcome of the clinical pilot study was the image quality difference between the baseline images and the images approved by AI decision support. Results Of the 98 patients included, the mean (SD) age was 49.8 (17.6) years, and 50 (51%) of the patients were male. On retrospective telemedicine images, the machine learning algorithm effectively identified poor-quality images (ROC-AUC of 0.78) and the reason for poor quality (blurry ROC-AUC of 0.84; lighting issues ROC-AUC of 0.70). The performance was consistent across age and sex. In the clinical pilot study, patient use of the machine learning algorithm was associated with improved image quality. An AI algorithm was associated with reduction in the number of patients with a poor-quality image by 68.0%. Conclusions and Relevance In this quality improvement study, patients use of the AI decision support with a machine learning algorithm was associated with improved quality of skin disease photographs submitted for telemedicine use.

Explainable Image Quality Assessments in Teledermatological Photography

Development and Clinical Evaluation of an AI Support Tool for Improving Telemedicine Photo Quality

Diagnostic Quality Assessment of Fundus Photographs: Hierarchical Deep Learning with Clinically Significant Explanations

Development and Clinical Evaluation of an Artificial Intelligence Support Tool for Improving Telemedicine Photo Quality

DermX: an end-to-end framework for explainable automated dermatological diagnosis

Human Visual System-Based Fundus Image Quality Assessment of Portable Fundus Camera Photographs.

Assessment of image quality on the diagnostic performance of clinicians and deep learning models: Cross‐sectional comparative reader study

Explainable Image Quality Assessment for Medical Imaging

Remote Assessment of Eczema Severity via AI-powered Skin Image Analytics: A Systematic Review

Towards the Use of Saliency Maps for Explaining Low-Quality Electrocardiograms to End Users

QuickQual: Lightweight, convenient retinal image quality scoring with off-the-shelf pretrained models

Evaluating the quality of visual explanations on chest X-ray images for thorax diseases classification

Quality assessment of colour fundus and fluorescein angiography images using deep learning

Quantifying Explainable AI Methods in Medical Diagnosis: A study in skin cancer

Application-Driven No-Reference Quality Assessment for Dermoscopy Images with Multiple Distortions.

Automatic quality assessment of knee radiographs using knowledge graphs and convolutional neural networks

DeepQuality Improves Infant Retinopathy Screening

Refined image quality assessment for color fundus photography based on deep learning

Investigating the Quality of DermaMNIST and Fitzpatrick17k Dermatological Image Datasets

The Clinical Value of Explainable Deep Learning for Diagnosing Fungal Keratitis Using in vivo Confocal Microscopy Images

Automatic Acne Object Detection and Acne Severity Grading Using Smartphone Images and Artificial Intelligence