Abstract:Background: Deep learning, which is a part of a broader concept of artificial intelligence (AI) and/or machine learning has achieved remarkable success in vision tasks. While there is growing interest in the use of this technology in diagnostic support for skin-related neglected tropical diseases (skin NTDs), there have been limited studies in this area and fewer focused on dark skin. In this study, we aimed to develop deep learning based AI models with clinical images we collected for five skin NTDs, namely, Buruli ulcer, leprosy, mycetoma, scabies, and yaws, to understand how diagnostic accuracy can or cannot be improved using different models and training patterns. Methodology: This study used photographs collected prospectively in Côte d'Ivoire and Ghana through our ongoing studies with use of digital health tools for clinical data documentation and for teledermatology. Our dataset included a total of 1,709 images from 506 patients. Two convolutional neural networks, ResNet-50 and VGG-16 models were adopted to examine the performance of different deep learning architectures and validate their feasibility in diagnosis of the targeted skin NTDs. Principal findings: The two models were able to correctly predict over 70% of the diagnoses, and there was a consistent performance improvement with more training samples. The ResNet-50 model performed better than the VGG-16 model. Model trained with PCR confirmed cases of Buruli ulcer yielded 1-3% increase in prediction accuracy over training sets including unconfirmed cases. Conclusions: Our approach was to have the deep learning model distinguish between multiple pathologies simultaneously - which is close to real-world practice. The more images used for training, the more accurate the diagnosis became. The percentages of correct diagnosis increased with PCR-positive cases of Buruli ulcer. This demonstrated that it may be better to input images from the more accurately diagnosed cases in the training models also for achieving better accuracy in the generated AI models. However, the increase was marginal which may be an indication that the accuracy of clinical diagnosis alone is reliable to an extent for Buruli ulcer. Diagnostic tests also have its flaws, and they are not always reliable. One hope for AI is that it will objectively resolve this gap between diagnostic tests and clinical diagnoses with addition of another tool. While there are still challenges to be overcome, there is a potential for AI to address the unmet needs where access to medical care is limited, like for those affected by skin NTDs. Author summary: The diagnosis of skin diseases depends in large part, though not exclusively on visual inspection. The diagnosis and management of these diseases is thus particularly amenable to teledermatology approaches. The widespread availability of cell phone technology and electronic information transfer provides new potential for access to health care in low-income countries, yet there are limited efforts targeting these neglected populations with dark skin and consequently limited availability of tools. In this study, we leveraged a collection of skin images gathered through a system of teledermatology in the West African countries of Côte d'Ivoire and Ghana, and applied deep learning, a form of artificial intelligence (AI) - to see if deep learning models can distinguish between different diseases and support their diagnosis. Skin-related neglected tropical diseases, or skin NTDs, prevail in these regions and were our target conditions: Buruli ulcer, leprosy, mycetoma, scabies, and yaws. The accuracy of prediction depended on the number of images that were fed into the model for training with marginal improvement using laboratory confirmed cases in training. Using more images and greater efforts in this area, it is possible that AI can help address the unmet needs where access to medical care is limited.

Computer Vision Identification of Trachomatous Inflammation-Follicular Using Deep Learning

Development and deployment of a smartphone application for diagnosing trachoma: Leveraging code-free deep learning and edge artificial intelligence

Evaluation of photography using head-mounted display technology (ICAPS) for district Trachoma surveys

Active trachoma: enhancing image classification using pretrained SOTA models and explainable AI

Adaptive feature selection for active trachoma image classification

Accuracy, acceptability and feasibility of photography for use in trachoma surveys: a mixed methods study in Tanzania

A Virtual Reading Center Model Using Crowdsourcing to Grade Photographs for Trachoma: Validation Study

Accurate Identification of the Trabecular Meshwork under Gonioscopic View in Real Time Using Deep Learning

Photographic grading to evaluate facial cleanliness and trachoma among children in Amhara region, Ethiopia

A deep transfer learning framework for the automated assessment of corneal inflammation on in vivo confocal microscopy images

Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: a pilot study

Classifying real-world macroscopic images in the primary-secondary care interface using transfer learning: implications for development of artificial intelligence solutions using nondermoscopic images

Retinal Photograph-based Deep Learning System for Detection of Thyroid-Associated Ophthalmopathy

Feasibility assessment of infectious keratitis depicted on slit-lamp and smartphone photographs using deep learning

Acceptability and feasibility of tests for infection, serological testing, and photography to define need for interventions against trachoma

Clinical Validation of a Handheld Deep Learning Tool for Identification of Glaucoma Medications

Ensemble Neural Network Model for Detecting Thyroid Eye Disease Using External Photographs.

Adopting low-shot deep learning for the detection of conjunctival melanoma using ocular surface images

Differentiation of Active Corneal Infections from Healed Scars Using Deep Learning

Deep learning for identifying corneal diseases from ocular surface slit-lamp photographs

Interpretable deep learning for diagnosis of fungal and acanthamoeba keratitis using in vivo confocal microscopy images