Abstract:Background: We aimed to establish and validate a deep learning-based hybrid artificial intelligence (AI) model for the objective morphometric and colorimetric assessment of vitiligo lesions.Methods: Two main datasets containing curated images of vitiligo lesions from Chinese patients (Fitzpatrick skin types III or IV) were established, including one with 2,720 images for lesion localization study and the other with 1,262 images for lesion segmentation study. Besides, an additional test set containing 145 images of vitiligo lesions from other Fitzpatrick skin types (I, II, or V) was also generated. A 3-stage hybrid model was constructed. YOLO v3 (You Only Look Once, v3) architecture was trained and validated to classify and localize vitiligo lesions, with sensitivity and error rate as primary performance outcomes. Then a segmentation study comparing 3 deep convolutional neural networks (DCNNs), Pyramid Scene Parsing Network (PSPNet), UNet, and UNet++, was carried out based on the Jaccard index (JI). The architecture with the best performance was integrated into the model. Three add-on metrics, namely VAreaA, VAreaR, and VColor were finally developed to measure absolute, relative size changes and pigmentation, respectively. Agreement between the AI model and dermatologist evaluators were assessed.Results: The sensitivity of the YOLO v3 architecture to detect vitiligo lesions was 92.91% with an error rate of 14.98%. The UNet++ architecture outperformed the others in the segmentation study (JI, 0.79) and was integrated into the model. On the additional test set, however, the model achieved a lower detection sensitivity (72.41%) and a lower segmentation score (JI, 0.69). With respect to size changes, no difference was observed between the AI model, trained dermatologists (W=0.812, P<0.05), and Photoshop analysis (P=0.075, P=0.212 respectively), which all displayed good concordance.Conclusions: We developed a novel, convenient, objective, and quantitative deep learning-based hybrid model which simultaneously evaluated both morphometric and colorimetric vitiligo lesions from patients with Fitzpatrick skin types III or IV, rendering it suitable for the assessment of severity of vitiligo lesions in Asians in both clinic and research scenarios. More work is also warranted for its use in other ethnic skin groups.

YOLOv7-based automated detection platform for scalp lesions

Oral mucosal lesions triage via YOLOv7 models

A Machine Learning-Based Model for the Detection of Skin Cancer Using YOLOv10

Utilizing deep learning for automated detection of oral lesions: A multicenter study

Skin Cancer Recognition Using Unified Deep Convolutional Neural Networks

Accurate Detection of Brain Tumor Lesions From Medical Images Based on Improved YOLOv8 Algorithm

A New Approach for Detecting Fundus Lesions Using Image Processing and Deep Neural Network Architecture Based on YOLO Model

Early Melanoma Detection Based on a Hybrid YOLOv5 and ResNet Technique

SOCR‐YOLO: Small Objects Detection Algorithm in Medical Images

Automated Detection of Small Bowel Lesions Based on Capsule Endoscopy Using Deep Learning Algorithm

Facial Skin Analysis in Malaysians using YOLOv5: A Deep Learning Perspective

Detecting white spot lesions on post-orthodontic oral photographs using deep learning based on the YOLOv5x algorithm: a pilot study

Hair-YOLO: A Hair Follicle Detection Model Based on YOLOv8

Automatic Localization of Five Relevant Dermoscopic Structures Based on YOLOv8 for Diagnosis Improvement

A challenge of deep-learning-based object detection for hair follicle dataset

Image‐based remote evaluation of PASI scores with psoriasis by the YOLO‐v4 algorithm

A deep learning-based hybrid artificial intelligence model for the detection and severity assessment of vitiligo lesions

Enhancing Skin Disease Diagnosis Through Convolutional Neural Networks and YOLO v8 Object Detection

Skin Lesion Diagnosis Using Convolutional Neural Networks

Automatic identification of benign pigmented skin lesions from clinical images using deep convolutional neural network

Diagnosis of cervical lymphoma using a YOLO-v7-based model with transfer learning