Abstract:Background: Numerous studies have attempted to apply artificial intelligence (AI) in the dermatological field, mainly on the classification and segmentation of various dermatoses. However, researches under real clinical settings are scarce. Objectives: This study was aimed to construct a novel framework based on deep learning trained by a dataset that represented the real clinical environment in a tertiary class hospital in China, for better adaptation of the AI application in clinical practice among Asian patients. Methods: Our dataset was composed of 13,603 dermatologist-labeled dermoscopic images, containing 14 categories of diseases, namely lichen planus (LP), rosacea (Rosa), viral warts (VW), acne vulgaris (AV), keloid and hypertrophic scar (KAHS), eczema and dermatitis (EAD), dermatofibroma (DF), seborrheic dermatitis (SD), seborrheic keratosis (SK), melanocytic nevus (MN), hemangioma (Hem), psoriasis (Pso), port wine stain (PWS), and basal cell carcinoma (BCC). In this study, we applied Google's EfficientNet-b4 with pre-trained weights on ImageNet as the backbone of our CNN architecture. The final fully-connected classification layer was replaced with 14 output neurons. We added seven auxiliary classifiers to each of the intermediate layer groups. The modified model was retrained with our dataset and implemented using Pytorch. We constructed saliency maps to visualize our network's attention area of input images for its prediction. To explore the visual characteristics of different clinical classes, we also examined the internal image features learned by the proposed framework using t-SNE (t-distributed Stochastic Neighbor Embedding). Results: Test results showed that the proposed framework achieved a high level of classification performance with an overall accuracy of 0.948, a sensitivity of 0.934 and a specificity of 0.950. We also compared the performance of our algorithm with three most widely used CNN models which showed our model outperformed existing models with the highest area under curve (AUC) of 0.985. We further compared this model with 280 board-certificated dermatologists, and results showed a comparable performance level in an 8-class diagnostic task. Conclusions: The proposed framework retrained by the dataset that represented the real clinical environment in our department could accurately classify most common dermatoses that we encountered during outpatient practice including infectious and inflammatory dermatoses, benign and malignant cutaneous tumors.

Intelligent Diagnosis of Hypopigmented Dermatoses and Intelligent Evaluation of Vitiligo Severity on the Basis of Deep Learning

A deep learning-based hybrid artificial intelligence model for the detection and severity assessment of vitiligo lesions

An Intelligent Diagnostic Model for Melasma Based on Deep Learning and Multimode Image Input

Image classification and auxiliary diagnosis system for hyperpigmented skin diseases based on deep learning

Optimizing vitiligo diagnosis with ResNet and Swin transformer deep learning models: a study on performance and interpretability

Development and validation of two artificial intelligence models for diagnosing benign, pigmented facial skin lesions

Intelligent Data Analytics for Diagnosing Melanoma Skin Lesions via Deep Learning in IoT System

Deep Learning based Model for Detection of Vitiligo Skin Disease using Pre-trained Inception V3

AI-Provided Instant Differential Diagnosis of Pemphigus Vulgaris and Bullous Pemphigoid: Qualitative Study (Preprint)

Skin Disease Classification Using Deep Learning

A Study on Deep Learning Methods for Skin Disease Classification

Skin disease diagnosis with deep learning: A review

Deep Skin Diseases Diagnostic System with Dual-channel Image and Extracted Text

An effective vitiligo intelligent classification system

Recent Advancements and Perspectives in the Diagnosis of Skin Diseases Using Machine Learning and Deep Learning: A Review

Deep learning models across the range of skin disease

[Deep learning-based fully automated intelligent and precise diagnosis for melanocytic lesions]

Detection algorithm for pigmented skin disease based on classifier-level and feature-level fusion

Deep learning-based pigment analysis model trained with optical approach and ground truth assistance

A Deep Learning Based Framework for Diagnosing Multiple Skin Diseases in a Clinical Environment

Development of a light‐weight deep learning model for cloud applications and remote diagnosis of skin cancers