Abstract:Background: Numerous studies have attempted to apply artificial intelligence (AI) in the dermatological field, mainly on the classification and segmentation of various dermatoses. However, researches under real clinical settings are scarce. Objectives: This study was aimed to construct a novel framework based on deep learning trained by a dataset that represented the real clinical environment in a tertiary class hospital in China, for better adaptation of the AI application in clinical practice among Asian patients. Methods: Our dataset was composed of 13,603 dermatologist-labeled dermoscopic images, containing 14 categories of diseases, namely lichen planus (LP), rosacea (Rosa), viral warts (VW), acne vulgaris (AV), keloid and hypertrophic scar (KAHS), eczema and dermatitis (EAD), dermatofibroma (DF), seborrheic dermatitis (SD), seborrheic keratosis (SK), melanocytic nevus (MN), hemangioma (Hem), psoriasis (Pso), port wine stain (PWS), and basal cell carcinoma (BCC). In this study, we applied Google's EfficientNet-b4 with pre-trained weights on ImageNet as the backbone of our CNN architecture. The final fully-connected classification layer was replaced with 14 output neurons. We added seven auxiliary classifiers to each of the intermediate layer groups. The modified model was retrained with our dataset and implemented using Pytorch. We constructed saliency maps to visualize our network's attention area of input images for its prediction. To explore the visual characteristics of different clinical classes, we also examined the internal image features learned by the proposed framework using t-SNE (t-distributed Stochastic Neighbor Embedding). Results: Test results showed that the proposed framework achieved a high level of classification performance with an overall accuracy of 0.948, a sensitivity of 0.934 and a specificity of 0.950. We also compared the performance of our algorithm with three most widely used CNN models which showed our model outperformed existing models with the highest area under curve (AUC) of 0.985. We further compared this model with 280 board-certificated dermatologists, and results showed a comparable performance level in an 8-class diagnostic task. Conclusions: The proposed framework retrained by the dataset that represented the real clinical environment in our department could accurately classify most common dermatoses that we encountered during outpatient practice including infectious and inflammatory dermatoses, benign and malignant cutaneous tumors.

Research on Diagnosis of Dermatology Based on Deep Residual Neural Network

Melanoma Classification in Dermoscopy Images via Ensemble Learning on Deep Neural Network

An automated deep learning models for classification of skin disease using Dermoscopy images: a comprehensive study

A Deep Learning Based Framework for Diagnosing Multiple Skin Diseases in a Clinical Environment

Deep Residual Network for Diagnosis of Retinal Diseases Using Optical Coherence Tomography Images

Skin diseases classification method based on SE-Inception-v4 convolutional neural network

Skin Cancer Classification with Deep Convolutional Neural Networks

Convolutional neural network based on regional features and dimension matching for skin cancer classification

A Deep Learning, Image Based Approach for Automated Diagnosis for Inflammatory Skin Diseases

Enhancing Dermatological Diagnostics with EfficientNet: A Deep Learning Approach

Dermatologist Level Dermoscopy Skin Cancer Classification Using Different Deep Learning Convolutional Neural Networks Algorithms

Analyze Skin Histopathology Images Using Multiple Deep Learning Methods

Automatic Skin Lesion Analysis using Large-scale Dermoscopy Images and Deep Residual Networks

Deep Neural Network for Melanoma Classification in Dermoscopic Images

DSCC_Net: Multi-Classification Deep Learning Models for Diagnosing of Skin Cancer Using Dermoscopic Images

SKINC-NET: an efficient Lightweight Deep Learning Model for Multiclass skin lesion classification in dermoscopic images

Deep neural networks show an equivalent and often superior performance to dermatologists in onychomycosis diagnosis: Automatic construction of onychomycosis datasets by region-based convolutional deep neural network

DermSegNet: smart IoT model for multi-class dermatological lesion diagnosis using adaptive segmentation and improved EfficientNetB3

Dermatologist vs Neural Network

Skin disease diagnosis with deep learning: A review

Multi-Channel-ResNet: an Integration Framework Towards Skin Lesion Analysis