Abstract:Background: Numerous studies have attempted to apply artificial intelligence (AI) in the dermatological field, mainly on the classification and segmentation of various dermatoses. However, researches under real clinical settings are scarce. Objectives: This study was aimed to construct a novel framework based on deep learning trained by a dataset that represented the real clinical environment in a tertiary class hospital in China, for better adaptation of the AI application in clinical practice among Asian patients. Methods: Our dataset was composed of 13,603 dermatologist-labeled dermoscopic images, containing 14 categories of diseases, namely lichen planus (LP), rosacea (Rosa), viral warts (VW), acne vulgaris (AV), keloid and hypertrophic scar (KAHS), eczema and dermatitis (EAD), dermatofibroma (DF), seborrheic dermatitis (SD), seborrheic keratosis (SK), melanocytic nevus (MN), hemangioma (Hem), psoriasis (Pso), port wine stain (PWS), and basal cell carcinoma (BCC). In this study, we applied Google's EfficientNet-b4 with pre-trained weights on ImageNet as the backbone of our CNN architecture. The final fully-connected classification layer was replaced with 14 output neurons. We added seven auxiliary classifiers to each of the intermediate layer groups. The modified model was retrained with our dataset and implemented using Pytorch. We constructed saliency maps to visualize our network's attention area of input images for its prediction. To explore the visual characteristics of different clinical classes, we also examined the internal image features learned by the proposed framework using t-SNE (t-distributed Stochastic Neighbor Embedding). Results: Test results showed that the proposed framework achieved a high level of classification performance with an overall accuracy of 0.948, a sensitivity of 0.934 and a specificity of 0.950. We also compared the performance of our algorithm with three most widely used CNN models which showed our model outperformed existing models with the highest area under curve (AUC) of 0.985. We further compared this model with 280 board-certificated dermatologists, and results showed a comparable performance level in an 8-class diagnostic task. Conclusions: The proposed framework retrained by the dataset that represented the real clinical environment in our department could accurately classify most common dermatoses that we encountered during outpatient practice including infectious and inflammatory dermatoses, benign and malignant cutaneous tumors.

A Two-Stage End-to-End Deep Learning Framework for Pathologic Examination in Skin Tumor Diagnosis

Deep Learning-Based Semantic Segmentation of Non-Melanocytic Skin Tumors in Whole-Slide Histopathological Images.

Diagnostic Performance of Deep Learning Algorithms Applied to Three Common Diagnoses in Dermatopathology

Two-Stage Deep Neural Network Via Ensemble Learning for Melanoma Classification

A Deep Learning Based Framework for Diagnosing Multiple Skin Diseases in a Clinical Environment

Detection and Localization of Melanoma Skin Cancer in Histopathological Whole Slide Images

Augmenting the Pathology Lab: An Intelligent Whole Slide Image Classification System for the Real World

A novel deep learning framework for accurate melanoma diagnosis integrating imaging and genomic data for improved patient outcomes

A Deep Learning Approach for Basal Cell Carcinomas and Bowen’s Disease Recognition in Dermatopathology Image

SKIN CANCER CLASSIFICATION: A DEEP LEARNING APPROACH

Automated Diagnosis of Lymphoma with Digital Pathology Images Using Deep Learning

Interpretable Classification from Skin Cancer Histology Slides Using Deep Learning: A Retrospective Multicenter Study

Melanoma Classification Using a Novel Deep Convolutional Neural Network with Dermoscopic Images

Diagnostic assessment of deep learning for melanocytic lesions using whole-slide pathological images

A novel framework of multiclass skin lesion recognition from dermoscopic images using deep learning and explainable AI

Development and validation of a deep learning model for improving detection of nonmelanoma skin cancers treated with Mohs micrographic surgery

The Application of Deep Learning in the Risk Grading of Skin Tumors for Patients Using Clinical Images

DePicT Melanoma Deep-CLASS: a deep convolutional neural networks approach to classify skin lesion images

Skin Lesion Diagnosis Using Convolutional Neural Networks

Automated Multi-Class Classification of Skin Lesions Through Deep Convolutional Neural Network with Dermoscopic Images.

Deep learning-based fully automated diagnosis of melanocytic lesions by using whole slide images