Abstract:Background: Numerous studies have attempted to apply artificial intelligence (AI) in the dermatological field, mainly on the classification and segmentation of various dermatoses. However, researches under real clinical settings are scarce. Objectives: This study was aimed to construct a novel framework based on deep learning trained by a dataset that represented the real clinical environment in a tertiary class hospital in China, for better adaptation of the AI application in clinical practice among Asian patients. Methods: Our dataset was composed of 13,603 dermatologist-labeled dermoscopic images, containing 14 categories of diseases, namely lichen planus (LP), rosacea (Rosa), viral warts (VW), acne vulgaris (AV), keloid and hypertrophic scar (KAHS), eczema and dermatitis (EAD), dermatofibroma (DF), seborrheic dermatitis (SD), seborrheic keratosis (SK), melanocytic nevus (MN), hemangioma (Hem), psoriasis (Pso), port wine stain (PWS), and basal cell carcinoma (BCC). In this study, we applied Google's EfficientNet-b4 with pre-trained weights on ImageNet as the backbone of our CNN architecture. The final fully-connected classification layer was replaced with 14 output neurons. We added seven auxiliary classifiers to each of the intermediate layer groups. The modified model was retrained with our dataset and implemented using Pytorch. We constructed saliency maps to visualize our network's attention area of input images for its prediction. To explore the visual characteristics of different clinical classes, we also examined the internal image features learned by the proposed framework using t-SNE (t-distributed Stochastic Neighbor Embedding). Results: Test results showed that the proposed framework achieved a high level of classification performance with an overall accuracy of 0.948, a sensitivity of 0.934 and a specificity of 0.950. We also compared the performance of our algorithm with three most widely used CNN models which showed our model outperformed existing models with the highest area under curve (AUC) of 0.985. We further compared this model with 280 board-certificated dermatologists, and results showed a comparable performance level in an 8-class diagnostic task. Conclusions: The proposed framework retrained by the dataset that represented the real clinical environment in our department could accurately classify most common dermatoses that we encountered during outpatient practice including infectious and inflammatory dermatoses, benign and malignant cutaneous tumors.

Assistant Diagnosis of Insanity Based on Infrared Thermal Image Analysis and Deep Learning Algorithm

Image Stitching and Partitioning Algorithms for Infrared Thermal Human-Body Images

Construction of Artificial Intelligence Assisted Diagnosis Model for Colonoscopy

The application and value evaluation of assisted diagnosis system for five fundus lesion based on artificial intelligence combined with optical coherence tomography

Deep learning-based analysis of infrared fundus photography for automated diagnosis of diabetic retinopathy with cataracts

Infrared Medical Image Visualization and Anomalies Analysis Method

Research on Intelligent Aided Diagnosis System of Medical Image Based on Computer Deep Learning

A Deep Learning Based Framework for Diagnosing Multiple Skin Diseases in a Clinical Environment

Development of an Al-Based Web Diagnostic System for Phenotyping Psychiatric Disorders

A Novel Hierarchical Deep Learning Framework for Diagnosing Multiple Visual Impairment Diseases in the Clinical Environment

Large Data of Medical Images Driven Repeatable Diseases Intelligent Diagnosis Model using Deep Learning Technology

Deep learning-based artificial intelligence imaging probes for Alzheimers disease

Intelligent quality control of traditional chinese medical tongue diagnosis images based on deep learning

Improved patient identification by incorporating symptom severity in deep learning using neuroanatomic images in first episode schizophrenia

Fundus image classification using Inception V3 and ResNet-50 for the early diagnostics of fundus diseases

Application of Machine Learning in Intelligent Medical Image Diagnosis and Construction of Intelligent Service Process

Deep-Learning Tool for Early Identifying Non-Traumatic Intracranial Hemorrhage Etiology based on CT Scan

Deep Skin Diseases Diagnostic System with Dual-channel Image and Extracted Text

Intelligent Diagnosis of Multiple Peripheral Retinal Lesions in Ultra-widefield Fundus Images Based on Deep Learning

Automatic Fault Diagnosis of Infrared Insulator Images Based on Image Instance Segmentation and Temperature Analysis