Abstract:Background: Deep-learning convolutional neural networks (CNNs) have outperformed even experienced dermatologists in dermoscopic melanoma detection under controlled conditions. It remains unexplored how real-world dermoscopic image transformations affect CNN robustness. Objectives: To investigate the consistency of melanoma risk assessment by two commercially available CNNs to help formulate recommendations for current clinical use. Methods: A comparative cohort study was conducted from January to July 2022 at the Department of Dermatology, University Hospital Basel. Five dermoscopic images of 116 different lesions on the torso of 66 patients were captured consecutively by the same operator without deliberate rotation. Classification was performed by two CNNs (CNN-1/CNN-2). Lesions were divided into four subgroups based on their initial risk scoring and clinical dignity assessment. Reliability was assessed by variation and intraclass correlation coefficients. Excisions were performed for melanoma suspicion or two consecutively elevated CNN risk scores, and benign lesions were confirmed by expert consensus (n = 3). Results: 117 repeated image series of 116 melanocytic lesions (2 melanomas, 16 dysplastic naevi, 29 naevi, 1 solar lentigo, 1 suspicious and 67 benign) were classified. CNN-1 demonstrated superior measurement repeatability for clinically benign lesions with an initial malignant risk score (mean variation coefficient (mvc): CNN-1: 49.5(±34.3)%; CNN-2: 71.4(±22.5)%; p = 0.03), while CNN-2 outperformed for clinically benign lesions with benign scoring (mvc: CNN-1: 49.7(±22.7)%; CNN-2: 23.8(±29.3)%; p = 0.002). Both systems exhibited lowest score consistency for lesions with an initial malignant risk score and benign assessment. In this context, averaging three initial risk scores achieved highest sensitivity of dignity assessment (CNN-1: 94%; CNN-2: 89%). Intraclass correlation coefficients indicated 'moderate'-to-'good' reliability for both systems (CNN-1: 0.80, 95% CI:0.71-0.87, p < 0.001; CNN-2: 0.67, 95% CI:0.55-0.77, p < 0.001). Conclusions: Potential user-induced image changes can significantly influence CNN classification. For clinical application, we recommend using the average of three initial risk scores. Furthermore, we advocate for CNN robustness optimization by cross-validation with repeated image sets. Trial registration: ClinicalTrials.gov (NCT04605822).

Fusion between an algorithm based on the characterization of melanocytic lesions asymmetry with an ensemble of CNN for melanoma detection

Two-Stage Deep Neural Network Via Ensemble Learning for Melanoma Classification

Computerizing the first step of the two-step algorithm in dermoscopy: A convolutional neural network for differentiating melanocytic from non-melanocytic skin lesions

Asymmetric lesion detection with geometric patterns and CNN-SVM classification

Consistency of convolutional neural networks in dermoscopic melanoma recognition: A prospective real-world study about the pitfalls of augmented intelligence

AI Techniques of Dermoscopy Image Analysis for the Early Detection of Skin Lesions Based on Combined CNN Features

DDCNN-F: double decker convolutional neural network 'F' feature fusion as a medical image classification framework

Melanoma Classification in Dermoscopy Images via Ensemble Learning on Deep Neural Network

Proposing a hybrid technique of feature fusion and convolutional neural network for melanoma skin cancer detection

Melanoma Detection using Convolutional Neural Network with Transfer Learning on Dermoscopic and Macroscopic Images

Hybrid Feature Fusion and Machine Learning Approaches for Melanoma Skin Cancer Detection

DP03 Melanoma detection in whole-slide images using a convolutional neural network for objective prognostic biomarker generation

Detection of Malignant Skin Lesions Based on Decision Fusion of Ensembles of Neural Networks

Melanoma identification and classification model based on fine-tuned convolutional neural network

Unveiling the power of convolutional neural networks in melanoma diagnosis

Expert-Level Diagnosis of Nonpigmented Skin Cancer by Combined Convolutional Neural Networks

An ensemble-based convolutional neural network model powered by a genetic algorithm for melanoma diagnosis

Melanoma Classification Using a Novel Deep Convolutional Neural Network with Dermoscopic Images

Region Extraction and Classification of Skin Cancer: A Heterogeneous framework of Deep CNN Features Fusion and Reduction

Fusion of deep and wavelet feature representation for improved melanoma classification

Enhanced convolutional neural network architecture optimized by improved chameleon swarm algorithm for melanoma detection using dermatological images