Abstract:Background: Melanoma is one of the deadliest skin cancers that originate from melanocytes due to sun exposure, causing mutations. Early detection boosts the cure rate to 90%, but misclassification drops survival to 15-20%. Clinical variations challenge dermatologists in distinguishing benign nevi and melanomas. Current diagnostic methods, including visual analysis and dermoscopy, have limitations, emphasizing the need for Artificial Intelligence understanding in dermatology. Objectives: In this paper, we aim to explore dermoscopic structures for the classification of melanoma lesions. The training of AI models faces a challenge known as brittleness, where small changes in input images impact the classification. A study explored AI vulnerability in discerning melanoma from benign lesions using features of size, color, and shape. Tests with artificial and natural variations revealed a notable decline in accuracy, emphasizing the necessity for additional information, such as dermoscopic structures. Methodology: The study utilizes datasets with clinically marked dermoscopic images examined by expert clinicians. Transformers and CNN-based models are employed to classify these images based on dermoscopic structures. Classification results are validated using feature visualization. To assess model susceptibility to image variations, classifiers are evaluated on test sets with original, duplicated, and digitally modified images. Additionally, testing is done on ISIC 2016 images. The study focuses on three dermoscopic structures crucial for melanoma detection: Blue-white veil, dots/globules, and streaks. Results: In evaluating model performance, adding convolutions to Vision Transformers proves highly effective for achieving up to 98% accuracy. CNN architectures like VGG-16 and DenseNet-121 reach 50-60% accuracy, performing best with features other than dermoscopic structures. Vision Transformers without convolutions exhibit reduced accuracy on diverse test sets, revealing their brittleness. OpenAI Clip, a pre-trained model, consistently performs well across various test sets. To address brittleness, a mitigation method involving extensive data augmentation during training and 23 transformed duplicates during test time, sustains accuracy. Conclusions: This paper proposes a melanoma classification scheme utilizing three dermoscopic structures across Ph2 and Derm7pt datasets. The study addresses AI susceptibility to image variations. Despite a small dataset, future work suggests collecting more annotated datasets and automatic computation of dermoscopic structural features.

Comparison of the impacts of dermoscopy image augmentation methods on skin cancer classification and a new augmentation method with wavelet packets

GAN based augmentation using a hybrid loss function for dermoscopy images

Data Augmentation for Skin Lesion Analysis

Enhancing skin lesion diagnosis with data augmentation techniques: a review of the state-of-the-art

Medical image data augmentation: techniques, comparisons and interpretations

Progressive growing of Generative Adversarial Networks for improving data augmentation and skin cancer diagnosis

Skin lesion classification on dermatoscopic images using effective data augmentation and pre-trained deep learning approach

Analysis of skin lesion images with deep learning

Enhancing Skin Cancer Detection and Classification in Dermoscopic Images through Concatenated MobileNetV2 and Xception Models

A Low-Cost High-Performance Data Augmentation for Deep Learning-Based Skin Lesion Classification

Investigating and Exploiting Image Resolution for Transfer Learning-based Skin Lesion Classification

Unsupervised SoftOtsuNet Augmentation for Clinical Dermatology Image Classifiers

A Skin Cancer Classification Method Based on Discrete Wavelet Down-Sampling Feature Reconstruction

Dermoscopy lesion classification based on GANs and a fuzzy rank-based ensemble of CNN models

Classification of skin lesions using transfer learning and augmentation with Alex-net

Analyzing Data Augmentation for Medical Images: A Case Study in Ultrasound Images

Exploring dermoscopic structures for melanoma lesions' classification

Ensemble of Deep Convolutional Neural Network for Skin Lesion Classification in Dermoscopy Images

Data Augmentation for Skin Lesion using Self-Attention based Progressive Generative Adversarial Network

Consistency of convolutional neural networks in dermoscopic melanoma recognition: A prospective real-world study about the pitfalls of augmented intelligence

Low-cost and high-performance data augmentation for deep-learning-based skin lesion classification