Abstract:Background: Melanoma is one of the deadliest skin cancers that originate from melanocytes due to sun exposure, causing mutations. Early detection boosts the cure rate to 90%, but misclassification drops survival to 15-20%. Clinical variations challenge dermatologists in distinguishing benign nevi and melanomas. Current diagnostic methods, including visual analysis and dermoscopy, have limitations, emphasizing the need for Artificial Intelligence understanding in dermatology. Objectives: In this paper, we aim to explore dermoscopic structures for the classification of melanoma lesions. The training of AI models faces a challenge known as brittleness, where small changes in input images impact the classification. A study explored AI vulnerability in discerning melanoma from benign lesions using features of size, color, and shape. Tests with artificial and natural variations revealed a notable decline in accuracy, emphasizing the necessity for additional information, such as dermoscopic structures. Methodology: The study utilizes datasets with clinically marked dermoscopic images examined by expert clinicians. Transformers and CNN-based models are employed to classify these images based on dermoscopic structures. Classification results are validated using feature visualization. To assess model susceptibility to image variations, classifiers are evaluated on test sets with original, duplicated, and digitally modified images. Additionally, testing is done on ISIC 2016 images. The study focuses on three dermoscopic structures crucial for melanoma detection: Blue-white veil, dots/globules, and streaks. Results: In evaluating model performance, adding convolutions to Vision Transformers proves highly effective for achieving up to 98% accuracy. CNN architectures like VGG-16 and DenseNet-121 reach 50-60% accuracy, performing best with features other than dermoscopic structures. Vision Transformers without convolutions exhibit reduced accuracy on diverse test sets, revealing their brittleness. OpenAI Clip, a pre-trained model, consistently performs well across various test sets. To address brittleness, a mitigation method involving extensive data augmentation during training and 23 transformed duplicates during test time, sustains accuracy. Conclusions: This paper proposes a melanoma classification scheme utilizing three dermoscopic structures across Ph2 and Derm7pt datasets. The study addresses AI susceptibility to image variations. Despite a small dataset, future work suggests collecting more annotated datasets and automatic computation of dermoscopic structural features.

Automatic Melanoma Detection using Discrete Cosine Transform Features and Metadata on Dermoscopic Images

Hybrid Deep Learning Framework for Melanoma Diagnosis Using Dermoscopic Medical Images

Distribution Quantification on Dermoscopy Images for Computer-Assisted Diagnosis of Cutaneous Melanomas

Deep Learning Classifier with Patient's Metadata of Dermoscopic Images in Malignant Melanoma Detection

Melanoma Classification Using a Novel Deep Convolutional Neural Network with Dermoscopic Images

Melanoma Diagnosis with Spatio-Temporal Feature Learning on Sequential Dermoscopic Images

Automatic melanoma detection via multi-scale lesion-biased representation and joint reverse classification

Intelligent Data Analytics for Diagnosing Melanoma Skin Lesions via Deep Learning in IoT System

Computational Intelligence-Based Melanoma Detection and Classification Using Dermoscopic Images

Early Melanoma Diagnosis With Sequential Dermoscopic Images

Hybrid Feature Fusion and Machine Learning Approaches for Melanoma Skin Cancer Detection

Useful Features for Computer-Aided Diagnosis Systems for Melanoma Detection Using Dermoscopic Images

ZooME: Efficient Melanoma Detection Using Zoom-in Attention and Metadata Embedding Deep Neural Network

Melanoma identification and classification model based on fine-tuned convolutional neural network

MelaNet: an effective deep learning framework for melanoma detection using dermoscopic images

MDDC: melanoma detection using discrete wavelet transform and convolutional neural network

Exploring dermoscopic structures for melanoma lesions' classification

Melanoma Detection Using XGB Classifier Combined with Feature Extraction and K-means SMOTE Techniques

Deep Learning Ensembles for Melanoma Recognition in Dermoscopy Images

Automated Machine Learning (AutoML) for the Diagnosis of Melanoma Skin Lesions From Consumer-Grade Camera Photos

Design and validation of a new machine-learning-based diagnostic tool for the differentiation of dermatoscopic skin cancer images