Abstract:Background: The idea of smart healthcare has gradually gained attention as a result of the information technology industry's rapid development. Smart healthcare uses next-generation technologies i.e., artificial intelligence (AI) and Internet of Things (IoT), to intelligently transform current medical methods to make them more efficient, dependable and individualized. One of the most prominent uses of telemedicine and e-health in medical image analysis is teledermatology. Telecommunications technologies are used in this industry to send medical information to professionals. Teledermatology is a useful method for the identification of skin lesions, particularly in rural locations, because the skin is visually perceptible. One of the most recent tools for diagnosing skin cancer is dermoscopy. To classify skin malignancies, numerous computational approaches have been proposed in the literature. However, difficulties still exist i.e., lesions with low contrast, imbalanced datasets, high level of memory complexity, and the extraction of redundant features. Methods: In this work, a unified CAD model is proposed based on a deep learning framework for skin lesion segmentation and classification. In the proposed approach, the source dermoscopic images are initially pre-processed using a contrast enhancement based modified bio-inspired multiple exposure fusion approach. In the second stage, a custom 26-layered convolutional neural network (CNN) architecture is designed to segment the skin lesion regions. In the third stage, four pre-trained CNN models (Xception, ResNet-50, ResNet-101 and VGG16) are modified and trained using transfer learning on the segmented lesion images. In the fourth stage, the deep features vectors are extracted from all the CNN models and fused using the convolutional sparse image decomposition fusion approach. In the fifth stage, the univariate measurement and Poisson distribution feature selection approach is used for the best features selection for classification. Finally, the selected features are fed to the multi-class support vector machine (MC-SVM) for the final classification. Results: The proposed approach employed to the HAM10000, ISIC2018, ISIC2019, and PH2 datasets and achieved an accuracy of 98.57%, 98.62%, 93.47%, and 98.98% respectively which are better than previous works. Conclusion: When compared to renowned state-of-the-art methods, experimental results show that the proposed skin lesion detection and classification approach achieved higher performance in terms of both visually and enhanced quantitative evaluation with enhanced accuracy.

Metadata-P2T-Net: a Skin Lesion Classification Network Integrating Dermoscopic Metadata and Image Data

Mmy-net: a Multimodal Network Exploiting Image and Patient Metadata for Simultaneous Segmentation and Diagnosis

Skin Lesion classification based on two-modal images using a multi-scale fully-shared fusion network

A Novel Perspective for Multi-modal Multi-label Skin Lesion Classification

Deep Learning Classifier with Patient's Metadata of Dermoscopic Images in Malignant Melanoma Detection

A multimodal transformer to fuse images and metadata for skin disease classification

Single-Shared Network with Prior-Inspired Loss for Parameter-Efficient Multi-Modal Imaging Skin Lesion Classification

Multiclass skin lesion localization and classification using deep learning based features fusion and selection framework for smart healthcare

An Improved Skin Lesion Classification Using a Hybrid Approach with Active Contour Snake Model and Lightweight Attention-Guided Capsule Networks

ZooME: Efficient Melanoma Detection Using Zoom-in Attention and Metadata Embedding Deep Neural Network

Skin Lesion Classification Using Densely Connected Convolutional Networks with Attention Residual Learning

Multi-level Relationship Capture Network for Automated Skin Lesion Recognition

MDFNet: application of multimodal fusion method based on skin image and clinical data to skin cancer classification

Skin lesion classification using ensembles of multi-resolution EfficientNets with meta data

Multi-task Explainable Skin Lesion Classification

Prediction of Skin Lesions Using Integrated Multi-Layered Network Model with Baseline Learning Approaches

Automatic skin lesion classification using a novel densely connected convolutional network integrated with an attention module

A novel multi-task learning network for skin lesion classification based on multi-modal clues and label-level fusion

An integrated framework of skin lesion detection and recognition through saliency method and optimal deep neural network features selection

DSCC_Net: Multi-Classification Deep Learning Models for Diagnosing of Skin Cancer Using Dermoscopic Images

Automatic Melanoma Detection using Discrete Cosine Transform Features and Metadata on Dermoscopic Images