Abstract:Background: The idea of smart healthcare has gradually gained attention as a result of the information technology industry's rapid development. Smart healthcare uses next-generation technologies i.e., artificial intelligence (AI) and Internet of Things (IoT), to intelligently transform current medical methods to make them more efficient, dependable and individualized. One of the most prominent uses of telemedicine and e-health in medical image analysis is teledermatology. Telecommunications technologies are used in this industry to send medical information to professionals. Teledermatology is a useful method for the identification of skin lesions, particularly in rural locations, because the skin is visually perceptible. One of the most recent tools for diagnosing skin cancer is dermoscopy. To classify skin malignancies, numerous computational approaches have been proposed in the literature. However, difficulties still exist i.e., lesions with low contrast, imbalanced datasets, high level of memory complexity, and the extraction of redundant features. Methods: In this work, a unified CAD model is proposed based on a deep learning framework for skin lesion segmentation and classification. In the proposed approach, the source dermoscopic images are initially pre-processed using a contrast enhancement based modified bio-inspired multiple exposure fusion approach. In the second stage, a custom 26-layered convolutional neural network (CNN) architecture is designed to segment the skin lesion regions. In the third stage, four pre-trained CNN models (Xception, ResNet-50, ResNet-101 and VGG16) are modified and trained using transfer learning on the segmented lesion images. In the fourth stage, the deep features vectors are extracted from all the CNN models and fused using the convolutional sparse image decomposition fusion approach. In the fifth stage, the univariate measurement and Poisson distribution feature selection approach is used for the best features selection for classification. Finally, the selected features are fed to the multi-class support vector machine (MC-SVM) for the final classification. Results: The proposed approach employed to the HAM10000, ISIC2018, ISIC2019, and PH2 datasets and achieved an accuracy of 98.57%, 98.62%, 93.47%, and 98.98% respectively which are better than previous works. Conclusion: When compared to renowned state-of-the-art methods, experimental results show that the proposed skin lesion detection and classification approach achieved higher performance in terms of both visually and enhanced quantitative evaluation with enhanced accuracy.

Joint-individual fusion structure with fusion attention module for multi-modal skin cancer classification

Joint-Individual Fusion Structure with Fusion Attention Module for Multi-Modal Skin Cancer Classification

Skin Lesion classification based on two-modal images using a multi-scale fully-shared fusion network

Pay Less On Clinical Images: Asymmetric Multi-Modal Fusion Method For Efficient Multi-Label Skin Lesion Classification

FusionM4Net: A Multi-Stage Multi-Modal Learning Algorithm for Multi-Label Skin Lesion Classification

CS-AF: A Cost-sensitive Multi-classifier Active Fusion Framework for Skin Lesion Classification

Multi-Model Attentional Fusion Ensemble for Accurate Skin Cancer Classification

MDFNet: application of multimodal fusion method based on skin image and clinical data to skin cancer classification

A Convolutional Neural Network Based on Soft Attention Mechanism and Multi-scale Fusion for Skin Cancer Classification

Multi-modal Medical Image Fusion For Non-Small Cell Lung Cancer Classification

MSMA: A multi-stage and multi-attention algorithm for the classification of multimodal skin lesions

[Skin lesion classification with multi-level fusion of Swin-T and ConvNeXt]

A Multi-modal Fusion Framework Based on Multi-task Correlation Learning for Cancer Prognosis Prediction

Hierarchical multimodal fusion framework based on noisy label learning and attention mechanism for cancer classification with pathology and genomic features

MLFF-Net: a multi-model late feature fusion network for skin disease classification

Multi-path synergic fusion deep neural network framework for breast mass classification using digital breast tomosynthesis

CIFF-Net: Contextual image feature fusion for Melanoma diagnosis

A multibranch and multiscale neural network based on semantic perception for multimodal medical image fusion

Multimodal Fusion Learning with Dual Attention for Medical Imaging

A two‐stream deep neural network‐based intelligent system for complex skin cancer types classification

Multiclass skin lesion localization and classification using deep learning based features fusion and selection framework for smart healthcare