Abstract:Accurate segmentation of skin lesions is a challenging task because the task is highly influenced by factors such as location, shape and scale. In recent years, Convolutional Neural Networks (CNNs) have achieved advanced performance in automated medical image segmentation. However, existing CNNs have problems such as inability to highlight relevant features and preserve local features, which limit their application in clinical decision-making. This paper proposes a CNN with an added attention mechanism (EA-Net) for more accurate medical image segmentation.EA-Net is based on the U-Net network model framework. Specifically, we added a pixel-level attention module (PA) to the encoder section to preserve the local features of the image during downsampling, making the feature maps input to the decoder more relevant to the ground-truth. At the same time, we added a spatial multi-scale attention module (SA) after the decoding process to increase the spatial weight of the feature maps that are more relevant to the ground-truth, thereby reducing the gap between the output results and the ground-truth. We conducted extensive segmentation experiments on skin lesion images from the ISIC 2017 and ISIC 2018 datasets. The results demonstrate that, when compared to U-Net, our proposed EA-Net achieves an average Dice score improvement of 1.94% and 5.38% for skin lesion tissue segmentation on the ISIC 2017 and ISIC 2018 datasets, respectively. The IoU also increases by 2.69% and 8.31%, and the ASSD decreases by 0.3783 pix and 0.5432 pix, indicating superior segmentation performance. EA-Net can achieve better segmentation results when the original image of skin lesions has an obscure boundary and the segmentation area contains interference factors, which proves that the addition of attention mechanism in the encoder and the application of comprehensive attention mechanism can improve the performance of neural network in the field of skin lesions image segmentation.

Skin lesion region segmentation model based on improved U2Net

Attention-Guided Network with Densely Connected Convolution for Skin Lesion Segmentation

SEACU-Net: Attentive ConvLSTM U-Net with squeeze-and-excitation layer for skin lesion segmentation

A Robust Segmentation Method Based on Improved U-Net

Improved U-Net Based on Contour Attention for Efficient Segmentation of Skin Lesion

U-Net-based Models for Skin Lesion Segmentation: More Attention and Augmentation

Skin lesion segmentation with attention-based SC-Conv U-Net and feature map distortion

DI-UNet: dual-branch interactive U-Net for skin cancer image segmentation

Channel Attention Separable Convolution Network for Skin Lesion Segmentation

Skin Lesion Segmentation Based on Mask R-CNN

Towards improved U-Net for efficient skin lesion segmentation

A Semantic Segmentation Algorithm Supported by Image Processing and Neural Network

Deep Hybrid Convolutional Neural Network for Segmentation of Melanoma Skin Lesion

LeaNet: Lightweight U-shaped Architecture for High-Performance Skin Cancer Image Segmentation

Channel Context and Dual-Domain Attention Based U-Net for Skin Lesion Attributes Segmentation

Skin Lesion Segmentation Based on Multi-Scale Attention Convolutional Neural Network.

GSCEU-Net: an End-to-End Lightweight Skin Lesion Segmentation Model with Feature Fusion Based on U-Net Enhancements

EIU-Net: Enhanced feature extraction and improved skip connections in U-Net for skin lesion segmentation

Mca-Net: Modified Comprehensive Attention Convolutional Neural Network for Skin Lesion Segmentation

Dense and Shuffle Attention U-Net for Automatic Skin Lesion Segmentation.

EA-Net: Research on Skin Lesion Segmentation Method Based on U-Net.