Abstract:Background and objective Melanoma is a highly malignant skin tumor. Accurate segmentation of skin lesions from dermoscopy images is pivotal for computer-aided diagnosis of melanoma. However, blurred lesion boundaries, variable lesion shapes, and other interference factors pose a challenge in this regard. Methods This work proposes a novel framework called CFF-Net (Cross Feature Fusion Network) for supervised skin lesion segmentation. The encoder of the network includes dual branches, where the CNNs branch aims to extract rich local features while MLPs branch is used to establish both the global-spatial-dependencies and global-channel-dependencies for precise delineation of skin lesions. Besides, a feature-interaction module between two branches is designed for strengthening the feature representation by allowing dynamic exchange of spatial and channel information, so as to retain more spatial details and inhibit irrelevant noise. Moreover, an auxiliary prediction task is introduced to learn the global geometric information, highlighting the boundary of the skin lesion. Results Comprehensive experiments using four publicly available skin lesion datasets (i.e., ISIC 2018, ISIC 2017, ISIC 2016, and PH2) indicated that CFF-Net outperformed the state-of-the-art models. In particular, CFF-Net greatly increased the average Jaccard Index score from 79.71% to 81.86% in ISIC 2018, from 78.03% to 80.21% in ISIC 2017, from 82.58% to 85.38% in ISIC 2016, and from 84.18% to 89.71% in PH2 compared with U-Net. Ablation studies demonstrated the effectiveness of each proposed component. Cross-validation experiments in ISIC 2018 and PH2 datasets verified the generalizability of CFF-Net under different skin lesion data distributions. Finally, comparison experiments using three public datasets demonstrated the superior performance of our model. Conclusion The proposed CFF-Net performed well in four public skin lesion datasets, especially for challenging cases with blurred edges of skin lesions and low contrast between skin lesions and background. CFF-Net can be employed for other segmentation tasks with better prediction and more accurate delineation of boundaries.

FCA-Net: Fully context-aware feature aggregation network for medical segmentation

Attention-Guided Network with Densely Connected Convolution for Skin Lesion Segmentation

Cross-level Feature Aggregation Network for Polyp Segmentation.

Cross-Level Context Fusion Network for Polyp Segmentation in Colonoscopy Images

Edge-aware Feature Aggregation Network for Polyp Segmentation

FAC-Net: Feedback Attention Network Based on Context Encoder Network for Skin Lesion Segmentation

EAAC-Net: An Efficient Adaptive Attention and Convolution Fusion Network for Skin Lesion Segmentation

Dynamically Aggregating MLPs and CNNs for Skin Lesion Segmentation with Geometry Regularization

FBCU-Net: A Fine-Grained Context Modeling Network Using Boundary Semantic Features for Medical Image Segmentation.

FECC-Net: A Novel Feature Enhancement and Context Capture Network Based on Brain MRI Images for Lesion Segmentation

ACFNet: an Adaptive Context Fusion Network for Skin Lesion Segmentation

AFANet: Adaptive Feature Aggregation for Polyp Segmentation

CAFE-Net: Cross-Attention and Feature Exploration Network for polyp segmentation

A frequency selection network for medical image segmentation

UACENet: Uncertain Area Attention and Cross-Image Context Extraction Network for Polyp Segmentation.

CFANet: Context Feature Fusion and Attention Mechanism Based Network for Small Target Segmentation in Medical Images

LCAUnet: A skin lesion segmentation network with enhanced edge and body fusion

FMCA-Net: A feature secondary multiplexing and dilated convolutional attention polyp segmentation network based on pyramid vision transformer

Edge and neighborhood guidance network for 2D medical image segmentation

Multi-scale aggregation networks with flexible receptive fields for melanoma segmentation

Multi-Scale Context-Guided Deep Network for Automated Lesion Segmentation With Endoscopy Images of Gastrointestinal Tract