Abstract:In medical images, various types of lesions often manifest significant differences in their shape and texture. Accurate medical image segmentation demands deep learning models with robust capabilities in multi-scale and boundary feature learning. However, previous networks still have limitations in addressing the above issues. Firstly, previous networks simultaneously fuse multi-level features or employ deep supervision to enhance multi-scale learning. However, this may lead to feature redundancy and excessive computational overhead, which is not conducive to network training and clinical deployment. Secondly, the majority of medical image segmentation networks exclusively learn features in the spatial domain, disregarding the abundant global information in the frequency domain. This results in a bias towards low-frequency components, neglecting crucial high-frequency information. To address these problems, we introduce SF-UNet, a spatial-frequency dual-domain attention network. It comprises two main components: the Multi-scale Progressive Channel Attention (MPCA) block, which progressively extract multi-scale features across adjacent encoder layers, and the lightweight Frequency-Spatial Attention (FSA) block, with only 0.05M parameters, enabling concurrent learning of texture and boundary features from both spatial and frequency domains. We validate the effectiveness of the proposed SF-UNet on three public datasets. Experimental results show that compared to previous state-of-the-art (SOTA) medical image segmentation networks, SF-UNet achieves the best performance, and achieves up to 9.4\% and 10.78\% improvement in DSC and IOU. Codes will be released at <a class="link-external link-https" href="https://github.com/nkicsl/SF-UNet" rel="external noopener nofollow">this https URL</a>.

Personalized image observation behavior learning in fixation based personalized salient object segmentation

PUB-SalNet: A Pre-Trained Unsupervised Self-Aware Backpropagation Network for Biomedical Salient Segmentation

Personal Fixations-Based Object Segmentation With Object Localization and Boundary Preservation

Object Detection Based on Saturation of Visual Perception

Mmy-net: a Multimodal Network Exploiting Image and Patient Metadata for Simultaneous Segmentation and Diagnosis

Learning Fixation Point Strategy for Object Detection and Classification

Salient Object Detection Driven By Fixation Prediction

Where's YOUR focus: Personalized Attention

Weakly Supervised Human Fixations Prediction

Personalize Segment Anything Model with One Shot

Inferring Salient Objects from Human Fixations

Personalized Image Semantic Segmentation

Fusion target attention mask generation network for video segmentation

Collaborative and Attentive Learning for Personalized Image Aesthetic Assessment

Spatial-Frequency Dual Progressive Attention Network For Medical Image Segmentation

Learning self-calibrated optic disc and cup segmentation from multi-rater annotations

Multi-level spatial-temporal and attentional information deep fusion network for retinal vessel segmentation

Deep Attention Unet: A Network Model with Global Feature Perception Ability

Shape Constrained Network for Eye Segmentation in the Wild

MSGSE-Net: Multi-scale guided squeeze-and-excitation network for subcortical brain structure segmentation

Diversified and Personalized Multi-rater Medical Image Segmentation