Abstract:Accurate medical image segmentation is critical for early medical diagnosis. Most existing methods are based on U-shape structure and use element-wise addition or concatenation to fuse different level features progressively in decoder. However, both the two operations easily generate plenty of redundant information, which will weaken the complementarity between different level features, resulting in inaccurate localization and blurred edges of lesions. To address this challenge, we propose a general multi-scale in multi-scale subtraction network (M$^{2}$SNet) to finish diverse segmentation from medical image. Specifically, we first design a basic subtraction unit (SU) to produce the difference features between adjacent levels in encoder. Next, we expand the single-scale SU to the intra-layer multi-scale SU, which can provide the decoder with both pixel-level and structure-level difference information. Then, we pyramidally equip the multi-scale SUs at different levels with varying receptive fields, thereby achieving the inter-layer multi-scale feature aggregation and obtaining rich multi-scale difference information. In addition, we build a training-free network ``LossNet'' to comprehensively supervise the task-aware features from bottom layer to top layer, which drives our multi-scale subtraction network to capture the detailed and structural cues simultaneously. Without bells and whistles, our method performs favorably against most state-of-the-art methods under different evaluation metrics on eleven datasets of four different medical image segmentation tasks of diverse image modalities, including color colonoscopy imaging, ultrasound imaging, computed tomography (CT), and optical coherence tomography (OCT). The source code can be available at \url{<a class="link-external link-https" href="https://github.com/Xiaoqi-Zhao-DLUT/MSNet" rel="external noopener nofollow">this https URL</a>}.

MpMsCFMA-Net: Multi-path Multi-scale Context Feature Mixup and Aggregation Network for medical image segmentation

MCA-Net: Multi-scale Context-aware Aggregation Network for Medical Image Segmentation.

Hybrid-scale Contextual Fusion Network for Medical Image Segmentation

Sub-pixel multi-scale fusion network for medical image segmentation

Multi-scale Feature Pyramid Fusion Network for Medical Image Segmentation

Multi-perspective feature compensation enhanced network for medical image segmentation

BMCS-Net: A Bi-directional multi-scale cascaded segmentation network based on transformer-guided feature Aggregation for medical images

NMNet: Learning Multi-level Semantic Information from Scale Extension Domain for Improved Medical Image Segmentation

CPFNet: Context Pyramid Fusion Network for Medical Image Segmentation.

MFH‐Net: A Hybrid CNN‐Transformer Network Based Multi‐Scale Fusion for Medical Image Segmentation

MC-Net: multi-scale context-attention network for medical CT image segmentation

Multi-Scale Context Interaction Learning Network for Medical Image Segmentation

AMFF-NET: Adaptive Multi-Layer Feature Fusion Network for Medical Image Segmentation

CRMEFNet: A coupled refinement, multiscale exploration and fusion network for medical image segmentation

M$^{2}$SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation

CASF-Net: Cross-attention and Cross-scale Fusion Network for Medical Image Segmentation

Contextual-wise Discriminative Feature Extraction and Robust Network Learning for Subcortical Structure Segmentation

Segmentation-based Context-Aware Enhancement Network for Medical Images

MSSA‐Net: A novel multi‐scale feature fusion and global self‐attention network for lesion segmentation

MFA-Net: Multiple Feature Association Network for Medical Image Segmentation

DMAGNet: Dual‐path Multi‐scale Attention Guided Network for Medical Image Segmentation