Abstract:The accurate segmentation of brain tumor is significant in clinical practice. Convolutional Neural Network (CNN)-based methods have made great progress in brain tumor segmentation due to powerful local modeling ability. However, brain tumors are frequently pattern-agnostic, i.e. variable in shape, size and location, which can not be effectively matched by traditional CNN-based methods with local and regular receptive fields. To address the above issues, we propose a shape-scale co-awareness network (S2CA-Net) for brain tumor segmentation, which can efficiently learn shape-aware and scale-aware features simultaneously to enhance pattern-agnostic representations. Primarily, three key components are proposed to accomplish the co-awareness of shape and scale. The Local-Global Scale Mixer (LGSM) decouples the extraction of local and global context by adopting the CNN-Former parallel structure, which contributes to obtaining finer hierarchical features. The Multi-level Context Aggregator (MCA) enriches the scale diversity of input patches by modeling global features across multiple receptive fields. The Multi-Scale Attentive Deformable Convolution (MS-ADC) learns the target deformation based on the multiscale inputs, which motivates the network to enforce feature constraints both in terms of scale and shape for optimal feature matching. Overall, LGSM and MCA focus on enhancing the scale-awareness of the network to cope with the size and location variations, while MS-ADC focuses on capturing deformation information for optimal shape matching. Finally, their effective integration prompts the network to perceive variations in shape and scale simultaneously, which can robustly tackle the variations in patterns of brain tumors. The experimental results on BraTS 2019, BraTS 2020, MSD BTS Task and BraTS2023-MEN show that S2CA-Net has superior overall performance in accuracy and efficiency compared to other state-of-the-art methods. Code: https://github.com/jiangyu945/S2CA-Net.

3D Shape Segmentation Via Shape Fully Convolutional Networks

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Shape-Scale Co-Awareness Network for 3D Brain Tumor Segmentation.

3D Shape Segmentation Based on Viewpoint Entropy and Projective Fully Convolutional Networks Fusing Multi-view Features

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

FD-FCN: 3D Fully Dense and Fully Convolutional Network for Semantic Segmentation of Brain Anatomy

Unsupervised 3D Shape Segmentation and Co-Segmentation Via Deep Learning.

A Deep Level Set Method For Image Segmentation

GVCNN: Group-View Convolutional Neural Networks for 3D Shape Recognition

Unify 3D Shape Retrieval and Classification in One Framework

Image Segmentation of Liver CT Based on Fully Convolutional Network.

3D shape classification based on convolutional neural networks fusing multi-view information

3D Shape Segmentation Using Soft Density Peak Clustering and Semi-Supervised Learning

Semi-supervised 3D shape segmentation with multilevel consistency and part substitution

Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images

Improved Sliding Shapes for Instance Segmentation of Amodal 3D Object.

SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation

3D Shapes Co-segmentation by Combining Fuzzy C-Means with Random Walks

3D Shape Segmentation Via Attentive Nonuniform Downsampling

Fully Convolutional Neural Networks With Full-Scale-Features For Semantic Segmentation

Deep Learning 3D Shapes Using Alt-az Anisotropic 2-Sphere Convolution