Abstract:Brain structure segmentation in Magnetic Resonance Images (MRI) is essential to the assessment and treatment of medical disorders, especially neuropsychiatric diseases. The key to semantic segmentation is to understand the low-level visual semantics and the high-level spatial semantics of the image. Due to the complex anatomical structures, the current approaches lack the ability to effectively extract rich semantic information, resulting in the inevitable loss of details in prediction results. To address this problem, we propose a novel spatial and visual feature enhancement network (SVF-Net) to accurately segment the brain structures. The SVF-Net is designed as a multi-task learning framework, in which an auxiliary coarse segmentation task is used for spatial information acquisition, an auxiliary image reconstruction task is used for visual information preservation, and a major refined segmentation task is used for brain structure segmentation. In this algorithm, multitasking optimization is mainly based on two strategies: firstly, a spatial feature enhancement (SFE) module is introduced to extract the location and spatial relationships of objects from the coarse prediction, which are then sent to the refined segmentation model for spatial information enhancement. Secondly, a visual feature preservation (VFP) model is introduced for image reconstruction, which shares the feature extractor with the refined segmentation model, so as to retain more useful low-level visual features for the model. Extensive experiments are performed on three public brain MRI T1 scan datasets (the IBSR dataset, the MALC dataset and the LPBA dataset) to evaluate the effectiveness of the proposed algorithm. The experimental results show that the SVF-Net achieves the best performance compared with the state-of-the-art methods. In addition, the ablation experiments and the noise interference experiments demonstrate that proposed SFE and VFP module have obvious advantages in improving segmentation accuracy and resisting noise interference.

BDB-Net: Boundary-Enhanced Dual Branch Network for Whole Brain Segmentation

WNET: an End-to-End Atlas-Guided and Boundary-Enhanced Network for Medical Image Segmentation

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

DRBANET: A Lightweight Dual-Resolution Network for Semantic Segmentation with Boundary Auxiliary

DBF-Net: A Dual-Branch Network with Feature Fusion for Ultrasound Image Segmentation

Whole brain segmentation with full volume neural network

Boundary-Aware Network for Abdominal Multi-Organ Segmentation

Adaptable Global Network for Whole-Brain Segmentation with Symmetry Consistency Loss

Geometric Brain Surface Network For Brain Cortical Parcellation

BUA-Net: Boundary and uncertainty-aware attention network for lumbar multi-region magnetic resonance imaging segmentation

BCAU-Net: A Novel Architecture with Binary Channel Attention Module for MRI Brain Segmentation.

Learning to detect boundary information for brain image segmentation

Subcortical Brain Segmentation Based On A Novel Discriminative Dictionary Learning Method And Sparse Coding

Brain Image Segmentation for Ultrascale Neuron Reconstruction via an Adaptive Dual-Task Learning Network

TBE-Net: A Deep Network Based on Tree-like Branch Encoder for Medical Image Segmentation

SVF-Net: spatial and visual feature enhancement network for brain structure segmentation

DDNet: A Novel Network for Cerebral Artery Segmentation from MRA Images

AssemblyNet: A Novel Deep Decision-Making Process for Whole Brain MRI Segmentation

Region-based U-net for accelerated training and enhanced precision in deep brain segmentation

Dual-guided network for endoscopic image segmentation with region and boundary cues

A novel medical image segmentation approach by using multi-branch segmentation network based on local and global information synchronous learning