Abstract:Scoliosis, spinal deformity and vertebral spondylolisthesis are spinal disorders with high incidence, which seriously affect people's lives and health. CT is an important medical tool for the detection and diagnosis of spinal disorders and provides a large amount of pathologically valid information in various clinical practices such as spine pathology assessment and computer-assisted surgical interventions. As the spine presents long span, complex shape of biological curve and high multi-stage similarity in the sagittal plane of CT images. Therefore, fast and accurate spine segmentation technology has become an important research direction for computer-aided diagnosis. We proposed an RUnT network based on the combination of residual U-Net feature extraction network and Vision Transformer structure for fast and efficient automatic segmentation of multiple vertebrae of the spine. The deep vertebral features are first extracted using the residual U-Net network to prevent gradient diffusion while improving the accuracy of vertebral contour segmentation. Then the multi-scale feature maps extracted by the residual structure containing rich vertebral superficial information are input to the edge segmentation module. We designed the vertebral contour feature extraction structure to refine the segmentation boundaries and ensure the segmentation consistency of each vertebra by combining the operations of deconvolution and convolution for three different scales of deep features.Finally, the global information extraction module based on Transformer structure is combined with the local feature extraction module to achieve the blending of global location information of vertebrae with local features through the self-attentive feature map of multi-scale volume. By mixing edge features with semantic features, the semantic confusion arising from the high similarity between vertebrae when the decoder extracts vertebral features is reduced. The model proposed in thi- paper is experimented on the CTSpine1K and VerSe 20 public datasets. The results show that the model proposed in this paper obtains the state-of-the-art segmentation performance with the average DSC scores of 88.4% and 81.5% on CTSpine1K and VerSe 20, respectively, while reducing the average distance of HD95 from 4.86 to 3.88.

Efficient spine segmentation network based on multi‐scale feature extraction and multi‐dimensional spatial attention

RAU-Net: U-Net network based on residual multi-scale fusion and attention skip layer for overall spine segmentation

Automatic segmentation of spine x-ray images based on multiscale feature enhancement network

Multi-Scale Hybrid Attention Convolutional Neural Network for Automatic Segmentation of Lumbar Vertebrae From MRI

SpineMamba: Enhancing 3D Spinal Segmentation in Clinical Imaging through Residual Visual Mamba Layers and Shape Priors

Spinal MRI image segmentation based on improved U-Net

Dilated SpineNet for Semantic Segmentation

SCANeXt: Enhancing 3D Medical Image Segmentation with Dual Attention Network and Depth-Wise Convolution

nnSegNeXt: A 3D Convolutional Network for Brain Tissue Segmentation Based on Quality Evaluation

A spine segmentation method based on scene aware fusion network

RUnT: A Network Combining Residual U-Net and Transformer for Vertebral Edge Feature Fusion Constrained Spine CT Image Segmentation

Ca-Segresnet: A Context-Aware Segmentation Residual Network for Automatic Segmentation of Identified Vertebral Bones from Ct Images

Multi-scale context UNet-like network with redesigned skip connections for medical image segmentation

SUnet: A Multi-Organ Segmentation Network Based on Multiple Attention

SALW-Net: a lightweight convolutional neural network based on self-adjusting loss function for spine MR image segmentation

SC-UneXt: Nested UNeXt Architecture based on Medical Image Segmentation

Spine X-ray Image Segmentation Based on Transformer and Adaptive Optimized Postprocessing

MSGSE-Net: Multi-scale guided squeeze-and-excitation network for subcortical brain structure segmentation

Atrous Residual Interconnected Encoder to Attention Decoder Framework for Vertebrae Segmentation via 3D Volumetric CT Images

WGAN-based multi-structure segmentation of vertebral cross-section MRI using ResU-Net and clustered transformer

Semi-Supervised Hybrid Spine Network for Segmentation of Spine MR Images