Abstract:Lumbar vertebral body cancellous bone location and segmentation is crucial in an automated lumbar spine processing pipeline. Accurate and reliable analysis of lumbar spine image is expected to advantage practical medical diagnosis and population-based analysis of bone strength. However, the design of automated algorithms for lumbar spine processing is demanding due to significant anatomical variations and scarcity of publicly available data. In recent years, convolutional neural network (CNN) and vision transformers (Vits) have been the de facto standard in medical image segmentation. Although adept at capturing global features, the inherent bias of locality and weight sharing of CNN constrains its capacity to model long-range dependency. In contrast, Vits excel at long-range dependency modeling, but they may not generalize well with limited datasets due to the lack of inductive biases inherent to CNN. In this paper, we propose a deep learning-based two-stage coarse-to-fine solution to address the problem of automatic location and segmentation of lumbar vertebral body cancellous bone. Specifically, in the first stage, a Swin-transformer based model is applied to predict the heatmap of lumbar vertebral body centroids. Considering the characteristic anatomical structure of lumbar spine, we propose a novel loss function called LumAnatomy loss, which enforces the order and bend of the predicted vertebral body centroids. To inherit the excellence of CNN and Vits while preventing their respective limitations, in the second stage, we propose an encoder-decoder network to segment the identified lumbar vertebral body cancellous bone, which consists of two parallel encoders, i.e., a Swin-transformer encoder and a CNN encoder. To enhance the combination of CNNs and Vits, we propose a novel multi-scale attention feature fusion module (MSA-FFM), which address issues that arise when fusing features given at different encoders. To tackle the issue of lack of data, we raise the first large-scale lumbar vertebral body cancellous bone segmentation dataset called LumVBCanSeg containing a total of 185 CT scans annotated at voxel level by 3 physicians. Extensive experimental results on the LumVBCanSeg dataset demonstrate the proposed algorithm outperform other state-of-the-art medical image segmentation methods. The data is publicly available at: https://zenodo.org/record/8181250. The implementation of the proposed method is available at: https://github.com/sia405yd/LumVertCancNet.

A combined mean-shift algorithm for vertebra image segmentation 1

A Novel Color Image Segmentation Algorithm Based on Vector Quantization and Region Growing

Improved Mean Shift Algorithm and Its Application

Interactive Color Image Segmentation by Region Growing Combined with Image Enhancement Based on Bezier Model

Image Segmentation with Mean Shift and Region Merging Methods

A multi-scale image segmentation algorithm based on mean shift

Interactive segmentation method with graph cut and SVMs

Improved techniques for automatic image segmentation

Snake-based Approach for Segmenting Pedicles in Radiographs and Its Application in Three-Dimensional Vertebrae Reconstruction

Combination of Region and Contour Models for Interactive Image Segmentation

Multi-vertebrae Segmentation from Arbitrary Spine MR Images Under Global View

Exploring Neighbor Spatial Relationships for Enhanced Lumbar Vertebrae Detection in X-ray Images

Improved Mean-Shift Segmentation Approach for Remote Sensing Images

Spinal MRI image segmentation based on improved U-Net

Adaptive image segmentation by using mean-shift and evolutionary optimisation

Efficient Lower-Limb Segmentation for Large-Scale Volumetric CT by Using Projection View and Voxel Group Attention.

Automated vertebral landmarks and spinal curvature estimation using non-directional part affinity fields

LumVertCancNet: A novel 3D lumbar vertebral body cancellous bone location and segmentation method based on hybrid Swin-transformer

VertXNet: An Ensemble Method for Vertebrae Segmentation and Identification of Spinal X-Ray

An image segmentation method based on the fusion of vector quantization and edge detection with applications to medical image processing

Incorporating global multiplicative decomposition and local statistical information for brain tissue segmentation and bias field estimation