Abstract:Lumbar vertebral body cancellous bone location and segmentation is crucial in an automated lumbar spine processing pipeline. Accurate and reliable analysis of lumbar spine image is expected to advantage practical medical diagnosis and population-based analysis of bone strength. However, the design of automated algorithms for lumbar spine processing is demanding due to significant anatomical variations and scarcity of publicly available data. In recent years, convolutional neural network (CNN) and vision transformers (Vits) have been the de facto standard in medical image segmentation. Although adept at capturing global features, the inherent bias of locality and weight sharing of CNN constrains its capacity to model long-range dependency. In contrast, Vits excel at long-range dependency modeling, but they may not generalize well with limited datasets due to the lack of inductive biases inherent to CNN. In this paper, we propose a deep learning-based two-stage coarse-to-fine solution to address the problem of automatic location and segmentation of lumbar vertebral body cancellous bone. Specifically, in the first stage, a Swin-transformer based model is applied to predict the heatmap of lumbar vertebral body centroids. Considering the characteristic anatomical structure of lumbar spine, we propose a novel loss function called LumAnatomy loss, which enforces the order and bend of the predicted vertebral body centroids. To inherit the excellence of CNN and Vits while preventing their respective limitations, in the second stage, we propose an encoder-decoder network to segment the identified lumbar vertebral body cancellous bone, which consists of two parallel encoders, i.e., a Swin-transformer encoder and a CNN encoder. To enhance the combination of CNNs and Vits, we propose a novel multi-scale attention feature fusion module (MSA-FFM), which address issues that arise when fusing features given at different encoders. To tackle the issue of lack of data, we raise the first large-scale lumbar vertebral body cancellous bone segmentation dataset called LumVBCanSeg containing a total of 185 CT scans annotated at voxel level by 3 physicians. Extensive experimental results on the LumVBCanSeg dataset demonstrate the proposed algorithm outperform other state-of-the-art medical image segmentation methods. The data is publicly available at: https://zenodo.org/record/8181250. The implementation of the proposed method is available at: https://github.com/sia405yd/LumVertCancNet.

A Highly Automatic Lumbar Vertebrae Segmentation Method Using 3D CT Data

An Accurately Represented Finite Element Model of Lumbar Motion Segment

Spine Explorer: a Deep Learning Based Fully Automated Program for Efficient and Reliable Quantifications of the Vertebrae and Discs on Sagittal Lumbar Spine MR Images

Automatic Lumbar Spine Measurement in CT Images

Segmentation of Vertebra Based on CT Image

A New 3D Method to Segment the Lumbar Vertebral Bodies and to Determine Bone Mineral Density and Geometry

Autonomous localization and segmentation for body composition quantization on abdominal CT

Three-dimensional Finite Element Modeling and Analysis of Human L3-L4 Lumbar Segment Based on CT Data

Automatic Localization And Segmentation Of Vertebral Bodies In 3d Ct Volumes With Deep Learning

Affinely Registered Multi-object Atlases As Shape Prior for Grid Cut Segmentation of Lumbar Vertebrae from CT Images.

Automatic Lumbar Spinal CT Image Segmentation With a Dual Densely Connected U-Net

A New 3D Segmentation Methodology for Lumbar Vertebral Bodies for the Measurement of BMD and Geometry

Automatic Segmentation of the Body and the Spinal Canal in CT Images Based on A Priori Information

A New Accurate and Precise 3-D Segmentation Method for Skeletal Structures in Volumetric Ct Data

A Spine Segmentation Method under an Arbitrary Field of View Based on 3D Swin Transformer

Automatic Spine Segmentation using Convolutional Neural Network via Redundant Generation of Class Labels for 3D Spine Modeling

Automatic Segmentation, Localization, and Identification of Vertebrae in 3D CT Images Using Cascaded Convolutional Neural Networks

Fully Automatic Localization and Segmentation of 3D Vertebral Bodies from CT/MR Images Via a Learning-Based Method

LumVertCancNet: A novel 3D lumbar vertebral body cancellous bone location and segmentation method based on hybrid Swin-transformer

CT-Based Automatic Spine Segmentation Using Patch-Based Deep Learning