Abstract:Background Spinal diseases are burdening an increasing number of patients. And fully automatic vertebrae segmentation for CT images with arbitrary field of views (FOVs), has been a fundamental research for computer‐assisted spinal disease diagnosis and surgical intervention. Therefore, researchers aim to solve this challenging task in the past years. Purpose This task suffers from challenges including the intra‐vertebrae inconsistency of segmentation and the poor identification of biterminal vertebrae in CT scans. And there are some limitations in existing models, which might be difficult to be applied to spinal cases with arbitrary FOVs or employ multi‐stage networks with too much computational cost. In this paper, we propose a single‐staged model called VerteFormer which can effectively deal with the challenges and limitations mentioned above. Methods The proposed VerteFormer utilizes the advantage of Vision Transformer (ViT), which does well in mining global relations for input data. The Transformer and UNet‐based structure effectively fuse global and local features of vertebrae. Beisdes, we propose the Edge Detection (ED) block based on convolution and self‐attention to divide neighboring vertebrae with clear boundary lines. And it simultaneously promotes the network to achieve more consistent segmentation masks of vertebrae. To better identify the labels of vertebrae in the spine, particularly biterminal vertebrae, we further introduce global information generated from the Global Information Extraction (GIE) block. Results We evaluate the proposed model on two public datasets: MICCAI Challenge VerSe 2019 and 2020. And VerteFormer achieve 86.39% and 86.54% of dice scores on the public and hidden test datasets of VerSe 2019, 84.53% and 86.86% of dice scores on VerSe 2020, which outperforms other Transformer‐based models and single‐staged methods specifically designed for the VerSe Challenge. Additional ablation experiments validate the effectiveness of ViT block, ED block and GIE block. Conclusions We propose a single‐staged Transformer‐based model for the task of fully automatic vertebrae segmentation from CT images with arbitrary FOVs. ViT demonstrates its effectiveness in modeling long‐term relations. The ED block and GIE block has shown their improvements to the segmentation performance of vertebrae. The proposed model can assist physicians for spinal diseases' diagnosis and surgical intervention, and is also promising to be generalized and transferred to other applications of medical imaging.

Adaptive geodesic transform for segmentation of vertebrae on CT images

Automatic Localization And Segmentation Of Vertebral Bodies In 3d Ct Volumes With Deep Learning

A Spine Segmentation Method under an Arbitrary Field of View Based on 3D Swin Transformer

Affinely Registered Multi-object Atlases As Shape Prior for Grid Cut Segmentation of Lumbar Vertebrae from CT Images.

Spinal Vertebrae Segmentation and Localization by Transfer Learning

Automatic Vertebra Labeling in Large-Scale 3D CT using Deep Image-to-Image Network with Message Passing and Sparsity Regularization

A Highly Automatic Lumbar Vertebrae Segmentation Method Using 3D CT Data

Automatic Segmentation, Localization, and Identification of Vertebrae in 3D CT Images Using Cascaded Convolutional Neural Networks

Spine-transformers: Vertebra labeling and segmentation in arbitrary field-of-view spine CTs via 3D transformers

Multi-object Model-Based Multi-atlas Segmentation Constrained Grid Cut for Automatic Segmentation of Lumbar Vertebrae from CT Images.

Fully Automatic Localization and Segmentation of 3D Vertebral Bodies from CT/MR Images Via a Learning-Based Method

Automatic Segmentation of the Body and the Spinal Canal in CT Images Based on A Priori Information

Automatic Spine Segmentation using Convolutional Neural Network via Redundant Generation of Class Labels for 3D Spine Modeling

Automatic Segmentation of Cervical Vertebrae in X-ray Images.

Atrous Residual Interconnected Encoder to Attention Decoder Framework for Vertebrae Segmentation via 3D Volumetric CT Images

Precise segmentation of multiple organs in CT volumes using learning-based approach and information theory.

A New Accurate and Precise 3-D Segmentation Method for Skeletal Structures in Volumetric Ct Data

Automatic Segmentation of Cerebrospinal Fluid, White and Gray Matter in Unenhanced Computed Tomography Images.

RUnT: A Network Combining Residual U-Net and Transformer for Vertebral Edge Feature Fusion Constrained Spine CT Image Segmentation

Automatic and Reliable Segmentation of Spinal Canals in Low-Resolution, Low-Contrast CT Images

VerteFormer: A single‐staged Transformer network for vertebrae segmentation from CT images with arbitrary field of views