Abstract:Spinal surgery planning necessitates automatic segmentation of vertebrae in cone-beam computed tomography (CBCT), an intraoperative imaging modality that is widely used in intervention. However, CBCT images are of low-quality and artifact-laden due to noise, poor tissue contrast, and the presence of metallic objects, causing vertebra segmentation, even manually, a demanding task. In contrast, there exists a wealth of artifact-free, high quality CT images with vertebra annotations. This motivates us to build a CBCT vertebra segmentation model using unpaired CT images with annotations. To overcome the domain and artifact gaps between CBCT and CT, it is a must to address the three heterogeneous tasks of vertebra segmentation, artifact reduction and modality translation all together. To this, we propose a novel anatomy-aware artifact disentanglement and segmentation network (A$^3$DSegNet) that intensively leverages knowledge sharing of these three tasks to promote learning. Specifically, it takes a random pair of CBCT and CT images as the input and manipulates the synthesis and segmentation via different decoding combinations from the disentangled latent layers. Then, by proposing various forms of consistency among the synthesized images and among segmented vertebrae, the learning is achieved without paired (i.e., anatomically identical) data. Finally, we stack 2D slices together and build 3D networks on top to obtain final 3D segmentation result. Extensive experiments on a large number of clinical CBCT (21,364) and CT (17,089) images show that the proposed A$^3$DSegNet performs significantly better than state-of-the-art competing methods trained independently for each task and, remarkably, it achieves an average Dice coefficient of 0.926 for unpaired 3D CBCT vertebra segmentation.

AFSegNet: few-shot 3D ankle-foot bone segmentation via hierarchical feature distillation and multi-scale attention and fusion

A3DSegNet: Anatomy-Aware Artifact Disentanglement and Segmentation Network for Unpaired Segmentation, Artifact Reduction, and Modality Translation

A$^3$DSegNet: Anatomy-aware artifact disentanglement and segmentation network for unpaired segmentation, artifact reduction, and modality translation

Three-Dimensional Feature-Enhanced Network for Automatic Femur Segmentation

A bone segmentation method based on Multi-scale features fuse U2Net and improved dice loss in CT image process

Efficient Lower-Limb Segmentation for Large-Scale Volumetric CT by Using Projection View and Voxel Group Attention.

A Robust Segmentation Method Based on Improved U-Net

A deep learning-based approach to automatic proximal femur segmentation in quantitative CT images

AFT-Net: Active Fusion-Transduction for Multi-stream Medical Image Segmentation.

Knee Bone and Cartilage Segmentation Based on a 3D Deep Neural Network Using Adversarial Loss for Prior Shape Constraint

KCB-Net: A 3D knee cartilage and bone segmentation network via sparse annotation

Fine-Grained Hand Bone Segmentation via Adaptive Multi-dimensional Convolutional Network and Anatomy-Constraint Loss

Improved distinct bone segmentation in upper-body CT through multi-resolution networks

3D Segmentation Networks for Excessive Numbers of Classes: Distinct Bone Segmentation in Upper Bodies

Accelerating segmentation of fossil CT scans through Deep Learning

Multi-Class Micro-CT Image Segmentation Using Sparse Regularized Deep Networks

2D-3D Hierarchical Feature Fusion Network for Segmentation of Bone Structure in Knee Mr Image

A Deep Learning-Based Approach to Extracting Periosteal and Endosteal Contours of Proximal Femur in Quantitative CT Images

mm3DSNet: multi-scale and multi-feedforward self-attention 3D segmentation network for CT scans of hepatobiliary ducts

Few-Shot 3D Volumetric Segmentation with Multi-Surrogate Fusion

Enhanced Attention Res-Unet for Segmentation of Knee Bones