Abstract:Background: X-ray image quality is critical for accurate intrafraction motion tracking in radiation therapy. Purpose: This study aims to develop a deep-learning algorithm to improve kV image contrast by decomposing the image into bony and soft tissue components. In particular, we designed a priori attention mechanism in the neural network framework for optimal decomposition. We show that a patient-specific prior cross-attention (PCAT) mechanism can boost the performance of kV image decomposition. We demonstrate its use in paraspinal SBRT motion tracking with online kV imaging. Methods: Online 2D kV projections were acquired during paraspinal SBRT for patient motion monitoring. The patient-specific prior images were generated by randomly shifting and rotating spine-only DRR created from the setup CBCT, simulating potential motions. The latent features of the prior images were incorporated into the PCAT using multi-head cross attention. The neural network aimed to learn to selectively amplify the transmission of the projection image features that correlate with features of the priori. The PCAT network structure consisted of (1) a dual-branch generator that separates the spine and soft tissue component of the kV projection image and (2) a dual-function discriminator (DFD) that provides the realness score of the predicted images. For supervision, we used a loss combining mean absolute error loss, discriminator loss, perceptual loss, total variation, and mean squared error loss for soft tissues. The proposed PCAT approach was benchmarked against previous work using the ResNet generative adversarial network (ResNetGAN) without prior information. Results: The trained PCAT had improved performance in effectively retaining and preserving the spine structure and texture information while suppressing the soft tissues from the kV projection images. The decomposed spine-only x-ray images had the submillimeter matching accuracy at all beam angles. The decomposed spine-only x-ray significantly reduced the maximum errors to 0.44 mm (<2 pixels) in comparison to 0.92 mm (∼4 pixels) of ResNetGAN. The PCAT decomposed spine images also had higher PSNR and SSIM (p-value < 0.001). Conclusion: The PCAT selectively learned the important latent features by incorporating the patient-specific prior knowledge into the deep learning algorithm, significantly improving the robustness of the kV projection image decomposition, and leading to improved motion tracking accuracy in paraspinal SBRT.

Pathological Priors Inspired Network for Vertebral Osteophytes Recognition

Quantifying Axial Spine Images Using Object-Specific Bi-Path Network

Anatomical Prior-Based Vertebral Landmark Detection for Spinal Disorder Diagnosis

Precise Localization for Anatomo-Physiological Hallmarks of the Cervical Spine by Using Neural Memory Ordinary Differential Equation

Robust vertebra identification using simultaneous node and edge predicting Graph Neural Networks

Dynamic Triple Reweighting Network for Automatic Femoral Head Necrosis Diagnosis from Computed Tomography

Vertebrae Labeling via End-to-End Integral Regression Localization and Multi-Label Classification Network

Spinal Osteophyte Detection via Robust Patch Extraction on minimally annotated X-rays

Interpretable vertebral fracture quantification via anchor-free landmarks localization

Part Affinity Fields and CoordConv for Detecting Landmarks of Lumbar Vertebrae and Sacrum in X-ray Images

Exploring Neighbor Spatial Relationships for Enhanced Lumbar Vertebrae Detection in X-ray Images

VertXNet: An Ensemble Method for Vertebrae Segmentation and Identification of Spinal X-Ray

Enhanced deep residual network for bone classification and abnormality detection

Sequence based local–global information fusion framework for vertebrae detection under pathological and FOV variation challenges

SpineOne: A One-Stage Detection Framework for Degenerative Discs and Vertebrae

BX2S-Net: Learning to reconstruct 3D spinal structures from bi-planar X-ray images

Stacked Hourglass Network with a Multi-level Attention Mechanism: Where to Look for Intervertebral Disc Labeling

Patient specific prior cross attention for kV decomposition in paraspinal motion tracking

Keypoints Localization for Joint Vertebra Detection and Fracture Severity Quantification

Detecting ossification of the posterior longitudinal ligament on plain radiographs using a deep convolutional neural network: a pilot study

Residual Block-based Multi-Label Classification and Localization Network with Integral Regression for Vertebrae Labeling