Abstract:Purpose: High-speed nonrigid registration between the planning CT and the treatment CBCT data is critical for real time image guided radiotherapy (IGRT) to improve the dose distribution and to reduce the toxicity to adjacent organs. The authors propose a new fully automatic 3D registration framework that integrates object-based global and seed constraints with the grayscale-based "demons" algorithm. Methods: Clinical objects were segmented on the planning CT images and were utilized as meshless deformable models during the nonrigid registration process. The meshless models reinforced a global constraint in addition to the grayscale difference between CT and CBCT in order to maintain the shape and the volume of geometrically complex 3D objects during the registration. To expedite the registration process, the framework was stratified into hierarchies, and the authors used a frequency domain formulation to diffuse the displacement between the reference and the target in each hierarchy. Also during the registration of pelvis images, they replaced the air region inside the rectum with estimated pixel values from the surrounding rectal wall and introduced an additional seed constraint to robustly track and match the seeds implanted into the prostate. The proposed registration framework and algorithm were evaluated on 15 real prostate cancer patients. For each patient, prostate gland, seminal vesicle, bladder, and rectum were first segmented by a radiation oncologist on planning CT images for radiotherapy planning purpose. The same radiation oncologist also manually delineated the tumor volumes and critical anatomical structures in the corresponding CBCT images acquired at treatment. These delineated structures on the CBCT were only used as the ground truth for the quantitative validation, while structures on the planning CT were used both as the input to the registration method and the ground truth in validation. By registering the planning CT to the CBCT, a displacement map was generated. Segmented volumes in the CT images deformed using the displacement field were compared against the manual segmentations in the CBCT images to quantitatively measure the convergence of the shape and the volume. Other image features were also used to evaluate the overall performance of the registration. Results: The algorithm was able to complete the segmentation and registration process within 1 min, and the superimposed clinical objects achieved a volumetric similarity measure of over 90% between the reference and the registered data. Validation results also showed that the proposed registration could accurately trace the deformation inside the target volume with average errors of less than 1 mm. The method had a solid performance in registering the simulated images with up to 20 Hounsfield unit white noise added. Also, the side by side comparison with the original demons algorithm demonstrated its improved registration performance over the local pixel-based registration approaches. Conclusions: Given the strength and efficiency of the algorithm, the proposed method has significant clinical potential to accelerate and to improve the CBCT delineation and targets tracking in online IGRT applications.

3D Lightweight Network for Simultaneous Registration and Segmentation of Organs-at-Risk in CT Images of Head and Neck Cancer

Comprehensive and Clinically Accurate Head and Neck Organs at Risk Delineation Via Stratified Deep Learning: A Large-scale Multi-Institutional Study

Comprehensive and Clinically Accurate Head and Neck Cancer Organs-at-risk Delineation on a Multi-Institutional Study

Organ at Risk Segmentation in Head and Neck CT Images Using a Two-Stage Segmentation Framework Based on 3D U-Net

Fully Automatic Multi-Organ Segmentation for Head and Neck Cancer Radiotherapy Using Shape Representation Model Constrained Fully Convolutional Neural Networks

Automated CT Segmentation for Rapid Assessment of Anatomical Variations in Head-and-neck Radiation Therapy.

A unified 3D framework for Organs at Risk Localization and Segmentation for Radiation Therapy Planning

Organ-at-Risk (OAR) Segmentation in Head and Neck CT Using U-RCNN

Automated Delineation of Head and Neck Organs at Risk Using Synthetic MRI-aided Mask Scoring Regional Convolutional Neural Network

Dual Shape Guided Segmentation Network for Organs-at-Risk in Head and Neck CT Images

Head-and-neck Organs-at-risk Auto-Delineation Using Dual Pyramid Networks for CBCT-guided Adaptive Radiotherapy

Clinically Applicable Deep Learning Framework for Organs at Risk Delineation in CT Images

DeepIGeoS-V2 - Deep Interactive Segmentation of Multiple Organs from Head and Neck Images with Lightweight CNNs.

Residual Mask Scoring Regional Convolutional Neural Network for Multi-Organ Segmentation in Head-and-neck CT

Prior Attention Enhanced Convolutional Neural Network Based Automatic Segmentation of Organs at Risk for Head and Neck Cancer Radiotherapy.

Object-constrained meshless deformable algorithm for high speed 3D nonrigid registration between CT and CBCT

Automatic segmentation of the clinical target volume and organs at risk for rectal cancer radiotherapy using structure-contextual representations based on 3D high-resolution network

Multi-View Spatial Aggregation Framework for Joint Localization and Segmentation of Organs at Risk in Head and Neck CT Images

Multi-organ Segmentation in Head and Neck MRI Using U-Faster-RCNN.

Automatic Segmentation of Head-Neck Organs by Multi-mode CNNs for Radiation Therapy

Region Proposal Network for Multi-Organ Segmentation in CT for Pancreatic Radiotherapy