Abstract:Purpose: High-speed nonrigid registration between the planning CT and the treatment CBCT data is critical for real time image guided radiotherapy (IGRT) to improve the dose distribution and to reduce the toxicity to adjacent organs. The authors propose a new fully automatic 3D registration framework that integrates object-based global and seed constraints with the grayscale-based "demons" algorithm. Methods: Clinical objects were segmented on the planning CT images and were utilized as meshless deformable models during the nonrigid registration process. The meshless models reinforced a global constraint in addition to the grayscale difference between CT and CBCT in order to maintain the shape and the volume of geometrically complex 3D objects during the registration. To expedite the registration process, the framework was stratified into hierarchies, and the authors used a frequency domain formulation to diffuse the displacement between the reference and the target in each hierarchy. Also during the registration of pelvis images, they replaced the air region inside the rectum with estimated pixel values from the surrounding rectal wall and introduced an additional seed constraint to robustly track and match the seeds implanted into the prostate. The proposed registration framework and algorithm were evaluated on 15 real prostate cancer patients. For each patient, prostate gland, seminal vesicle, bladder, and rectum were first segmented by a radiation oncologist on planning CT images for radiotherapy planning purpose. The same radiation oncologist also manually delineated the tumor volumes and critical anatomical structures in the corresponding CBCT images acquired at treatment. These delineated structures on the CBCT were only used as the ground truth for the quantitative validation, while structures on the planning CT were used both as the input to the registration method and the ground truth in validation. By registering the planning CT to the CBCT, a displacement map was generated. Segmented volumes in the CT images deformed using the displacement field were compared against the manual segmentations in the CBCT images to quantitatively measure the convergence of the shape and the volume. Other image features were also used to evaluate the overall performance of the registration. Results: The algorithm was able to complete the segmentation and registration process within 1 min, and the superimposed clinical objects achieved a volumetric similarity measure of over 90% between the reference and the registered data. Validation results also showed that the proposed registration could accurately trace the deformation inside the target volume with average errors of less than 1 mm. The method had a solid performance in registering the simulated images with up to 20 Hounsfield unit white noise added. Also, the side by side comparison with the original demons algorithm demonstrated its improved registration performance over the local pixel-based registration approaches. Conclusions: Given the strength and efficiency of the algorithm, the proposed method has significant clinical potential to accelerate and to improve the CBCT delineation and targets tracking in online IGRT applications.

Deep‐learning‐based joint rigid and deformable contour propagation for magnetic resonance imaging‐guided prostate radiotherapy

Non-rigid Registration of Biomedical Image for Radiotherapy Based on Adaptive Feature Density Flow

Label-driven magnetic resonance imaging (MRI)-transrectal ultrasound (TRUS) registration using weakly supervised learning for MRI-guided prostate radiotherapy

Deformable MR‐CBCT prostate registration using biomechanically constrained deep learning networks

Deformable registration of magnetic resonance images using unsupervised deep learning in neuro-/radiation oncology

Mri-Us Registration Using Label-Driven Weakly-Supervised Learning For Multiparametric Mri-Guided Hdr Prostate Brachytherapy

Deformable MRI-TRUS Registration Using Biomechanically Constrained Deep Learning Model for Tumor-Targeted Prostate Brachytherapy

Joint Registration and Segmentation via Multi-Task Learning for Adaptive Radiotherapy of Prostate Cancer

Biomechanically constrained non-rigid MR-TRUS prostate registration using deep learning based 3D point cloud matching

Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance

MR to ultrasound image registration with segmentation-based learning for HDR prostate brachytherapy

Deformable Image Registration using Unsupervised Deep Learning for CBCT-guided Abdominal Radiotherapy

Validation of a surface-based deformable MRI-3D ultrasound image registration algorithm toward clinical implementation for interstitial prostate brachytherapy

Object-constrained meshless deformable algorithm for high speed 3D nonrigid registration between CT and CBCT

Adversarial optimization for joint registration and segmentation in prostate CT radiotherapy

Weakly Supervised Registration of Prostate MRI and Histopathology Images

Improving accelerated 3D imaging in MRI-guided radiotherapy for prostate cancer using a deep learning method

Inter-fraction Deformable Image Registration Using Unsupervised Deep Learning for CBCT-guided Abdominal Radiotherapy

ProsRegNet: A deep learning framework for registration of MRI and histopathology images of the prostate

Multitask Weakly Supervised Generative Network for MR-US Registration

A deep learning framework for prostate localization in cone beam CT‐guided radiotherapy