Abstract:Purpose: High-speed nonrigid registration between the planning CT and the treatment CBCT data is critical for real time image guided radiotherapy (IGRT) to improve the dose distribution and to reduce the toxicity to adjacent organs. The authors propose a new fully automatic 3D registration framework that integrates object-based global and seed constraints with the grayscale-based "demons" algorithm. Methods: Clinical objects were segmented on the planning CT images and were utilized as meshless deformable models during the nonrigid registration process. The meshless models reinforced a global constraint in addition to the grayscale difference between CT and CBCT in order to maintain the shape and the volume of geometrically complex 3D objects during the registration. To expedite the registration process, the framework was stratified into hierarchies, and the authors used a frequency domain formulation to diffuse the displacement between the reference and the target in each hierarchy. Also during the registration of pelvis images, they replaced the air region inside the rectum with estimated pixel values from the surrounding rectal wall and introduced an additional seed constraint to robustly track and match the seeds implanted into the prostate. The proposed registration framework and algorithm were evaluated on 15 real prostate cancer patients. For each patient, prostate gland, seminal vesicle, bladder, and rectum were first segmented by a radiation oncologist on planning CT images for radiotherapy planning purpose. The same radiation oncologist also manually delineated the tumor volumes and critical anatomical structures in the corresponding CBCT images acquired at treatment. These delineated structures on the CBCT were only used as the ground truth for the quantitative validation, while structures on the planning CT were used both as the input to the registration method and the ground truth in validation. By registering the planning CT to the CBCT, a displacement map was generated. Segmented volumes in the CT images deformed using the displacement field were compared against the manual segmentations in the CBCT images to quantitatively measure the convergence of the shape and the volume. Other image features were also used to evaluate the overall performance of the registration. Results: The algorithm was able to complete the segmentation and registration process within 1 min, and the superimposed clinical objects achieved a volumetric similarity measure of over 90% between the reference and the registered data. Validation results also showed that the proposed registration could accurately trace the deformation inside the target volume with average errors of less than 1 mm. The method had a solid performance in registering the simulated images with up to 20 Hounsfield unit white noise added. Also, the side by side comparison with the original demons algorithm demonstrated its improved registration performance over the local pixel-based registration approaches. Conclusions: Given the strength and efficiency of the algorithm, the proposed method has significant clinical potential to accelerate and to improve the CBCT delineation and targets tracking in online IGRT applications.

Multiple Segmentation for Medical 2D/3D Registration

2D-3D Medical Image Registration Based on Modified Sum of Local Normalized Correlation

SGReg: segmentation guided 3D/2D rigid registration for orthogonal x-ray and CT images in spine surgery navigation

Multi-step 3D/2D Image Registration for Image-guided Spinal Surgery

Anatomy-guided multimodal registration by learning segmentation without ground truth: Application to intraprocedural CBCT/MR liver segmentation and registration

Segmentation Guided Registration for 3D Spectral-Domain Optical Coherence Tomography Images.

Multi-Step 2D/3D Image Registration in Image-Guided Spine Surgery

A New 3d Multi-Modality Medical Bone Image Registration Algorithm

Machine learning for automated and real-time two-dimensional to three-dimensional registration of the spine using a single radiograph

2D/3D registration based on biplanar X-ray and CT images for surgical navigation

Object-constrained meshless deformable algorithm for high speed 3D nonrigid registration between CT and CBCT

Personalized X-ray Reconstruction of the Proximal Femur Via a New Control Point-based 2D-3D Registration and Residual Complexity Minimization.

An efficient two-step multi-organ registration on abdominal CT via deep-learning based segmentation

2D/3D registration and motion tracking for surgical interventions

Fully automated 2D-3D registration and verification

Automatic Registration Between Reference And On-Board Digital Tomosynthesis Images For Positioning Verification

One registration is worth two segmentations

Registration and Segmentation of Multimodality Images for Post Processing of Skeleton in Preclinical Oncology Studies

Registration-based automatic 3D segmentation of cardiac CT images

Conditional Segmentation in Lieu of Image Registration

Medical Image Elastic Registration Using Local Region Constraints