Abstract:PURPOSE: A critical step in adaptive radiotherapy (ART) workflow is deformably registering the simulation CT with the daily or weekly volumetric imaging. Quantifying the deformable image registration accuracy under these circumstances is a complex task due to the lack of known ground-truth landmark correspondences between the source data and target data. Generating landmarks manually (using experts) is time-consuming, and limited by image quality and observer variability. While image similarity metrics (ISM) may be used as an alternative approach to quantify the registration error, there is a need to characterize the ISM values by developing a nonlinear cost function and translate them to physical distance measures in order to enable fast, quantitative comparison of registration performance.METHODS: In this paper, we present a proof-of-concept methodology for automated quantification of DIR performance. A nonlinear cost function was developed as a combination of ISM values and governed by the following two expectations for an accurate registration: (a) the deformed data obtained from transforming the simulation CT data with the deformation vector field (DVF) should match the target image data with near perfect similarity, and (b) the similarity between the simulation CT and deformed data should match the similarity between the simulation CT and the target image data. A deep neural network (DNN) was developed that translated the cost function values to actual physical distance measure. To train the neural network, patient-specific biomechanical models of the head-and-neck anatomy were employed. The biomechanical model anatomy was systematically deformed to represent changes in patient posture and physiological regression. Volumetric source and target images with known ground-truth deformations vector fields were then generated, representing the daily or weekly imaging data. Annotated data was then fed through a supervised machine learning process, iteratively optimizing a nonlinear model able to predict the target registration error (TRE) for given ISM values. The cost function for sub-volumes enclosing critical radiotherapy structures in the head-and-neck region were computed and compared with the ground truth TRE values.RESULTS: When examining different combinations of registration parameters for a single DIR, the neural network was able to quantify DIR error to within a single voxel for 95% of the sub-volumes examined. In addition, correlations between the neural network predicted error and the ground-truth TRE for the Planning Target Volume and the parotid contours were consistently observed to be > 0.9. For variations in posture and tumor regression for 10 different patients, patient-specific neural networks predicted the TRE to within a single voxel > 90% on average.CONCLUSIONS: The formulation presented in this paper demonstrates the ability for fast, accurate quantification of registration performance. DNN provided the necessary level of abstraction to estimate a quantified TRE from the ISM expectations described above, when sufficiently trained on annotated data. In addition, biomechanical models facilitated the DNN with the required variations in the patient posture and physiological regression. With further development and validation on clinical patient data, such networks have potential impact in patient and site-specific optimization, and stream-lining clinical registration validation.

A fast DRR-based image regestrition algorithm for calculation of setup error in radiotherapy

Accuracy of UTE-MRI-based patient setup for brain cancer radiation therapy.

Registration of On-Board X-ray Images with 4DCT: A Proposed Method of Phase and Setup Verification for Gated Radiotherapy

[Accurate 3D free-form registration between fan-beam CT and cone-beam CT].

Accuracy of 2D and 3D Image Auto-Registration Used in Radiotherapy Positioning

Shortening image registration time using a deep neural network for patient positional verification in radiotherapy

A Fast Matching Way Using the Legengre Orthogonal Moment and Application in Image Guided Radiotherapy

Radiotherapy Treatment Based on Binocular Location: Real-Time Monitoring System of Patient Setup Errors

Implementation and evaluation of various demons deformable image registration algorithms on GPU

Isocentric fixed angle irradiation-based DRR: a novel approach to enhance x-ray and CT image registration

A contour-guided deformable image registration algorithm for adaptive radiotherapy

Automatic and fast registration method for image-guided surgery

Analysis of the Setup Errors of Medical Image Registration-Based Cone-Beam Ct for Lung Cancer

DRR acceleration using inexpensive GPUs for model-image registration based joint kinematic measurements

A neural network approach for fast, automated quantification of DIR performance

LandmarkNet: a 2D Digital Radiograph Landmark Estimator for Registration

A New Robust Markerless Method for Automatic Image-to-patient Registration in Image-Guided Neurosurgery System.

A Noninvasive Body Setup Method for Radiotherapy by Using a Multimodal Image Fusion Technique.

Object-constrained meshless deformable algorithm for high speed 3D nonrigid registration between CT and CBCT

Neural Graphics Primitives-based Deformable Image Registration for On-the-fly Motion Extraction

Dynamic coordinate registration method for image-guided surgery.