Abstract:PurposeTo develop an accurate and fast deformable image registration (DIR) method for four‐dimensional computed tomography (4D‐CT) lung images. Deep learning‐based methods have the potential to quickly predict the deformation vector field (DVF) in a few forward predictions. We have developed an unsupervised deep learning method for 4D‐CT lung DIR with excellent performances in terms of registration accuracies, robustness, and computational speed.MethodsA fast and accurate 4D‐CT lung DIR method, namely LungRegNet, was proposed using deep learning. LungRegNet consists of two subnetworks which are CoarseNet and FineNet. As the name suggests, CoarseNet predicts large lung motion on a coarse scale image while FineNet predicts local lung motion on a fine scale image. Both the CoarseNet and FineNet include a generator and a discriminator. The generator was trained to directly predict the DVF to deform the moving image. The discriminator was trained to distinguish the deformed images from the original images. CoarseNet was first trained to deform the moving images. The deformed images were then used by the FineNet for FineNet training. To increase the registration accuracy of the LungRegNet, we generated vessel‐enhanced images by generating pulmonary vasculature probability maps prior to the network prediction.ResultsWe performed fivefold cross validation on ten 4D‐CT datasets from our department. To compare with other methods, we also tested our method using separate 10 DIRLAB datasets that provide 300 manual landmark pairs per case for target registration error (TRE) calculation. Our results suggested that LungRegNet has achieved better registration accuracy in terms of TRE than other deep learning‐based methods available in the literature on DIRLAB datasets. Compared to conventional DIR methods, LungRegNet could generate comparable registration accuracy with TRE smaller than 2 mm. The integration of both the discriminator and pulmonary vessel enhancements into the network was crucial to obtain high registration accuracy for 4D‐CT lung DIR. The mean and standard deviation of TRE were 1.00 ± 0.53 mm and 1.59 ± 1.58 mm on our datasets and DIRLAB datasets respectively.ConclusionsAn unsupervised deep learning‐based method has been developed to rapidly and accurately register 4D‐CT lung images. LungRegNet has outperformed its deep‐learning‐based peers and achieved excellent registration accuracy in terms of TRE.

Deformable Lung CT Registration by Decomposing Large Deformation

Deformable registration of chest CT images using a 3D convolutional neural network based on unsupervised learning

CNN-based Lung CT Registration with Multiple Anatomical Constraints

Respiratory Deformation Registration in 4D-Ct/cone Beam CT Using Deep Learning.

A Study on the Deformable Image Registration Based on the Tissue Features of Lungs

Deformable Image Registration of Chest CT Using Deep Cycle Network.

Deformable Lung 4DCT Image Registration Via Landmark-Driven Cycle Network

Estimation of Large Motion in Lung CT by Integrating Regularized Keypoint Correspondences into Dense Deformable Registration

CDIDN: A Registration Model with High Deformation Impedance Capability for Long-Term Tracking of Pulmonary Lesion Dynamics

CCMNet: Cross-scale correlation-aware mapping network for 3D lung CT image registration

Learning Deformable Point Set Registration with Regularized Dynamic Graph CNNs for Large Lung Motion in COPD Patients

Boundary-aware registration network for 4D-CT lung image with sliding motion

Residual Aligner-based Network (RAN): Motion-separable structure for coarse-to-fine discontinuous deformable registration

Fluid registration between lung CT and stationary chest tomosynthesis images

Physics-informed motion registration of lung parenchyma across static CT images

LungRegNet: an Unsupervised Deformable Image Registration Method for 4D-CT Lung.

Multi-phase Deformable Registration for Time-dependent Abdominal Organ Variations

ORRN: An ODE-based Recursive Registration Network for Deformable Respiratory Motion Estimation with Lung 4DCT Images

DART: DEFORMABLE ANATOMY-AWARE REGISTRATION TOOLKIT FOR LUNG CT REGISTRATION WITH KEYPOINTS SUPERVISION

Uncertain Prediction of Deformable Image Registration on Lung CT Using Multi-Category Features and Supervised Learning

MA-VoxelMorph: Multi-scale attention-based VoxelMorph for nonrigid registration of thoracoabdominal CT images