Abstract:Background and objectives: Deep learning is being increasingly used for deformable image registration and unsupervised approaches, in particular, have shown great potential. However, the registration of abdominopelvic Computed Tomography (CT) images remains challenging due to the larger displacements compared to those in brain or prostate Magnetic Resonance Imaging datasets that are typically considered as benchmarks. In this study, we investigate the use of the commonly used unsupervised deep learning framework VoxelMorph for the registration of a longitudinal abdominopelvic CT dataset acquired in patients with bone metastases from breast cancer. Methods: As a pre-processing step, the abdominopelvic CT images were refined by automatically removing the CT table and all other extra-corporeal components. To improve the learning capabilities of the VoxelMorph framework when only a limited amount of training data is available, a novel incremental training strategy is proposed based on simulated deformations of consecutive CT images in the longitudinal dataset. This devised training strategy was compared against training on simulated deformations of a single CT volume. A widely used software toolbox for deformable image registration called NiftyReg was used as a benchmark. The evaluations were performed by calculating the Dice Similarity Coefficient (DSC) between manual vertebrae segmentations and the Structural Similarity Index (SSIM). Results: The CT table removal procedure allowed both VoxelMorph and NiftyReg to achieve significantly better registration performance. In a 4-fold cross-validation scheme, the incremental training strategy resulted in better registration performance compared to training on a single volume, with a mean DSC of 0.929±0.037 and 0.883±0.033, and a mean SSIM of 0.984±0.009 and 0.969±0.007, respectively. Although our deformable image registration method did not outperform NiftyReg in terms of DSC (0.988±0.003) or SSIM (0.995±0.002), the registrations were approximately 300 times faster. Conclusions: This study showed the feasibility of deep learning based deformable registration of longitudinal abdominopelvic CT images via a novel incremental training strategy based on simulated deformations.

MA-VoxelMorph: Multi-scale Attention-based VoxelMorph for Non-Rigid Registration of Thoracoabdominal CT Images

MA-VoxelMorph: Multi-scale attention-based VoxelMorph for nonrigid registration of thoracoabdominal CT images

Multi-phase Deformable Registration for Time-dependent Abdominal Organ Variations

Deformable registration of chest CT images using a 3D convolutional neural network based on unsupervised learning

Voxelmorph++ Going beyond the cranial vault with keypoint supervision and multi-channel instance optimisation

VoxelMorph++: a Convolutional Neural Network Architecture for Unsupervised CBCT to CT Deformable Image Registration

Hierarchical Anatomical Structure-Aware Based Thoracic CT Images Registration

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.

An efficient two-step multi-organ registration on abdominal CT via deep-learning based segmentation

3D deformable registration of longitudinal abdominopelvic CT images using unsupervised deep learning

Residual Aligner-based Network (RAN): Motion-separable structure for coarse-to-fine discontinuous deformable registration

Deformable Lung CT Registration by Decomposing Large Deformation

Deformable Image Registration using Unsupervised Deep Learning for CBCT-guided Abdominal Radiotherapy

CvTMorph: Improving Local Feature Extraction in Medical Image Registration for Respiratory Motion Modeling with Convolutional Vision Transformer

Dual attention network for unsupervised medical image registration based on VoxelMorph

Non-rigid Registration Algorithm Based on Modally Controlled Free Form Deformation

Residual Aligner Network

CMAN: Cascaded Multi-scale Spatial Channel Attention-guided Network for large 3D deformable registration of liver CT images

Multi-Task Learning for Registering Images with Large Deformation.

A hybrid deformable registration method to generate motion-compensated 3D virtual MRI for fusion with interventional real-time 3D ultrasound

Diffeomorphic Transformer-based Abdomen MRI-CT Deformable Image Registration