Abstract:We propose FlowReg, a deep learning-based framework for unsupervised image registration for neuroimaging applications. The system is composed of two architectures that are trained sequentially: FlowReg-A which affinely corrects for gross differences between moving and fixed volumes in 3D followed by FlowReg-O which performs pixel-wise deformations on a slice-by-slice basis for fine tuning in 2D. The affine network regresses the 3D affine matrix based on a correlation loss function that enforces global similarity. The deformable network operates on 2D image slices based on the optical flow network FlowNet-Simple but with three loss components. The photometric loss minimizes pixel intensity differences differences, the smoothness loss encourages similar magnitudes between neighbouring vectors, and a correlation loss that is used to maintain the intensity similarity between fixed and moving image slices. The proposed method is compared to four open source registration techniques ANTs, Demons, SE, and Voxelmorph. In total, 4643 FLAIR MR imaging volumes are used from dementia and vascular disease cohorts, acquired from over 60 international centres with varying acquisition parameters. A battery of quantitative novel registration validation metrics are proposed that focus on the structural integrity of tissues, spatial alignment, and intensity similarity. Experimental results show FlowReg (FlowReg-A+O) performs better than iterative-based registration algorithms for intensity and spatial alignment metrics with a Pixelwise Agreement of 0.65, correlation coefficient of 0.80, and Mutual Information of 0.29. Among the deep learning frameworks, FlowReg-A or FlowReg-A+O provided the highest performance over all but one of the metrics. Results show that FlowReg is able to obtain high intensity and spatial similarity while maintaining the shape and structure of anatomy and pathology.

Robust Deformable Medical Image Registration Using Optical Flow and Multilevel Free Form Deformation

Non-rigid Registration of Biomedical Image for Radiotherapy Based on Adaptive Feature Density Flow

Non-rigid medical image registration using optical flow and locally-refined multilevel free form deformation

Medical Image Elastic Registration Based on Contour and Feature Points

Non-rigid Medical Image Registration Based on Improved Optical Flow Method and Scale-invariant Feature Transform

Non-rigid Registration Algorithm Based on Modally Controlled Free Form Deformation

Optical Flow with Learning Feature for Deformable Medical Image Registration

A Nonrigid Registration Method for Correcting Brain Deformation Induced by Tumor Resection.

Study on Non-Rigid Medical Image Registration Based on Optical Flow Model

Optical Flow Model Based on Medical Image Registration

Registration using sparse free-form deformations.

A Non-Rigid Image Registration Method Based on Multi-Level B-spline and L2-regularization

Multi-modality Liver Image Registration Based on Multilevel B-splines Free-Form Deformation and L-BFGS Optimal Algorithm

Non-Rigid Multi-Modal 3D Medical Image Registration Based on Foveated Modality Independent Neighborhood Descriptor.

Free-form deformation based non-rigid registration on breast cancer MR imaging

Medical Image Registration Algorithm in Image-Guided Noninvasive Surgery

A point based non-rigid registration for tumor resection using iMRI

FlowReg: Fast Deformable Unsupervised Medical Image Registration using Optical Flow

An Unsupervised Registration Method for Brain Images Based on Contour Guidance

A Non-Rigid Cardiac Image Registration Method Based on an Optical Flow Model

Finite Element Approach Driven by Mutual Information for Medical Image Registration