Abstract:Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as “modalities”). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the imaging content across modalities. Inter- and intra-modality affine and non-rigid image registration is an essential medical image analysis process in clinical imaging, as for example before imaging biomarkers need to be derived and clinically evaluated across different MRI modalities, time phases and slices. Although commonly needed in real clinical scenarios, affine and non-rigid image registration is not extensively investigated using a single unsupervised model architecture. In our work, we present an unsupervised deep learning registration methodology that can accurately model affine and non-rigid transformations, simultaneously. Moreover, inverse-consistency is a fundamental inter-modality registration property that is not considered in deep learning registration algorithms. To address inverse consistency, our methodology performs bi-directional cross-modality image synthesis to learn modality-invariant latent representations, and involves two factorised transformation networks (one per each encoder-decoder channel) and an inverse-consistency loss to learn topology-preserving anatomical transformations. Overall, our model (named “FIRE”) shows improved performances against the reference standard baseline method (i.e., Symmetric Normalization implemented using the ANTs toolbox) on multi-modality brain 2D and 3D MRI and intra-modality cardiac 4D MRI data experiments. We focus on explaining model-data components to enhance model explainability in medical image registration. On computational time experiments, we show that the FIRE model performs on a memory-saving mode, as it can inherently learn topology-preserving image registration directly in the training phase. We therefore demonstrate an efficient and versatile registration technique that can have merit in multi-modal image registrations in the clinical setting.

Digital Analysis of Smart Registration Methods for Magnetic Resonance Images in Public Healthcare

An Image Registration Approach Based on 3D Geometric Projection Similarity of the Human Head

Evaluation of Five Diffeomorphic Image Registration Algorithms for Mouse Brain Magnetic Resonance Microscopy.

A Reproducible Comparative Study on Registration Packages for Toddler MRI Images

Cerebral ASL, SPECT and MRI image registration, enhancing fusion and joint analysis system

Methodological Research on Image Registration Based on Human Brain Tissue in Vivo

NRAAF: A Framework for Comparative Analysis of fMRI Registration Algorithms and Their Impact on Resting-State Neuroimaging Accuracy

MRI-PET Registration with Automated Algorithm in Pre-clinical Studies

Analysis of cerebral ischemia MRI images using non-rigid registration

Detecting Brain Structural Changes As Biomarker from Magnetic Resonance Images Using a Local Feature Based SVM Approach.

Adaptive Independent Subspace Analysis of Brain Magnetic Resonance Imaging Data

Multimodal 3D Image Registration for Mapping Brain Disorders

Mutual information based three-dimensional registration of rat brain magnetic resonance imaging time-series

A More Robust Method for Multi-modality Medical Image Registration

3D MRI Image Super-Resolution for Brain Combining Rigid and Large Diffeomorphic Registration

3D registration of MR image sequence of human brain based on normalized mutual information

DeepMapi: a Fully Automatic Registration Method for Mesoscopic Optical Brain Images Using Convolutional Neural Networks

Research on Medical Image Registration Algorithm Based on Double Immunolabeling Technology

Unsupervised Image Registration towards Enhancing Performance and Explainability in Cardiac and Brain Image Analysis

Deep learning facilitates fully automated brain image registration of optoacoustic tomography and magnetic resonance imaging

Automatic Alignment of Brain MR Scout Scans Using Data-Adaptive Multi-Structural Model