Geometry of Image Registration: The Diffeomorphism Group and Momentum Maps

Martins Bruveris,Darryl D. Holm

DOI: https://doi.org/10.48550/arXiv.1306.6854

2013-10-31

Abstract:These lecture notes explain the geometry and discuss some of the analytical questions underlying image registration within the framework of large deformation diffeomorphic metric mapping (LDDMM) used in computational anatomy.

Differential Geometry

What problem does this paper attempt to address?

The Momentum Map Representation of Images.

M. Bruveris,F. Gay-Balmaz,D. D. Holm,T. S. Ratiu

DOI: https://doi.org/10.1007/s00332-010-9079-5

2010-01-01

Journal of Nonlinear Science

Abstract:This paper discusses the mathematical framework for designing methods of Large Deformation Diffeomorphic Matching (LDM) for image registration in computational anatomy. After reviewing the geometrical framework of LDM image registration methods, we prove a theorem showing that these methods may be designed by using the actions of diffeomorphisms on the image data structure to define their associated momentum representations as (cotangent-lift) momentum maps. To illustrate its use, the momentum map theorem is shown to recover the known algorithms for matching landmarks, scalar images, and vector fields. After briefly discussing the use of this approach for diffusion tensor (DT) images, we explain how to use momentum maps in the design of registration algorithms for more general data structures. For example, we extend our methods to determine the corresponding momentum map for registration using semidirect product groups, for the purpose of matching images at two different length scales. Finally, we discuss the use of momentum maps in the design of image registration algorithms when the image data is defined on manifolds instead of vector spaces.
Sliding at first order: Higher-order momentum distributions for discontinuous image registration

Lili Bao,Jiahao Lu,Shihui Ying,Stefan Sommer

2023-03-14

Abstract:In this paper, we propose a new approach to deformable image registration that captures sliding motions. The large deformation diffeomorphic metric mapping (LDDMM) registration method faces challenges in representing sliding motion since it per construction generates smooth warps. To address this issue, we extend LDDMM by incorporating both zeroth- and first-order momenta with a non-differentiable kernel. This allows to represent both discontinuous deformation at switching boundaries and diffeomorphic deformation in homogeneous regions. We provide a mathematical analysis of the proposed deformation model from the viewpoint of discontinuous systems. To evaluate our approach, we conduct experiments on both artificial images and the publicly available DIR-Lab 4DCT dataset. Results show the effectiveness of our approach in capturing plausible sliding motion.

Optimization and Control,Computer Vision and Pattern Recognition
Sliding at First-Order: Higher-Order Momentum Distributions for Discontinuous Image Registration

Lili Bao,Jiahao Lu,Shihui Ying,Stefan Sommer

DOI: https://doi.org/10.1137/23m1558665

IF: 1.938

2024-04-09

SIAM Journal on Imaging Sciences

Abstract:SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 861-887, June 2024. In this paper, we propose a new approach to deformable image registration that captures sliding motions. The large deformation diffeomorphic metric mapping (LDDMM) registration method faces challenges in representing sliding motion since it per construction generates smooth warps. To address this issue, we extend LDDMM by incorporating both zeroth- and first-order momenta with a nondifferentiable kernel. This allows us to represent both discontinuous deformation at switching boundaries and diffeomorphic deformation in homogeneous regions. We provide a mathematical analysis of the proposed deformation model from the viewpoint of discontinuous systems. To evaluate our approach, we conduct experiments on both artificial images and the publicly available DIR-Lab 4DCT dataset. Results show the effectiveness of our approach in capturing plausible sliding motion.

mathematics, applied,computer science, software engineering, artificial intelligence,imaging science & photographic technology
Frequency Diffeomorphisms for Efficient Image Registration

Miaomiao Zhang,Ruizhi Liao,Adrian V. Dalca,Esra A. Turk,Jie Luo,P. Ellen Grant,Polina Golland

DOI: https://doi.org/10.1007/978-3-319-59050-9_44

2017-01-01

Abstract:This paper presents an efficient algorithm for large deformation diffeomorphic metric mapping (LDDMM) with geodesic shooting for image registration. We introduce a novel finite dimensional Fourier representation of diffeomorphic deformations based on the key fact that the high frequency components of a diffeomorphism remain stationary throughout the integration process when computing the deformation associated with smooth velocity fields. We show that manipulating high dimensional diffeomorphisms can be carried out entirely in the bandlimited space by integrating the nonstationary low frequency components of the displacement field. This insight substantially reduces the computational cost of the registration problem. Experimental results show that our method is significantly faster than the state-of-the-art diffeomorphic image registration methods while producing equally accurate alignment. We demonstrate our algorithm in two different applications of image registration: neuroimaging and in-utero imaging.
An optimal control approach for deformable registration

Gabriel L Hart, Christopher Zach, Marc Niethammer

2009-06-20

Abstract:This paper addresses large-displacement-diffeomorphic mapping registration from an optimal control perspective. This viewpoint leads to two complementary formulations. One approach requires the explicit computation of coordinate maps, whereas the other is formulated strictly in the image domain (thus making it also applicable to manifolds which require multiple coordinate charts). We discuss their intrinsic relation as well as the advantages and disadvantages of the two approaches. Further, we propose a novel formulation for unbiased image registration, which naturally extends to the case of time-series of images. We discuss numerical implementation details and carefully evaluate the properties of the alternative algorithms.
Registration Uncertainty Quantification Via Low-Dimensional Characterization of Geometric Deformations.

Jian Wang,William M. Wells,Polina Golland,Miaomiao Zhang

DOI: https://doi.org/10.1016/j.mri.2019.05.034

IF: 3.13

2019-01-01

Magnetic Resonance Imaging

Abstract:This paper presents an efficient approach to quantifying image registration uncertainty based on a low-dimensional representation of geometric deformations. In contrast to previous methods, we develop a Bayesian diffeomorphic registration framework in a bandlimited space, rather than a high-dimensional image space. We show that a dense posterior distribution on deformation fields can be fully characterized by much fewer parameters, which dramatically reduces the computational complexity of model inferences. To further avoid heavy computation loads introduced by random sampling algorithms, we approximate a marginal posterior by using Laplace's method at the optimal solution of log-posterior distribution. Experimental results on both 2D synthetic data and real 3D brain magnetic resonance imaging (MRI) scans demonstrate that our method is significantly faster than the state-of-the-art diffeomorphic registration uncertainty quantification algorithms, while producing comparable results.
A discretize–optimize approach for lddmm registration

Thomas Polzin, Marc Niethammer, François-Xavier Vialard, Jan Modersitzki

2020-01-01

Abstract:Large deformation diffeomorphic metric mapping (LDDMM) is a popular approach for deformable image registration with nice mathematical properties. LDDMM encodes spatial deformations through time-varying velocity fields. Hence registration requires optimization over these time-varying velocity fields, resulting in a large-scale constrained optimization problem.Typical numerical solution approaches for LDDMM use an optimize–discretize strategy, where optimality conditions are derived in the continuum and subsequently discretized and solved. Here we explore solution methods based on the discretize–optimize approach and discuss ramifications for popular LDDMM relaxation and shooting approaches. The focus is on a consistent method that uses the appropriate Runge–Kutta methods for the solution of all arising PDEs in the Eulerian frame. Additionally, we discuss both run-time and memory consumption …
A Novel Diffeomorphic Model for Image Registration and Its Algorithm

Daoping Zhang,Ke Chen

DOI: https://doi.org/10.1007/s10851-018-0811-3

IF: 1.627

2018-04-10

Journal of Mathematical Imaging and Vision

Abstract:In this work, we investigate image registration by mapping one image to another in a variational framework and focus on both model robustness and solver efficiency. We first propose a new variational model with a special regularizer, based on the quasi-conformal theory, which can guarantee that the registration map is diffeomorphic. It is well known that when the deformation is large, many variational models including the popular diffusion model cannot ensure diffeomorphism. One common observation is that the fidelity error appears small while the obtained transform is incorrect by way of mesh folding. However, direct reformulation from the Beltrami framework does not lead to effective models; our new regularizer is constructed based on this framework and added to the diffusion model to get a new model, which can achieve diffeomorphism. However, the idea is applicable to a wide class of models. We then propose an iterative method to solve the resulting nonlinear optimization problem and prove the convergence of the method. Numerical experiments can demonstrate that the new model can not only get a diffeomorphic registration even when the deformation is large, but also possess the accuracy in comparing with the currently best models.

mathematics, applied,computer science, software engineering, artificial intelligence
GRAM: A framework for geodesic registration on anatomical manifolds

Jihun Hamm,Dong Hye Ye,Ragini Verma,Christos Davatzikos

DOI: https://doi.org/10.1016/j.media.2010.06.001

Abstract:Medical image registration is a challenging problem, especially when there is large anatomical variation in the anatomies. Geodesic registration methods have been proposed to solve the large deformation registration problem. However, analytically defined geodesic paths may not coincide with biologically plausible paths of registration, since the manifold of diffeomorphisms is immensely broader than the manifold spanned by diffeomorphisms between real anatomies. In this paper, we propose a novel framework for large deformation registration using the learned manifold of anatomical variation in the data. In this framework, a large deformation between two images is decomposed into a series of small deformations along the shortest path on an empirical manifold that represents anatomical variation. Using a manifold learning technique, the major variation of the data can be visualized by a low-dimensional embedding, and the optimal group template is chosen as the geodesic mean on the manifold. We demonstrate the advantages of the proposed framework over direct registration with both simulated and real databases of brain images.
Probabilistic diffeomorphic registration: Representing uncertainty

Demian Wassermann, Matthew Toews, Marc Niethammer, William Wells Iii

2014-07-07

Abstract:This paper presents a novel mathematical framework for representing uncertainty in large deformation diffeomorphic image registration. The Bayesian posterior distribution over the deformations aligning a moving and a fixed image is approximated via a variational formulation. A stochastic differential equation (SDE) modeling the deformations as the evolution of a time-varying velocity field leads to a prior density over deformations in the form of a Gaussian process. This permits estimating the full posterior distribution in order to represent uncertainty, in contrast to methods in which the posterior is approximated via Monte Carlo sampling or maximized in maximum a-posteriori (MAP) estimation. The framework is demonstrated in the case of landmark-based image registration, including simulated data and annotated pre and intra-operative 3D images.
Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Cong Liu,Longhua Ma,Zheming Lu,Xiance Jin,Jingyun Xu

DOI: https://doi.org/10.1049/el.2018.6713

2019-01-01

Electronics Letters

Abstract:Multimodal medical image registration remains a challenging problem when strong appearance variations and imprecise alignment exist in images. Previous deep network approaches cannot handle such a high degree of variability and prohibit the use of strong geometric constraints. The authors introduce a novel deep architecture that not only produces image representations that are well-suited for this challenging task, but also leverages knowledge of the geometry constraints for robust registration. By enforcing the representations of different modalities living in a common semantic space, they obtain convolutional features tending to respond to object parts consistently across modality. This yields a unique description for all object fragments and allows the end user to know the model's decision process, whereas most existing models remain unclear and difficult to explain. By using the differentiable spatial transformer to compensate transform, they integrate geometric consensus into the cost function to enable end-to-end model optimisation which has not yet been exploited before. The authors evaluate their method on a very challenging medical image dataset. Experiments demonstrate that the proposed method provides a plausible representation and outperforms state-of-the-art approaches by a significant margin.
Diffeomorphic Image Registration with an Optimal Control Relaxation and Its Implementation

Jianping Zhang,Yanyan Li

DOI: https://doi.org/10.1137/21M1391274

IF: 1.938

2021-12-15

SIAM Journal on Imaging Sciences

Abstract:SIAM Journal on Imaging Sciences, Volume 14, Issue 4, Page 1890-1931, January 2021. Image registration has played an important role in image processing problems, especially in medical imaging applications. It is well known that when the deformation is large, many variational models cannot ensure diffeomorphism. In this paper, we propose a new registration model based on an optimal control relaxation constraint for large deformation images, which can theoretically guarantee that the registration mapping is diffeomorphic. We present an analysis of optimal control relaxation for indirectly seeking the diffeomorphic transformation of the Jacobian determinant equation and its registration applications, including the construction of diffeomorphic transformation as a special space. We also provide an existence result for the control increment optimization problem in the proposed diffeomorphic image registration model with an optimal control relaxation. Furthermore, a fast iterative scheme based on the augmented Lagrangian multipliers method (ALMM) is analyzed to solve the control increment optimization problem, and a convergence analysis follows. Finally, a grid unfolding indicator is given, and a robust solving algorithm for using the deformation correction and backtrack strategy is proposed to guarantee that the solution is diffeomorphic. Numerical experiments show that the registration model we propose not only obtains a diffeomorphic mapping when the deformation is large but also achieves a state-of-the-art performance in quantitative evaluations that is comparable to that of other classical models.

mathematics, applied,computer science, software engineering, artificial intelligence,imaging science & photographic technology
Shape analysis via gradient flows on diffeomorphism groups

Tracey Balehowsky,Carl-Joar Karlsson,Klas Modin

DOI: https://doi.org/10.1088/1361-6544/aca73c

2022-12-20

Nonlinearity

Abstract:We study a Riemannian gradient flow on Sobolev diffeomorphisms for the problem of image registration. The energy functional quantifies the effect of transforming a template to a target, while also penalizing non-isometric deformations. The main result is well-posedness of the flow. We also give a geometric description of the gradient in terms of the momentum map.

mathematics, applied,physics, mathematical
Robust Diffeomorphic Mapping Via Geodesically Controlled Active Shapes

Daniel J. Tward,Jun Ma,Michael I. Miller,Laurent Younes

DOI: https://doi.org/10.1155/2013/205494

2013-01-01

International Journal of Biomedical Imaging

Abstract:This paper presents recent advances in the use of diffeomorphic active shapes which incorporate the conservation laws of large deformation diffeomorphic metric mapping. The equations of evolution satisfying the conservation law are geodesics under the diffeomorphism metric and therefore termed geodesically controlled diffeomorphic active shapes (GDAS). Our principal application in this paper is on robust diffeomorphic mapping methods based on parameterized surface representations of subcortical template structures. Our parametrization of the GDAS evolution is via the initial momentum representation in the tangent space of the template surface. The dimension of this representation is constrained using principal component analysis generated from training samples. In this work, we seek to use template surfaces to generate segmentations of the hippocampus with three data attachment terms: surface matching, landmark matching, and inside-outside modeling from grayscale T1 MR imaging data. This is formulated as an energy minimization problem, where energy describes shape variability and data attachment accuracy, and we derive a variational solution. A gradient descent strategy is employed in the numerical optimization. For the landmark matching case, we demonstrate the robustness of this algorithm as applied to the workflow of a large neuroanatomical study by comparing to an existing diffeomorphic landmark matching algorithm.
Efficient Diffeomorphic Metric Image Registration Via Stationary Velocity.

Xianfeng Yang,Jian Yang

DOI: https://doi.org/10.1016/j.jocs.2018.11.011

IF: 3.817

2018-01-01

Journal of Computational Science

Abstract:Diffeomorphic image registration is a fundamental tool for MRI analysis, and fast growing image data demand highly efficient registration methods. Stationary velocity based method has much faster speed than non-stationary one in producing diffeomorphism, but how to achieve validity for large deformation while keeping its efficiency remains to be solved. To this end, we have proposed a new simplified model for optimal stationary velocity by representing temporal integration form of transformation variation via a single point model, e.g. the middle time point, according to mean value theorem and smoothness of transformation. This model can maintain the same registration accuracy as integral model but reduce the time cost a lot. It also shows as a better strategy than first order approximation model for large deformation mapping. Comparative study has also been conducted between this method and non-stationary approach on both synthesized and real brain images, and this approach demonstrated comparable whole brain mapping accuracy with much faster speed. Results showed efficacy of this approach in reducing complexity of stationary velocity based diffeomorphic registration while achieving validity for large deformation.
Diffeomorphisms Groups and Pattern Matching in Image Analysis

Alain Trouvé

DOI: https://doi.org/10.1023/a:1008001603737

IF: 13.369

1998-01-01

International Journal of Computer Vision

Abstract:In a previous paper, it was proposed to see the deformations of a common pattern as the action of an infinite dimensional group. We show in this paper that this approac h can be applied numerically for pattern matching in image analysis of digital images. Using Lie group ideas, we construct a distance between deformations defined through a metric given the cost of infinitesimal deformations. Then we propose a numerical scheme to solve a variational problem involving this distance and leading to a sub-optimal gradient pattern matching. Its links with fluid models are established.

computer science, artificial intelligence
A Multiscale Theory for Image Registration and Nonlinear Inverse Problems

Klas Modin,Adrian Nachman,Luca Rondi

DOI: https://doi.org/10.1016/j.aim.2019.02.014

2020-03-19

Abstract:In an influential paper, Tadmor, Nezzar and Vese (Multiscale Model. Simul. (2004)) introduced a hierarchical decomposition of an image as a sum of constituents of different scales. Here we construct analogous hierarchical expansions for diffeomorphisms, in the context of image registration, with the sum replaced by composition of maps. We treat this as a special case of a general framework for multiscale decompositions, applicable to a wide range of imaging and nonlinear inverse problems. As a paradigmatic example of the latter, we consider the Calderón inverse conductivity problem. We prove that we can simultaneously perform a numerical reconstruction and a multiscale decomposition of the unknown conductivity, driven by the inverse problem itself. We provide novel convergence proofs which work in the general abstract settings, yet are sharp enough to settle an open problem on the hierarchical decompostion of Tadmor, Nezzar and Vese for arbitrary functions in $L^2$. We also give counterexamples that show the optimality of our general results.

Analysis of PDEs
Distributed-memory large deformation diffeomorphic 3D image registration

Andreas Mang,Amir Gholami,George Biros

DOI: https://doi.org/10.1109/SC.2016.71

2016-08-12

Abstract:We present a parallel distributed-memory algorithm for large deformation diffeomorphic registration of volumetric images that produces large isochoric deformations (locally volume preserving). Image registration is a key technology in medical image analysis. Our algorithm uses a partial differential equation constrained optimal control formulation. Finding the optimal deformation map requires the solution of a highly nonlinear problem that involves pseudo-differential operators, biharmonic operators, and pure advection operators both forward and back- ward in time. A key issue is the time to solution, which poses the demand for efficient optimization methods as well as an effective utilization of high performance computing resources. To address this problem we use a preconditioned, inexact, Gauss-Newton- Krylov solver. Our algorithm integrates several components: a spectral discretization in space, a semi-Lagrangian formulation in time, analytic adjoints, different regularization functionals (including volume-preserving ones), a spectral preconditioner, a highly optimized distributed Fast Fourier Transform, and a cubic interpolation scheme for the semi-Lagrangian time-stepping. We demonstrate the scalability of our algorithm on images with resolution of up to $1024^3$ on the "Maverick" and "Stampede" systems at the Texas Advanced Computing Center (TACC). The critical problem in the medical imaging application domain is strong scaling, that is, solving registration problems of a moderate size of $256^3$---a typical resolution for medical images. We are able to solve the registration problem for images of this size in less than five seconds on 64 x86 nodes of TACC's "Maverick" system.

Distributed, Parallel, and Cluster Computing,Computer Vision and Pattern Recognition,Optimization and Control
Efficient Laplace Approximation for Bayesian Registration Uncertainty Quantification

Jian Wang,Polina Golland,Miaomiao Zhang

DOI: https://doi.org/10.1007/978-3-030-00928-1_99

2018-01-01

Abstract:This paper presents a novel approach to modeling the posterior distribution in image registration that is computationally efficient for large deformation diffeomorphic metric mapping (LDDMM). We develop a Laplace approximation of Bayesian registration models entirely in a bandlimited space that fully describes the properties of diffeomorphic transformations. In contrast to current methods, we compute the inverse Hessian at the mode of the posterior distribution of diffeomorphisms directly in the low dimensional frequency domain. This dramatically reduces the computational complexity of approximating posterior marginals in the high dimensional imaging space. Experimental results show that our method is significantly faster than the state-of-the-art diffeomorphic image registration uncertainty quantification algorithms, while producing comparable results. The efficiency of our method strengthens the feasibility in prospective clinical applications, e.g., real-time image-guided navigation for brain surgery.
A method for large diffeomorphic registration via broken geodesics

Alphin J. Thottupattu,Jayanthi Sivaswamy,Venkateswaran P. Krishnan

DOI: https://doi.org/10.48550/arXiv.2011.14298

2021-01-03

Abstract:Anatomical variabilities seen in longitudinal data or inter-subject data is usually described by the underlying deformation, captured by non-rigid registration of these images. Stationary Velocity Field (SVF) based non-rigid registration algorithms are widely used for registration. SVF based methods form a metric-free framework which captures a finite dimensional submanifold of deformations embedded in the infinite dimensional smooth manifold of diffeomorphisms. However, these methods cover only a limited degree of deformations. In this paper, we address this limitation and define an approximate metric space for the manifold of diffeomorphisms $\mathcal{G}$. We propose a method to break down the large deformation into finite compositions of small deformations. This results in a broken geodesic path on $\mathcal{G}$ and its length now forms an approximate registration metric. We illustrate the method using a simple, intensity-based, log-demon implementation. Validation results of the proposed method show that it can capture large and complex deformations while producing qualitatively better results than the state-of-the-art methods. The results also demonstrate that the proposed registration metric is a good indicator of the degree of deformation.

Computer Vision and Pattern Recognition

Geometry of Image Registration: The Diffeomorphism Group and Momentum Maps

The Momentum Map Representation of Images.

Sliding at first order: Higher-order momentum distributions for discontinuous image registration

Sliding at First-Order: Higher-Order Momentum Distributions for Discontinuous Image Registration

Frequency Diffeomorphisms for Efficient Image Registration

An optimal control approach for deformable registration

Registration Uncertainty Quantification Via Low-Dimensional Characterization of Geometric Deformations.

A discretize–optimize approach for lddmm registration

A Novel Diffeomorphic Model for Image Registration and Its Algorithm

GRAM: A framework for geodesic registration on anatomical manifolds

Probabilistic diffeomorphic registration: Representing uncertainty

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Diffeomorphic Image Registration with an Optimal Control Relaxation and Its Implementation

Shape analysis via gradient flows on diffeomorphism groups

Robust Diffeomorphic Mapping Via Geodesically Controlled Active Shapes

Efficient Diffeomorphic Metric Image Registration Via Stationary Velocity.

Diffeomorphisms Groups and Pattern Matching in Image Analysis

A Multiscale Theory for Image Registration and Nonlinear Inverse Problems

Distributed-memory large deformation diffeomorphic 3D image registration

Efficient Laplace Approximation for Bayesian Registration Uncertainty Quantification

A method for large diffeomorphic registration via broken geodesics