A variational problem arising in registration of diffusion tensor images

Huan HAN

DOI: https://doi.org/10.1016/S0252-9602(17)30020-6

2017-03-01

Acta Mathematica Scientia

Abstract:The existence of a global minimizer for a variational problem arising in registration of diffusion tensor images is proved, which ensures that there is a regular spatial transformation for the registration of diffusion tensor images.

mathematics

What problem does this paper attempt to address?

A variational formulation for discrete registration

Karteek Popuri,Dana Cobzas,Martin Jägersand

DOI: https://doi.org/10.1007/978-3-642-40760-4_24

Abstract:We present a novel variational formulation of discrete deformable registration as the minimization of a convex energy functional that involves diffusion regularization. We show that a finite difference solution (FD) of the variational formulation is equivalent to a continuous-valued Gaussian Markov random field (MRF) energy minimization formulation previously proposed as the random walker deformable registration method. A computationally efficient solution using the finite element method (FEM) method has been proposed to solve the variational minimization problem. Our proposed method obtained competitive results when compared with 14 other deformable registration methods on the CUMC12 MRI dataset.
Information-Theoretic Registration with Explicit Reorientation of Diffusion-Weighted Images

Henrik Grønholt Jensen,François Lauze,Sune Darkner

DOI: https://doi.org/10.48550/arXiv.1905.12056

2021-07-09

Abstract:We present an information-theoretic approach to the registration of images with directional information, and especially for diffusion-Weighted Images (DWI), with explicit optimization over the directional scale. We call it Locally Orderless Registration with Directions (LORD). We focus on normalized mutual information as a robust information-theoretic similarity measure for DWI. The framework is an extension of the LOR-DWI density-based hierarchical scale-space model that varies and optimizes the integration, spatial, directional, and intensity scales. As affine transformations are insufficient for inter-subject registration, we extend the model to non-rigid deformations. We illustrate that the proposed model deforms orientation distribution functions (ODFs) correctly and is capable of handling the classic complex challenges in DWI-registrations, such as the registration of fiber-crossings along with kissing, fanning, and interleaving fibers. Our experimental results clearly illustrate a novel promising regularizing effect, that comes from the nonlinear orientation-based cost function. We show the properties of the different image scales and, we show that including orientational information in our model makes the model better at retrieving deformations in contrast to standard scalar-based registration.

Computer Vision and Pattern Recognition
Template-based CT Reconstruction with Optimal Transport and Total Generalized Variation

Yiming Gao,Zhengmeng Jin,Xu Li

DOI: https://doi.org/10.1088/1361-6420/aceb17

IF: 2.408

2023-01-01

Inverse Problems

Abstract:x-ray computed tomography (CT) has been widely used in clinical diagnosis as a modality of medical imaging. To decrease the radiation dose patients suffering from, sparse-view CT has gained much attention in medical imaging field. In this paper, we propose to design a variational model based on dynamic optimal transportation and total generalized variation for CT reconstruction. This is a joint task involving inverse problem and template registration. The final state image of the optimal transport problem is unknown and needs to be reconstructed through CT inversion, while the given initial state can be regarded as a template to provide some structural information for the final one. Moreover, the existence and stability of minimizers to our proposed model are shown in continuous space. In discretization with the continuity equation, we utilize the well-known staggered grid in fluid mechanics and develop a first-order algorithm based on primal-dual method for numerically solving the proposed model. Finally, numerical experiments for sparse-view CT reconstruction are exhibited to show the performance of our proposed model in recovering images with high quality and structure preservation.
A Bi-variant Variational Model for Diffeomorphic Image Registration with Relaxed Jacobian Determinant Constraints

Yanyan Li,Ke Chen,Chong Chen,Jianping Zhang

DOI: https://doi.org/10.1016/j.apm.2024.02.033

IF: 5.336

2024-03-07

Applied Mathematical Modelling

Abstract:Diffeomorphic registration is a widely used technique for finding a smooth and invertible transformation between two coordinate systems, which are measured using template and reference images. The point-wise volume-preserving constraint det⁡(∇φ(x))=1 is effective in some cases, but may be too restrictive in others, especially when local deformations are relatively large. This can result in poor matching when enforcing large local deformations. In this paper, we propose a new bi-variant diffeomorphic image registration model that introduces a soft constraint on the Jacobian equation det⁡(∇φ(x))=f(x)>0 . This allows local deformations to shrink and grow within a flexible range 0<κm . The Jacobian determinant of transformation is explicitly controlled by optimizing the relaxation function f(x) . To prevent deformation folding and improve the smoothness of the transformation, a positive constraint is imposed on the optimization of the relaxation function f(x) , and a regularizer is used to ensure the smoothness of f(x) . Furthermore, the positivity constraint ensures that f(x) is as close to one as possible, which helps to achieve a volume-preserving transformation on average. We also analyze the existence of the minimizer for the variational model and propose a penalty-splitting algorithm with a multilevel strategy to solve this model. Numerical experiments demonstrate the convergence of the proposed algorithm and show that the positivity constraint can effectively control the range of relative volume without compromising the accuracy of the registration. Moreover, the proposed model generates diffeomorphic maps for large local deformations and outperforms several existing registration models in terms of performance.

mechanics,engineering, multidisciplinary,mathematics, interdisciplinary applications
A Novel Diffeomorphic Model for Image Registration and Its Algorithm

Daoping Zhang,Ke Chen

DOI: https://doi.org/10.1007/s10851-018-0811-3

IF: 1.627

2018-04-10

Journal of Mathematical Imaging and Vision

Abstract:In this work, we investigate image registration by mapping one image to another in a variational framework and focus on both model robustness and solver efficiency. We first propose a new variational model with a special regularizer, based on the quasi-conformal theory, which can guarantee that the registration map is diffeomorphic. It is well known that when the deformation is large, many variational models including the popular diffusion model cannot ensure diffeomorphism. One common observation is that the fidelity error appears small while the obtained transform is incorrect by way of mesh folding. However, direct reformulation from the Beltrami framework does not lead to effective models; our new regularizer is constructed based on this framework and added to the diffusion model to get a new model, which can achieve diffeomorphism. However, the idea is applicable to a wide class of models. We then propose an iterative method to solve the resulting nonlinear optimization problem and prove the convergence of the method. Numerical experiments can demonstrate that the new model can not only get a diffeomorphic registration even when the deformation is large, but also possess the accuracy in comparing with the currently best models.

mathematics, applied,computer science, software engineering, artificial intelligence
Variational Inequalities for Set-Valued Vector Fields on Riemannian Manifolds: Convexity of the Solution Set and the Proximal Point Algorithm.

Chong Li,Jen-Chih Yao

DOI: https://doi.org/10.1137/110834962

IF: 2.2

2012-01-01

SIAM Journal on Control and Optimization

Abstract:We consider variational inequality problems for set-valued vector fields on general Riemannian manifolds. The existence results of the solution, convexity of the solution set, and the convergence property of the proximal point algorithm for the variational inequality problems for set-valued mappings on Riemannian manifolds are established. Applications to convex optimization problems on Riemannian manifolds are provided.
Diffeomorphic Image Registration with an Optimal Control Relaxation and Its Implementation

Jianping Zhang,Yanyan Li

DOI: https://doi.org/10.1137/21M1391274

IF: 1.938

2021-12-15

SIAM Journal on Imaging Sciences

Abstract:SIAM Journal on Imaging Sciences, Volume 14, Issue 4, Page 1890-1931, January 2021. Image registration has played an important role in image processing problems, especially in medical imaging applications. It is well known that when the deformation is large, many variational models cannot ensure diffeomorphism. In this paper, we propose a new registration model based on an optimal control relaxation constraint for large deformation images, which can theoretically guarantee that the registration mapping is diffeomorphic. We present an analysis of optimal control relaxation for indirectly seeking the diffeomorphic transformation of the Jacobian determinant equation and its registration applications, including the construction of diffeomorphic transformation as a special space. We also provide an existence result for the control increment optimization problem in the proposed diffeomorphic image registration model with an optimal control relaxation. Furthermore, a fast iterative scheme based on the augmented Lagrangian multipliers method (ALMM) is analyzed to solve the control increment optimization problem, and a convergence analysis follows. Finally, a grid unfolding indicator is given, and a robust solving algorithm for using the deformation correction and backtrack strategy is proposed to guarantee that the solution is diffeomorphic. Numerical experiments show that the registration model we propose not only obtains a diffeomorphic mapping when the deformation is large but also achieves a state-of-the-art performance in quantitative evaluations that is comparable to that of other classical models.

mathematics, applied,computer science, software engineering, artificial intelligence,imaging science & photographic technology
Variational problems related to some fractional kinetic equations

H. Hajaiej

DOI: https://doi.org/10.48550/arXiv.1205.1202

2012-05-06

Abstract:We establish the existence and symmetry of all minimizers of a constrained variational problem involving the fractional gradient. This problem is closely connected to some fractional kinetic equations.

Analysis of PDEs
Hierarchical Multiview Rigid Registration

Yizhi Tang,Jieqing Feng

DOI: https://doi.org/10.1111/cgf.12698

IF: 2.5

2015-01-01

Computer Graphics Forum

Abstract:AbstractRegistration is a key step in the 3D reconstruction of real‐world objects. In this paper, we propose a hierarchical method for the rigid registration of multiple views. The multiview registration problem is solved via hierarchical optimization defined on an undirected graph. Each node or edge in this graph represents a single view or a connection between two overlapped views, respectively. The optimizations are performed hierarchically on the edges, the loops, and the entire graph. First, each overlapped pair of views is locally aligned. Then, a loop‐based incremental registration algorithm is introduced to refine the initial pairwise alignments. After a loop is registered, the views in the loop are merged into a metaview in the graph. Finally, global error diffusion is applied to the entire graph to evenly distribute the accumulated errors to all views. In addition, a new objective function is defined to describe the loop closure problem; it improves the accuracy and robustness of registration by simultaneously considering transformation and registration errors. The experimental results show that the proposed hierarchical approach is accurate, efficient and robust for initial view states that are not well posed.
Multiscale Approach for Variational Problem Joint Diffeomorphic Image Registration and Intensity Correction: Theory and Application

Peng Chen,Ke Chen,Huan Han,Daoping Zhang

DOI: https://doi.org/10.1137/23m155952x

2024-09-03

Multiscale Modeling and Simulation

Abstract:Multiscale Modeling &Simulation, Volume 22, Issue 3, Page 1097-1135, September 2024. Image registration matches the features of two images by minimizing the intensity difference, so that useful and complementary information can be extracted from the mapping. However, in real life problems, images may be affected by the imaging environment, such as varying illumination and noise during the process of imaging acquisition. This may lead to the local intensity distortion, which makes it meaningless to minimize the intensity difference in the traditional registration framework. To address this problem, we propose a variational model for joint image registration and intensity correction. Based on this model, a related greedy matching problem is solved by introducing a multiscale approach for joint image registration and intensity correction. An alternating direction method (ADM) is proposed to solve each multiscale step, and the convergence of the ADM method is proved. For the numerical implementation, a coarse-to-fine strategy is further proposed to accelerate the numerical algorithm, and the convergence of the proposed coarse-to-fine strategy is also established. Some numerical tests are performed to validate the efficiency of the proposed algorithm.

mathematics, interdisciplinary applications,physics, mathematical
Minimum Spanning Tree Fusing Uniform Sub-Sampling Points and High-Dimensional Features for Medical Image Registration

Zhang Shao-min,Zhi Li-jia,Zhang Shao-min,Zhao Da-zhe

DOI: https://doi.org/10.1109/icbbe.2011.5780358

2011-01-01

Abstract:In this paper, we propose a novel registration algorithm based on minimal spanning tree. First, we extracted uniform sub-sampling points from image. Second, based on the feature points, in addition to using pixel intensity, we also added region based feature to include more spatial information. The proposed method is evaluated by performing registration experiments on BrainWeb database. The experimental results show that the proposed method achieves better robustness while maintaining good registration accuracy, compared to the conventional normalized mutual information (NMI) based registration method.
Diff-Reg: Diffusion Model in Doubly Stochastic Matrix Space for Registration Problem

Qianliang Wu,Haobo Jiang,Lei Luo,Jun Li,Yaqing Ding,Jin Xie,Jian Yang

DOI: https://doi.org/10.1007/978-3-031-73650-6_10

2024-01-01

Abstract:Establishing reliable correspondences is essential for registration tasks such as 3D and 2D3D registration. Existing methods commonly leverage geometric or semantic point features to generate potential correspondences. However, these features may face challenges such as large deformation, scale inconsistency, and ambiguous matching problems (e.g., symmetry). Additionally, many previous methods, which rely on single-pass prediction, may struggle with local minima in complex scenarios. To mitigate these challenges, we introduce a diffusion matching model for robust correspondence construction. Our approach treats correspondence estimation as a denoising diffusion process within the doubly stochastic matrix space, which gradually denoises (refines) a doubly stochastic matching matrix to the ground-truth one for high-quality correspondence estimation. It involves a forward diffusion process that gradually introduces Gaussian noise into the ground truth matching matrix and a reverse denoising process that iteratively refines the noisy matching matrix. In particular, the feature extraction from the backbone occurs only once during the inference phase. Our lightweight denoising module utilizes the same feature at each reverse sampling step. Evaluation of our method on both 3D and 2D3D registration tasks confirms its effectiveness. The code will be made available online.
Medical Image Registration using optimal control of a linear hyperbolic transport equation with a DG discretization

Bastian Zapf,Johannes Haubner,Lukas Baumgärtner,Stephan Schmidt

2024-04-09

Abstract:Patient specific brain mesh generation from MRI can be a time consuming task and require manual corrections, e.g., for meshing the ventricular system or defining subdomains. To address this issue, we consider an image registration approach. The idea is to use the registration of an input magnetic resonance image (MRI) to a respective target in order to obtain a new mesh from a template mesh. To obtain the transformation, we solve an optimization problem that is constrained by a linear hyperbolic transport equation. We use a higher-order discontinuous Galerkin finite element method for discretization and motivate the numerical upwind scheme and its limitations from the continuous weak space--time formulation of the transport equation. We present a numerical implementation that builds on the finite element packages FEniCS and dolfin-adjoint. To demonstrate the efficacy of the proposed approach, numerical results for the registration of an input to a target MRI of two distinct individuals are presented. Moreover, it is shown that the registration transforms a manually crafted input mesh into a new mesh for the target subject whilst preserving mesh quality. Challenges of the algorithm are discussed.

Numerical Analysis,Optimization and Control
Topology-preserving Image Registration with Novel Multi-Dimensional Beltrami Regularization

Chongfei Huang,Ke Chen,Meixiang Huang,Dexing Kong,Jing Yuan

DOI: https://doi.org/10.1016/j.apm.2023.09.033

IF: 5.336

2024-01-01

Applied Mathematical Modelling

Abstract:Beltrami coefficient provides a proper measure to quantify local distortions for a topology-preserving mapping, a.k.a general quasi-conformal mapping, in 2D. Recent studies managed to extend Beltrami coefficient from 2D to nD, and introduced its corresponding Beltrami-like measures to encode local deformation information in challenging nD topology-preserving image registration tasks. However, all these nD measures are not consistent with the classical 2D Beltrami coefficient. We propose a novel nD measure for evaluating local distortions of an nD diffeomorphic mapping in this work. We show its key mathematical properties, and prove that the new measure coincides with the classical 2D Beltrami coefficient. We further introduce a new nD topology-preserving image registration model by means of regularizing such proposed Beltrami-consistent coefficient, and show the existence of its solution. Meanwhile, a generalized Gauss-Newton scheme is applied to establish a fast multi-level numerical solver. Extensive experiments over different 3D medical image registration tasks, including the challenging multi-modal medical image registration, illustrate that the proposed approach by regularizing the introduced Beltrami-consistent coefficient outperforms the other state-of-the-art topology-preserving methods in both efficiency and accuracy.
Diff-Reg v1: Diffusion Matching Model for Registration Problem

Qianliang Wu,Haobo Jiang,Lei Luo,Jun Li,Yaqing Ding,Jin Xie,Jian Yang

2024-07-25

Abstract:Establishing reliable correspondences is essential for registration tasks such as 3D and 2D3D registration. Existing methods commonly leverage geometric or semantic point features to generate potential correspondences. However, these features may face challenges such as large deformation, scale inconsistency, and ambiguous matching problems (e.g., symmetry). Additionally, many previous methods, which rely on single-pass prediction, may struggle with local minima in complex scenarios. To mitigate these challenges, we introduce a diffusion matching model for robust correspondence construction. Our approach treats correspondence estimation as a denoising diffusion process within the doubly stochastic matrix space, which gradually denoises (refines) a doubly stochastic matching matrix to the ground-truth one for high-quality correspondence estimation. It involves a forward diffusion process that gradually introduces Gaussian noise into the ground truth matching matrix and a reverse denoising process that iteratively refines the noisy matching matrix. In particular, the feature extraction from the backbone occurs only once during the inference phase. Our lightweight denoising module utilizes the same feature at each reverse sampling step. Evaluation of our method on both 3D and 2D3D registration tasks confirms its effectiveness. The code is available at <a class="link-external link-https" href="https://github.com/wuqianliang/Diff-Reg" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition
Registration of algebraic varieties using Riemannian optimization

Florentin Goyens,Coralia Cartis,Stéphane Chrétien

2024-01-17

Abstract:We consider the point cloud registration problem, the task of finding a transformation between two point clouds that represent the same object but are expressed in different coordinate systems. Our approach is not based on a point-to-point correspondence, matching every point in the source point cloud to a point in the target point cloud. Instead, we assume and leverage a low-dimensional nonlinear geometric structure of the data. Firstly, we approximate each point cloud by an algebraic variety (a set defined by finitely many polynomial equations). This is done by solving an optimization problem on the Grassmann manifold, using a connection between algebraic varieties and polynomial bases. Secondly, we solve an optimization problem on the orthogonal group to find the transformation (rotation $+$ translation) which makes the two algebraic varieties overlap. We use second-order Riemannian optimization methods for the solution of both steps. Numerical experiments on real and synthetic data are provided, with encouraging results. Our approach is particularly useful when the two point clouds describe different parts of an objects (which may not even be overlapping), on the condition that the surface of the object may be well approximated by a set of polynomial equations. The first procedure -- the approximation -- is of independent interest, as it can be used for denoising data that belongs to an algebraic variety. We provide statistical guarantees for the estimation error of the denoising using Stein's unbiased estimator.

Optimization and Control,Computer Vision and Pattern Recognition
Constrained Higher Degree Total P-Variation Minimization for MRI Reconstruction from Undersampled K-Space Data

Jiaquan Jin,Hongwei Du,Bensheng Qiu,Jinzhang Xu

DOI: https://doi.org/10.2174/1573405614666180425124008

2018-01-01

Current Medical Imaging Reviews

Abstract:Background: In Magnetic Resonance (MR) image reconstruction, Higher Degree Total Variation (HDTV) using high-order directional derivatives outperforms total variation-based method in preserving edge information and suppressing unfavourable staircase artifacts. Traditional HDTV regularization, however, takes the form of L-1-based, which is not the most straightforward way to maximize sparsity prior. Previous work has shown that nonconvex L-p-norm is potentially more effective than L-1-norm in promoting sparsity. Methods: This work develops a Higher Degree Total p-variation (HDTpV) regularization model to enhance the sparsity utilization of HDTV and offers more accurate solutions for MR image reconstruction issues. To resolve the nonconvex optimization issue of the HDTpV minimization model, Split Bregman (SB) method was adopted to translate the original constrained problem into a succession of unconstrained subproblems, which can be solved by fast Fourier transform and generalized p-shrinkage mapping. The qualitative and quantitative simulation experiments are conducted to demonstrate the accuracy and efficiency of the proposed method. Results & Conclusion: On the whole, improved performance is exhibited by the proposed method over the original HDTV-based method while applied to compressed MR image reconstruction.
Diffusion tensor driven image registration: a deep learning approach

Irina Grigorescu,Alena Uus,Daan Christiaens,Lucilio Cordero-Grande,Jana Hutter,A. David Edwards,Joseph V. Hajnal,Marc Modat,Maria Deprez

DOI: https://doi.org/10.48550/arXiv.2005.06926

2020-05-14

Abstract:Tracking microsctructural changes in the developing brain relies on accurate inter-subject image registration. However, most methods rely on either structural or diffusion data to learn the spatial correspondences between two or more images, without taking into account the complementary information provided by using both. Here we propose a deep learning registration framework which combines the structural information provided by T2-weighted (T2w) images with the rich microstructural information offered by diffusion tensor imaging (DTI) scans. We perform a leave-one-out cross-validation study where we compare the performance of our multi-modality registration model with a baseline model trained on structural data only, in terms of Dice scores and differences in fractional anisotropy (FA) maps. Our results show that in terms of average Dice scores our model performs better in subcortical regions when compared to using structural data only. Moreover, average sum-of-squared differences between warped and fixed FA maps show that our proposed model performs better at aligning the diffusion data.

Image and Video Processing
Diffeomorphic image registration of diffusion MRI using spherical harmonics

Xiujuan Geng,Thomas J Ross,Hong Gu,Wanyong Shin,Wang Zhan,Yi-Ping Chao,Ching-Po Lin,Norbert Schuff,Yihong Yang

DOI: https://doi.org/10.1109/TMI.2010.2095027

Abstract:Nonrigid registration of diffusion magnetic resonance imaging (MRI) is crucial for group analyses and building white matter and fiber tract atlases. Most current diffusion MRI registration techniques are limited to the alignment of diffusion tensor imaging (DTI) data. We propose a novel diffeomorphic registration method for high angular resolution diffusion images by mapping their orientation distribution functions (ODFs). ODFs can be reconstructed using q-ball imaging (QBI) techniques and represented by spherical harmonics (SHs) to resolve intra-voxel fiber crossings. The registration is based on optimizing a diffeomorphic demons cost function. Unlike scalar images, deforming ODF maps requires ODF reorientation to maintain its consistency with the local fiber orientations. Our method simultaneously reorients the ODFs by computing a Wigner rotation matrix at each voxel, and applies it to the SH coefficients during registration. Rotation of the coefficients avoids the estimation of principal directions, which has no analytical solution and is time consuming. The proposed method was validated on both simulated and real data sets with various metrics, which include the distance between the estimated and simulated transformation fields, the standard deviation of the general fractional anisotropy and the directional consistency of the deformed and reference images. The registration performance using SHs with different maximum orders were compared using these metrics. Results show that the diffeomorphic registration improved the affine alignment, and registration using SHs with higher order SHs further improved the registration accuracy by reducing the shape difference and improving the directional consistency of the registered and reference ODF maps.

A variational problem arising in registration of diffusion tensor images

A variational formulation for discrete registration

Information-Theoretic Registration with Explicit Reorientation of Diffusion-Weighted Images

Template-based CT Reconstruction with Optimal Transport and Total Generalized Variation

A Bi-variant Variational Model for Diffeomorphic Image Registration with Relaxed Jacobian Determinant Constraints

A Novel Diffeomorphic Model for Image Registration and Its Algorithm

Variational Inequalities for Set-Valued Vector Fields on Riemannian Manifolds: Convexity of the Solution Set and the Proximal Point Algorithm.

Diffeomorphic Image Registration with an Optimal Control Relaxation and Its Implementation

Variational problems related to some fractional kinetic equations

Hierarchical Multiview Rigid Registration

Multiscale Approach for Variational Problem Joint Diffeomorphic Image Registration and Intensity Correction: Theory and Application

Minimum Spanning Tree Fusing Uniform Sub-Sampling Points and High-Dimensional Features for Medical Image Registration

Diff-Reg: Diffusion Model in Doubly Stochastic Matrix Space for Registration Problem

Medical Image Registration using optimal control of a linear hyperbolic transport equation with a DG discretization

Topology-preserving Image Registration with Novel Multi-Dimensional Beltrami Regularization

Diff-Reg v1: Diffusion Matching Model for Registration Problem

Registration of algebraic varieties using Riemannian optimization

Constrained Higher Degree Total P-Variation Minimization for MRI Reconstruction from Undersampled K-Space Data

Diffusion tensor driven image registration: a deep learning approach

Diffeomorphic image registration of diffusion MRI using spherical harmonics