Abstract:This paper considers the joint geometric and photometric image registration problem. The inverse compositional (IC) algorithm and the efficient second-order minimization (ESM) algorithm are two typical efficient methods applied to the geometric registration problem. Their efficiency stems from the utilization of the group structure of geometric transformations. To allow for photometric variations, the dual IC algorithm (DIC) proposed by Bartoli performs joint geometric and photometric image registration by extending the IC algorithm. The group structures of both geometric and photometric transformations are exploited. Despite the robustness to large photometric variations, DIC is vulnerable to large geometric deformations. The ESM algorithm is extended by Silveira et al. to address photometric variations. In their approach, the photometric transformations are modeled in Euclidean space. Their approach is robust to relatively large geometric and photometric transformations; however, it is not efficient for large photometric variations. We propose a new efficient and robust image registration method by exploiting the non-Euclidean Lie group structure of joint geometric and photometric transformations for both grayscale and color images. The image registration is formulated as a nonlinear least squares problem. In our method, the geometric and photometric transformations are jointly parameterized by their corresponding Lie algebras. Based on this parameterization approach, the second-order approximation strategy of ESM is employed to optimize the joint geometric and photometric parameters. The error function in the nonlinear least squares problem is approximated by a second-order Taylor expansion with respect to joint geometric and photometric parameters without computing the Hessian matrix. For further efficiency, independent convergence criteria for geometric and photometric parameters are used in the iterative optimization process. The superiority of our proposed method over the previous methods, in terms of efficiency, accuracy, and robustness, is demonstrated through extensive experiments on synthetic and real data.

Semantic similarity metrics for image registration

Primitive Simultaneous Optimization of Similarity Metrics for Image Registration

Semantic Discriminative Metric Learning for Image Similarity Measurement

Similarity Metric in Medical Image Registration

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Decoupling Semantic Similarity from Spatial Alignment for Neural Networks

DISA: DIfferentiable Similarity Approximation for Universal Multimodal Registration

A Hybrid Semantic Similarity Measurement for Geospatial Entities

Collaborative Similarity Metric Learning for Semantic Image Annotation and Retrieval.

Hessian-based Similarity Metric for Multimodal Medical Image Registration

A Deep Metric for Multimodal Registration

An evolutionary computational based approach towards automatic image registration

Adversarial Similarity Network for Evaluating Image Alignment in Deep Learning Based Registration.

Efficient and Robust Direct Image Registration Based on Joint Geometric and Photometric Lie Algebra

A New Similarity Measure for Deformable Image Registration Based on Intensity Matching

Metric Learning for Image Registration

Intensity-Based Robust Similarity for Multimodal Image Registration, International Journal of Computer Mathematics

Self-similarity weighted mutual information: A new nonrigid image registration metric

Image Registration Based on Geometric Pattern Matching

A Novel Image Registration Approach Via Combining Local Features and Geometric Invariants

An efficient similarity metric for 3D medical image registration