Abstract:This paper considers the joint geometric and photometric image registration problem. The inverse compositional (IC) algorithm and the efficient second-order minimization (ESM) algorithm are two typical efficient methods applied to the geometric registration problem. Their efficiency stems from the utilization of the group structure of geometric transformations. To allow for photometric variations, the dual IC algorithm (DIC) proposed by Bartoli performs joint geometric and photometric image registration by extending the IC algorithm. The group structures of both geometric and photometric transformations are exploited. Despite the robustness to large photometric variations, DIC is vulnerable to large geometric deformations. The ESM algorithm is extended by Silveira et al. to address photometric variations. In their approach, the photometric transformations are modeled in Euclidean space. Their approach is robust to relatively large geometric and photometric transformations; however, it is not efficient for large photometric variations. We propose a new efficient and robust image registration method by exploiting the non-Euclidean Lie group structure of joint geometric and photometric transformations for both grayscale and color images. The image registration is formulated as a nonlinear least squares problem. In our method, the geometric and photometric transformations are jointly parameterized by their corresponding Lie algebras. Based on this parameterization approach, the second-order approximation strategy of ESM is employed to optimize the joint geometric and photometric parameters. The error function in the nonlinear least squares problem is approximated by a second-order Taylor expansion with respect to joint geometric and photometric parameters without computing the Hessian matrix. For further efficiency, independent convergence criteria for geometric and photometric parameters are used in the iterative optimization process. The superiority of our proposed method over the previous methods, in terms of efficiency, accuracy, and robustness, is demonstrated through extensive experiments on synthetic and real data.

Shear-Resize Factorizations for Fast Image Registration

Fast Algorithm for Image Registration Based on Hausdorff Distance

A novel image registration method based on edge fitting

A Novel Image Registration Algorithm Using Wavelet Transform and Matrix-Multiply Discrete Fourier Transform

Automatic Image Registration Using Multi-Resolution Based Hough Transform

A Faster Image Registration Algorithm

Mutual Information-Based Registration of Temporal and Stereo Retinal Images Using Constrained Optimization.

Efficient Diffeomorphic Metric Image Registration Via Stationary Velocity.

Fast Rotation-Free Feature-Based Image Registration Using Improved N-SIFT and GMM-Based Parallel Optimization

High Speed Image Registration Algorithm Based on ORB and Corner Angle Constraint

A Fast Image Registration Algorithm for Diffeomorphic Image with Large Deformation

Efficient and Robust Direct Image Registration Based on Joint Geometric and Photometric Lie Algebra

Image Registration Method Based on Rigid Dynamics

A Fast Image Registration Algorithm Based on Fourier-Mellin Transform for Space Image

A Fast Algorithm to Estimate Mutual Information for Image Registration

Registration of images with affine geometric distortion based on Maximally Stable Extremal Regions and phase congruency

A Sift-Based Image Fingerprinting Approach Robust to Geometric Transformations

A speed-up and robust image registration algorithm based on FAST

Efficient Feature-based Image Registration by Mapping Sparsified Surfaces

Image Registration Via Low-Rank Factorization and Maximum Rank Resolving

A Novel Image Registration Approach Via Combining Local Features and Geometric Invariants