Abstract:Homography estimation refers to the problem of computing a 3 × 3 matrix which transfers image points between two images of a planar scene or two images captured from the same location. While existing algorithms exploiting hand-crafted sparse image features are well-established and efficient, recent methods based on convolutional neural networks (CNNs) achieve promising results especially for low-texture scenes. This work proposes to solve homography estimation using a hybrid framework HomoNetComb which incorporates deep learning method and energy minimization. In particular, a customized light-weight CNN named HomoNetSim is designed to calculate an initial estimation of homography, where the network is trained in an end-to-end fashion using large amount of image pairs generated from a publicly available dataset. Due to the tiny size of the employed network, the computation time of both training and inference for HomoNetSim can be reduced significantly compared with existing CNN-based homography estimation method. The initial estimate is then refined via gradient-decent algorithm by minimizing the masked pixel-level photometric discrepancy between the warped image and the destination image in a parallel fashion. Extensive experiments on the large scale synthetic dataset demonstrate that the proposed HomoNetComb improves robustness of homography estimation significantly compared with traditional methods based on sparse image features, and meanwhile HomoNetComb achieves a mean average corner error (MACE) of 0.58 pixels which outperforms previous state-of-the-art CNN-based method. Moreover, the usefulness and applicability of the proposed method is demonstrated by applying it to solve a real-world image stitching problem.

Homography Matrix Estimation in Monocular Vision Mosaic Navigation

Optical Image Mosaic Methods Based on MEMS Gyroscope

MCNet: Rethinking the Core Ingredients for Accurate and Efficient Homography Estimation

A new stereo matching algorithm for UAV autonomous navigation

Realization of odometry system using monocular vision

Estimation Method of Homography Matrix Based on the Quantum-Behaved Particle Swarm Optimization

A Monocular Odometer for a Quadrotor Using a Homography Model and Inertial Cues

A Robust Homography Estimation Method Based on Keypoint Consensus and Appearance Similarity.

Homography Matrix Genetic Consensus Estimation Algorithm

Homography-based Correspondence in Weakly Calibrated Curved Surface Environment and Its Error Analysis

Homography-based Camera Pose Estimation with Known Gravity Direction for UAV Navigation

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

A Review of Homography Estimation: Advances and Challenges

A highly accurate dense approach for homography estimation using modified differential evolution.

An Aerial Image Mosaic Method Based on UAV Position and Attitude Information

Homography Estimation Network Based on Dense Correspondence

Combining Convolutional Neural Network and Photometric Refinement for Accurate Homography Estimation.

A Two-Point Spatial Mapping Method for Hybrid Vision Systems

Deep Homography Estimation And Its Application To Wall Maps Of Wall-Climbing Robots

Homography estimation from planar contours in image sequence

A Global Fundamental Matrix Estimation Method of Planar Motion Based on Inlier Updating.