Abstract:Image registration based on feature is a commonly used approach due to its robustness in complex geometric deformation and larger gray difference. However, in practical application, due to the effect of various noises, occlusions, shadows, gray differences, and even changes of image contents, the corresponding feature point set may be contaminated, which may degrade the accuracy of the transformation model estimate based on Random Sample Consensus (RANSAC). In this work, we proposed a semi-automated method to create the image registration training data, which greatly reduced the workload of labeling and made it possible to train a deep neural network. In addition, for the model estimation based on RANSAC, we determined the process according to a probabilistic perspective and presented a formulation of RANSAC with the learned guidance of hypothesis sampling. At the same time, a deep convolutional neural network of ProbNet was built to generate a sampling probability of corresponding feature points, which were then used to guide the sampling of a minimum set of RANSAC to acquire a more accurate estimation model. To illustrate the effectiveness and advantages of the proposed method, qualitative and quantitative experiments are conducted. In the qualitative experiment, the effectiveness of the proposed method was illustrated by a checkerboard visualization of image pairs before and after being registered by the proposed method. In the quantitative experiment, other three representative and popular methods of vanilla RANSAC, LMeds-RANSAC, and ProSAC-RANSAC were compared, and seven different measures were introduced to comprehensively evaluate the performance of the proposed method. The quantitative experimental result showed that the proposed method had better performance than the other methods. Furthermore, with the integration of the model estimation of the image registration into the deep-learning framework, it was possible to jointly optimize all the processes of image registration via end-to-end learning to further improve the accuracy of image registration.

Image feature detection as robust model fitting

Reliable RANSAC using a novel preprocessing model.

Facial feature points detecting based on Gaussian Mixture Models

Detection of engineering vehicles in high-resolution monitoring images

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

An Object-Level Feature Representation Model for the Multi-target Retrieval of Remote Sensing Images.

A New Robust Approach for Remote Sensing Image Regional Classification

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Robust Feature Matching for Remote Sensing Image Registration via Guided Hyperplane Fitting

An Accurate and Robust Registration Framework Based on Outlier Removal and Feature Point Adjustment for Remote Sensing Images

Landmark Tracking Algorithm Based on Adaptive Feature

Robust Feature Matching for Remote Sensing Image Registration via Linear Adaptive Filtering

Fine-Grained Feature Enhancement for Object Detection in Remote Sensing Images

CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote-Sensing Images

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

Robust Heterogeneous Model Fitting for Multi-source Image Correspondences

A New Method for Remote Sensing Image Matching by Integrating Affine Invariant Feature Extraction and RANSAC

Object detection in remote sensing imagery using a discriminatively trained mixture model

A Novel Remote Sensing Image Registration Algorithm Based on Feature Using ProbNet-RANSAC

A Novel Robust Point Cloud Fitting Algorithm Based on Nonlinear Gauss–Helmert Model

Object Detection in Vhr Optical Remote Sensing Images Via Learning Rotation-Invariant Hog Feature