Abstract:One primary difficulty preventing the visual localization for service robots is the robustness against changes, including environmental changes and perspective changes. In recent years, learning-based feature matching methods have been widely studied and effectively verified in practical applications. Learning-based feature matching effectively solves the problem of environmental changes, including illumination changes and man-made changes. However, there is still room for improvement dealing with large perspective changes. In this letter, we leverage local planar motion property to simplify the affine transform and propose an augmentation-based feature matching method that greatly enhances the robustness to perspective changes. The proposed feature matching approach maintains low matching costs as the augmentation is performed on the simplified affine matrix space. Combined with the motion property aided minimal solution for pose estimation, an end-to-end robust visual localization system is proposed which is shown to bring 67% improvement in localization performance under large perspective changes in publicly available OpenLORIS dataset, while increasing computational cost by only 20% by using batch processing techniques with a single GPU. In addition, a guide for map frame selection is presented to support robust localization with very sparse map frames in storage. Experiments on the classified dataset with environmental changes and perspective changes validate the effectiveness of the proposed system.

Robust and Fast Spatial Verification

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

2-Entity RANSAC for Robust Visual Localization in Changing Environment

Fast and Robust Spatial Matching for Object Retrieval

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Reliable RANSAC using a novel preprocessing model.

Fast Object Retrieval Using Direct Spatial Matching

Improved Robust Kernel Subspace for Object-Based Registration and Change Detection

Locality preserving verification for image search.

An Automatic and Robust Point Cloud Registration Framework Based on View-Invariant Local Feature Descriptors and Transformation Consistency Verification

Fast Verification Via Statistical Geometric for Mobile Visual Search

Two-View Geometry Estimation Using Ransac With Locality Preserving Constraint

Visual Localization Using Sparse Semantic 3D Map

A frame-based probabilistic local verification method for robust correspondence

Robust feature point matching based on geometric consistency and affine invariant spatial constraint

A Robust Visual SLAM System for Low-Texture and Semi-Static Environments

Efficient Single Correspondence Voting for Point Cloud Registration

Fast Registration for cross-source point clouds by using weak regional affinity and pixel-wise refinement

Semantic Object-level Modeling for Robust Visual Camera Relocalization

A Graph-Matching Approach for Cross-view Registration of Over-view 2 and Street-view based Point Clouds

A New Robust 2D Camera Calibration Method Using RANSAC