Abstract:One primary difficulty preventing the visual localization for service robots is the robustness against changes, including environmental changes and perspective changes. In recent years, learning-based feature matching methods have been widely studied and effectively verified in practical applications. Learning-based feature matching effectively solves the problem of environmental changes, including illumination changes and man-made changes. However, there is still room for improvement dealing with large perspective changes. In this letter, we leverage local planar motion property to simplify the affine transform and propose an augmentation-based feature matching method that greatly enhances the robustness to perspective changes. The proposed feature matching approach maintains low matching costs as the augmentation is performed on the simplified affine matrix space. Combined with the motion property aided minimal solution for pose estimation, an end-to-end robust visual localization system is proposed which is shown to bring 67% improvement in localization performance under large perspective changes in publicly available OpenLORIS dataset, while increasing computational cost by only 20% by using batch processing techniques with a single GPU. In addition, a guide for map frame selection is presented to support robust localization with very sparse map frames in storage. Experiments on the classified dataset with environmental changes and perspective changes validate the effectiveness of the proposed system.

A Practical Approach To Motion Estimation For Omnidirectional Vision

Stereo Camera Motion Estimation Based on Euclidean Reconstruction

Robust and Efficient Vehicles Motion Estimation with Low-Cost Multi-Camera and Odometer-Gyroscope

PALVO: Visual Odometry Based on Panoramic Annular Lens.

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Stereo Calibration and Rectification for Omnidirectional Multi-Camera Systems

Pose Estimation of Omnidirectional Camera with Improved EPnP Algorithm

Robust Camera Motion Estimation in Video Sequences

Visual Odometry in dynamical scenes

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

Simplified 3-D Motion Estimation With Point Correspondences

Visual Odometry through Appearance- and Feature-Based Method with Omnidirectional Images

Motion Detection For Multiple Moving Targets By Using An Onmidirectional Camera

Consistent and Asymptotically Statistically-Efficient Solution to Camera Motion Estimation

Region-Based Tracking in Video Sequences Using Planar Perspective Models

Nonparametric motion model.

Robust Monocular Edge Visual Odometry through Coarse-to-Fine Data Association

Reduced egomotion estimation drift using omnidirectional views

Motion detection for multiple moving targets by using an omnidirectional camera

Cognitively Inspired 6D Motion Estimation of a Noncooperative Target Using Monocular RGB-D Images

Pose Estimation for Omni-directional Cameras using Sinusoid Fitting