Abstract:Visual localization plays a critical role in the functionality of low-cost autonomous mobile robots. Contemporary leading methods for precise visual localization are predominantly 3D scene-specific, necessitating extra computational and memory overhead to construct a 3D scene model in novel environments. An alternative approach of directly using a database of 2D images for visual localization offers more flexibility. However, such methods currently suffer from limited localization accuracy. In this paper, we propose an accurate and robust multiple checking-based 3D model-free visual localization system to address the aforementioned issues. To ensure high accuracy, our focus is on estimating the pose of a query image relative to the retrieved database images using 2D-2D feature matches. Theoretically, by incorporating the local planar motion constraint into both the estimation of the essential matrix and the triangulation stages, we reduce the minimum required feature matches for absolute pose estimation, thereby enhancing the robustness of outlier rejection. Additionally, we introduce a multiple-checking mechanism to ensure the correctness of the solution throughout the solving process. The efficacy of our approach is substantiated through both qualitative and quantitative assessments on simulated and two real-world datasets evidencing significant improvements in accuracy and robustness provided by our 3D model-free visual localization system. Note to Practitioners-The motivation of this article stems from the need to develop an accurate visual localization system with simplicity and flexibility of map construction and easy adaption to new environments. Such a system holds great practical value for a range of applications, including warehouse robots, service robots, and countless others. Existing visual localization systems that achieve high accuracy are dependent on a pre-built accurate 3D scene map, which pose challenges in terms of map construction and consume significant storage resources onboard, particularly for large scenes. And the aforementioned efforts need to be repeated when changing to a new scene. In this article, an accurate and robust 3D model-free visual localization system is proposed to handle this problem. The map construction is simplified to build a set of database images with associated camera poses, which is trivial as it amounts to adding posed images to a database. The core idea for achieving high accuracy and robustness is to model the local planar motion characteristic of general ground-moving robots into both essential matrix estimation and triangulation stages to obtain two minimal solutions. The proposed localization system simplifies the task of switching between different application scenarios for the robot, reducing additional workload and lowering the difficulty of use.

Scene-Aware Error Modeling of LiDAR/Visual Odometry for Fusion-Based Vehicle Localization

RoLM: Radar on LiDAR Map Localization.

Multimodal Localization: Stereo over LiDAR Map

Learning Scene Adaptive Covariance Error Model of LiDAR Scan Matching for Fusion Based Localization

A Robust Localization Approach Using Multi-Sensor Fusion

Degeneration-Aware Localization with Arbitrary Global-Local Sensor Fusion.

3D Model-free Visual Localization System from Essential Matrix under Local Planar Motion

A robust data-model dual-driven fusion with uncertainty estimation for LiDAR–IMU localization system

Learning Visual Semantic Map-Matching for Loosely Multi-Sensor Fusion Localization of Autonomous Vehicles

LVIO-SAM: A Multi-sensor Fusion Odometry via Smoothing and Mapping

An Integrated LSTM-Rule-Based Fusion Method for the Localization of Intelligent Vehicles in a Complex Environment

Multi-Sensor Fusion Tomato Picking Robot Localization and Mapping Research

Robust and Precise Vehicle Localization based on Multi-sensor Fusion in Diverse City Scenes

GNSS/IMU/LO integration with a new LO error model and lateral constraint for navigation in urban areas

Multi-Sensor Fusion Simultaneous Localization Mapping Based on Deep Reinforcement Learning and Multi-Model Adaptive Estimation

Beyond Learning: Back to Geometric Essence of Visual Odometry via Fusion-Based Paradigm

Multi-sensor fusion for robust localization with moving object segmentation in complex dynamic 3D scenes

Lvio-Fusion: A Self-adaptive Multi-sensor Fusion SLAM Framework Using Actor-critic Method

GNSS/IMU/LiDAR fusion for vehicle localization in urban driving environments within a consensus framework

Semantic-Structure-Aware Multi-Level Information Fusion for Robust Global Orientation Optimization of Autonomous Mobile Robots

Enhanced Mobile Robot Odometry With Error Kalman Filtering Incorporating 3D Point Cloud Intensity