Abstract:Localization, an indispensable component in robotics and automation, encounters difficulties arising from appearance variations, resulting in inaccurate data associations. Semantic-based positioning mitigates these challenges by filtering out invalid data, such as moving vehicles and worn road markings. Building on this insight, we introduce a robust semantic visual localization system, which has been successfully deployed in real-world settings. The system uses neural networks to extract road markers and associate data with a semantic map. To enhance system reliability, we use several data filters. These filters remove images that are prone to misrecognition or poorly processed by neural networks. We propose two techniques for vehicle state estimation. The first, using the inverse perspective mapping (IPM) matrix, directly determines the vehicle's central pose. The second technique derives the camera pose using the perspective-n-points (PnP) method and leverages external parameters to infer the vehicle's central state. The wheel encoder, with its robust anti-noise capability, offers odometry in the absence of semantic information, enhancing the system's resilience. The crux of our approach lies in distinct semantic strategies: using lane lines for orientation and road markers exclusively for translation estimation. We also detail an automatic construction method for the semantic map, enhancing the system's practicality. Experimental results indicate that the IPM method outperforms the PnP approach, leading to notably improved positioning accuracy. In addition, the error distribution of the IPM method more closely aligns with a normal distribution compared with that of the PnP approach.

Robust Multi-Robot Global Localization with Unknown Initial Pose based on Neighbor Constraints

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

2-Entity RANSAC for Robust Visual Localization in Changing Environment

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Communication Constrained Cloud-Based Long-Term Visual Localization in Real Time.

A Robust Localization Approach Using Multi-Sensor Fusion

A Pose Pruning Driven Solution to Pose Feature GraphSLAM

Semantic Histogram Based Graph Matching for Real-Time Multi-Robot Global Localization in Large Scale Environment

Graph-Based Robust Localization of Object-Level Map for Mobile Robotic Navigation.

RHAML: Rendezvous-based Hierarchical Architecture for Mutual Localization

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Single Beacon-Based Localization with Constraints and Unknown Initial Poses

GOReloc: Graph-based Object-Level Relocalization for Visual SLAM

Lightweight Object-level Topological Semantic Mapping and Long-term Global Localization based on Graph Matching

Global Localization with Object-Level Semantics and Topology

Robust Visual Localization System with HD Map Based on Joint Probabilistic Data Association

Visual-Marker-Based Localization for Flat-Variation Scene

ROMAN: Open-Set Object Map Alignment for Robust View-Invariant Global Localization

Robust localization for planar moving robot in changing environment: A perspective on density of correspondence and depth

MR-GMMapping: Communication Efficient Multi-Robot Mapping System via Gaussian Mixture Model

SLAM with Objects using a Nonparametric Pose Graph