Abstract:Localization, an indispensable component in robotics and automation, encounters difficulties arising from appearance variations, resulting in inaccurate data associations. Semantic-based positioning mitigates these challenges by filtering out invalid data, such as moving vehicles and worn road markings. Building on this insight, we introduce a robust semantic visual localization system, which has been successfully deployed in real-world settings. The system uses neural networks to extract road markers and associate data with a semantic map. To enhance system reliability, we use several data filters. These filters remove images that are prone to misrecognition or poorly processed by neural networks. We propose two techniques for vehicle state estimation. The first, using the inverse perspective mapping (IPM) matrix, directly determines the vehicle's central pose. The second technique derives the camera pose using the perspective-n-points (PnP) method and leverages external parameters to infer the vehicle's central state. The wheel encoder, with its robust anti-noise capability, offers odometry in the absence of semantic information, enhancing the system's resilience. The crux of our approach lies in distinct semantic strategies: using lane lines for orientation and road markers exclusively for translation estimation. We also detail an automatic construction method for the semantic map, enhancing the system's practicality. Experimental results indicate that the IPM method outperforms the PnP approach, leading to notably improved positioning accuracy. In addition, the error distribution of the IPM method more closely aligns with a normal distribution compared with that of the PnP approach.

SO-PFH: Semantic Object-based Point Feature Histogram for Global Localization in Parking Lot

LESS-Map: Lightweight and Evolving Semantic Map in Parking Lots for Long-term Self-Localization

SemSCo: Semantic Frequency Domain Scan Context for LiDAR-Based Place Recognition.

3D LiDAR-Based Global Localization Using Siamese Neural Network

LocNet: Global Localization in 3D Point Clouds for Mobile Robots.

LiDAR-Based Global Localization Using Histogram of Orientations of Principal Normals

2-Entity RANSAC for Robust Visual Localization in Changing Environment

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

Visual Semantic Landmark-Based Robust Mapping and Localization for Autonomous Indoor Parking

Towards Autonomous Indoor Parking: A Globally Consistent Semantic SLAM System and A Semantic Localization Subsystem

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Global Localization with Object-Level Semantics and Topology

Visual-Marker-Based Localization for Flat-Variation Scene

Vision-based Semantic Mapping and Localization for Autonomous Indoor Parking

A real-time semantic visual SLAM approach with points and objects

GF-SLAM: A Novel Hybrid Localization Method Incorporating Global and Arc Features

Semantic closed-loop based visual mapping algorithm for automated valet parking

A fast LiDAR place recognition and localization method by fusing local and global search

Global Perception-based Robust Parking Space Detection Using a Low-cost Camera

Monocular Localization with Semantics Map for Autonomous Vehicles

Utilization of Semantic Planes: Improved Localization and Dense Semantic Map for Monocular SLAM in Urban Environment