Abstract:High-precision localization through multi-sensor fusion has become a popular research direction in unmanned driving. However, most previous studies have performed optimally only in open-sky conditions; therefore, high-precision localization in complex urban environments required an urgent solution. The complex urban environments employed in this study include dynamic environments, which result in limited visual localization performance, and highly occluded environments, which yield limited global navigation satellite system (GNSS) performance. In order to provide high-precision localization in these environments, we propose a vision-aided GNSS positioning method using semantic information by integrating stereo cameras and GNSS into a loosely coupled navigation system. To suppress the effect of dynamic objects on visual positioning accuracy, we propose a dynamic-simultaneous localization and mapping (Dynamic-SLAM) algorithm to extract semantic information from images using a deep learning framework. For the GPS-challenged environment, we propose a semantic-based dynamic adaptive Kalman filtering fusion (S-AKF) algorithm to develop vision aided GNSS and achieve stable and high-precision positioning. Experiments were carried out in GNSS-challenged environments using the open-source KITTI dataset to evaluate the performance of the proposed algorithm. The results indicate that the dynamic-SLAM algorithm improved the performance of the visual localization algorithm and effectively suppressed the error spread of the visual localization algorithm. Additionally, after vision was integrated, the loosely-coupled navigation system achieved continuous high-accuracy positioning in GNSS-challenged environments.

Feature based Monocular Visual Odometry for Autonomous Driving and Hyperparameter Tuning to Improve Trajectory Estimation

A robust stereo feature-aided semi-direct SLAM system

Design of an Enhanced Visual Odometry by Building and Matching Compressive Panoramic Landmarks Online

An Enhanced Trajectory Optimization Approach for Equirectangular Camera-based Visual SLAM

Visual Odometry Research Based on Efficient Feature Tracking

Research on Vehicle Adaptive Real-Time Positioning Based on Binocular Vision

Challenges in Monocular Visual Odometry: Photometric Calibration, Motion Bias, and Rolling Shutter Effect

Visual Odometry Based on Improved Feature Matching and Unscented Kalman Filter

Off-road environment Localization of unmanned vehicles based on Visual-Inertial

An Efficient Vehicle Localization Method by Using Monocular Vision

Monocular Visual-Inertial Navigation for Dynamic Environment

Angular Tracking Consistency Guided Fast Feature Association for Visual-Inertial SLAM

Monocular Vehicle Self-localization Method Based on Compact Semantic Map

An Adaptive Feature Extraction Visual SLAM Method for Autonomous Driving

High Precision Vehicle Localization Based on Tightly-coupled Visual Odometry and Vector HD Map

Multi-Camera Visual-Inertial Simultaneous Localization and Mapping for Autonomous Valet Parking

A Method of Vision Aided GNSS Positioning Using Semantic Information in Complex Urban Environment

Mapping with Monocular Camera Sensor under Adversarial Illumination for Intelligent Vehicles

Semantic Segmentation–aided Visual Odometry for Urban Autonomous Driving

Design of visual inertial state estimator for autonomous systems via multi-sensor fusion approach