Abstract:This study addresses the challenge of visual localization using monocular images, a crucial technology for autonomous systems that facilitates their navigation and interaction capabilities. With the advent of deep learning, visual localization techniques that utilize these methods have demonstrated improved robustness across diverse environments. Existing end-to-end models apply convolutional neural networks (CNNs) to extract salient features and directly estimate continuous spatial poses from map models that allow for implicit differentiation. Nonetheless, these models often falter in adapting their feature representations to extreme variations in environmental conditions, leading to critical localization inaccuracies during episodes of altered lighting, varying weather, or in the presence of moving objects. To overcome these limitations, we introduce the end-to-end feature refinement network for visual localization (EFRNet-VL). This network architecture is specifically designed to prioritize the extraction of static features crucial for the six degrees of freedom (6DoF) pose estimation, thereby outperforming prior methodologies. EFRNet-VL meticulously integrates a convolutional network structure with self-attention mechanisms and Long Short-Term Memory (LSTM) modules, which together facilitate the accurate association of a single image with its corresponding camera pose, even within dynamic environments. The proposed feature refinement approach is straightforward to implement and can enhance the performance of existing neural pose estimators. Our comprehensive evaluations of EFRNet-VL underscore its effectiveness. Notably, it has diminished the average position and orientation errors by 54.5% and 25.7%, respectively, as compared to the popular PoseNet model across various indoor settings. Moreover, in large-scale outdoor environments, it has achieved an average localization precision of 7.02m/2.79°. EFRNet-VL has set a new benchmark for end-to-end learning-based methods in visual localization and operates efficiently in real time, processing at a speed of 9.8 ms per image frame.

Appearance-Invariant 6-DoF Visual Localization using Generative Adversarial Networks

Explicit Feature Disentanglement for Visual Place Recognition Across Appearance Changes

Adversarial Feature Disentanglement for Place Recognition Across Changing Appearance.

Visual Localizer: Outdoor Localization Based on ConvNet Descriptor and Global Optimization for Visually Impaired Pedestrians

2-Entity RANSAC for Robust Visual Localization in Changing Environment

Laser Map Aided Visual Inertial Localization in Changing Environment.

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Robust Visual Localization Across Seasons

Learning Bipartite Graph Matching for Robust Visual Localization.

Learning robust representation and sequence constraint for retrieval-based long-term visual place recognition

Seeing Through Darkness: Visual Localization at Night Via Weakly Supervised Learning of Domain Invariant Features

Weatherproofing Retrieval for Localization with Generative AI and Geometric Consistency

Long-Term Invariant Local Features via Implicit Cross-Domain Correspondences

Adversarial Learning of Structure-Aware Fully Convolutional Networks for Landmark Localization

Appearance-invariant place recognition by adversarially learning disentangled representation

What to Learn: Features, Image Transformations, or Both?

6D Camera Relocalization in Visually Ambiguous Extreme Environments

EFRNet-VL: An end-to-end feature refinement network for monocular visual localization in dynamic environments

Deep Convolutional Neural Network for 6-DOF Image Localization

LSG-GAN: Latent space guided generative adversarial network for person pose transfer

GANVO: Unsupervised Deep Monocular Visual Odometry and Depth Estimation with Generative Adversarial Networks