Abstract:When a human drives a car along a road for the first time, they later recognize where they are on the return journey typically without needing to look in their rear-view mirror or turn around to look back, despite significant viewpoint and appearance change. Such navigation capabilities are typically attributed to our semantic visual understanding of the environment [1] beyond geometry to recognizing the types of places we are passing through such as "passing a shop on the left" or "moving through a forested area". Humans are in effect using place categorization [2] to perform specific place recognition even when the viewpoint is 180 degrees reversed. Recent advances in deep neural networks have enabled high-performance semantic understanding of visual places and scenes, opening up the possibility of emulating what humans do. In this work, we develop a novel methodology for using the semantics-aware higher-order layers of deep neural networks for recognizing specific places from within a reference database. To further improve the robustness to appearance change, we develop a descriptor normalization scheme that builds on the success of normalization schemes for pure appearance-based techniques such as SeqSLAM [3]. Using two different datasets - one road-based, one pedestrian-based, we evaluate the performance of the system in performing place recognition on reverse traversals of a route with a limited field of view camera and no turn-back-and-look behaviours, and compare to existing state-of-the-art techniques and vanilla off-the-shelf features. The results demonstrate significant improvements over the existing state of the art, especially for extreme perceptual challenges that involve both great viewpoint change and environmental appearance change. We also provide experimental analyses of the contributions of the various system components.

Variational Bayesian Approach to Condition-Invariant Feature Extraction for Visual Place Recognition

Explicit Feature Disentanglement for Visual Place Recognition Across Appearance Changes

Adversarial Feature Disentanglement for Place Recognition Across Changing Appearance.

Improving Condition- and Environment-Invariant Place Recognition with Semantic Place Categorization

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Multi-condition Place Generator for Robust Place Recognition.

Learning robust representation and sequence constraint for retrieval-based long-term visual place recognition

EigenPlaces: Training Viewpoint Robust Models for Visual Place Recognition

A Multi-Domain Feature Learning Method for Visual Place Recognition

Probabilistic Visual Place Recognition for Hierarchical Localization

Hybrid CNN-Transformer Features for Visual Place Recognition

Excavate Condition-invariant Space by Intrinsic Encoder.

Conditional Variational Autoencoders for Probabilistic Pose Regression

Sequence Searching With Deep-Learnt Depth For Condition-And Viewpointin-Variant Route-Based Place Recognition

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

Don't Look Back: Robustifying Place Categorization for Viewpoint- and Condition-Invariant Place Recognition

Robust Visual Place Recognition Based on Context Information

Appearance-invariant place recognition by adversarially learning disentangled representation

A Novel Approach to Image-Sequence-Based Mobile Robot Place Recognition

Appearance-Invariant 6-DoF Visual Localization using Generative Adversarial Networks