Abstract:Visual Place Recognition (VPR) aims to determine whether a robot or visual navigation system locates in a previously visited place using visual information. It is an essential technology and challenging problem in computer vision and robotic communities. Recently, numerous works have demonstrated that the performance of Convolutional Neural Network (CNN)-based VPR is superior to that of traditional methods. However, with a huge number of parameters, large memory storage is necessary for these CNN models. It is a great challenge for mobile robot platforms equipped with limited resources. Fortunately, Binary Neural Networks (BNNs) can reduce memory consumption by converting weights and activation values from 32-bit into 1-bit. But current BNNs always suffer from gradients vanishing and a marked drop in accuracy. Therefore, this work proposed a BinVPR model to handle this issue. The solution is twofold. Firstly, a feature restoration strategy was explored to add features into the latter convolutional layers to further solve the gradient-vanishing problem during the training process. Moreover, we identified two principles to address gradient vanishing: restoring basic features and restoring basic features from higher to lower layers. Secondly, considering the marked drop in accuracy results from gradient mismatch during backpropagation, this work optimized the combination of binarized activation and binarized weight functions in the Larq framework, and the best combination was obtained. The performance of BinVPR was validated on public datasets. The experimental results show that it outperforms state-of-the-art BNN-based approaches and full-precision networks of AlexNet and ResNet in terms of both recognition accuracy and model size. It is worth mentioning that BinVPR achieves the same accuracy with only 1% and 4.6% model sizes of AlexNet and ResNet.

Simple and Effective Visual Place Recognition Via Spiking Neural Networks and Deep Information

Visual Place Recognition Based on Multilevel Descriptors for the Visually Impaired People

SVS-VPR: A Semantic Visual and Spatial Information-Based Hierarchical Visual Place Recognition for Autonomous Navigation in Challenging Environmental Conditions

Applications of Spiking Neural Networks in Visual Place Recognition

VPRTempo: A Fast Temporally Encoded Spiking Neural Network for Visual Place Recognition

Visual Place Recognition for Opposite Viewpoints and Environment Changes

VIPeR: Visual Incremental Place Recognition with Adaptive Mining and Lifelong Learning

Event-VPR: End-to-End Weakly Supervised Deep Network Architecture for Visual Place Recognition using Event-based Vision Sensor

BinVPR: Binary Neural Networks towards Real-Valued for Visual Place Recognition

Design Space Exploration of Low-Bit Quantized Neural Networks for Visual Place Recognition

The Research Status of Visual Place Recognition

LoCS-Net: Localizing Convolutional Spiking Neural Network for Fast Visual Place Recognition

A Hierarchical Utilization of Semantic Gradients and Scene Structure for Visual Place Recognition

A Visual Place Recognition Approach Using Learnable Feature Map Filtering and Graph Attention Networks.

Are State-of-the-art Visual Place Recognition Techniques any Good for Aerial Robotics?

Event-VPR: End-to-End Weakly Supervised Network Architecture for Event-based Visual Place Recognition

Brain-inspired multimodal hybrid neural network for robot place recognition

Improving Visual Place Recognition Based Robot Navigation By Verifying Localization Estimates

BEVGM: A Visual Place Recognition Method with Bird's Eye View Graph Matching

VDNA-PR: Using General Dataset Representations for Robust Sequential Visual Place Recognition

A Novel Approach to Image-Sequence-Based Mobile Robot Place Recognition