Abstract:Map-based, high-precision dynamic pose tracking and rapid relocalization in the case of unknown poses are very important for indoor navigation robots. This paper aims to propose a robust and high-precision indoor robot positioning algorithm that combines vision and laser sensor information. This algorithm mainly includes two parts: initialization and real-time pose tracking. The initialization component is mainly to solve the problem of the uncertainty of a robot’s initial pose and loss of pose tracking. First, the laser information is added to the posenetLSTM neural network that only considers image information as a geometric constraint, and the loss function is redesigned thereby improving global positioning accuracy. Second, on the basis of visual rough positioning, the branch and bound method is used to quickly search the high-precision pose of the robot. In the real-time tracking component, small-scale correlation sampling is performed on the high-resolution environment grid map, and the robot’s pose is dynamically tracked in real time. When the score of the tracking pose is lower than a certain threshold, the method of nonlinear graph optimization is used to perform the pose optimization. In order to prove the robustness, high precision, and real-time performance of the algorithm, this article first builds a simulation environment in Gazebo for evaluation, and then verifies the relevant performance of the algorithm through the Mir robot platform. Both simulations and experiments show that the introduction of laser information into the neural network can greatly improve the accuracy of vision relocalization and the system can quickly perform high-precision repositioning when the camera is not severely blocked. At the same time, compared with the pose tracking performance of the adaptive Monte Carlo localization (AMCL) algorithm, the proposed algorithm has also improved in accuracy and in real-time performance.

Robot Target Localization and Visual Navigation Based on Neural Network

Computer Vision Positioning and Local Obstacle Avoidance Optimization Based on Neural Network Algorithm

A CNN-Based System for Mobile Robot Navigation in Indoor Environments via Visual Localization with a Small Dataset

Vision-based mobile robot navigation through deep convolutional neural networks and end-to-end learning

An End-to-End Robotic Visual Localization Algorithm Based on Deep Learning.

Target location method of intelligent deicing robot based on nonlinear auto disturbance rejection neural network

NeRF-IBVS: Visual Servo Based on NeRF for Visual Localization and Navigation.

Door recognition and deep learning algorithm for visual based robot navigation

Robot visual navigation estimation and target localization based on neural network

A Robust Localization System Fusion Vision-CNN Relocalization and Progressive Scan Matching for Indoor Mobile Robots

Target Recognition and Location Based on Deep Learning

A Neural Network Approach to Indoor Mobile Robot Localization

Indoor Positioning Algorithm Based on Improved Convolutional Neural Network

Visual Landmark Learning Via Attention-Based Deep Neural Networks.

Scene perception based visual navigation of mobile robot in indoor environment

Image-similarity-based Convolutional Neural Network for Robot Visual Relocalization

Visual Localization and Object Tracking for the NAO Robot in Dynamic Environment.

Visual Information Processing Using Cellular Neural Networks for Mobile Robot

Real-Time Object Navigation With Deep Neural Networks and Hierarchical Reinforcement Learning

A Neural Network-Based Navigation Approach for Autonomous Mobile Robot Systems

Visual Perception and Navigation of Security Robot Based on Deep Learning