Abstract:An accurate and robust large-scale localization system is an integral component for active areas of research such as autonomous vehicles and augmented reality. To this end, many learning algorithms have been proposed that predict 6DOF camera pose from RGB or RGB-D images. However, previous methods that incorporate depth typically treat the data the same way as RGB images, often adding depth maps as additional channels to RGB images and passing them through convolutional neural networks (CNNs). In this paper, we show that converting depth maps into pseudo-LiDAR signals, previously shown to be useful for 3D object detection, is a better representation for camera localization tasks by projecting point clouds that can accurately determine 6DOF camera pose. This is demonstrated by first comparing localization accuracies of a network operating exclusively on pseudo-LiDAR representations, with networks operating exclusively on depth maps. We then propose FusionLoc, a novel architecture that uses pseudo-LiDAR to regress a 6DOF camera pose. FusionLoc is a dual stream neural network, which aims to remedy common issues with typical 2D CNNs operating on RGB-D images. The results from this architecture are compared against various other state-of-the-art deep pose regression implementations using the 7 Scenes dataset. The findings are that FusionLoc performs better than a number of other camera localization methods, with a notable improvement being, on average, 0.33m and 4.35° more accurate than RGB-D PoseNet. By proving the validity of using pseudo-LiDAR signals over depth maps for localization, there are new considerations when implementing large-scale localization systems.

Normalized Localization for 6-DOF Camera Pose Regression

Accurate Rgb Camera Relocalization Using Regression Forest

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

2-Entity RANSAC for Robust Visual Localization in Changing Environment

Deep Convolutional Neural Network for 6-DOF Image Localization

Regression-Based Camera Pose Estimation through Multi-Level Local Features and Global Features

Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization

6D Camera Relocalization in Visually Ambiguous Extreme Environments

A Novel 6D Pose Estimation Method for Indoor Objects Based on Monocular Regression Depth

6-DOF Image Localization From Massive Geo-Tagged Reference Images.

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images

Deep Camera Pose Regression Using Pseudo-LiDAR

Fast Estimation of Relative Poses for 6-DOF Image Localization

PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization

A 6-Dofs Event-Based Camera Relocalization System by CNN-LSTM and Image Denoising

Relative geometry-aware siamese neural network for 6DOF camera relocalization

6D Object Pose Regression Via Supervised Learning on Point Clouds.

Global Localization: Utilizing Relative Spatio-Temporal Geometric Constraints from Adjacent and Distant Cameras

Render-and-Compare: Cross-View 6 DoF Localization from Noisy Prior

Local Supports Global: Deep Camera Relocalization With Sequence Enhancement

NVR-Net: Normal Vector Guided Regression Network for Disentangled 6D Pose Estimation