Abstract:As scene coordinate regression (SCoRe) methods become prevailing in the area of visual camera localization, the issue of repetitive or sparse texture scenes continues to be a concern. Specifically, they will suffer from performance degeneration due to ambiguous patterns caused by visual similarity. In this work, we propose a novel network for camera localization through a single RGB image, with our key insight that taking only high-level feature maps as input can be difficult for the network to accurately model the regression problem due to ambiguous patterns and utilizing the rich spatial details in low-level feature maps can tackle this issue. The core components of the network are 1) Deep Feature Aggregation Module (DFAM), which eliminates the difference among the different level feature representations and fuses multi-level context information; 2) CoordConv Scheme, which further improves the discrimination of features in repetitive or sparse texture areas of the image; 3) Deep Supervision, which endows low-level feature maps with direct supervision from the ground truth to improve the accuracy of camera localization; 4) Uncertainty Modeling, which quantifies the prediction errors stemming from the intrinsic noise in the data. Moreover, to maximize the power of DFAM, we embed channel attention modules into it to prune redundant and noisy features, through which we can refine the different level feature maps. Our network is designed to be lightweight and efficient, and the proposed DFAM can be integrated into general SCoRe-based networks. Comprehensive experiments demonstrate the effectiveness of DFAM and the superiority of our network over the state-of-the-art methods on two benchmarks.

Accurate Rgb Camera Relocalization Using Regression Forest

Regression Forest Based RGB-D Visual Relocalization Using Coarse-to-Fine Strategy

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

2-Entity RANSAC for Robust Visual Localization in Changing Environment

Robust 3D Reconstruction with an RGB-D Camera

Deep Camera Pose Regression Using Pseudo-LiDAR

Predicting World Coordinates of Pixels in RGB Images Using Convolutional Neural Network for Camera Relocalization

An End-to-end Learning Framework for Visual Camera Relocalization Using RGB and RGB-D Images

PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization

Scene Coordinate Regression with Angle-Based Reprojection Loss for Camera Relocalization

6D Camera Relocalization in Visually Ambiguous Extreme Environments

Local Optimized and Scalable Frame-to-model SLAM

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

Self-Supervised Camera Relocalization with Hierarchical Fern Encoding

Decoupling Features and Coordinates for Few-shot RGB Relocalization

Real-Time Accurate 3D Head Tracking and Pose Estimation with Consumer RGB-D Cameras

Regression-Based Camera Pose Estimation through Multi-Level Local Features and Global Features

Multiview Facial Landmark Localization in RGB-D Images Via Hierarchical Regression with Binary Patterns.

A Deep Feature Aggregation Network for Accurate Indoor Camera Localization

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images

Robust 3D face modeling and tracking from RGB-D images